2024-05-07T13:44:43.425 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-07T13:44:43.426 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_cbodley@teuthology --name cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi --verbose --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} --archive /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427 -- /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427/orig.config.yaml 2024-05-07T13:44:43.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-07T13:44:43.537 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427 branch: wip-cbodley2-testing description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7695427' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cbodley2-testing ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley2-testing sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 4511 sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley2-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1dfb479e40144c07778a01ea762def8ca56f6eee/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOooDTYqWbjUZDpwjuuyI7DmTBjADZD/S5wn/Rbn3pN1fl90PyaJqQueXQiS4Aqvw4VJqmrqsxaemHTJN5Bfl+I= smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8tYXssRzD/Fxd4iz+N5yiAU/qSoMw96bSuhxkZ7WCLlJHKARR5SHaTw3kzomDpKZO7f06v3mxlEElYHBUY1Jk= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-07_13:33:35 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-07T13:44:43.537 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1dfb479e40144c07778a01ea762def8ca56f6eee/qa; will attempt to use it 2024-05-07T13:44:43.538 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1dfb479e40144c07778a01ea762def8ca56f6eee/qa/tasks 2024-05-07T13:44:43.538 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-07T13:44:43.539 INFO:teuthology.task.internal:Checking packages... 2024-05-07T13:44:43.565 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1dfb479e40144c07778a01ea762def8ca56f6eee' 2024-05-07T13:44:43.565 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-07T13:44:43.565 INFO:teuthology.packaging:ref: None 2024-05-07T13:44:43.565 INFO:teuthology.packaging:tag: None 2024-05-07T13:44:43.565 INFO:teuthology.packaging:branch: wip-cbodley2-testing 2024-05-07T13:44:43.565 INFO:teuthology.packaging:sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:44:43.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cbodley2-testing 2024-05-07T13:44:43.716 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2521.g1dfb479e 2024-05-07T13:44:43.718 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-07T13:44:43.725 INFO:teuthology.task.internal:no buildpackages task found 2024-05-07T13:44:43.725 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-07T13:44:43.780 INFO:teuthology.task.internal:Saving configuration 2024-05-07T13:44:43.793 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-07T13:44:43.826 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-07T13:44:43.848 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 13:39:55.367778', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOooDTYqWbjUZDpwjuuyI7DmTBjADZD/S5wn/Rbn3pN1fl90PyaJqQueXQiS4Aqvw4VJqmrqsxaemHTJN5Bfl+I='} 2024-05-07T13:44:43.870 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 13:39:55.369366', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8tYXssRzD/Fxd4iz+N5yiAU/qSoMw96bSuhxkZ7WCLlJHKARR5SHaTw3kzomDpKZO7f06v3mxlEElYHBUY1Jk='} 2024-05-07T13:44:43.870 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-07T13:44:43.876 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-05-07T13:44:43.876 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-07T13:44:43.877 INFO:teuthology.run_tasks:Running task console_log... 2024-05-07T13:44:44.055 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3896bf50d0>, signals=[15]) 2024-05-07T13:44:44.056 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-07T13:44:44.062 INFO:teuthology.task.internal:Opening connections... 2024-05-07T13:44:44.062 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-05-07T13:44:44.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:44:44.163 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-05-07T13:44:44.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:44:44.238 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-07T13:44:44.245 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-05-07T13:44:44.264 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-05-07T13:44:44.264 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-05-07T13:44:44.323 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-05-07T13:44:44.323 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-05-07T13:44:44.323 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-05-07T13:44:44.323 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-07T13:44:44.324 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-07T13:44:44.325 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-05-07T13:44:44.349 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-05-07T13:44:44.368 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-05-07T13:44:44.368 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-05-07T13:44:44.426 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-05-07T13:44:44.426 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-07T13:44:44.427 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-07T13:44:44.428 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-05-07T13:44:44.449 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-07T13:44:44.458 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-07T13:44:44.508 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-07T13:44:44.508 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-05-07T13:44:44.511 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-05-07T13:44:44.529 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-07T13:44:44.551 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-07T13:44:44.551 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-05-07T13:44:44.568 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-05-07T13:44:44.602 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-07T13:44:44.659 INFO:teuthology.run_tasks:Running task kernel... 2024-05-07T13:44:44.676 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-07T13:44:44.677 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-07T13:44:44.677 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-07T13:44:44.678 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-07T13:44:44.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:44:44.695 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-05-07T13:44:44.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:44:44.696 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-05-07T13:44:44.754 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-437.el9.x86_64 2024-05-07T13:44:44.754 INFO:teuthology.task.kernel:Running kernel on smithi022: 5.14.0-437.el9.x86_64 2024-05-07T13:44:44.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2024-05-07T13:44:44.755 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-437.el9.x86_64 2024-05-07T13:44:44.756 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.14.0-437.el9.x86_64 2024-05-07T13:44:44.756 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2024-05-07T13:44:47.772 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.1 MB 00:01 2024-05-07T13:44:51.070 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.1 MB 00:04 2024-05-07T13:44:53.164 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 19 MB 00:04 2024-05-07T13:44:53.205 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-05-07T13:44:57.555 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.2 MB 00:00 2024-05-07T13:44:58.714 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.2 MB 00:01 2024-05-07T13:44:58.898 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 128 kB/s | 16 kB 00:00 2024-05-07T13:45:00.257 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-05-07T13:45:00.516 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-07T13:45:01.936 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-07T13:45:05.883 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-07T13:45:06.095 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:01 ago on Tue 07 May 2024 01:45:05 PM UTC. 2024-05-07T13:45:07.283 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-05-07T13:45:08.089 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-07T13:45:08.089 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-07T13:45:08.195 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:45:08.203 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:45:08.203 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2024-05-07T13:45:08.203 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:45:08.203 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:45:08.203 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-07T13:45:08.203 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:45:08.203 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-07T13:45:08.203 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-07T13:45:08.203 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-07T13:45:08.204 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:45:08.204 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:45:08.204 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:45:08.204 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2024-05-07T13:45:08.204 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:45:08.204 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 78 M 2024-05-07T13:45:08.204 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 123 M 2024-05-07T13:45:08.205 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:45:08.651 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.6 MB/s | 484 kB 00:00 2024-05-07T13:45:09.340 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-07T13:45:09.340 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-07T13:45:09.351 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 17 MB/s | 15 MB 00:00 2024-05-07T13:45:09.431 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:45:09.437 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:45:09.437 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-05-07T13:45:09.437 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:45:09.437 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:45:09.437 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-07T13:45:09.437 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:45:09.437 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-07T13:45:09.437 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-07T13:45:09.437 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-07T13:45:09.438 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:45:09.438 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:45:09.438 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:45:09.438 INFO:teuthology.orchestra.run.smithi022.stdout:Install 4 Packages 2024-05-07T13:45:09.438 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:45:09.438 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 78 M 2024-05-07T13:45:09.439 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 123 M 2024-05-07T13:45:09.439 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:45:09.759 INFO:teuthology.orchestra.run.smithi022.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.7 MB/s | 484 kB 00:00 2024-05-07T13:45:09.768 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 25 MB/s | 28 MB 00:01 2024-05-07T13:45:10.052 INFO:teuthology.orchestra.run.smithi022.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 33 MB/s | 15 MB 00:00 2024-05-07T13:45:10.127 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 20 MB/s | 34 MB 00:01 2024-05-07T13:45:10.127 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:45:10.127 INFO:teuthology.orchestra.run.smithi050.stdout:Total 40 MB/s | 78 MB 00:01 2024-05-07T13:45:10.502 INFO:teuthology.orchestra.run.smithi022.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 37 MB/s | 34 MB 00:00 2024-05-07T13:45:10.778 INFO:teuthology.orchestra.run.smithi022.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 27 MB/s | 28 MB 00:01 2024-05-07T13:45:10.778 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:45:10.778 INFO:teuthology.orchestra.run.smithi022.stdout:Total 58 MB/s | 78 MB 00:01 2024-05-07T13:45:10.840 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:45:11.239 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:45:11.240 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:45:11.487 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:45:11.887 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:45:11.887 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:45:12.204 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:45:12.205 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:45:12.883 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:45:12.883 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:45:14.738 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:45:15.401 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-07T13:45:15.440 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:45:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T13:45:16.098 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-07T13:45:16.322 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T13:45:18.291 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T13:45:18.416 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T13:45:18.968 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T13:45:19.108 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T13:45:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T13:45:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:45:24.181 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T13:45:24.228 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:45:28.620 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:45:29.325 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:45:59.360 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:45:59.400 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:45:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:45:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-07T13:45:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T13:45:59.760 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T13:46:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:46:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:46:00.544 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:46:00.544 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:46:00.544 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:46:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-07T13:46:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-07T13:46:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-07T13:46:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-07T13:46:00.545 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:46:00.545 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:46:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:46:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-07T13:46:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-07T13:46:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-07T13:46:00.887 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T13:46:00.957 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T13:46:00.958 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T13:46:00.958 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-07T13:46:00.958 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-07T13:46:00.958 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-07T13:46:00.958 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-05-07T13:46:00.958 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-05-07T13:46:00.959 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T13:46:01.009 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T13:46:01.009 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T13:46:01.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 68.el9 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8264254 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-07T13:46:01.045 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:46:01.046 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2024-05-07T13:46:01.047 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-07T13:46:01.047 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 5.14.0-444.el9.x86_64 2024-05-07T13:46:01.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-07T13:46:01.599 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-07T13:46:01.599 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:46:01.599 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:46:01.599 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-07T13:46:01.599 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-07T13:46:01.599 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-07T13:46:01.599 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-07T13:46:01.599 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:46:01.599 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:46:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-05-07T13:46:01.994 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T13:46:02.075 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T13:46:02.075 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T13:46:02.075 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-07T13:46:02.076 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-07T13:46:02.076 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-07T13:46:02.076 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-07T13:46:02.076 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2024-05-07T13:46:02.076 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-05-07T13:46:02.127 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-07T13:46:02.127 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-07T13:46:02.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2024-05-07T13:46:02.164 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2024-05-07T13:46:02.164 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2024-05-07T13:46:02.164 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.06 2024-05-07T13:46:02.165 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 68.el9 2024-05-07T13:46:02.165 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2024-05-07T13:46:02.165 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-07T13:46:02.165 INFO:teuthology.orchestra.run.smithi022.stdout:Group : Unspecified 2024-05-07T13:46:02.165 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 8264254 2024-05-07T13:46:02.165 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2024-05-07T13:46:02.165 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-07T13:46:02.166 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-07T13:46:02.166 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-07T13:46:02.166 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-07T13:46:02.166 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : builder@centos.org 2024-05-07T13:46:02.166 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2024-05-07T13:46:02.166 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-07T13:46:02.166 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2024-05-07T13:46:02.166 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2024-05-07T13:46:02.166 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:46:02.167 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-07T13:46:02.167 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-07T13:46:02.167 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-07T13:46:02.167 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2024-05-07T13:46:02.167 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:46:02.167 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2024-05-07T13:46:02.169 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-07T13:46:02.169 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 5.14.0-444.el9.x86_64 2024-05-07T13:46:02.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-07T13:46:02.760 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2024-05-07T13:46:03.124 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-07T13:46:03.161 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-05-07T13:46:03.163 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-05-07T13:46:03.180 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.tGGdUgWvDM 2024-05-07T13:46:03.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tGGdUgWvDM 2024-05-07T13:46:03.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.tGGdUgWvDM 2024-05-07T13:46:03.381 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.tGGdUgWvDM is 6KB 2024-05-07T13:46:03.431 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.tGGdUgWvDM 2024-05-07T13:46:03.448 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2024-05-07T13:46:03.511 INFO:teuthology.orchestra.run.smithi050.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-07T13:46:03.511 INFO:teuthology.orchestra.run.smithi050.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-07T13:46:03.511 INFO:teuthology.orchestra.run.smithi050.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-07T13:46:03.511 INFO:teuthology.orchestra.run.smithi050.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-07T13:46:03.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-07T13:46:03.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-05-07T13:46:04.176 INFO:teuthology.orchestra.run.smithi022.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-07T13:46:04.214 INFO:teuthology.orchestra.run.smithi022.stderr:done 2024-05-07T13:46:04.216 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-05-07T13:46:04.232 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.BGLYvVqmhP 2024-05-07T13:46:04.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BGLYvVqmhP 2024-05-07T13:46:04.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.BGLYvVqmhP 2024-05-07T13:46:04.445 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.BGLYvVqmhP is 6KB 2024-05-07T13:46:04.494 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.BGLYvVqmhP 2024-05-07T13:46:04.510 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2024-05-07T13:46:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-07T13:46:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-07T13:46:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-07T13:46:04.582 INFO:teuthology.orchestra.run.smithi022.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-07T13:46:04.584 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-07T13:46:04.740 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2024-05-07T13:46:33.698 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-05-07T13:46:33.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-07T13:46:33.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:46:34.744 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-07T13:46:34.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-07T13:46:34.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:46:52.063 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-05-07T13:47:01.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-07T13:47:01.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:47:04.130 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-05-07T13:47:16.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-07T13:47:16.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:47:34.766 DEBUG:teuthology.orchestra.remote:timed out 2024-05-07T13:47:43.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-07T13:47:43.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:47:44.198 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-05-07T13:47:44.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-07T13:47:44.632 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-07T13:47:44.633 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-05-07T13:47:44.648 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-444.el9.x86_64 2024-05-07T13:47:44.648 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-07T13:47:44.649 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-07T13:47:44.649 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-07T13:47:45.649 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-07T13:47:45.649 DEBUG:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-07T13:47:45.739 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2024-05-07T13:47:45.785 DEBUG:teuthology.parallel:result is None 2024-05-07T13:47:47.916 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-05-07T13:47:48.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-07T13:47:48.272 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-444.el9.x86_64"... 2024-05-07T13:47:48.272 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-05-07T13:47:48.288 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-444.el9.x86_64 2024-05-07T13:47:48.288 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-07T13:47:48.288 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-07T13:47:48.288 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-07T13:47:49.289 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-05-07T13:47:49.290 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-07T13:47:49.364 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-05-07T13:47:49.417 DEBUG:teuthology.parallel:result is None 2024-05-07T13:47:49.417 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-07T13:47:49.425 INFO:teuthology.task.internal:Creating test directory... 2024-05-07T13:47:49.425 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-07T13:47:49.428 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-07T13:47:49.448 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-07T13:47:49.456 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-07T13:47:49.462 INFO:teuthology.task.internal:Creating archive directory... 2024-05-07T13:47:49.462 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-07T13:47:49.491 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-07T13:47:49.522 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-07T13:47:49.530 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-07T13:47:49.530 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-07T13:47:49.561 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-07T13:47:49.591 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T13:47:49.596 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T13:47:49.602 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T13:47:49.608 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T13:47:49.610 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-07T13:47:49.618 INFO:teuthology.task.internal:Configuring sudo... 2024-05-07T13:47:49.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-07T13:47:49.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-07T13:47:49.680 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-07T13:47:49.691 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-07T13:47:49.691 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-07T13:47:49.721 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-07T13:47:49.738 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T13:47:49.818 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T13:47:49.871 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T13:47:49.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T13:47:50.002 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:47:50.002 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-07T13:47:50.072 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T13:47:50.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T13:47:50.168 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T13:47:50.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T13:47:50.298 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:47:50.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-07T13:47:50.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-05-07T13:47:50.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-05-07T13:47:50.421 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T13:47:50.452 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T13:47:50.970 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-07T13:47:50.978 INFO:teuthology.task.internal:Starting timer... 2024-05-07T13:47:50.978 INFO:teuthology.run_tasks:Running task pcp... 2024-05-07T13:47:50.995 INFO:teuthology.run_tasks:Running task selinux... 2024-05-07T13:47:51.004 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-07T13:47:51.005 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-05-07T13:47:51.091 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-05-07T13:47:51.092 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2024-05-07T13:47:51.161 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2024-05-07T13:47:51.163 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-07T13:47:51.163 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-05-07T13:47:51.189 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-05-07T13:47:51.189 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2024-05-07T13:47:51.227 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2024-05-07T13:47:51.227 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi050.front.sepia.ceph.com': 'permissive'} 2024-05-07T13:47:51.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T13:47:51.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:47:51.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T13:47:51.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:47:51.299 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-07T13:47:51.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-05-07T13:47:51.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2024-05-07T13:47:51.369 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-07T13:47:51.379 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-07T13:47:51.401 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-07T13:47:51.402 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi050.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-07T13:52:03.142 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi050.front.sepia.ceph.com')] 2024-05-07T13:52:03.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-07T13:52:03.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:52:03.225 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-05-07T13:52:03.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-07T13:52:03.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-07T13:52:03.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:52:03.346 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-05-07T13:52:03.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-05-07T13:52:03.432 INFO:teuthology.run_tasks:Running task clock... 2024-05-07T13:52:03.447 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-07T13:52:03.447 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-07T13:52:03.448 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T13:52:03.451 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-07T13:52:03.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T13:52:03.485 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-07T13:52:03.499 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-07T13:52:03.506 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-07T13:52:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-07T13:52:03.526 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-05-07T13:52:03.539 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-05-07T13:52:03.550 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2024-05-07T13:52:03.554 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-07T13:52:03.562 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2024-05-07T13:52:03.569 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-07T13:52:03.577 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-07T13:52:03.592 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-07T13:52:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-05-07T13:52:03.632 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T13:52:03.632 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-05-07T13:52:03.632 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T13:52:03.632 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T13:52:03.632 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T13:52:03.633 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T13:52:03.652 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-05-07T13:52:03.655 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T13:52:03.655 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-05-07T13:52:03.655 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T13:52:03.655 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T13:52:03.655 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T13:52:03.655 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T13:52:03.656 INFO:teuthology.run_tasks:Running task install... 2024-05-07T13:52:03.665 DEBUG:teuthology.task.install:project ceph 2024-05-07T13:52:03.665 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}} 2024-05-07T13:52:03.665 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'} 2024-05-07T13:52:03.665 INFO:teuthology.task.install:Using flavor: default 2024-05-07T13:52:03.671 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-07T13:52:03.671 INFO:teuthology.task.install:extra packages: [] 2024-05-07T13:52:03.672 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee', 'tag': None, 'wait_for_package': False} 2024-05-07T13:52:03.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:52:03.674 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee', 'tag': None, 'wait_for_package': False} 2024-05-07T13:52:03.674 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:52:03.819 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/centos/9/flavors/default/ 2024-05-07T13:52:03.819 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2521.g1dfb479e 2024-05-07T13:52:03.823 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/centos/9/flavors/default/ 2024-05-07T13:52:03.823 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2521.g1dfb479e 2024-05-07T13:52:03.935 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-07T13:52:03.935 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:52:03.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-07T13:52:03.964 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-07T13:52:03.965 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1dfb479e40144c07778a01ea762def8ca56f6eee/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-07T13:52:03.994 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-07T13:52:03.994 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:52:03.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-07T13:52:04.021 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-07T13:52:04.021 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1dfb479e40144c07778a01ea762def8ca56f6eee/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-07T13:52:04.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-07T13:52:04.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-07T13:52:04.112 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-07T13:52:04.164 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-07T13:52:04.179 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-05-07T13:52:04.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-05-07T13:52:04.229 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2024-05-07T13:52:04.230 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2024-05-07T13:52:04.422 INFO:teuthology.orchestra.run.smithi022.stdout:54 files removed 2024-05-07T13:52:04.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw 2024-05-07T13:52:04.478 INFO:teuthology.orchestra.run.smithi050.stdout:54 files removed 2024-05-07T13:52:04.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw 2024-05-07T13:52:05.166 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 195 kB/s | 83 kB 00:00 2024-05-07T13:52:05.283 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 170 kB/s | 83 kB 00:00 2024-05-07T13:52:05.659 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 26 kB/s | 11 kB 00:00 2024-05-07T13:52:05.800 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 25 kB/s | 11 kB 00:00 2024-05-07T13:52:06.084 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-05-07T13:52:06.267 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-05-07T13:52:07.467 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.1 MB 00:01 2024-05-07T13:52:08.351 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.1 MB 00:02 2024-05-07T13:52:09.768 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-05-07T13:52:14.402 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 3.9 MB/s | 19 MB 00:04 2024-05-07T13:52:14.477 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.2 MB 00:01 2024-05-07T13:52:17.045 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-05-07T13:52:18.724 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-07T13:52:19.103 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 6.2 MB 00:01 2024-05-07T13:52:20.887 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-07T13:52:22.239 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-07T13:52:24.030 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-07T13:52:26.484 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:52:26.498 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:52:26.498 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:52:26.498 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:52:26.498 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:52:26.498 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 10 M 2024-05-07T13:52:26.498 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-05-07T13:52:26.498 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 3.4 M 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 3.1 M 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 5.4 M 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 21 M 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 25 k 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 745 k 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-07T13:52:26.499 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 501 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 5.3 M 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 45 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 135 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 162 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 321 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 298 k 2024-05-07T13:52:26.500 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 99 k 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout:Install 30 Packages 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 2 Packages 2024-05-07T13:52:26.501 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:52:26.502 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 60 M 2024-05-07T13:52:26.502 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:52:27.564 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-07T13:52:27.606 INFO:teuthology.orchestra.run.smithi022.stdout:(1/32): ceph-radosgw-19.0.0-2521.g1dfb479e.el9. 11 MB/s | 10 MB 00:00 2024-05-07T13:52:27.681 INFO:teuthology.orchestra.run.smithi022.stdout:(2/32): ceph-base-19.0.0-2521.g1dfb479e.el9.x86 5.2 MB/s | 5.4 MB 00:01 2024-05-07T13:52:27.707 INFO:teuthology.orchestra.run.smithi022.stdout:(3/32): ceph-selinux-19.0.0-2521.g1dfb479e.el9. 251 kB/s | 25 kB 00:00 2024-05-07T13:52:27.774 INFO:teuthology.orchestra.run.smithi022.stdout:(4/32): libcephfs2-19.0.0-2521.g1dfb479e.el9.x8 7.9 MB/s | 745 kB 00:00 2024-05-07T13:52:27.799 INFO:teuthology.orchestra.run.smithi022.stdout:(5/32): libradosstriper1-19.0.0-2521.g1dfb479e. 5.3 MB/s | 501 kB 00:00 2024-05-07T13:52:27.850 INFO:teuthology.orchestra.run.smithi022.stdout:(6/32): python3-ceph-argparse-19.0.0-2521.g1dfb 904 kB/s | 45 kB 00:00 2024-05-07T13:52:27.908 INFO:teuthology.orchestra.run.smithi022.stdout:(7/32): python3-ceph-common-19.0.0-2521.g1dfb47 2.3 MB/s | 135 kB 00:00 2024-05-07T13:52:27.975 INFO:teuthology.orchestra.run.smithi022.stdout:(8/32): python3-cephfs-19.0.0-2521.g1dfb479e.el 2.4 MB/s | 162 kB 00:00 2024-05-07T13:52:28.051 INFO:teuthology.orchestra.run.smithi022.stdout:(9/32): python3-rados-19.0.0-2521.g1dfb479e.el9 4.2 MB/s | 321 kB 00:00 2024-05-07T13:52:28.267 INFO:teuthology.orchestra.run.smithi022.stdout:(10/32): python3-rbd-19.0.0-2521.g1dfb479e.el9. 1.3 MB/s | 298 kB 00:00 2024-05-07T13:52:28.343 INFO:teuthology.orchestra.run.smithi022.stdout:(11/32): librgw2-19.0.0-2521.g1dfb479e.el9.x86_ 9.3 MB/s | 5.3 MB 00:00 2024-05-07T13:52:28.385 INFO:teuthology.orchestra.run.smithi022.stdout:(12/32): python3-rgw-19.0.0-2521.g1dfb479e.el9. 846 kB/s | 99 kB 00:00 2024-05-07T13:52:28.527 INFO:teuthology.orchestra.run.smithi022.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 582 kB/s | 107 kB 00:00 2024-05-07T13:52:28.552 INFO:teuthology.orchestra.run.smithi022.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 960 kB/s | 160 kB 00:00 2024-05-07T13:52:28.569 INFO:teuthology.orchestra.run.smithi022.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-05-07T13:52:28.678 INFO:teuthology.orchestra.run.smithi022.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-07T13:52:28.745 INFO:teuthology.orchestra.run.smithi022.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-05-07T13:52:28.762 INFO:teuthology.orchestra.run.smithi022.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 506 kB/s | 42 kB 00:00 2024-05-07T13:52:28.987 INFO:teuthology.orchestra.run.smithi022.stdout:(19/32): ceph-common-19.0.0-2521.g1dfb479e.el9. 9.0 MB/s | 21 MB 00:02 2024-05-07T13:52:29.012 INFO:teuthology.orchestra.run.smithi022.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 143 kB/s | 36 kB 00:00 2024-05-07T13:52:29.038 INFO:teuthology.orchestra.run.smithi022.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 754 kB/s | 221 kB 00:00 2024-05-07T13:52:29.122 INFO:teuthology.orchestra.run.smithi022.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 354 kB/s | 47 kB 00:00 2024-05-07T13:52:29.155 INFO:teuthology.orchestra.run.smithi022.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.1 MB/s | 309 kB 00:00 2024-05-07T13:52:29.189 INFO:teuthology.orchestra.run.smithi022.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-05-07T13:52:29.214 INFO:teuthology.orchestra.run.smithi022.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 282 kB/s | 26 kB 00:00 2024-05-07T13:52:29.239 INFO:teuthology.orchestra.run.smithi022.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-07T13:52:29.282 INFO:teuthology.orchestra.run.smithi022.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-05-07T13:52:29.349 INFO:teuthology.orchestra.run.smithi022.stdout:(28/32): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-05-07T13:52:29.382 INFO:teuthology.orchestra.run.smithi022.stdout:(29/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-05-07T13:52:29.432 INFO:teuthology.orchestra.run.smithi022.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-07T13:52:29.708 INFO:teuthology.orchestra.run.smithi022.stdout:(31/32): librbd1-19.0.0-2521.g1dfb479e.el9.x86_ 9.6 MB/s | 3.1 MB 00:00 2024-05-07T13:52:29.833 INFO:teuthology.orchestra.run.smithi022.stdout:(32/32): librados2-19.0.0-2521.g1dfb479e.el9.x8 7.0 MB/s | 3.4 MB 00:00 2024-05-07T13:52:29.836 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:52:29.836 INFO:teuthology.orchestra.run.smithi022.stdout:Total 18 MB/s | 60 MB 00:03 2024-05-07T13:52:29.945 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:52:29.986 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:52:29.986 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:52:30.017 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:52:30.021 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 10 M 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 3.4 M 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 3.1 M 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 5.4 M 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 21 M 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 25 k 2024-05-07T13:52:30.022 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 745 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 501 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 5.3 M 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-07T13:52:30.023 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 45 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 135 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 162 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 321 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 298 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 99 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:52:30.024 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:52:30.025 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:52:30.025 INFO:teuthology.orchestra.run.smithi050.stdout:Install 30 Packages 2024-05-07T13:52:30.025 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2024-05-07T13:52:30.025 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:52:30.025 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 60 M 2024-05-07T13:52:30.025 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:52:30.659 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:52:30.659 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:52:30.782 INFO:teuthology.orchestra.run.smithi050.stdout:(1/32): ceph-base-19.0.0-2521.g1dfb479e.el9.x86 9.4 MB/s | 5.4 MB 00:00 2024-05-07T13:52:30.841 INFO:teuthology.orchestra.run.smithi050.stdout:(2/32): ceph-selinux-19.0.0-2521.g1dfb479e.el9. 434 kB/s | 25 kB 00:00 2024-05-07T13:52:30.933 INFO:teuthology.orchestra.run.smithi050.stdout:(3/32): libcephfs2-19.0.0-2521.g1dfb479e.el9.x8 7.9 MB/s | 745 kB 00:00 2024-05-07T13:52:31.024 INFO:teuthology.orchestra.run.smithi050.stdout:(4/32): libradosstriper1-19.0.0-2521.g1dfb479e. 5.3 MB/s | 501 kB 00:00 2024-05-07T13:52:31.475 INFO:teuthology.orchestra.run.smithi050.stdout:(5/32): librgw2-19.0.0-2521.g1dfb479e.el9.x86_6 12 MB/s | 5.3 MB 00:00 2024-05-07T13:52:31.533 INFO:teuthology.orchestra.run.smithi050.stdout:(6/32): python3-ceph-argparse-19.0.0-2521.g1dfb 776 kB/s | 45 kB 00:00 2024-05-07T13:52:31.600 INFO:teuthology.orchestra.run.smithi050.stdout:(7/32): python3-ceph-common-19.0.0-2521.g1dfb47 2.0 MB/s | 135 kB 00:00 2024-05-07T13:52:31.667 INFO:teuthology.orchestra.run.smithi050.stdout:(8/32): python3-cephfs-19.0.0-2521.g1dfb479e.el 2.4 MB/s | 162 kB 00:00 2024-05-07T13:52:31.743 INFO:teuthology.orchestra.run.smithi050.stdout:(9/32): python3-rados-19.0.0-2521.g1dfb479e.el9 4.2 MB/s | 321 kB 00:00 2024-05-07T13:52:31.960 INFO:teuthology.orchestra.run.smithi050.stdout:(10/32): ceph-common-19.0.0-2521.g1dfb479e.el9. 12 MB/s | 21 MB 00:01 2024-05-07T13:52:31.985 INFO:teuthology.orchestra.run.smithi050.stdout:(11/32): python3-rbd-19.0.0-2521.g1dfb479e.el9. 1.2 MB/s | 298 kB 00:00 2024-05-07T13:52:32.010 INFO:teuthology.orchestra.run.smithi050.stdout:(12/32): python3-rgw-19.0.0-2521.g1dfb479e.el9. 1.9 MB/s | 99 kB 00:00 2024-05-07T13:52:32.087 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:52:32.177 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-07T13:52:32.205 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-07T13:52:32.230 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-07T13:52:32.253 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-07T13:52:32.281 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-07T13:52:32.498 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-07T13:52:32.551 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-07T13:52:32.790 INFO:teuthology.orchestra.run.smithi050.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 133 kB/s | 107 kB 00:00 2024-05-07T13:52:32.886 INFO:teuthology.orchestra.run.smithi050.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 183 kB/s | 160 kB 00:00 2024-05-07T13:52:32.950 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-07T13:52:33.015 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 7/34 2024-05-07T13:52:33.086 INFO:teuthology.orchestra.run.smithi050.stdout:(15/32): ceph-radosgw-19.0.0-2521.g1dfb479e.el9 3.6 MB/s | 10 MB 00:02 2024-05-07T13:52:33.091 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 7/34 2024-05-07T13:52:33.206 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:19.0.0-2521.g1dfb479e.el9.x86_64 8/34 2024-05-07T13:52:33.233 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 9/34 2024-05-07T13:52:33.288 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 9/34 2024-05-07T13:52:33.326 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-07T13:52:33.369 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:19.0.0-2521.g1dfb479e.el9. 11/34 2024-05-07T13:52:33.439 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:19.0.0-2521.g1dfb479e.el9.x86_64 12/34 2024-05-07T13:52:33.460 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:19.0.0-2521.g1dfb479e.el9.x86_6 13/34 2024-05-07T13:52:33.508 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2521.g1dfb479e.el9.x86_6 13/34 2024-05-07T13:52:33.528 INFO:teuthology.orchestra.run.smithi050.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 61 kB/s | 45 kB 00:00 2024-05-07T13:52:33.543 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-07T13:52:33.654 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-07T13:52:33.685 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-07T13:52:33.738 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-07T13:52:33.767 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-07T13:52:33.797 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-07T13:52:33.829 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-07T13:52:33.896 INFO:teuthology.orchestra.run.smithi050.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 657 kB/s | 662 kB 00:01 2024-05-07T13:52:33.962 INFO:teuthology.orchestra.run.smithi050.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 345 kB/s | 292 kB 00:00 2024-05-07T13:52:34.162 INFO:teuthology.orchestra.run.smithi050.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 67 kB/s | 42 kB 00:00 2024-05-07T13:52:34.168 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-07T13:52:34.217 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 22/34 2024-05-07T13:52:34.308 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 22/34 2024-05-07T13:52:34.338 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 23/34 2024-05-07T13:52:34.375 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-07T13:52:34.621 INFO:teuthology.orchestra.run.smithi050.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 54 kB/s | 36 kB 00:00 2024-05-07T13:52:34.821 INFO:teuthology.orchestra.run.smithi050.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 238 kB/s | 221 kB 00:00 2024-05-07T13:52:34.854 INFO:teuthology.orchestra.run.smithi050.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 71 kB/s | 47 kB 00:00 2024-05-07T13:52:34.875 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-07T13:52:34.948 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:19.0.0-2521.g1dfb479e.el9.x86_64 26/34 2024-05-07T13:52:34.948 INFO:teuthology.orchestra.run.smithi050.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.2 MB/s | 309 kB 00:00 2024-05-07T13:52:34.948 INFO:teuthology.orchestra.run.smithi050.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 830 kB/s | 49 kB 00:00 2024-05-07T13:52:34.972 INFO:teuthology.orchestra.run.smithi050.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-05-07T13:52:34.975 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:19.0.0-2521.g1dfb479e.el9.x86_64 26/34 2024-05-07T13:52:34.997 INFO:teuthology.orchestra.run.smithi050.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-07T13:52:35.054 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 27/34 2024-05-07T13:52:35.064 INFO:teuthology.orchestra.run.smithi050.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-05-07T13:52:35.080 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:19.0.0-2521.g1dfb479e.el9.x8 28/34 2024-05-07T13:52:35.215 INFO:teuthology.orchestra.run.smithi050.stdout:(28/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-07T13:52:35.249 INFO:teuthology.orchestra.run.smithi050.stdout:(29/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.0 MB/s | 839 kB 00:00 2024-05-07T13:52:35.290 INFO:teuthology.orchestra.run.smithi050.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-05-07T13:52:35.532 INFO:teuthology.orchestra.run.smithi050.stdout:(31/32): librados2-19.0.0-2521.g1dfb479e.el9.x8 11 MB/s | 3.4 MB 00:00 2024-05-07T13:52:35.616 INFO:teuthology.orchestra.run.smithi050.stdout:(32/32): librbd1-19.0.0-2521.g1dfb479e.el9.x86_ 8.5 MB/s | 3.1 MB 00:00 2024-05-07T13:52:35.618 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:52:35.619 INFO:teuthology.orchestra.run.smithi050.stdout:Total 11 MB/s | 60 MB 00:05 2024-05-07T13:52:35.730 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:52:35.771 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:52:35.772 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:52:36.409 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:52:36.410 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:52:37.423 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 29/34 2024-05-07T13:52:37.460 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 29/34 2024-05-07T13:52:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:52:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-07T13:52:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-07T13:52:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-07T13:52:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-07T13:52:38.044 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 29/34 2024-05-07T13:52:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-07T13:52:38.081 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 30/34 2024-05-07T13:52:38.191 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 30/34 2024-05-07T13:52:38.192 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-07T13:52:38.192 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-07T13:52:38.192 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:52:38.224 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:19.0.0-2521.g1dfb479e.el9.x86_64 31/34 2024-05-07T13:52:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-07T13:52:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-07T13:52:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-07T13:52:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 7/34 2024-05-07T13:52:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 7/34 2024-05-07T13:52:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.0.0-2521.g1dfb479e.el9.x86_64 8/34 2024-05-07T13:52:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 9/34 2024-05-07T13:52:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 9/34 2024-05-07T13:52:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-07T13:52:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.0.0-2521.g1dfb479e.el9. 11/34 2024-05-07T13:52:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.0.0-2521.g1dfb479e.el9.x86_64 12/34 2024-05-07T13:52:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.0.0-2521.g1dfb479e.el9.x86_6 13/34 2024-05-07T13:52:39.267 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2521.g1dfb479e.el9.x86_6 13/34 2024-05-07T13:52:39.309 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-07T13:52:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-07T13:52:39.461 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-07T13:52:39.502 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-07T13:52:39.542 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-07T13:52:39.571 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-07T13:52:39.613 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-07T13:52:39.943 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-07T13:52:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 22/34 2024-05-07T13:52:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 22/34 2024-05-07T13:52:40.097 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 23/34 2024-05-07T13:52:40.133 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-07T13:52:40.633 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-07T13:52:40.661 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.0.0-2521.g1dfb479e.el9.x86_64 26/34 2024-05-07T13:52:40.733 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.0.0-2521.g1dfb479e.el9.x86_64 26/34 2024-05-07T13:52:40.814 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 27/34 2024-05-07T13:52:40.839 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.0.0-2521.g1dfb479e.el9.x8 28/34 2024-05-07T13:52:43.213 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 29/34 2024-05-07T13:52:43.253 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 29/34 2024-05-07T13:52:43.843 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 29/34 2024-05-07T13:52:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 30/34 2024-05-07T13:52:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 30/34 2024-05-07T13:52:43.975 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-07T13:52:43.975 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-07T13:52:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:52:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.0.0-2521.g1dfb479e.el9.x86_64 31/34 2024-05-07T13:52:48.420 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2521.g1dfb479e.el9.x86_64 31/34 2024-05-07T13:52:48.420 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-05-07T13:52:48.420 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-05-07T13:52:48.420 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-05-07T13:52:48.421 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-05-07T13:52:48.421 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-05-07T13:52:48.421 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2024-05-07T13:52:48.421 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-05-07T13:52:48.421 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:52:49.401 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 32/34 2024-05-07T13:52:49.436 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 32/34 2024-05-07T13:52:49.436 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:52:49.436 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-07T13:52:49.436 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T13:52:49.436 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T13:52:49.436 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:52:49.437 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-07T13:52:49.529 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-07T13:52:49.529 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-07T13:52:50.739 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 3/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:19.0.0-2521.g1dfb479e.el9.x86_64 4/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 5/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:19.0.0-2521.g1dfb479e.el9.x86_6 6/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:19.0.0-2521.g1dfb479e.el9.x86_64 7/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2521.g1dfb479e.el9. 8/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:19.0.0-2521.g1dfb479e.el9.x8 9/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:19.0.0-2521.g1dfb479e.el9.x86_64 10/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:19.0.0-2521.g1dfb479e.el9.x86_64 11/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 12/34 2024-05-07T13:52:50.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 13/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-07T13:52:50.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-07T13:52:50.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-07T13:52:50.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-07T13:52:50.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-07T13:52:50.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 31/34 2024-05-07T13:52:50.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-07T13:52:50.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 33/34 2024-05-07T13:52:51.666 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-07T13:52:51.666 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:52:51.666 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-07T13:52:51.667 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.668 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:51.669 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-07T13:52:51.669 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-07T13:52:51.669 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-07T13:52:51.669 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-3.el9.x86_64 2024-05-07T13:52:51.669 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-07T13:52:51.669 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:52:51.669 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:52:52.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-test 2024-05-07T13:52:52.628 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:29 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:52:52.755 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:52:52.756 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:52:52.756 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:52:52.756 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:52:52.756 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:52:52.756 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 48 M 2024-05-07T13:52:52.756 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:52:52.756 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 163 k 2024-05-07T13:52:52.756 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-07T13:52:52.756 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-07T13:52:52.757 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:52:52.757 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:52:52.757 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:52:52.757 INFO:teuthology.orchestra.run.smithi022.stdout:Install 4 Packages 2024-05-07T13:52:52.757 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:52:52.757 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 49 M 2024-05-07T13:52:52.757 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 207 M 2024-05-07T13:52:52.758 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:52:53.553 INFO:teuthology.orchestra.run.smithi022.stdout:(1/4): libcephsqlite-19.0.0-2521.g1dfb479e.el9. 276 kB/s | 163 kB 00:00 2024-05-07T13:52:53.894 INFO:teuthology.orchestra.run.smithi022.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 186 kB/s | 64 kB 00:00 2024-05-07T13:52:53.961 INFO:teuthology.orchestra.run.smithi022.stdout:(3/4): socat-1.7.4.1-5.el9.x86_64.rpm 305 kB/s | 305 kB 00:00 2024-05-07T13:52:54.323 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2521.g1dfb479e.el9.x86_64 31/34 2024-05-07T13:52:54.323 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2024-05-07T13:52:54.323 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2024-05-07T13:52:54.323 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2024-05-07T13:52:54.323 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2024-05-07T13:52:54.323 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2024-05-07T13:52:54.323 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2024-05-07T13:52:54.323 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2024-05-07T13:52:54.323 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:52:55.311 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 32/34 2024-05-07T13:52:55.338 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 32/34 2024-05-07T13:52:55.338 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:52:55.338 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-07T13:52:55.338 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T13:52:55.338 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-07T13:52:55.338 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:52:55.340 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-07T13:52:55.422 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-07T13:52:55.422 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-07T13:52:56.682 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 3/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.0.0-2521.g1dfb479e.el9.x86_64 4/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 5/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.0.0-2521.g1dfb479e.el9.x86_6 6/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.0.0-2521.g1dfb479e.el9.x86_64 7/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2521.g1dfb479e.el9. 8/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.0.0-2521.g1dfb479e.el9.x8 9/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.0.0-2521.g1dfb479e.el9.x86_64 10/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.0.0-2521.g1dfb479e.el9.x86_64 11/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 12/34 2024-05-07T13:52:56.683 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 13/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-07T13:52:56.684 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-07T13:52:56.685 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-07T13:52:56.685 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-07T13:52:56.685 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-07T13:52:56.685 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-07T13:52:56.685 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 31/34 2024-05-07T13:52:56.685 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-07T13:52:56.685 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 33/34 2024-05-07T13:52:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-07T13:52:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:52:57.515 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2024-05-07T13:52:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-07T13:52:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:52:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-07T13:52:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-07T13:52:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-07T13:52:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-3.el9.x86_64 2024-05-07T13:52:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-07T13:52:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:52:57.518 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:52:57.894 INFO:teuthology.orchestra.run.smithi022.stdout:(4/4): ceph-test-19.0.0-2521.g1dfb479e.el9.x86_ 9.8 MB/s | 48 MB 00:04 2024-05-07T13:52:57.897 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:52:57.897 INFO:teuthology.orchestra.run.smithi022.stdout:Total 9.5 MB/s | 49 MB 00:05 2024-05-07T13:52:57.918 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-test 2024-05-07T13:52:57.926 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:52:57.950 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:52:57.951 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:52:58.335 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:52:58.336 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:52:58.511 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:31 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:52:58.639 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:52:58.639 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 48 M 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 163 k 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:52:58.640 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2024-05-07T13:52:58.641 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:52:58.641 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 49 M 2024-05-07T13:52:58.641 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 207 M 2024-05-07T13:52:58.641 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:52:58.883 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:52:58.966 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-07T13:52:59.002 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): libcephsqlite-19.0.0-2521.g1dfb479e.el9. 694 kB/s | 163 kB 00:00 2024-05-07T13:52:59.011 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-07T13:52:59.038 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:19.0.0-2521.g1dfb479e.el9.x86_64 3/4 2024-05-07T13:52:59.636 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 351 kB/s | 305 kB 00:00 2024-05-07T13:52:59.695 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 95 kB/s | 64 kB 00:00 2024-05-07T13:53:03.882 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2521.g1dfb479e.el9.x86_64 3/4 2024-05-07T13:53:03.956 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:19.0.0-2521.g1dfb479e.el9.x86_64 4/4 2024-05-07T13:53:06.384 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-test-2:19.0.0-2521.g1dfb479e.el9.x86_64 4/4 2024-05-07T13:53:06.384 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/4 2024-05-07T13:53:06.384 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/4 2024-05-07T13:53:06.384 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-07T13:53:06.635 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-07T13:53:06.635 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:06.635 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:53:06.635 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:06.635 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:06.635 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-07T13:53:06.635 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-07T13:53:06.636 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:06.636 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:53:06.927 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph 2024-05-07T13:53:07.514 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:44 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:53:07.643 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:53:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:07.646 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:53:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:53:07.646 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 6.6 k 2024-05-07T13:53:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 2.4 M 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 1.5 M 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 249 k 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 4.7 M 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 17 M 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-07T13:53:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-07T13:53:07.648 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:07.649 INFO:teuthology.orchestra.run.smithi022.stdout:Install 36 Packages 2024-05-07T13:53:07.650 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:07.651 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 30 M 2024-05-07T13:53:07.651 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 107 M 2024-05-07T13:53:07.651 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:53:08.440 INFO:teuthology.orchestra.run.smithi022.stdout:(1/36): ceph-19.0.0-2521.g1dfb479e.el9.x86_64.r 43 kB/s | 6.6 kB 00:00 2024-05-07T13:53:08.931 INFO:teuthology.orchestra.run.smithi022.stdout:(2/36): ceph-mgr-19.0.0-2521.g1dfb479e.el9.x86_ 2.3 MB/s | 1.5 MB 00:00 2024-05-07T13:53:09.336 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): ceph-test-19.0.0-2521.g1dfb479e.el9.x86_ 4.6 MB/s | 48 MB 00:10 2024-05-07T13:53:09.337 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:53:09.338 INFO:teuthology.orchestra.run.smithi050.stdout:Total 4.6 MB/s | 49 MB 00:10 2024-05-07T13:53:09.365 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:53:09.387 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:53:09.387 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:53:09.774 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:53:09.774 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:53:10.057 INFO:teuthology.orchestra.run.smithi022.stdout:(3/36): ceph-mon-19.0.0-2521.g1dfb479e.el9.x86_ 2.9 MB/s | 4.7 MB 00:01 2024-05-07T13:53:10.157 INFO:teuthology.orchestra.run.smithi022.stdout:(4/36): ceph-mds-19.0.0-2521.g1dfb479e.el9.x86_ 1.3 MB/s | 2.4 MB 00:01 2024-05-07T13:53:10.224 INFO:teuthology.orchestra.run.smithi022.stdout:(5/36): ceph-mgr-modules-core-19.0.0-2521.g1dfb 1.5 MB/s | 249 kB 00:00 2024-05-07T13:53:10.311 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:53:10.393 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-07T13:53:10.416 INFO:teuthology.orchestra.run.smithi022.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 980 kB/s | 253 kB 00:00 2024-05-07T13:53:10.435 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-07T13:53:10.463 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.0.0-2521.g1dfb479e.el9.x86_64 3/4 2024-05-07T13:53:10.482 INFO:teuthology.orchestra.run.smithi022.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-07T13:53:10.550 INFO:teuthology.orchestra.run.smithi022.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-05-07T13:53:10.600 INFO:teuthology.orchestra.run.smithi022.stdout:(9/36): python3-cryptography-36.0.1-4.el9.x86_6 3.3 MB/s | 1.2 MB 00:00 2024-05-07T13:53:10.625 INFO:teuthology.orchestra.run.smithi022.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-05-07T13:53:10.667 INFO:teuthology.orchestra.run.smithi022.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-05-07T13:53:10.826 INFO:teuthology.orchestra.run.smithi022.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 940 kB/s | 188 kB 00:00 2024-05-07T13:53:10.859 INFO:teuthology.orchestra.run.smithi022.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 898 kB/s | 172 kB 00:00 2024-05-07T13:53:10.876 INFO:teuthology.orchestra.run.smithi022.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 692 kB/s | 35 kB 00:00 2024-05-07T13:53:10.910 INFO:teuthology.orchestra.run.smithi022.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-07T13:53:10.927 INFO:teuthology.orchestra.run.smithi022.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-05-07T13:53:10.960 INFO:teuthology.orchestra.run.smithi022.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2024-05-07T13:53:11.178 INFO:teuthology.orchestra.run.smithi022.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 200 kB/s | 43 kB 00:00 2024-05-07T13:53:11.203 INFO:teuthology.orchestra.run.smithi022.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 548 kB/s | 151 kB 00:00 2024-05-07T13:53:11.329 INFO:teuthology.orchestra.run.smithi022.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.8 MB/s | 358 kB 00:00 2024-05-07T13:53:11.354 INFO:teuthology.orchestra.run.smithi022.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 978 kB/s | 172 kB 00:00 2024-05-07T13:53:11.404 INFO:teuthology.orchestra.run.smithi022.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 142 kB/s | 11 kB 00:00 2024-05-07T13:53:11.429 INFO:teuthology.orchestra.run.smithi022.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2024-05-07T13:53:11.471 INFO:teuthology.orchestra.run.smithi022.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 345 kB/s | 23 kB 00:00 2024-05-07T13:53:11.505 INFO:teuthology.orchestra.run.smithi022.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-05-07T13:53:11.547 INFO:teuthology.orchestra.run.smithi022.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 262 kB/s | 20 kB 00:00 2024-05-07T13:53:11.581 INFO:teuthology.orchestra.run.smithi022.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 615 kB/s | 46 kB 00:00 2024-05-07T13:53:11.623 INFO:teuthology.orchestra.run.smithi022.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-05-07T13:53:11.706 INFO:teuthology.orchestra.run.smithi022.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 197 kB/s | 16 kB 00:00 2024-05-07T13:53:11.731 INFO:teuthology.orchestra.run.smithi022.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-05-07T13:53:11.773 INFO:teuthology.orchestra.run.smithi022.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-05-07T13:53:11.799 INFO:teuthology.orchestra.run.smithi022.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 536 kB/s | 36 kB 00:00 2024-05-07T13:53:11.849 INFO:teuthology.orchestra.run.smithi022.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-07T13:53:11.883 INFO:teuthology.orchestra.run.smithi022.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-05-07T13:53:11.924 INFO:teuthology.orchestra.run.smithi022.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 265 kB/s | 20 kB 00:00 2024-05-07T13:53:12.867 INFO:teuthology.orchestra.run.smithi022.stdout:(36/36): ceph-osd-19.0.0-2521.g1dfb479e.el9.x86 4.3 MB/s | 17 MB 00:03 2024-05-07T13:53:12.868 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:53:12.869 INFO:teuthology.orchestra.run.smithi022.stdout:Total 5.8 MB/s | 30 MB 00:05 2024-05-07T13:53:13.018 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:53:13.063 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:53:13.063 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:53:13.539 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:53:13.540 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:53:14.813 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:53:14.885 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-07T13:53:14.920 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-07T13:53:14.946 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-07T13:53:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-07T13:53:15.071 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-07T13:53:15.104 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-07T13:53:15.201 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-07T13:53:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-07T13:53:15.294 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2521.g1dfb479e.el9.x86_64 3/4 2024-05-07T13:53:15.324 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-07T13:53:15.359 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-07T13:53:15.381 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.0.0-2521.g1dfb479e.el9.x86_64 4/4 2024-05-07T13:53:15.388 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-07T13:53:15.423 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-07T13:53:15.456 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-07T13:53:15.498 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-07T13:53:15.551 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-07T13:53:15.591 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-07T13:53:15.630 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-07T13:53:15.707 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-07T13:53:15.860 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-07T13:53:15.942 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-07T13:53:15.993 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-07T13:53:16.030 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-07T13:53:16.098 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-07T13:53:16.170 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-07T13:53:16.367 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-07T13:53:16.418 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-07T13:53:16.500 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-07T13:53:16.599 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-07T13:53:16.648 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-07T13:53:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-07T13:53:16.939 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2521.g1dfb479e.el9. 31/36 2024-05-07T13:53:16.968 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 32/36 2024-05-07T13:53:16.995 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 32/36 2024-05-07T13:53:16.996 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:16.996 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-07T13:53:16.996 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T13:53:16.996 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T13:53:16.996 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:17.823 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-test-2:19.0.0-2521.g1dfb479e.el9.x86_64 4/4 2024-05-07T13:53:17.823 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/4 2024-05-07T13:53:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/4 2024-05-07T13:53:17.824 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-07T13:53:18.100 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-07T13:53:18.100 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:18.100 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:53:18.100 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:18.100 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:18.101 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-07T13:53:18.101 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-07T13:53:18.101 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:18.101 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:53:18.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph 2024-05-07T13:53:18.511 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:19.0.0-2521.g1dfb479e.el9.x86_64 33/36 2024-05-07T13:53:18.540 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:19.0.0-2521.g1dfb479e.el9.x86_64 33/36 2024-05-07T13:53:18.541 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:18.541 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-07T13:53:18.541 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T13:53:18.541 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T13:53:18.541 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:18.969 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:51 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:53:19.012 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:19.0.0-2521.g1dfb479e.el9.x86_64 34/36 2024-05-07T13:53:19.038 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:19.0.0-2521.g1dfb479e.el9.x86_64 34/36 2024-05-07T13:53:19.038 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:19.038 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-07T13:53:19.038 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T13:53:19.038 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T13:53:19.038 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:19.099 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 6.6 k 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 2.4 M 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 1.5 M 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 249 k 2024-05-07T13:53:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 4.7 M 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 17 M 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-07T13:53:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-07T13:53:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout:Install 36 Packages 2024-05-07T13:53:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:19.106 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 30 M 2024-05-07T13:53:19.106 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 107 M 2024-05-07T13:53:19.106 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:53:19.271 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:19.0.0-2521.g1dfb479e.el9.x86_64 35/36 2024-05-07T13:53:19.296 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:19.0.0-2521.g1dfb479e.el9.x86_64 35/36 2024-05-07T13:53:19.296 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:19.296 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-07T13:53:19.296 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T13:53:19.297 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T13:53:19.297 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:19.364 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:19.0.0-2521.g1dfb479e.el9.x86_64 36/36 2024-05-07T13:53:19.539 INFO:teuthology.orchestra.run.smithi050.stdout:(1/36): ceph-19.0.0-2521.g1dfb479e.el9.x86_64.r 37 kB/s | 6.6 kB 00:00 2024-05-07T13:53:20.056 INFO:teuthology.orchestra.run.smithi050.stdout:(2/36): ceph-mgr-19.0.0-2521.g1dfb479e.el9.x86_ 2.1 MB/s | 1.5 MB 00:00 2024-05-07T13:53:20.173 INFO:teuthology.orchestra.run.smithi050.stdout:(3/36): ceph-mon-19.0.0-2521.g1dfb479e.el9.x86_ 7.4 MB/s | 4.7 MB 00:00 2024-05-07T13:53:20.223 INFO:teuthology.orchestra.run.smithi050.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2521.g1dfb 4.9 MB/s | 249 kB 00:00 2024-05-07T13:53:20.265 INFO:teuthology.orchestra.run.smithi050.stdout:(5/36): ceph-mds-19.0.0-2521.g1dfb479e.el9.x86_ 2.6 MB/s | 2.4 MB 00:00 2024-05-07T13:53:20.449 INFO:teuthology.orchestra.run.smithi050.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-05-07T13:53:20.507 INFO:teuthology.orchestra.run.smithi050.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-07T13:53:20.566 INFO:teuthology.orchestra.run.smithi050.stdout:(8/36): python3-cryptography-36.0.1-4.el9.x86_6 4.1 MB/s | 1.2 MB 00:00 2024-05-07T13:53:20.591 INFO:teuthology.orchestra.run.smithi050.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-05-07T13:53:20.625 INFO:teuthology.orchestra.run.smithi050.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 2.1 MB/s | 125 kB 00:00 2024-05-07T13:53:20.650 INFO:teuthology.orchestra.run.smithi050.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-05-07T13:53:20.792 INFO:teuthology.orchestra.run.smithi050.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-05-07T13:53:20.826 INFO:teuthology.orchestra.run.smithi050.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 982 kB/s | 172 kB 00:00 2024-05-07T13:53:20.851 INFO:teuthology.orchestra.run.smithi050.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 593 kB/s | 35 kB 00:00 2024-05-07T13:53:20.884 INFO:teuthology.orchestra.run.smithi050.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-05-07T13:53:20.910 INFO:teuthology.orchestra.run.smithi050.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-05-07T13:53:21.002 INFO:teuthology.orchestra.run.smithi050.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-05-07T13:53:21.026 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] luarocks-3.9.2-1.el9.noarch.rpm: Curl error (60): SSL peer certificate or SSH remote key was not OK for https://mirror-mci.yuki.net.uk/fedora-epel/9/Everything/x86_64/Packages/l/luarocks-3.9.2-1.el9.noarch.rpm [SSL certificate problem: certificate has expired] 2024-05-07T13:53:21.123 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] python3-bcrypt-3.2.2-1.el9.x86_64.rpm: Curl error (60): SSL peer certificate or SSH remote key was not OK for https://mirror-mci.yuki.net.uk/fedora-epel/9/Everything/x86_64/Packages/p/python3-bcrypt-3.2.2-1.el9.x86_64.rpm [SSL certificate problem: certificate has expired] 2024-05-07T13:53:21.327 INFO:teuthology.orchestra.run.smithi050.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 362 kB/s | 151 kB 00:00 2024-05-07T13:53:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-2:19.0.0-2521.g1dfb479e.el9.x86_64 36/36 2024-05-07T13:53:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/36 2024-05-07T13:53:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/36 2024-05-07T13:53:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 3/36 2024-05-07T13:53:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:19.0.0-2521.g1dfb479e.el9.x86_64 4/36 2024-05-07T13:53:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:19.0.0-2521.g1dfb479e.el9.x86_64 5/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2521.g1dfb479e.el9. 6/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-07T13:53:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-07T13:53:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-07T13:53:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-07T13:53:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-07T13:53:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-07T13:53:21.352 INFO:teuthology.orchestra.run.smithi050.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 124 kB/s | 43 kB 00:00 2024-05-07T13:53:21.442 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] python3-cheroot-8.6.0-4.el9.noarch.rpm: Curl error (60): SSL peer certificate or SSH remote key was not OK for https://mirror-mci.yuki.net.uk/fedora-epel/9/Everything/x86_64/Packages/p/python3-cheroot-8.6.0-4.el9.noarch.rpm [SSL certificate problem: certificate has expired] 2024-05-07T13:53:21.473 INFO:teuthology.orchestra.run.smithi050.stdout:[MIRROR] python3-cherrypy-18.6.1-2.el9.noarch.rpm: Curl error (60): SSL peer certificate or SSH remote key was not OK for https://mirror-mci.yuki.net.uk/fedora-epel/9/Everything/x86_64/Packages/p/python3-cherrypy-18.6.1-2.el9.noarch.rpm [SSL certificate problem: certificate has expired] 2024-05-07T13:53:21.569 INFO:teuthology.orchestra.run.smithi050.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 710 kB/s | 172 kB 00:00 2024-05-07T13:53:21.736 INFO:teuthology.orchestra.run.smithi050.stdout:(21/36): ceph-osd-19.0.0-2521.g1dfb479e.el9.x86 10 MB/s | 17 MB 00:01 2024-05-07T13:53:21.762 INFO:teuthology.orchestra.run.smithi050.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 56 kB/s | 11 kB 00:00 2024-05-07T13:53:21.812 INFO:teuthology.orchestra.run.smithi050.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 234 kB/s | 18 kB 00:00 2024-05-07T13:53:21.887 INFO:teuthology.orchestra.run.smithi050.stdout:(24/36): python3-cherrypy-18.6.1-2.el9.noarch.r 670 kB/s | 358 kB 00:00 2024-05-07T13:53:21.931 INFO:teuthology.orchestra.run.smithi050.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 164 kB/s | 19 kB 00:00 2024-05-07T13:53:21.954 INFO:teuthology.orchestra.run.smithi050.stdout:(26/36): python3-jaraco-collections-3.0.0-8.el9 120 kB/s | 23 kB 00:00 2024-05-07T13:53:21.980 INFO:teuthology.orchestra.run.smithi050.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 213 kB/s | 20 kB 00:00 2024-05-07T13:53:22.005 INFO:teuthology.orchestra.run.smithi050.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 624 kB/s | 46 kB 00:00 2024-05-07T13:53:22.081 INFO:teuthology.orchestra.run.smithi050.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 219 kB/s | 16 kB 00:00 2024-05-07T13:53:22.114 INFO:teuthology.orchestra.run.smithi050.stdout:(30/36): python3-more-itertools-8.12.0-2.el9.no 495 kB/s | 79 kB 00:00 2024-05-07T13:53:22.164 INFO:teuthology.orchestra.run.smithi050.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-05-07T13:53:22.198 INFO:teuthology.orchestra.run.smithi050.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 429 kB/s | 36 kB 00:00 2024-05-07T13:53:22.323 INFO:teuthology.orchestra.run.smithi050.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-05-07T13:53:22.349 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-07T13:53:22.349 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:22.349 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:53:22.349 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:22.349 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:22.349 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:22.349 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: lua-5.4.4-4.el9.x86_64 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-07T13:53:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-07T13:53:22.351 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:22.352 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:53:22.407 INFO:teuthology.orchestra.run.smithi050.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 240 kB/s | 20 kB 00:00 2024-05-07T13:53:22.440 INFO:teuthology.orchestra.run.smithi050.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.7 MB/s | 427 kB 00:00 2024-05-07T13:53:22.465 INFO:teuthology.orchestra.run.smithi050.stdout:(36/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 234 kB/s | 90 kB 00:00 2024-05-07T13:53:22.467 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:53:22.467 INFO:teuthology.orchestra.run.smithi050.stdout:Total 9.0 MB/s | 30 MB 00:03 2024-05-07T13:53:22.617 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:53:22.661 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:53:22.661 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:53:22.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-base 2024-05-07T13:53:23.133 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:53:23.134 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:53:23.287 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:00 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:53:23.372 INFO:teuthology.orchestra.run.smithi022.stdout:Package ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:53:23.420 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:53:23.421 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-05-07T13:53:23.422 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:53:23.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install cephadm 2024-05-07T13:53:24.080 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:01 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:53:24.207 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:53:24.208 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:24.208 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:53:24.208 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 762 k 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 762 k 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 769 k 2024-05-07T13:53:24.209 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:53:24.454 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:53:24.510 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-07T13:53:24.521 INFO:teuthology.orchestra.run.smithi022.stdout:cephadm-19.0.0-2521.g1dfb479e.el9.noarch.rpm 2.4 MB/s | 762 kB 00:00 2024-05-07T13:53:24.522 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:53:24.522 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.4 MB/s | 762 kB 00:00 2024-05-07T13:53:24.522 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:53:24.528 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:53:24.528 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:53:24.535 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:53:24.535 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:53:24.552 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-07T13:53:24.579 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-07T13:53:24.606 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:53:24.647 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-07T13:53:24.695 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-07T13:53:24.728 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-07T13:53:24.826 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-07T13:53:24.920 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-07T13:53:24.966 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-07T13:53:25.000 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-07T13:53:25.029 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-07T13:53:25.064 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-07T13:53:25.093 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/1 2024-05-07T13:53:25.097 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-07T13:53:25.138 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-07T13:53:25.182 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-07T13:53:25.186 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/1 2024-05-07T13:53:25.215 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-07T13:53:25.254 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-07T13:53:25.333 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-07T13:53:25.485 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-07T13:53:25.567 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/1 2024-05-07T13:53:25.575 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-07T13:53:25.634 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-07T13:53:25.671 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-07T13:53:25.730 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-07T13:53:25.796 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-07T13:53:25.810 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/1 2024-05-07T13:53:25.810 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:25.810 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:53:25.811 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:53:25.811 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:25.811 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:53:26.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-immutable-object-cache 2024-05-07T13:53:26.012 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-07T13:53:26.059 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-07T13:53:26.141 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-07T13:53:26.239 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-07T13:53:26.277 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-07T13:53:26.409 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-07T13:53:26.580 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2521.g1dfb479e.el9. 31/36 2024-05-07T13:53:26.604 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:03 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:53:26.625 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 32/36 2024-05-07T13:53:26.653 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 32/36 2024-05-07T13:53:26.654 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:26.654 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-07T13:53:26.654 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T13:53:26.654 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-07T13:53:26.654 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:26.733 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 145 k 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 145 k 2024-05-07T13:53:26.734 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 435 k 2024-05-07T13:53:26.735 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:53:27.045 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-immutable-object-cache-19.0.0-2521.g1dfb47 467 kB/s | 145 kB 00:00 2024-05-07T13:53:27.046 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:53:27.046 INFO:teuthology.orchestra.run.smithi022.stdout:Total 465 kB/s | 145 kB 00:00 2024-05-07T13:53:27.046 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:53:27.055 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:53:27.055 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:53:27.115 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:53:27.115 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:53:27.261 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:53:27.329 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2521.g1dfb479e. 1/1 2024-05-07T13:53:27.356 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2521.g1dfb479e. 1/1 2024-05-07T13:53:27.357 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:27.357 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-07T13:53:27.357 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:28.176 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.0.0-2521.g1dfb479e.el9.x86_64 33/36 2024-05-07T13:53:28.206 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.0.0-2521.g1dfb479e.el9.x86_64 33/36 2024-05-07T13:53:28.206 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:28.206 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-07T13:53:28.206 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T13:53:28.206 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-07T13:53:28.206 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:28.376 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2521.g1dfb479e. 1/1 2024-05-07T13:53:28.376 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:28.377 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:53:28.377 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:28.377 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:28.377 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:53:28.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr 2024-05-07T13:53:28.668 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.0.0-2521.g1dfb479e.el9.x86_64 34/36 2024-05-07T13:53:28.694 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.0.0-2521.g1dfb479e.el9.x86_64 34/36 2024-05-07T13:53:28.694 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:28.694 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-07T13:53:28.695 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T13:53:28.695 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-07T13:53:28.695 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:28.927 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.0.0-2521.g1dfb479e.el9.x86_64 35/36 2024-05-07T13:53:28.953 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.0.0-2521.g1dfb479e.el9.x86_64 35/36 2024-05-07T13:53:28.953 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:28.953 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-07T13:53:28.953 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T13:53:28.953 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-07T13:53:28.953 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:29.019 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.0.0-2521.g1dfb479e.el9.x86_64 36/36 2024-05-07T13:53:29.191 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:06 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:53:29.276 INFO:teuthology.orchestra.run.smithi022.stdout:Package ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:53:29.320 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:53:29.321 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-05-07T13:53:29.322 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:53:29.384 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-dashboard 2024-05-07T13:53:29.973 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:06 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:53:30.102 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 3.5 M 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 32 k 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 16 k 2024-05-07T13:53:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout:Install 12 Packages 2024-05-07T13:53:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:30.106 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 8.6 M 2024-05-07T13:53:30.106 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 103 M 2024-05-07T13:53:30.106 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:53:30.613 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-2:19.0.0-2521.g1dfb479e.el9.x86_64 36/36 2024-05-07T13:53:30.613 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/36 2024-05-07T13:53:30.613 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/36 2024-05-07T13:53:30.613 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 3/36 2024-05-07T13:53:30.613 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.0.0-2521.g1dfb479e.el9.x86_64 4/36 2024-05-07T13:53:30.613 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.0.0-2521.g1dfb479e.el9.x86_64 5/36 2024-05-07T13:53:30.613 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2521.g1dfb479e.el9. 6/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-07T13:53:30.614 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-07T13:53:30.615 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-07T13:53:30.615 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-07T13:53:30.615 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-07T13:53:30.615 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-07T13:53:30.615 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-07T13:53:30.615 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-07T13:53:30.615 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-07T13:53:30.617 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-07T13:53:30.617 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-07T13:53:30.617 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-07T13:53:30.617 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-07T13:53:30.617 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-07T13:53:30.617 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-07T13:53:30.617 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-07T13:53:30.618 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-07T13:53:30.625 INFO:teuthology.orchestra.run.smithi022.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2521.g1d 163 kB/s | 32 kB 00:00 2024-05-07T13:53:30.650 INFO:teuthology.orchestra.run.smithi022.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2521.g1df 75 kB/s | 16 kB 00:00 2024-05-07T13:53:30.909 INFO:teuthology.orchestra.run.smithi022.stdout:(3/12): ceph-mgr-dashboard-19.0.0-2521.g1dfb479 7.3 MB/s | 3.5 MB 00:00 2024-05-07T13:53:31.531 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-07T13:53:31.531 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:31.531 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:53:31.531 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:31.531 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:31.531 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:31.531 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-07T13:53:31.532 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-07T13:53:31.533 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-07T13:53:31.534 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-07T13:53:31.534 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-07T13:53:31.534 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-07T13:53:31.534 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-07T13:53:31.534 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-07T13:53:31.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:31.534 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:53:31.559 INFO:teuthology.orchestra.run.smithi022.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 296 kB/s | 269 kB 00:00 2024-05-07T13:53:31.678 INFO:teuthology.orchestra.run.smithi022.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 983 kB/s | 1.0 MB 00:01 2024-05-07T13:53:31.826 INFO:teuthology.orchestra.run.smithi022.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 997 kB/s | 863 kB 00:00 2024-05-07T13:53:31.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-base 2024-05-07T13:53:31.927 INFO:teuthology.orchestra.run.smithi022.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.5 MB/s | 548 kB 00:00 2024-05-07T13:53:31.952 INFO:teuthology.orchestra.run.smithi022.stdout:(8/12): grpc-data-1.46.7-10.el9.noarch.rpm 70 kB/s | 19 kB 00:00 2024-05-07T13:53:32.236 INFO:teuthology.orchestra.run.smithi022.stdout:(9/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 5.0 MB/s | 2.0 MB 00:00 2024-05-07T13:53:32.261 INFO:teuthology.orchestra.run.smithi022.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 433 kB/s | 144 kB 00:00 2024-05-07T13:53:32.286 INFO:teuthology.orchestra.run.smithi022.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 92 kB/s | 31 kB 00:00 2024-05-07T13:53:32.311 INFO:teuthology.orchestra.run.smithi022.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-05-07T13:53:32.315 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:53:32.315 INFO:teuthology.orchestra.run.smithi022.stdout:Total 3.9 MB/s | 8.6 MB 00:02 2024-05-07T13:53:32.369 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:53:32.389 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:53:32.389 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:53:32.451 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:05 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:53:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-base-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:53:32.578 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:53:32.579 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-05-07T13:53:32.579 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:53:32.583 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:53:32.583 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:53:32.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install cephadm 2024-05-07T13:53:33.198 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:53:33.233 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:06 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:53:33.288 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-07T13:53:33.323 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-07T13:53:33.360 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 762 k 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:33.361 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 762 k 2024-05-07T13:53:33.362 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 769 k 2024-05-07T13:53:33.362 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:53:33.370 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-07T13:53:33.400 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-07T13:53:33.522 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-07T13:53:33.644 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm-19.0.0-2521.g1dfb479e.el9.noarch.rpm 2.6 MB/s | 762 kB 00:00 2024-05-07T13:53:33.644 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:53:33.645 INFO:teuthology.orchestra.run.smithi050.stdout:Total 2.6 MB/s | 762 kB 00:00 2024-05-07T13:53:33.645 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:53:33.650 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:53:33.650 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:53:33.654 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-07T13:53:33.656 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:53:33.657 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:53:33.731 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:53:33.750 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-07T13:53:33.800 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-07T13:53:33.835 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-07T13:53:33.867 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2521.g1dfb479e.el9 10/12 2024-05-07T13:53:34.164 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/1 2024-05-07T13:53:34.242 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/1 2024-05-07T13:53:34.619 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/1 2024-05-07T13:53:34.869 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/1 2024-05-07T13:53:34.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:34.870 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:53:34.870 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:53:34.870 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:34.870 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:53:34.984 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2521.g1dfb479e.el 11/12 2024-05-07T13:53:35.034 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2521.g1dfb479e.el9.noa 12/12 2024-05-07T13:53:35.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-immutable-object-cache 2024-05-07T13:53:35.685 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:08 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:53:35.818 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:53:35.818 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 145 k 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 145 k 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 435 k 2024-05-07T13:53:35.819 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:53:36.042 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-immutable-object-cache-19.0.0-2521.g1dfb47 650 kB/s | 145 kB 00:00 2024-05-07T13:53:36.043 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:53:36.043 INFO:teuthology.orchestra.run.smithi050.stdout:Total 647 kB/s | 145 kB 00:00 2024-05-07T13:53:36.043 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:53:36.052 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:53:36.052 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:53:36.113 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:53:36.113 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:53:36.262 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:53:36.327 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2521.g1dfb479e. 1/1 2024-05-07T13:53:36.355 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2521.g1dfb479e. 1/1 2024-05-07T13:53:36.355 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:53:36.355 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-07T13:53:36.355 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:36.384 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2521.g1dfb479e.el9.noa 12/12 2024-05-07T13:53:36.384 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2521.g1dfb479e.el 1/12 2024-05-07T13:53:36.384 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2521.g1dfb479e.el9.noa 2/12 2024-05-07T13:53:36.385 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2521.g1dfb479e.el9 3/12 2024-05-07T13:53:36.385 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-07T13:53:36.385 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-07T13:53:36.385 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-07T13:53:36.385 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-07T13:53:36.385 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-07T13:53:36.386 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-07T13:53:36.386 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-07T13:53:36.386 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-07T13:53:36.699 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-07T13:53:36.699 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:36.699 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:53:36.699 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-07T13:53:36.699 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:53:36.699 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:53:36.699 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:36.700 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:53:36.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-07T13:53:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2521.g1dfb479e. 1/1 2024-05-07T13:53:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:37.322 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:53:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:53:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:37.322 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:53:37.510 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:14 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:53:37.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr 2024-05-07T13:53:37.639 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:53:37.640 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2024-05-07T13:53:37.640 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:53:37.640 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2024-05-07T13:53:37.640 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:53:37.641 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 7.4 M 2024-05-07T13:53:37.641 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:53:37.641 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-07T13:53:37.641 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-07T13:53:37.641 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-07T13:53:37.641 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-07T13:53:37.641 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-07T13:53:37.642 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-07T13:53:37.642 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-07T13:53:37.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-07T13:53:37.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-07T13:53:37.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-07T13:53:37.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-07T13:53:37.642 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:37.642 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:53:37.643 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2024-05-07T13:53:37.643 INFO:teuthology.orchestra.run.smithi022.stdout:Install 12 Packages 2024-05-07T13:53:37.643 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:37.644 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 38 M 2024-05-07T13:53:37.644 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 209 M 2024-05-07T13:53:37.644 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:53:38.161 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:11 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:53:38.245 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-mgr-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:53:38.290 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:53:38.291 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-05-07T13:53:38.291 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:53:38.339 INFO:teuthology.orchestra.run.smithi022.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 372 kB/s | 195 kB 00:00 2024-05-07T13:53:38.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-dashboard 2024-05-07T13:53:38.539 INFO:teuthology.orchestra.run.smithi022.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 164 kB/s | 33 kB 00:00 2024-05-07T13:53:38.952 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:11 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:53:38.972 INFO:teuthology.orchestra.run.smithi022.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 693 kB/s | 803 kB 00:01 2024-05-07T13:53:39.080 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:53:39.081 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:53:39.081 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:39.081 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:53:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 3.5 M 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 32 k 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 16 k 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-07T13:53:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-07T13:53:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-07T13:53:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:39.083 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:53:39.083 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:53:39.083 INFO:teuthology.orchestra.run.smithi050.stdout:Install 12 Packages 2024-05-07T13:53:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:53:39.084 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 8.6 M 2024-05-07T13:53:39.084 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 103 M 2024-05-07T13:53:39.084 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:53:39.131 INFO:teuthology.orchestra.run.smithi022.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 115 kB/s | 18 kB 00:00 2024-05-07T13:53:39.231 INFO:teuthology.orchestra.run.smithi022.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 353 kB/s | 35 kB 00:00 2024-05-07T13:53:39.473 INFO:teuthology.orchestra.run.smithi022.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.2 MB/s | 3.0 MB 00:00 2024-05-07T13:53:39.565 INFO:teuthology.orchestra.run.smithi022.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-05-07T13:53:39.857 INFO:teuthology.orchestra.run.smithi050.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2521.g1d 158 kB/s | 32 kB 00:00 2024-05-07T13:53:39.882 INFO:teuthology.orchestra.run.smithi050.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2521.g1df 73 kB/s | 16 kB 00:00 2024-05-07T13:53:40.124 INFO:teuthology.orchestra.run.smithi022.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.1 MB/s | 5.1 MB 00:00 2024-05-07T13:53:40.190 INFO:teuthology.orchestra.run.smithi022.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.7 MB/s | 250 kB 00:00 2024-05-07T13:53:40.250 INFO:teuthology.orchestra.run.smithi050.stdout:(3/12): ceph-mgr-dashboard-19.0.0-2521.g1dfb479 5.9 MB/s | 3.5 MB 00:00 2024-05-07T13:53:40.283 INFO:teuthology.orchestra.run.smithi022.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.5 MB/s | 4.7 MB 00:01 2024-05-07T13:53:40.741 INFO:teuthology.orchestra.run.smithi050.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 314 kB/s | 269 kB 00:00 2024-05-07T13:53:40.894 INFO:teuthology.orchestra.run.smithi050.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-05-07T13:53:41.050 INFO:teuthology.orchestra.run.smithi022.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-05-07T13:53:41.342 INFO:teuthology.orchestra.run.smithi050.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 43 kB/s | 19 kB 00:00 2024-05-07T13:53:41.934 INFO:teuthology.orchestra.run.smithi050.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 460 kB/s | 548 kB 00:01 2024-05-07T13:53:42.201 INFO:teuthology.orchestra.run.smithi050.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 542 kB/s | 144 kB 00:00 2024-05-07T13:53:42.309 INFO:teuthology.orchestra.run.smithi050.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 284 kB/s | 31 kB 00:00 2024-05-07T13:53:42.576 INFO:teuthology.orchestra.run.smithi050.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 706 kB/s | 188 kB 00:00 2024-05-07T13:53:43.843 INFO:teuthology.orchestra.run.smithi050.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 834 kB/s | 2.0 MB 00:02 2024-05-07T13:53:44.166 INFO:teuthology.orchestra.run.smithi022.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 1.2 MB/s | 7.4 MB 00:06 2024-05-07T13:53:44.170 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:53:44.171 INFO:teuthology.orchestra.run.smithi022.stdout:Total 5.8 MB/s | 38 MB 00:06 2024-05-07T13:53:44.537 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:53:44.565 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:53:44.565 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:53:45.022 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:53:45.023 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:53:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:53:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-07T13:53:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-07T13:53:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-07T13:53:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-07T13:53:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-07T13:53:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-07T13:53:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-07T13:53:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-07T13:53:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-07T13:53:48.506 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-07T13:53:49.600 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-07T13:53:49.621 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2521.g1dfb4 12/12 2024-05-07T13:53:52.212 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2521.g1dfb4 12/12 2024-05-07T13:53:52.212 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2521.g1dfb4 1/12 2024-05-07T13:53:52.212 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-07T13:53:52.213 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-07T13:53:52.213 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-07T13:53:52.213 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-07T13:53:52.213 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-07T13:53:52.213 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-07T13:53:52.213 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-07T13:53:52.213 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-07T13:53:52.213 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-07T13:53:52.213 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-07T13:53:52.765 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-07T13:53:52.766 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-07T13:53:52.767 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-07T13:53:52.767 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-07T13:53:52.767 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-07T13:53:52.767 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:52.767 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:53:53.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-rook 2024-05-07T13:53:53.695 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:30 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:53:53.822 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:53:53.823 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:53.823 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:53:53.823 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 49 k 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-07T13:53:53.824 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-07T13:53:53.825 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-07T13:53:53.825 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-07T13:53:53.825 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-07T13:53:53.825 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:53.825 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:53:53.825 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:53:53.825 INFO:teuthology.orchestra.run.smithi022.stdout:Install 13 Packages 2024-05-07T13:53:53.825 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:53:53.826 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 2.2 M 2024-05-07T13:53:53.826 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 26 M 2024-05-07T13:53:53.826 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:53:54.496 INFO:teuthology.orchestra.run.smithi022.stdout:(1/13): ceph-mgr-rook-19.0.0-2521.g1dfb479e.el9 265 kB/s | 49 kB 00:00 2024-05-07T13:54:02.554 INFO:teuthology.orchestra.run.smithi022.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 3.1 kB/s | 26 kB 00:08 2024-05-07T13:54:02.579 INFO:teuthology.orchestra.run.smithi022.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 2.3 kB/s | 19 kB 00:08 2024-05-07T13:54:02.591 INFO:teuthology.orchestra.run.smithi050.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 39 kB/s | 863 kB 00:22 2024-05-07T13:54:02.597 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:02.597 INFO:teuthology.orchestra.run.smithi050.stdout:Total 375 kB/s | 8.6 MB 00:23 2024-05-07T13:54:02.629 INFO:teuthology.orchestra.run.smithi022.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 27 kB/s | 222 kB 00:08 2024-05-07T13:54:02.649 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:54:02.669 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:54:02.669 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:54:02.696 INFO:teuthology.orchestra.run.smithi022.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-05-07T13:54:02.730 INFO:teuthology.orchestra.run.smithi022.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 536 kB/s | 54 kB 00:00 2024-05-07T13:54:02.755 INFO:teuthology.orchestra.run.smithi022.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-05-07T13:54:02.865 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:54:02.866 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:54:03.014 INFO:teuthology.orchestra.run.smithi022.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 53 kB/s | 15 kB 00:00 2024-05-07T13:54:03.039 INFO:teuthology.orchestra.run.smithi022.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 94 kB/s | 32 kB 00:00 2024-05-07T13:54:03.206 INFO:teuthology.orchestra.run.smithi022.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 354 kB/s | 59 kB 00:00 2024-05-07T13:54:03.273 INFO:teuthology.orchestra.run.smithi022.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 420 kB/s | 206 kB 00:00 2024-05-07T13:54:03.398 INFO:teuthology.orchestra.run.smithi022.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 468 kB/s | 90 kB 00:00 2024-05-07T13:54:03.494 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:54:03.567 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-07T13:54:03.611 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-07T13:54:03.659 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-07T13:54:03.665 INFO:teuthology.orchestra.run.smithi022.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.6 MB/s | 1.0 MB 00:00 2024-05-07T13:54:03.668 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:03.669 INFO:teuthology.orchestra.run.smithi022.stdout:Total 229 kB/s | 2.2 MB 00:09 2024-05-07T13:54:03.687 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-07T13:54:03.741 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:54:03.758 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:54:03.758 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:54:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-07T13:54:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:54:03.855 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:54:03.954 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-07T13:54:04.045 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-07T13:54:04.094 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-07T13:54:04.130 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-07T13:54:04.162 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2521.g1dfb479e.el9 10/12 2024-05-07T13:54:04.380 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:54:04.554 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-07T13:54:04.610 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-07T13:54:04.666 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-07T13:54:04.701 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-07T13:54:04.743 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-07T13:54:04.849 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-07T13:54:04.960 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-07T13:54:05.012 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-07T13:54:05.267 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2521.g1dfb479e.el 11/12 2024-05-07T13:54:05.304 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2521.g1dfb479e.el9.noa 12/12 2024-05-07T13:54:05.776 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-07T13:54:05.841 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-07T13:54:05.883 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-07T13:54:05.932 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-07T13:54:05.961 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:19.0.0-2521.g1dfb479e.el9.noarch 13/13 2024-05-07T13:54:06.566 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2521.g1dfb479e.el9.noa 12/12 2024-05-07T13:54:06.566 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2521.g1dfb479e.el 1/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2521.g1dfb479e.el9.noa 2/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2521.g1dfb479e.el9 3/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-07T13:54:06.567 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2521.g1dfb479e.el9.noarch 13/13 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2521.g1dfb479e.el9.noarch 1/13 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-07T13:54:06.721 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-07T13:54:06.722 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-07T13:54:06.722 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-07T13:54:06.722 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-07T13:54:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-07T13:54:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:06.874 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:54:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-07T13:54:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:06.875 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:07.045 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-07T13:54:07.046 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-07T13:54:07.047 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-07T13:54:07.047 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-07T13:54:07.047 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-07T13:54:07.047 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-07T13:54:07.047 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-07T13:54:07.047 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:07.047 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:07.090 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-07T13:54:07.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-cephadm 2024-05-07T13:54:07.683 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:01:40 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:54:07.811 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:54:07.813 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-05-07T13:54:07.813 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:54:07.813 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-05-07T13:54:07.813 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:54:07.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 7.4 M 2024-05-07T13:54:07.813 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:54:07.813 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-07T13:54:07.813 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-07T13:54:07.813 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-07T13:54:07.814 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-07T13:54:07.814 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-07T13:54:07.814 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-07T13:54:07.814 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-07T13:54:07.814 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-07T13:54:07.814 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-07T13:54:07.814 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-07T13:54:07.814 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-07T13:54:07.815 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:07.815 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:54:07.815 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-05-07T13:54:07.815 INFO:teuthology.orchestra.run.smithi050.stdout:Install 12 Packages 2024-05-07T13:54:07.815 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:07.815 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 38 M 2024-05-07T13:54:07.816 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 209 M 2024-05-07T13:54:07.816 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:54:07.906 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:44 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:08.035 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 142 k 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-07T13:54:08.036 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:08.037 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:54:08.037 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:08.037 INFO:teuthology.orchestra.run.smithi022.stdout:Install 6 Packages 2024-05-07T13:54:08.037 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:08.037 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 7.0 M 2024-05-07T13:54:08.037 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 33 M 2024-05-07T13:54:08.038 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:54:08.433 INFO:teuthology.orchestra.run.smithi022.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 2.0 MB/s | 248 kB 00:00 2024-05-07T13:54:08.591 INFO:teuthology.orchestra.run.smithi022.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-05-07T13:54:08.650 INFO:teuthology.orchestra.run.smithi050.stdout:(1/12): ceph-mgr-diskprediction-local-19.0.0-25 13 MB/s | 7.4 MB 00:00 2024-05-07T13:54:08.658 INFO:teuthology.orchestra.run.smithi022.stdout:(3/6): ceph-mgr-cephadm-19.0.0-2521.g1dfb479e.e 406 kB/s | 142 kB 00:00 2024-05-07T13:54:08.942 INFO:teuthology.orchestra.run.smithi022.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 165 kB/s | 58 kB 00:00 2024-05-07T13:54:08.943 INFO:teuthology.orchestra.run.smithi050.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 112 kB/s | 33 kB 00:00 2024-05-07T13:54:08.992 INFO:teuthology.orchestra.run.smithi022.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 153 kB/s | 51 kB 00:00 2024-05-07T13:54:09.017 INFO:teuthology.orchestra.run.smithi022.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 939 kB/s | 548 kB 00:00 2024-05-07T13:54:09.018 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:09.019 INFO:teuthology.orchestra.run.smithi022.stdout:Total 7.1 MB/s | 7.0 MB 00:00 2024-05-07T13:54:09.084 INFO:teuthology.orchestra.run.smithi050.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 193 kB/s | 195 kB 00:01 2024-05-07T13:54:09.094 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:54:09.106 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:54:09.106 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:54:09.160 INFO:teuthology.orchestra.run.smithi050.stdout:(4/12): libgfortran-11.4.1-3.el9.x86_64.rpm 739 kB/s | 803 kB 00:01 2024-05-07T13:54:09.209 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:54:09.210 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:54:09.351 INFO:teuthology.orchestra.run.smithi050.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 68 kB/s | 18 kB 00:00 2024-05-07T13:54:09.418 INFO:teuthology.orchestra.run.smithi050.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 136 kB/s | 35 kB 00:00 2024-05-07T13:54:09.518 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:54:09.700 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-07T13:54:09.754 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-07T13:54:09.820 INFO:teuthology.orchestra.run.smithi050.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.4 MB/s | 3.0 MB 00:00 2024-05-07T13:54:09.855 INFO:teuthology.orchestra.run.smithi050.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 562 kB/s | 244 kB 00:00 2024-05-07T13:54:10.044 INFO:teuthology.orchestra.run.smithi050.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.3 MB/s | 250 kB 00:00 2024-05-07T13:54:10.303 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-07T13:54:10.391 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-07T13:54:10.463 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-07T13:54:10.487 INFO:teuthology.orchestra.run.smithi050.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.2 MB/s | 4.7 MB 00:01 2024-05-07T13:54:10.498 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 6/6 2024-05-07T13:54:11.301 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 6/6 2024-05-07T13:54:11.302 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/6 2024-05-07T13:54:11.302 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-07T13:54:11.302 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-07T13:54:11.302 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-07T13:54:11.302 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-07T13:54:11.570 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-07T13:54:11.570 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:11.570 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:54:11.570 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:11.570 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-07T13:54:11.571 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-07T13:54:11.571 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-07T13:54:11.571 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-07T13:54:11.571 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-07T13:54:11.571 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:11.571 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:11.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-fuse 2024-05-07T13:54:12.417 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:49 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:12.547 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 889 k 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:12.548 INFO:teuthology.orchestra.run.smithi022.stdout:Install 2 Packages 2024-05-07T13:54:12.549 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:12.549 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 970 k 2024-05-07T13:54:12.549 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 2.8 M 2024-05-07T13:54:12.549 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:54:12.895 INFO:teuthology.orchestra.run.smithi022.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 400 kB/s | 80 kB 00:00 2024-05-07T13:54:13.120 INFO:teuthology.orchestra.run.smithi022.stdout:(2/2): ceph-fuse-19.0.0-2521.g1dfb479e.el9.x86_ 2.0 MB/s | 889 kB 00:00 2024-05-07T13:54:13.120 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:13.120 INFO:teuthology.orchestra.run.smithi022.stdout:Total 1.7 MB/s | 970 kB 00:00 2024-05-07T13:54:13.133 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:54:13.156 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:54:13.157 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:54:13.239 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:54:13.239 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:54:13.435 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:54:13.601 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-07T13:54:13.663 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/2 2024-05-07T13:54:14.292 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/2 2024-05-07T13:54:14.292 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/2 2024-05-07T13:54:14.534 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-07T13:54:14.535 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:14.535 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:54:14.535 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-07T13:54:14.535 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:14.535 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:14.561 INFO:teuthology.orchestra.run.smithi050.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.1 MB/s | 5.1 MB 00:04 2024-05-07T13:54:14.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-volume 2024-05-07T13:54:15.398 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:52 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:15.526 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:15.527 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:15.527 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-05-07T13:54:15.527 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:15.527 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:54:15.527 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 264 k 2024-05-07T13:54:15.527 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-05-07T13:54:15.528 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-07T13:54:15.528 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:15.528 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:54:15.528 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:15.528 INFO:teuthology.orchestra.run.smithi022.stdout:Install 2 Packages 2024-05-07T13:54:15.528 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:15.528 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 341 k 2024-05-07T13:54:15.528 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 1.5 M 2024-05-07T13:54:15.528 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:54:15.933 INFO:teuthology.orchestra.run.smithi022.stdout:(1/2): ceph-volume-19.0.0-2521.g1dfb479e.el9.no 945 kB/s | 264 kB 00:00 2024-05-07T13:54:16.075 INFO:teuthology.orchestra.run.smithi022.stdout:(2/2): python3-packaging-20.9-5.el9.noarch.rpm 183 kB/s | 77 kB 00:00 2024-05-07T13:54:16.075 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:16.075 INFO:teuthology.orchestra.run.smithi022.stdout:Total 622 kB/s | 341 kB 00:00 2024-05-07T13:54:16.088 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:54:16.099 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:54:16.099 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:54:16.138 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:54:16.139 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:54:16.287 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:54:16.585 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-07T13:54:16.627 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:19.0.0-2521.g1dfb479e.el9.noarch 2/2 2024-05-07T13:54:16.644 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:19.0.0-2521.g1dfb479e.el9.noarch 2/2 2024-05-07T13:54:16.644 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:54:16.644 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-07T13:54:16.645 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:17.396 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:19.0.0-2521.g1dfb479e.el9.noarch 1/2 2024-05-07T13:54:17.679 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-07T13:54:17.679 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:17.679 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:54:17.679 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:17.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-07T13:54:17.679 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:17.679 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:17.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados-devel 2024-05-07T13:54:18.571 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:55 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:18.700 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:18.701 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:18.701 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2024-05-07T13:54:18.701 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:18.701 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:54:18.701 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 126 k 2024-05-07T13:54:18.701 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:18.701 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:54:18.701 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:18.702 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-05-07T13:54:18.702 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:18.702 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 126 k 2024-05-07T13:54:18.702 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 456 k 2024-05-07T13:54:18.702 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:54:18.911 INFO:teuthology.orchestra.run.smithi022.stdout:librados-devel-19.0.0-2521.g1dfb479e.el9.x86_64 609 kB/s | 126 kB 00:00 2024-05-07T13:54:18.911 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:18.912 INFO:teuthology.orchestra.run.smithi022.stdout:Total 605 kB/s | 126 kB 00:00 2024-05-07T13:54:18.912 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:54:18.917 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:54:18.917 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:54:18.984 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:54:18.984 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:54:19.143 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:54:19.252 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:19.687 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:19.951 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:19.951 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:19.951 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:54:19.951 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:54:19.951 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:19.951 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:20.206 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs2 2024-05-07T13:54:20.792 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:57 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:20.876 INFO:teuthology.orchestra.run.smithi022.stdout:Package libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:54:20.920 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:20.921 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-05-07T13:54:20.921 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:20.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs-devel 2024-05-07T13:54:21.582 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:58 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:21.710 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 32 k 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-05-07T13:54:21.711 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:21.712 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 32 k 2024-05-07T13:54:21.712 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 142 k 2024-05-07T13:54:21.712 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:54:21.889 INFO:teuthology.orchestra.run.smithi022.stdout:libcephfs-devel-19.0.0-2521.g1dfb479e.el9.x86_6 179 kB/s | 32 kB 00:00 2024-05-07T13:54:21.890 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:21.890 INFO:teuthology.orchestra.run.smithi022.stdout:Total 178 kB/s | 32 kB 00:00 2024-05-07T13:54:21.890 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:54:21.893 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:54:21.894 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:54:21.911 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:54:21.911 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:54:21.994 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:54:22.114 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:22.501 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:22.724 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:22.725 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:22.725 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:54:22.725 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:54:22.725 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:22.725 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:22.908 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados2 2024-05-07T13:54:23.494 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:00 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:23.577 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:54:23.622 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:23.622 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-05-07T13:54:23.623 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:23.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librbd1 2024-05-07T13:54:24.286 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:01 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:24.370 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:54:24.415 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:24.415 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-05-07T13:54:24.415 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:24.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-rados 2024-05-07T13:54:24.827 INFO:teuthology.orchestra.run.smithi050.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.1 MB/s | 16 MB 00:14 2024-05-07T13:54:24.828 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:24.829 INFO:teuthology.orchestra.run.smithi050.stdout:Total 2.2 MB/s | 38 MB 00:17 2024-05-07T13:54:25.071 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:02 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:25.154 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-rados-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:54:25.199 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:25.200 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-05-07T13:54:25.200 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:25.201 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:54:25.230 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:54:25.230 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:54:25.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-rgw 2024-05-07T13:54:25.687 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:54:25.687 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:54:25.855 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:02 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:25.939 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-rgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:54:25.983 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:25.984 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-05-07T13:54:25.984 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:26.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-cephfs 2024-05-07T13:54:26.471 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:54:26.550 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-07T13:54:26.601 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-07T13:54:26.643 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:03 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:26.705 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-07T13:54:26.727 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-cephfs-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:54:26.735 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-07T13:54:26.772 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:26.773 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-05-07T13:54:26.773 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:26.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-rbd 2024-05-07T13:54:26.921 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-07T13:54:26.951 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-07T13:54:27.030 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-07T13:54:27.438 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:04 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:27.522 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-rbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:54:27.566 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:27.567 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2024-05-07T13:54:27.567 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:27.635 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-fuse 2024-05-07T13:54:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-07T13:54:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-07T13:54:28.223 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:05 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 85 k 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-05-07T13:54:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:28.351 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 85 k 2024-05-07T13:54:28.351 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 231 k 2024-05-07T13:54:28.351 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:54:28.734 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-fuse-19.0.0-2521.g1dfb479e.el9.x86_64.rpm 223 kB/s | 85 kB 00:00 2024-05-07T13:54:28.735 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:28.735 INFO:teuthology.orchestra.run.smithi022.stdout:Total 222 kB/s | 85 kB 00:00 2024-05-07T13:54:28.735 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:54:28.743 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:54:28.743 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:54:28.810 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:54:28.810 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:54:28.978 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:54:29.077 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:29.197 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-07T13:54:29.449 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:29.725 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:54:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:54:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:29.725 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:29.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-mirror 2024-05-07T13:54:30.282 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-07T13:54:30.309 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2521.g1dfb4 12/12 2024-05-07T13:54:30.579 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:07 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:30.707 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:30.707 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 3.1 M 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 3.1 M 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 13 M 2024-05-07T13:54:30.708 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:54:31.446 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-mirror-19.0.0-2521.g1dfb479e.el9.x86_64.rpm 4.2 MB/s | 3.1 MB 00:00 2024-05-07T13:54:31.446 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:31.447 INFO:teuthology.orchestra.run.smithi022.stdout:Total 4.2 MB/s | 3.1 MB 00:00 2024-05-07T13:54:31.447 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:54:31.458 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:54:31.458 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:54:31.545 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:54:31.545 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:54:31.993 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:54:32.047 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:32.073 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:32.073 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:54:32.073 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-07T13:54:32.073 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T13:54:32.074 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T13:54:32.074 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2521.g1dfb4 12/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2521.g1dfb4 1/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-07T13:54:32.761 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-07T13:54:32.762 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-07T13:54:33.147 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-07T13:54:33.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:33.147 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:54:33.147 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:33.147 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-07T13:54:33.147 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-07T13:54:33.147 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:33.148 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:33.149 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:33.149 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:33.149 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:54:33.149 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:54:33.149 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:33.149 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:33.400 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-nbd 2024-05-07T13:54:33.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-rook 2024-05-07T13:54:33.997 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:11 ago on Tue 07 May 2024 01:52:23 PM UTC. 2024-05-07T13:54:34.103 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:07 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:54:34.124 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-05-07T13:54:34.125 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:34.125 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-05-07T13:54:34.125 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:34.125 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-05-07T13:54:34.125 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 170 k 2024-05-07T13:54:34.125 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:34.126 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-05-07T13:54:34.126 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-05-07T13:54:34.126 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2024-05-07T13:54:34.126 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:34.126 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 170 k 2024-05-07T13:54:34.126 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 494 k 2024-05-07T13:54:34.126 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-05-07T13:54:34.231 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:54:34.233 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:34.233 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:54:34.233 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:34.233 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:54:34.233 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 49 k 2024-05-07T13:54:34.233 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:54:34.233 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-07T13:54:34.233 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-07T13:54:34.233 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:54:34.234 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:34.235 INFO:teuthology.orchestra.run.smithi050.stdout:Install 13 Packages 2024-05-07T13:54:34.235 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:34.235 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 2.2 M 2024-05-07T13:54:34.235 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 26 M 2024-05-07T13:54:34.236 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:54:34.486 INFO:teuthology.orchestra.run.smithi050.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 251 kB/s | 26 kB 00:00 2024-05-07T13:54:34.503 INFO:teuthology.orchestra.run.smithi050.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 161 kB/s | 19 kB 00:00 2024-05-07T13:54:34.508 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-nbd-19.0.0-2521.g1dfb479e.el9.x86_64.rpm 446 kB/s | 170 kB 00:00 2024-05-07T13:54:34.509 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:34.509 INFO:teuthology.orchestra.run.smithi022.stdout:Total 444 kB/s | 170 kB 00:00 2024-05-07T13:54:34.509 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-05-07T13:54:34.518 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-05-07T13:54:34.519 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-05-07T13:54:34.586 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-05-07T13:54:34.586 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-05-07T13:54:34.603 INFO:teuthology.orchestra.run.smithi050.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-05-07T13:54:34.628 INFO:teuthology.orchestra.run.smithi050.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-05-07T13:54:34.670 INFO:teuthology.orchestra.run.smithi050.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 279 kB 00:00 2024-05-07T13:54:34.687 INFO:teuthology.orchestra.run.smithi050.stdout:(6/13): ceph-mgr-rook-19.0.0-2521.g1dfb479e.el9 162 kB/s | 49 kB 00:00 2024-05-07T13:54:34.704 INFO:teuthology.orchestra.run.smithi050.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 710 kB/s | 54 kB 00:00 2024-05-07T13:54:34.744 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-05-07T13:54:34.851 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:34.913 INFO:teuthology.orchestra.run.smithi050.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 66 kB/s | 15 kB 00:00 2024-05-07T13:54:34.930 INFO:teuthology.orchestra.run.smithi050.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 124 kB/s | 32 kB 00:00 2024-05-07T13:54:35.097 INFO:teuthology.orchestra.run.smithi050.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 354 kB/s | 59 kB 00:00 2024-05-07T13:54:35.131 INFO:teuthology.orchestra.run.smithi050.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 482 kB/s | 206 kB 00:00 2024-05-07T13:54:35.264 INFO:teuthology.orchestra.run.smithi050.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 537 kB/s | 90 kB 00:00 2024-05-07T13:54:35.272 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:35.356 INFO:teuthology.orchestra.run.smithi050.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.3 MB/s | 1.0 MB 00:00 2024-05-07T13:54:35.357 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:35.357 INFO:teuthology.orchestra.run.smithi050.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-05-07T13:54:35.432 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:54:35.448 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:54:35.449 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:54:35.525 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:35.525 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-05-07T13:54:35.525 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:54:35.525 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:54:35.525 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-05-07T13:54:35.545 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:54:35.546 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:54:35.753 DEBUG:teuthology.parallel:result is None 2024-05-07T13:54:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:54:36.407 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-07T13:54:36.593 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-07T13:54:36.649 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-07T13:54:36.684 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-07T13:54:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-07T13:54:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-07T13:54:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-07T13:54:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-07T13:54:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-07T13:54:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-07T13:54:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-07T13:54:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-07T13:54:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.0.0-2521.g1dfb479e.el9.noarch 13/13 2024-05-07T13:54:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2521.g1dfb479e.el9.noarch 13/13 2024-05-07T13:54:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2521.g1dfb479e.el9.noarch 1/13 2024-05-07T13:54:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-07T13:54:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-07T13:54:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-07T13:54:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-07T13:54:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-07T13:54:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-07T13:54:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-07T13:54:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-07T13:54:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-07T13:54:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-07T13:54:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-07T13:54:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-07T13:54:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:39.030 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:54:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-07T13:54:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-07T13:54:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-07T13:54:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-07T13:54:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-07T13:54:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-07T13:54:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-07T13:54:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-07T13:54:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-07T13:54:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-07T13:54:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-07T13:54:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-07T13:54:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:39.031 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:39.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-cephadm 2024-05-07T13:54:39.871 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:12 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:54:39.999 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:54:40.000 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:54:40.000 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:40.000 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:54:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 142 k 2024-05-07T13:54:40.000 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:54:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-07T13:54:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-07T13:54:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-07T13:54:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-07T13:54:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-07T13:54:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:40.001 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:54:40.001 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:40.001 INFO:teuthology.orchestra.run.smithi050.stdout:Install 6 Packages 2024-05-07T13:54:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:40.002 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 7.0 M 2024-05-07T13:54:40.002 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 33 M 2024-05-07T13:54:40.002 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:54:41.477 INFO:teuthology.orchestra.run.smithi050.stdout:(1/6): ceph-mgr-cephadm-19.0.0-2521.g1dfb479e.e 132 kB/s | 142 kB 00:01 2024-05-07T13:54:41.594 INFO:teuthology.orchestra.run.smithi050.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 208 kB/s | 248 kB 00:01 2024-05-07T13:54:42.186 INFO:teuthology.orchestra.run.smithi050.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 102 kB/s | 58 kB 00:00 2024-05-07T13:54:42.394 INFO:teuthology.orchestra.run.smithi050.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 245 kB/s | 51 kB 00:00 2024-05-07T13:54:42.744 INFO:teuthology.orchestra.run.smithi050.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 432 kB/s | 548 kB 00:01 2024-05-07T13:54:44.936 INFO:teuthology.orchestra.run.smithi050.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 1.3 MB/s | 6.0 MB 00:04 2024-05-07T13:54:44.938 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:44.939 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.4 MB/s | 7.0 MB 00:04 2024-05-07T13:54:45.015 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:54:45.028 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:54:45.028 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:54:45.132 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:54:45.133 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:54:45.465 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:54:45.644 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-07T13:54:45.698 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-07T13:54:46.256 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-07T13:54:46.345 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-07T13:54:46.423 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-07T13:54:46.450 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 6/6 2024-05-07T13:54:47.209 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 6/6 2024-05-07T13:54:47.209 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 1/6 2024-05-07T13:54:47.209 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-07T13:54:47.209 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-07T13:54:47.209 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-07T13:54:47.209 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-07T13:54:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-07T13:54:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:47.477 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:54:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-07T13:54:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-07T13:54:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-07T13:54:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-07T13:54:47.477 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-07T13:54:47.478 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:47.478 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:47.731 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-fuse 2024-05-07T13:54:48.330 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:21 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:54:48.460 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:54:48.461 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:48.461 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:54:48.462 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:48.462 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:54:48.462 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 889 k 2024-05-07T13:54:48.462 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:54:48.462 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-07T13:54:48.462 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:48.462 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:54:48.463 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:48.463 INFO:teuthology.orchestra.run.smithi050.stdout:Install 2 Packages 2024-05-07T13:54:48.463 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:48.463 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 970 k 2024-05-07T13:54:48.463 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 2.8 M 2024-05-07T13:54:48.463 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:54:49.022 INFO:teuthology.orchestra.run.smithi050.stdout:(1/2): ceph-fuse-19.0.0-2521.g1dfb479e.el9.x86_ 2.0 MB/s | 889 kB 00:00 2024-05-07T13:54:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 115 kB/s | 80 kB 00:00 2024-05-07T13:54:49.298 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:49.298 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.1 MB/s | 970 kB 00:00 2024-05-07T13:54:49.311 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:54:49.334 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:54:49.334 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:54:49.418 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:54:49.419 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:54:49.633 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:54:49.779 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-07T13:54:49.849 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/2 2024-05-07T13:54:50.485 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 2/2 2024-05-07T13:54:50.485 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/2 2024-05-07T13:54:50.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-07T13:54:50.752 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:50.752 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:54:50.752 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-07T13:54:50.752 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:50.752 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:51.042 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-volume 2024-05-07T13:54:51.641 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:24 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:54:51.773 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:54:51.773 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:51.773 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.0.0-2521.g1dfb479e.el9 ceph-noarch 264 k 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout:Install 2 Packages 2024-05-07T13:54:51.774 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:51.775 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 341 k 2024-05-07T13:54:51.775 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 1.5 M 2024-05-07T13:54:51.775 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:54:52.120 INFO:teuthology.orchestra.run.smithi050.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 395 kB/s | 77 kB 00:00 2024-05-07T13:54:52.145 INFO:teuthology.orchestra.run.smithi050.stdout:(2/2): ceph-volume-19.0.0-2521.g1dfb479e.el9.no 1.2 MB/s | 264 kB 00:00 2024-05-07T13:54:52.146 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:52.146 INFO:teuthology.orchestra.run.smithi050.stdout:Total 918 kB/s | 341 kB 00:00 2024-05-07T13:54:52.158 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:54:52.168 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:54:52.168 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:54:52.202 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:54:52.202 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:54:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:54:52.570 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-07T13:54:52.597 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.0.0-2521.g1dfb479e.el9.noarch 2/2 2024-05-07T13:54:52.615 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.0.0-2521.g1dfb479e.el9.noarch 2/2 2024-05-07T13:54:52.615 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:54:52.615 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-07T13:54:52.615 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:53.369 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.0.0-2521.g1dfb479e.el9.noarch 1/2 2024-05-07T13:54:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-07T13:54:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:53.693 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:54:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.0.0-2521.g1dfb479e.el9.noarch 2024-05-07T13:54:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-07T13:54:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:53.693 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:53.970 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados-devel 2024-05-07T13:54:54.570 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:27 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:54:54.698 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:54:54.699 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:54.699 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2024-05-07T13:54:54.699 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:54.699 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:54:54.699 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 126 k 2024-05-07T13:54:54.699 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:54.699 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:54:54.700 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:54.700 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2024-05-07T13:54:54.700 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:54.700 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 126 k 2024-05-07T13:54:54.700 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 456 k 2024-05-07T13:54:54.700 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:54:54.935 INFO:teuthology.orchestra.run.smithi050.stdout:librados-devel-19.0.0-2521.g1dfb479e.el9.x86_64 539 kB/s | 126 kB 00:00 2024-05-07T13:54:54.935 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:54.936 INFO:teuthology.orchestra.run.smithi050.stdout:Total 536 kB/s | 126 kB 00:00 2024-05-07T13:54:54.936 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:54:54.942 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:54:54.942 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:54:55.009 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:54:55.009 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:54:55.166 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:54:55.278 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:55.770 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:56.034 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:56.034 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:56.034 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:54:56.034 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:54:56.034 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:56.034 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:56.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs2 2024-05-07T13:54:56.897 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:29 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:54:56.981 INFO:teuthology.orchestra.run.smithi050.stdout:Package libcephfs2-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:54:57.026 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:54:57.027 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-05-07T13:54:57.027 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:57.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs-devel 2024-05-07T13:54:57.690 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:30 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:54:57.819 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:54:57.820 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:57.820 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2024-05-07T13:54:57.820 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:57.820 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:54:57.820 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 32 k 2024-05-07T13:54:57.820 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:57.820 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:54:57.820 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:54:57.821 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2024-05-07T13:54:57.821 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:57.821 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 32 k 2024-05-07T13:54:57.821 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 142 k 2024-05-07T13:54:57.821 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:54:57.997 INFO:teuthology.orchestra.run.smithi050.stdout:libcephfs-devel-19.0.0-2521.g1dfb479e.el9.x86_6 180 kB/s | 32 kB 00:00 2024-05-07T13:54:57.998 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:54:57.998 INFO:teuthology.orchestra.run.smithi050.stdout:Total 179 kB/s | 32 kB 00:00 2024-05-07T13:54:57.998 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:54:58.002 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:54:58.002 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:54:58.021 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:54:58.021 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:54:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:54:58.223 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:58.579 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:54:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:58.799 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:54:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:54:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:54:58.800 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:58.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librados2 2024-05-07T13:54:59.577 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:32 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:54:59.662 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:54:59.705 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:54:59.706 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-05-07T13:54:59.706 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:54:59.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install librbd1 2024-05-07T13:55:00.367 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:33 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:55:00.450 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:55:00.493 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:55:00.494 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-05-07T13:55:00.495 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:55:00.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rados 2024-05-07T13:55:01.164 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:34 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:55:01.248 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rados-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:55:01.293 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:55:01.294 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-05-07T13:55:01.294 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:55:01.359 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rgw 2024-05-07T13:55:01.948 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:34 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:55:02.031 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rgw-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:55:02.076 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:55:02.077 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-05-07T13:55:02.077 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:55:02.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-cephfs 2024-05-07T13:55:02.734 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:35 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:55:02.817 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-cephfs-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:55:02.863 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:55:02.863 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-05-07T13:55:02.863 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:55:02.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rbd 2024-05-07T13:55:03.539 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:36 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:55:03.623 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 is already installed. 2024-05-07T13:55:03.667 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:55:03.669 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-05-07T13:55:03.669 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:55:03.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-fuse 2024-05-07T13:55:04.336 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:37 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:55:04.464 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:55:04.466 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:55:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2024-05-07T13:55:04.466 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:55:04.466 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:55:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 85 k 2024-05-07T13:55:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:04.466 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:55:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:55:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2024-05-07T13:55:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 85 k 2024-05-07T13:55:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 231 k 2024-05-07T13:55:04.467 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:55:04.884 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-fuse-19.0.0-2521.g1dfb479e.el9.x86_64.rpm 204 kB/s | 85 kB 00:00 2024-05-07T13:55:04.885 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:55:04.885 INFO:teuthology.orchestra.run.smithi050.stdout:Total 203 kB/s | 85 kB 00:00 2024-05-07T13:55:04.885 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:55:04.893 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:55:04.893 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:55:04.961 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:55:04.961 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:55:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:55:05.218 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:55:05.556 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:55:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:55:05.789 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:05.789 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:55:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:55:05.790 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:05.790 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:55:06.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-mirror 2024-05-07T13:55:06.639 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:39 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:55:06.768 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:55:06.769 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:55:06.769 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repo Size 2024-05-07T13:55:06.769 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:55:06.769 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:55:06.770 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 3.1 M 2024-05-07T13:55:06.770 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:06.770 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:55:06.770 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:55:06.770 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2024-05-07T13:55:06.770 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:06.770 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 3.1 M 2024-05-07T13:55:06.770 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 13 M 2024-05-07T13:55:06.770 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:55:07.137 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-mirror-19.0.0-2521.g1dfb479e.el9.x86_64.rpm 8.4 MB/s | 3.1 MB 00:00 2024-05-07T13:55:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:55:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:Total 8.4 MB/s | 3.1 MB 00:00 2024-05-07T13:55:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:55:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:55:07.148 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:55:07.234 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:55:07.683 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:55:07.866 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:55:07.892 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:55:07.892 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-07T13:55:07.892 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-07T13:55:07.892 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T13:55:07.892 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-07T13:55:07.892 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:08.907 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:55:08.907 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:08.907 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:55:08.907 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:55:08.907 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:08.907 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:55:09.170 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-nbd 2024-05-07T13:55:09.782 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:02:42 ago on Tue 07 May 2024 01:52:27 PM UTC. 2024-05-07T13:55:09.909 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-05-07T13:55:09.910 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:55:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2024-05-07T13:55:09.910 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:55:09.910 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-05-07T13:55:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.0.0-2521.g1dfb479e.el9 ceph 170 k 2024-05-07T13:55:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:09.910 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-05-07T13:55:09.910 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2024-05-07T13:55:09.910 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2024-05-07T13:55:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:09.911 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 170 k 2024-05-07T13:55:09.911 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 494 k 2024-05-07T13:55:09.911 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-05-07T13:55:10.142 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-nbd-19.0.0-2521.g1dfb479e.el9.x86_64.rpm 737 kB/s | 170 kB 00:00 2024-05-07T13:55:10.143 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-05-07T13:55:10.143 INFO:teuthology.orchestra.run.smithi050.stdout:Total 732 kB/s | 170 kB 00:00 2024-05-07T13:55:10.143 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-05-07T13:55:10.152 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-05-07T13:55:10.152 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-05-07T13:55:10.220 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-05-07T13:55:10.221 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-05-07T13:55:10.384 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-05-07T13:55:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:55:10.940 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:55:11.187 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 1/1 2024-05-07T13:55:11.187 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:11.187 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-05-07T13:55:11.187 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.0.0-2521.g1dfb479e.el9.x86_64 2024-05-07T13:55:11.187 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:11.187 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-05-07T13:55:11.432 DEBUG:teuthology.parallel:result is None 2024-05-07T13:55:11.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:55:11.730 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-07T13:55:11.758 INFO:teuthology.orchestra.run.smithi022.stdout:19.0.0-2521.g1dfb479e.el9 2024-05-07T13:55:11.759 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2521.g1dfb479e.el9 2024-05-07T13:55:11.759 INFO:teuthology.task.install:The correct ceph version 19.0.0-2521.g1dfb479e is installed. 2024-05-07T13:55:11.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:55:11.910 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-07T13:55:11.934 INFO:teuthology.orchestra.run.smithi050.stdout:19.0.0-2521.g1dfb479e.el9 2024-05-07T13:55:11.934 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2521.g1dfb479e.el9 2024-05-07T13:55:11.934 INFO:teuthology.task.install:The correct ceph version 19.0.0-2521.g1dfb479e is installed. 2024-05-07T13:55:11.936 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-07T13:55:11.936 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:11.936 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-07T13:55:11.969 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:11.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-07T13:55:12.002 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-07T13:55:12.003 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:12.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-05-07T13:55:12.041 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-07T13:55:12.112 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:12.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-05-07T13:55:12.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-07T13:55:12.208 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-07T13:55:12.208 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:12.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-07T13:55:12.237 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-07T13:55:12.306 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:12.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-07T13:55:12.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-07T13:55:12.402 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-07T13:55:12.403 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:12.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-05-07T13:55:12.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-07T13:55:12.500 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:12.501 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-05-07T13:55:12.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-07T13:55:12.596 INFO:teuthology.run_tasks:Running task ceph... 2024-05-07T13:55:12.697 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-07T13:55:12.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2024-05-07T13:55:12.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-05-07T13:55:12.730 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-07T13:55:12.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-07T13:55:12.772 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-07T13:55:12.800 INFO:tasks.ceph:Creating extra log directories... 2024-05-07T13:55:12.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-07T13:55:12.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-07T13:55:12.877 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-07T13:55:12.877 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-07T13:55:12.878 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427', 'branch': 'wip-cbodley2-testing', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7695427', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cbodley2-testing'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley2-testing', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 4511, 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley2-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1dfb479e40144c07778a01ea762def8ca56f6eee/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee', 'targets': {'smithi022.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOooDTYqWbjUZDpwjuuyI7DmTBjADZD/S5wn/Rbn3pN1fl90PyaJqQueXQiS4Aqvw4VJqmrqsxaemHTJN5Bfl+I=', 'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8tYXssRzD/Fxd4iz+N5yiAU/qSoMw96bSuhxkZ7WCLlJHKARR5SHaTw3kzomDpKZO7f06v3mxlEElYHBUY1Jk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-07_13:33:35', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-07T13:55:12.878 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-07T13:55:12.912 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-07T13:55:12.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2024-05-07T13:55:12.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-05-07T13:55:12.999 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:13.000 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-05-07T13:55:13.058 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-07T13:55:13.058 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-05-07T13:55:13.116 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-07T13:55:13.116 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:55:13.116 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-07T13:55:13.116 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:55:13.117 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T13:55:13.117 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-05-07 13:54:32.329789534 +0000 2024-05-07T13:55:13.117 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-05-07 13:51:41.228681017 +0000 2024-05-07T13:55:13.117 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-05-07 13:51:41.228681017 +0000 2024-05-07T13:55:13.117 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-05-07 13:51:41.228681017 +0000 2024-05-07T13:55:13.117 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-07T13:55:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-05-07T13:55:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-05-07T13:55:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000111084 s, 4.6 MB/s 2024-05-07T13:55:13.186 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-07T13:55:13.245 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-05-07T13:55:13.303 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-07T13:55:13.303 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:55:13.303 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-07T13:55:13.303 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:55:13.303 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T13:55:13.304 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-05-07 13:54:32.329789534 +0000 2024-05-07T13:55:13.304 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-05-07 13:51:41.569676766 +0000 2024-05-07T13:55:13.304 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-05-07 13:51:41.569676766 +0000 2024-05-07T13:55:13.304 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-05-07 13:51:41.569676766 +0000 2024-05-07T13:55:13.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-07T13:55:13.371 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-05-07T13:55:13.371 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-05-07T13:55:13.371 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000116112 s, 4.4 MB/s 2024-05-07T13:55:13.372 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-07T13:55:13.432 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-05-07T13:55:13.491 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-07T13:55:13.491 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:55:13.491 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-07T13:55:13.492 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:55:13.492 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T13:55:13.492 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-05-07 13:54:32.330789522 +0000 2024-05-07T13:55:13.492 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-05-07 13:51:41.930672267 +0000 2024-05-07T13:55:13.492 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-05-07 13:51:41.930672267 +0000 2024-05-07T13:55:13.492 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-05-07 13:51:41.930672267 +0000 2024-05-07T13:55:13.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-07T13:55:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-05-07T13:55:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-05-07T13:55:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000117178 s, 4.4 MB/s 2024-05-07T13:55:13.561 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-07T13:55:13.625 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-05-07T13:55:13.684 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-07T13:55:13.684 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:55:13.684 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-07T13:55:13.685 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:55:13.685 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T13:55:13.685 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-05-07 13:54:32.330789522 +0000 2024-05-07T13:55:13.685 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-05-07 13:51:42.272668005 +0000 2024-05-07T13:55:13.685 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-05-07 13:51:42.272668005 +0000 2024-05-07T13:55:13.685 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-05-07 13:51:42.272668005 +0000 2024-05-07T13:55:13.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-07T13:55:13.753 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-05-07T13:55:13.753 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-05-07T13:55:13.753 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000117149 s, 4.4 MB/s 2024-05-07T13:55:13.754 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-07T13:55:13.814 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-07T13:55:13.814 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:13.814 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-05-07T13:55:13.834 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-07T13:55:13.835 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-05-07T13:55:13.894 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-07T13:55:13.894 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:55:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-07T13:55:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:55:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T13:55:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-05-07 13:55:08.155398638 +0000 2024-05-07T13:55:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-05-07 13:51:43.786036323 +0000 2024-05-07T13:55:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-05-07 13:51:43.786036323 +0000 2024-05-07T13:55:13.894 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-05-07 13:51:43.786036323 +0000 2024-05-07T13:55:13.895 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-07T13:55:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-05-07T13:55:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-05-07T13:55:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000121219 s, 4.2 MB/s 2024-05-07T13:55:13.964 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-07T13:55:14.024 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-05-07T13:55:14.083 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-07T13:55:14.083 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:55:14.083 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-07T13:55:14.083 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:55:14.083 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T13:55:14.083 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-05-07 13:55:08.155398638 +0000 2024-05-07T13:55:14.083 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-05-07 13:51:44.115027311 +0000 2024-05-07T13:55:14.083 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-05-07 13:51:44.115027311 +0000 2024-05-07T13:55:14.083 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-05-07 13:51:44.115027311 +0000 2024-05-07T13:55:14.084 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-07T13:55:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-05-07T13:55:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-05-07T13:55:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.9815e-05 s, 5.1 MB/s 2024-05-07T13:55:14.153 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-07T13:55:14.212 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-05-07T13:55:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-07T13:55:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:55:14.270 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-07T13:55:14.270 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:55:14.270 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T13:55:14.270 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-05-07 13:55:08.156398613 +0000 2024-05-07T13:55:14.270 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-05-07 13:51:44.460017861 +0000 2024-05-07T13:55:14.271 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-05-07 13:51:44.460017861 +0000 2024-05-07T13:55:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-05-07 13:51:44.460017861 +0000 2024-05-07T13:55:14.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-07T13:55:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-05-07T13:55:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-05-07T13:55:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 8.655e-05 s, 5.9 MB/s 2024-05-07T13:55:14.338 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-07T13:55:14.396 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-05-07T13:55:14.453 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-07T13:55:14.453 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:55:14.453 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-07T13:55:14.453 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:55:14.454 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-05-07T13:55:14.454 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-05-07 13:55:08.156398613 +0000 2024-05-07T13:55:14.454 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-05-07 13:51:44.794008712 +0000 2024-05-07T13:55:14.454 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-05-07 13:51:44.794008712 +0000 2024-05-07T13:55:14.454 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-05-07 13:51:44.794008712 +0000 2024-05-07T13:55:14.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-07T13:55:14.518 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-05-07T13:55:14.519 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-05-07T13:55:14.519 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000103558 s, 4.9 MB/s 2024-05-07T13:55:14.520 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-07T13:55:14.578 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-07T13:55:14.578 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-07T13:55:14.578 INFO:tasks.ceph:Generating config... 2024-05-07T13:55:14.579 INFO:tasks.ceph:[client] debug ms = 1 2024-05-07T13:55:14.579 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-05-07T13:55:14.579 INFO:tasks.ceph:[client] debug rgw = 20 2024-05-07T13:55:14.579 INFO:tasks.ceph:[client] setgroup = ceph 2024-05-07T13:55:14.579 INFO:tasks.ceph:[client] setuser = ceph 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] debug objclass = 20 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-07T13:55:14.580 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-07T13:55:14.581 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-07T13:55:14.581 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-07T13:55:14.581 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-07T13:55:14.581 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-07T13:55:14.581 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-07T13:55:14.581 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-07T13:55:14.581 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-07T13:55:14.581 INFO:tasks.ceph:Setting up mon.a... 2024-05-07T13:55:14.581 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-07T13:55:14.642 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.keyring 2024-05-07T13:55:14.645 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-07T13:55:14.692 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T13:55:14.720 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.22')] 2024-05-07T13:55:14.721 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.22'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-05-07T13:55:14.723 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:14.723 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-07T13:55:14.777 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.22 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:55:14.859 INFO:teuthology.orchestra.run.smithi022.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:55:14.859 INFO:teuthology.orchestra.run.smithi022.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:55:14.859 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:55:14.859 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: generated fsid 454556b8-fea2-4140-96b4-1e350fef55bd 2024-05-07T13:55:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = quincy 2024-05-07T13:55:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 0 2024-05-07T13:55:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:fsid 454556b8-fea2-4140-96b4-1e350fef55bd 2024-05-07T13:55:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:last_changed 2024-05-07T13:55:14.872343+0000 2024-05-07T13:55:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-05-07T13:55:14.872343+0000 2024-05-07T13:55:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:min_mon_release 17 (quincy) 2024-05-07T13:55:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:election_strategy: 1 2024-05-07T13:55:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-05-07T13:55:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-05-07T13:55:14.861 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-07T13:55:14.917 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 454556b8-fea2-4140-96b4-1e350fef55bd... 2024-05-07T13:55:14.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-07T13:55:14.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-07T13:55:15.002 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2024-05-07T13:55:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: chdir = "" 2024-05-07T13:55:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-07T13:55:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: auth supported = cephx 2024-05-07T13:55:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.002 INFO:teuthology.orchestra.run.smithi022.stdout: filestore xattr use omap = true 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: mon clock drift allowed = 1.000 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: osd crush chooseleaf type = 0 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: auth debug = true 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on old message = true 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on bug = true 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn max object skew = 0 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: # disable pg_autoscaler by default for new pools 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-07T13:55:15.003 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default size = 2 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow primary affinity = true 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow pg remap = true 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on legacy crush tunables = false 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on crush straw calc version zero = false 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on no sortbitwise = false 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = false 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on too few osds = false 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon_allow_pool_size_one = true 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.004 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: osd default data pool replay window = 5 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: mon allow pool delete = true 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: mon cluster log file level = debug 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: debug asserts on shutdown = true 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: mon health detail to clog = false 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: mon host = 172.21.15.22 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = 454556b8-fea2-4140-96b4-1e350fef55bd 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:[osd] 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: osd journal size = 100 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.005 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub load threshold = 5.0 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub max interval = 600 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd mclock profile = high_recovery_ops 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd recover clone overlap = true 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd recovery max chunk = 1048576 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug shutdown = true 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug op order = true 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify stray on activate = true 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug trim objects = true 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd open classes on start = true 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug pg log writeout = true 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.006 INFO:teuthology.orchestra.run.smithi022.stdout: osd deep scrub update digest min age = 30 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: osd map max advance = 10 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: journal zero on create = true 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: filestore ondisk finisher threads = 3 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: filestore apply finisher threads = 3 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: bdev debug aio = true 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug misdirected ops = true 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: debug objclass = 20 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: bdev async discard = True 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: bdev enable discard = True 2024-05-07T13:55:15.007 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore allocator = bitmap 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore block size = 96636764160 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore fsck on mount = True 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluefs = 1/20 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluestore = 1/20 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: debug osd = 20 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: debug rocksdb = 4/10 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd backfillfull_ratio = 0.85 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd full ratio = 0.9 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd nearfull ratio = 0.8 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: osd failsafe full ratio = 0.95 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: osd objectstore = bluestore 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr] 2024-05-07T13:55:15.008 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: debug mgr = 20 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: mgr/telemetry/nag = false 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout:[mon] 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: debug paxos = 20 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: mon data avail warn = 5 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: mon mgr mkfs grace = 240 2024-05-07T13:55:15.009 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd reporter subtree level = osd 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd prime pg temp = true 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: auth mon ticket ttl = 660 # 11m 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: auth service ticket ttl = 240 # 4m 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: # don't complain about insecure global_id in the test suite 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: # 1m isn't quite enough 2024-05-07T13:55:15.010 INFO:teuthology.orchestra.run.smithi022.stdout: mon_down_mkfs_grace = 2m 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_filestore_osds = false 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout:[client] 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: rgw cache enabled = true 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable ops log = true 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable usage log = true 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: rgw gc obj min wait = 15 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: debug rgw = 20 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: setgroup = ceph 2024-05-07T13:55:15.011 INFO:teuthology.orchestra.run.smithi022.stdout: setuser = ceph 2024-05-07T13:55:15.012 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.a] 2024-05-07T13:55:15.012 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-05-07T13:55:15.012 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-05-07T13:55:15.012 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-07T13:55:15.012 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-05-07T13:55:15.012 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.012 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-05-07T13:55:15.012 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-07T13:55:15.013 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.014 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = 172.21.15.22 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 454556b8-fea2-4140-96b4-1e350fef55bd 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.016 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: debug objclass = 20 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: bdev async discard = True 2024-05-07T13:55:15.017 INFO:teuthology.orchestra.run.smithi050.stdout: bdev enable discard = True 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore allocator = bitmap 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 1/20 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 1/20 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 4/10 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-05-07T13:55:15.018 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-05-07T13:55:15.019 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-05-07T13:55:15.020 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: rgw gc obj min wait = 15 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: debug rgw = 20 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: setgroup = ceph 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout: setuser = ceph 2024-05-07T13:55:15.021 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-05-07T13:55:15.023 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-07T13:55:15.023 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-07T13:55:15.121 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-07T13:55:15.121 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:15.121 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-07T13:55:15.138 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:15.138 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-07T13:55:15.193 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2024-05-07T13:55:15.193 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:15.193 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-07T13:55:15.193 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T13:55:15.269 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:15.269 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:55:15.325 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-05-07T13:55:15.325 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:15.326 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-07T13:55:15.326 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T13:55:15.367 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:15.367 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:55:15.427 INFO:tasks.ceph:Setting up mon nodes... 2024-05-07T13:55:15.427 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-07T13:55:15.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-07T13:55:15.537 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-07T13:55:15.540 INFO:tasks.ceph:Setting up mds nodes... 2024-05-07T13:55:15.540 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-07T13:55:15.541 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-07T13:55:15.585 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-07T13:55:15.597 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-07T13:55:15.598 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-07T13:55:15.598 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-07T13:55:15.624 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-07T13:55:15.624 INFO:tasks.ceph:role: osd.0 2024-05-07T13:55:15.624 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-07T13:55:15.624 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T13:55:15.693 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T13:55:15.723 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2024-05-07T13:55:15.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2024-05-07T13:55:15.725 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-07T13:55:15.795 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-07T13:55:15.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:55:15.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:15.974+0000 7f659d610640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-07T13:55:15.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:15.974+0000 7f659d610640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-07T13:55:15.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:15.975+0000 7f659d610640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-07T13:55:15.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:15.975+0000 7f659d610640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-07T13:55:15.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:15.975+0000 7f659d610640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-07T13:55:15.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:15.975+0000 7f659d610640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-07T13:55:18.810 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-07T13:55:18.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-07T13:55:18.873 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-07T13:55:18.873 INFO:tasks.ceph:role: osd.1 2024-05-07T13:55:18.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-05-07T13:55:18.874 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-07T13:55:18.942 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T13:55:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T13:55:18.942 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T13:55:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-07T13:55:18.943 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T13:55:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-05-07T13:55:18.943 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T13:55:18.943 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-07T13:55:18.943 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T13:55:18.943 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T13:55:18.975 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-05-07T13:55:18.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-05-07T13:55:18.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-05-07T13:55:19.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-07T13:55:19.121 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-07T13:55:19.188 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-07T13:55:19.188 INFO:tasks.ceph:role: osd.2 2024-05-07T13:55:19.188 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-05-07T13:55:19.189 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T13:55:19.255 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T13:55:19.286 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-05-07T13:55:19.288 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-05-07T13:55:19.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-05-07T13:55:19.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-07T13:55:19.428 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-07T13:55:19.494 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-07T13:55:19.494 INFO:tasks.ceph:role: osd.3 2024-05-07T13:55:19.494 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-05-07T13:55:19.494 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T13:55:19.564 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T13:55:19.596 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-05-07T13:55:19.598 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-05-07T13:55:19.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-05-07T13:55:19.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-07T13:55:19.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:55:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:19.859+0000 7fb02931a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-07T13:55:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:19.860+0000 7fb02931a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-07T13:55:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:19.860+0000 7fb02931a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-07T13:55:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:19.860+0000 7fb02931a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-07T13:55:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:19.860+0000 7fb02931a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-07T13:55:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:19.860+0000 7fb02931a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-07T13:55:22.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-07T13:55:22.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:55:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:22.839+0000 7f641e02e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-07T13:55:22.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:22.839+0000 7f641e02e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-07T13:55:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:22.839+0000 7f641e02e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-07T13:55:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:22.839+0000 7f641e02e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-07T13:55:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:22.839+0000 7f641e02e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-07T13:55:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:22.840+0000 7f641e02e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-07T13:55:25.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-07T13:55:25.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:55:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:25.823+0000 7f1c4821f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-07T13:55:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:25.823+0000 7f1c4821f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-07T13:55:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:25.823+0000 7f1c4821f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-07T13:55:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:25.823+0000 7f1c4821f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-07T13:55:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:25.823+0000 7f1c4821f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-07T13:55:25.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:25.824+0000 7f1c4821f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-07T13:55:28.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-07T13:55:28.700 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-07T13:55:28.700 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:28.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-07T13:55:28.732 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:28.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-07T13:55:28.770 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:28.771 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-07T13:55:28.840 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:28.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-07T13:55:28.909 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:28.909 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-07T13:55:28.977 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:28.978 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-07T13:55:29.035 INFO:tasks.ceph:Adding keys to all mons... 2024-05-07T13:55:29.035 DEBUG:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDDMjpmiJQsOhAAPUnAekA5TmwiGiVl4M5SGA== 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDDMjpmNkbUIBAADImuZXjhuv4dJfh1Kf58Ig== 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDHMjpmJkVHMxAAxDEyfdWYYOpcRNG4RrpMAQ== 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDKMjpmNwESMhAAkRiIo2cjZdpJj1mI/lRBDQ== 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDNMjpmUK8oMRAAJFSsLjOEJN+5MysUnH7tDA== 2024-05-07T13:55:29.065 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-05-07T13:55:29.066 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDDMjpm6QegIxAAWTLwJAnG+p8x2TVERQIn6A== 2024-05-07T13:55:29.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T13:55:29.166 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-07T13:55:29.221 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T13:55:29.275 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T13:55:29.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T13:55:29.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-07T13:55:29.433 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-07T13:55:29.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-07T13:55:29.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-07T13:55:29.557 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-07T13:55:29.583 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:55:29.639 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-07T13:55:29.640 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-07T13:55:29.640 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-07T13:55:29.682 INFO:tasks.ceph.mon.a:Started 2024-05-07T13:55:29.682 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-07T13:55:29.682 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-07T13:55:29.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-07T13:55:29.686 INFO:tasks.ceph.mgr.x:Started 2024-05-07T13:55:29.686 INFO:tasks.ceph:Setting crush tunables to default 2024-05-07T13:55:29.686 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd crush tunables default 2024-05-07T13:55:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.802+0000 7fc02524e640 1 Processor -- start 2024-05-07T13:55:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc02524e640 1 -- start start 2024-05-07T13:55:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc02524e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc02006dfe0 0x7fc0201337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc02524e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0200720b0 con 0x7fc02006d4f0 2024-05-07T13:55:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc02524e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc02006f6b0 con 0x7fc02006dfe0 2024-05-07T13:55:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc017fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc02006dfe0 0x7fc0201337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc017fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc02006dfe0 0x7fc0201337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58428/0 (socket says 172.21.15.22:58428) 2024-05-07T13:55:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc01ed9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc02006d4f0 0x7fc02006d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60106/0 (socket says 172.21.15.22:60106) 2024-05-07T13:55:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc017fff640 1 -- 172.21.15.22:0/1607554730 learned_addr learned my addr 172.21.15.22:0/1607554730 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc017fff640 1 -- 172.21.15.22:0/1607554730 >> v1:172.21.15.22:6789/0 conn(0x7fc02006d4f0 legacy=0x7fc02006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc017fff640 1 -- 172.21.15.22:0/1607554730 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02006e710 con 0x7fc02006dfe0 2024-05-07T13:55:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.803+0000 7fc01e59c640 1 -- 172.21.15.22:0/1607554730 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458447306 0 0) 0x7fc0200720b0 con 0x7fc02006d4f0 2024-05-07T13:55:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.804+0000 7fc017fff640 1 --2- 172.21.15.22:0/1607554730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006dfe0 0x7fc0201337c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc0080097f0 tx=0x7fc00802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef74e35588223ef9 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.804+0000 7fc01e59c640 1 -- 172.21.15.22:0/1607554730 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc008035020 con 0x7fc02006dfe0 2024-05-07T13:55:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.804+0000 7fc01e59c640 1 -- 172.21.15.22:0/1607554730 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0080317a0 con 0x7fc02006dfe0 2024-05-07T13:55:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.804+0000 7fc01e59c640 1 -- 172.21.15.22:0/1607554730 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc008031aa0 con 0x7fc02006dfe0 2024-05-07T13:55:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.805+0000 7fc02524e640 1 -- 172.21.15.22:0/1607554730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006dfe0 msgr2=0x7fc0201337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.805+0000 7fc02524e640 1 --2- 172.21.15.22:0/1607554730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006dfe0 0x7fc0201337c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc0080097f0 tx=0x7fc00802b910 comp rx=0 tx=0).stop 2024-05-07T13:55:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.805+0000 7fc02524e640 1 -- 172.21.15.22:0/1607554730 shutdown_connections 2024-05-07T13:55:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.805+0000 7fc02524e640 1 --2- 172.21.15.22:0/1607554730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006dfe0 0x7fc0201337c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.805+0000 7fc02524e640 1 -- 172.21.15.22:0/1607554730 >> 172.21.15.22:0/1607554730 conn(0x7fc02009d750 msgr2=0x7fc02009db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.805+0000 7fc02524e640 1 -- 172.21.15.22:0/1607554730 shutdown_connections 2024-05-07T13:55:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.805+0000 7fc02524e640 1 -- 172.21.15.22:0/1607554730 wait complete. 2024-05-07T13:55:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.806+0000 7fc02524e640 1 Processor -- start 2024-05-07T13:55:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.806+0000 7fc02524e640 1 -- start start 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.806+0000 7fc02524e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006d4f0 0x7fc0201280e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.806+0000 7fc02524e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc02009fe30 con 0x7fc02006d4f0 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.806+0000 7fc01ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006d4f0 0x7fc0201280e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.806+0000 7fc01ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006d4f0 0x7fc0201280e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58436/0 (socket says 172.21.15.22:58436) 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc01ed9d640 1 -- 172.21.15.22:0/4192305392 learned_addr learned my addr 172.21.15.22:0/4192305392 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc01ed9d640 1 -- 172.21.15.22:0/4192305392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02012b3c0 con 0x7fc02006d4f0 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc01ed9d640 1 --2- 172.21.15.22:0/4192305392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006d4f0 0x7fc0201280e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc01000c420 tx=0x7fc01000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc0177fe640 1 -- 172.21.15.22:0/4192305392 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc010018070 con 0x7fc02006d4f0 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc0177fe640 1 -- 172.21.15.22:0/4192305392 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0100074d0 con 0x7fc02006d4f0 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc0177fe640 1 -- 172.21.15.22:0/4192305392 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc010004950 con 0x7fc02006d4f0 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc02524e640 1 -- 172.21.15.22:0/4192305392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02012b9e0 con 0x7fc02006d4f0 2024-05-07T13:55:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc02524e640 1 -- 172.21.15.22:0/4192305392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02012ab20 con 0x7fc02006d4f0 2024-05-07T13:55:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc0177fe640 1 -- 172.21.15.22:0/4192305392 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc01001b070 con 0x7fc02006d4f0 2024-05-07T13:55:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.807+0000 7fc0177fe640 1 -- 172.21.15.22:0/4192305392 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc01001c3b0 con 0x7fc02006d4f0 2024-05-07T13:55:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.808+0000 7fc02524e640 1 -- 172.21.15.22:0/4192305392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02006fdc0 con 0x7fc02006d4f0 2024-05-07T13:55:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.810+0000 7fc0177fe640 1 -- 172.21.15.22:0/4192305392 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc02006fdc0 con 0x7fc02006d4f0 2024-05-07T13:55:29.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.877+0000 7fc02524e640 1 -- 172.21.15.22:0/4192305392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc02009cf00 con 0x7fc02006d4f0 2024-05-07T13:55:29.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.878+0000 7fc0177fe640 1 -- 172.21.15.22:0/4192305392 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fc02009cf00 con 0x7fc02006d4f0 2024-05-07T13:55:29.865 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2024-05-07T13:55:29.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.878+0000 7fc02524e640 1 -- 172.21.15.22:0/4192305392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006d4f0 msgr2=0x7fc0201280e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:29.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.878+0000 7fc02524e640 1 --2- 172.21.15.22:0/4192305392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006d4f0 0x7fc0201280e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc01000c420 tx=0x7fc01000c8e0 comp rx=0 tx=0).stop 2024-05-07T13:55:29.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.878+0000 7fc02524e640 1 -- 172.21.15.22:0/4192305392 shutdown_connections 2024-05-07T13:55:29.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.878+0000 7fc02524e640 1 --2- 172.21.15.22:0/4192305392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02006d4f0 0x7fc0201280e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:29.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.878+0000 7fc02524e640 1 -- 172.21.15.22:0/4192305392 >> 172.21.15.22:0/4192305392 conn(0x7fc02009d750 msgr2=0x7fc02009b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:29.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.878+0000 7fc02524e640 1 -- 172.21.15.22:0/4192305392 shutdown_connections 2024-05-07T13:55:29.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:29.878+0000 7fc02524e640 1 -- 172.21.15.22:0/4192305392 wait complete. 2024-05-07T13:55:29.876 INFO:tasks.ceph:check_enable_crimson: False 2024-05-07T13:55:29.877 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-07T13:55:29.877 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-07T13:55:29.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-07T13:55:29.896 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:29.908+0000 7fe3dc231040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-07T13:55:29.903 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:29.903 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-07T13:55:29.930 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:29.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-07T13:55:29.998 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-05-07T13:55:29.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-07T13:55:30.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new dfafa174-71f4-467c-a8c9-5a236b7ce235 0 2024-05-07T13:55:30.066 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:30.077+0000 7fe3dc231040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-07T13:55:30.123 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:30.135+0000 7fe3dc231040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-07T13:55:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.179+0000 7fe2e20e0640 1 Processor -- start 2024-05-07T13:55:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.179+0000 7fe2e20e0640 1 -- start start 2024-05-07T13:55:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.179+0000 7fe2e20e0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2dc116c60 0x7fe2dc117040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.179+0000 7fe2e20e0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2dc117610 con 0x7fe2dc111a90 2024-05-07T13:55:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.179+0000 7fe2e20e0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe2dc112620 con 0x7fe2dc116c60 2024-05-07T13:55:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.179+0000 7fe2db7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2dc116c60 0x7fe2dc117040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.179+0000 7fe2daffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe2dc111a90 0x7fe2dc111f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:54614/0 (socket says 172.21.15.50:54614) 2024-05-07T13:55:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.180+0000 7fe2daffd640 1 -- 172.21.15.50:0/275624258 learned_addr learned my addr 172.21.15.50:0/275624258 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:55:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.180+0000 7fe2db7fe640 1 -- 172.21.15.50:0/275624258 >> v1:172.21.15.22:6789/0 conn(0x7fe2dc111a90 legacy=0x7fe2dc111f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.180+0000 7fe2db7fe640 1 -- 172.21.15.50:0/275624258 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc1127d0 con 0x7fe2dc116c60 2024-05-07T13:55:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.181+0000 7fe2db7fe640 1 --2- 172.21.15.50:0/275624258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc116c60 0x7fe2dc117040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009720 tx=0x7fe2cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab16ad380f68c73 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.181+0000 7fe2da7fc640 1 -- 172.21.15.50:0/275624258 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc0316d0 con 0x7fe2dc116c60 2024-05-07T13:55:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.181+0000 7fe2da7fc640 1 -- 172.21.15.50:0/275624258 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2cc037070 con 0x7fe2dc116c60 2024-05-07T13:55:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.181+0000 7fe2da7fc640 1 -- 172.21.15.50:0/275624258 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc0319c0 con 0x7fe2dc116c60 2024-05-07T13:55:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.181+0000 7fe2e20e0640 1 -- 172.21.15.50:0/275624258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc116c60 msgr2=0x7fe2dc117040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.181+0000 7fe2e20e0640 1 --2- 172.21.15.50:0/275624258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc116c60 0x7fe2dc117040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009720 tx=0x7fe2cc02b840 comp rx=0 tx=0).stop 2024-05-07T13:55:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.182+0000 7fe2e20e0640 1 -- 172.21.15.50:0/275624258 shutdown_connections 2024-05-07T13:55:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.182+0000 7fe2e20e0640 1 --2- 172.21.15.50:0/275624258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc116c60 0x7fe2dc117040 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.182+0000 7fe2e20e0640 1 -- 172.21.15.50:0/275624258 >> 172.21.15.50:0/275624258 conn(0x7fe2dc06e8f0 msgr2=0x7fe2dc10fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.182+0000 7fe2e20e0640 1 -- 172.21.15.50:0/275624258 shutdown_connections 2024-05-07T13:55:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.182+0000 7fe2e20e0640 1 -- 172.21.15.50:0/275624258 wait complete. 2024-05-07T13:55:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.182+0000 7fe2e20e0640 1 Processor -- start 2024-05-07T13:55:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.183+0000 7fe2e20e0640 1 -- start start 2024-05-07T13:55:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.183+0000 7fe2e20e0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc111a90 0x7fe2dc1a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.183+0000 7fe2e20e0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc11deb0 con 0x7fe2dc111a90 2024-05-07T13:55:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.183+0000 7fe2db7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc111a90 0x7fe2dc1a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.183+0000 7fe2db7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc111a90 0x7fe2dc1a6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:33226/0 (socket says 172.21.15.50:33226) 2024-05-07T13:55:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.183+0000 7fe2db7fe640 1 -- 172.21.15.50:0/4221247934 learned_addr learned my addr 172.21.15.50:0/4221247934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.183+0000 7fe2db7fe640 1 -- 172.21.15.50:0/4221247934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc1a6f30 con 0x7fe2dc111a90 2024-05-07T13:55:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.183+0000 7fe2db7fe640 1 --2- 172.21.15.50:0/4221247934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc111a90 0x7fe2dc1a6960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc034040 tx=0x7fe2cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.184+0000 7fe2c3fff640 1 -- 172.21.15.50:0/4221247934 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc032770 con 0x7fe2dc111a90 2024-05-07T13:55:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.184+0000 7fe2c3fff640 1 -- 172.21.15.50:0/4221247934 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2cc032910 con 0x7fe2dc111a90 2024-05-07T13:55:30.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.184+0000 7fe2c3fff640 1 -- 172.21.15.50:0/4221247934 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc032c30 con 0x7fe2dc111a90 2024-05-07T13:55:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.184+0000 7fe2e20e0640 1 -- 172.21.15.50:0/4221247934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2dc1a71c0 con 0x7fe2dc111a90 2024-05-07T13:55:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.184+0000 7fe2e20e0640 1 -- 172.21.15.50:0/4221247934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2dc1ab270 con 0x7fe2dc111a90 2024-05-07T13:55:30.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.184+0000 7fe2c3fff640 1 -- 172.21.15.50:0/4221247934 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2cc04c060 con 0x7fe2dc111a90 2024-05-07T13:55:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.184+0000 7fe2c3fff640 1 -- 172.21.15.50:0/4221247934 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe2cc02f050 con 0x7fe2dc111a90 2024-05-07T13:55:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.185+0000 7fe2e20e0640 1 -- 172.21.15.50:0/4221247934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2dc04fe40 con 0x7fe2dc111a90 2024-05-07T13:55:30.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.187+0000 7fe2c3fff640 1 -- 172.21.15.50:0/4221247934 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe2cc064dd0 con 0x7fe2dc111a90 2024-05-07T13:55:30.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.281+0000 7fe2e20e0640 1 -- 172.21.15.50:0/4221247934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dfafa174-71f4-467c-a8c9-5a236b7ce235", "id": 0} v 0) -- 0x7fe2dc1a7390 con 0x7fe2dc111a90 2024-05-07T13:55:30.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.282+0000 7fe2c3fff640 1 -- 172.21.15.50:0/4221247934 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dfafa174-71f4-467c-a8c9-5a236b7ce235", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe2cc053030 con 0x7fe2dc111a90 2024-05-07T13:55:30.271 INFO:teuthology.orchestra.run.smithi050.stdout:0 2024-05-07T13:55:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.283+0000 7fe2e20e0640 1 -- 172.21.15.50:0/4221247934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc111a90 msgr2=0x7fe2dc1a6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.283+0000 7fe2e20e0640 1 --2- 172.21.15.50:0/4221247934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc111a90 0x7fe2dc1a6960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc034040 tx=0x7fe2cc0046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.283+0000 7fe2e20e0640 1 -- 172.21.15.50:0/4221247934 shutdown_connections 2024-05-07T13:55:30.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.283+0000 7fe2e20e0640 1 --2- 172.21.15.50:0/4221247934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2dc111a90 0x7fe2dc1a6960 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.283+0000 7fe2e20e0640 1 -- 172.21.15.50:0/4221247934 >> 172.21.15.50:0/4221247934 conn(0x7fe2dc06e8f0 msgr2=0x7fe2dc11cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:30.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.283+0000 7fe2e20e0640 1 -- 172.21.15.50:0/4221247934 shutdown_connections 2024-05-07T13:55:30.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.283+0000 7fe2e20e0640 1 -- 172.21.15.50:0/4221247934 wait complete. 2024-05-07T13:55:30.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 50061477-74f3-4cad-83da-eeee2d48855f 1 2024-05-07T13:55:30.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.396+0000 7fb44fbc7640 1 Processor -- start 2024-05-07T13:55:30.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.396+0000 7fb44fbc7640 1 -- start start 2024-05-07T13:55:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.396+0000 7fb44fbc7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb44811ab90 0x7fb44811cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.396+0000 7fb44fbc7640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44811d550 con 0x7fb448117f10 2024-05-07T13:55:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.396+0000 7fb44fbc7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb44811e750 con 0x7fb44811ab90 2024-05-07T13:55:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.397+0000 7fb44d162640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb44811ab90 0x7fb44811cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.397+0000 7fb44d963640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb448117f10 0x7fb4481182f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:54620/0 (socket says 172.21.15.50:54620) 2024-05-07T13:55:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.397+0000 7fb44d963640 1 -- 172.21.15.50:0/1989038869 learned_addr learned my addr 172.21.15.50:0/1989038869 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:55:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.397+0000 7fb44d162640 1 -- 172.21.15.50:0/1989038869 >> v1:172.21.15.22:6789/0 conn(0x7fb448117f10 legacy=0x7fb4481182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.397+0000 7fb44d162640 1 -- 172.21.15.50:0/1989038869 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44811e900 con 0x7fb44811ab90 2024-05-07T13:55:30.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.398+0000 7fb44d162640 1 --2- 172.21.15.50:0/1989038869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb44811ab90 0x7fb44811cf80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb438009720 tx=0x7fb43802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1484dfb2ece19971 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.398+0000 7fb44c961640 1 -- 172.21.15.50:0/1989038869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380316d0 con 0x7fb44811ab90 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.398+0000 7fb44c961640 1 -- 172.21.15.50:0/1989038869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb438037070 con 0x7fb44811ab90 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.398+0000 7fb44c961640 1 -- 172.21.15.50:0/1989038869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4380319c0 con 0x7fb44811ab90 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.398+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1989038869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb44811ab90 msgr2=0x7fb44811cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.398+0000 7fb44fbc7640 1 --2- 172.21.15.50:0/1989038869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb44811ab90 0x7fb44811cf80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb438009720 tx=0x7fb43802b840 comp rx=0 tx=0).stop 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.399+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1989038869 shutdown_connections 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.399+0000 7fb44fbc7640 1 --2- 172.21.15.50:0/1989038869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb44811ab90 0x7fb44811cf80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.399+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1989038869 >> 172.21.15.50:0/1989038869 conn(0x7fb44806e840 msgr2=0x7fb44810fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.399+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1989038869 shutdown_connections 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.399+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1989038869 wait complete. 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.399+0000 7fb44fbc7640 1 Processor -- start 2024-05-07T13:55:30.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.399+0000 7fb44fbc7640 1 -- start start 2024-05-07T13:55:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.400+0000 7fb44fbc7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb448117f10 0x7fb4481a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.400+0000 7fb44fbc7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb44811dc40 con 0x7fb448117f10 2024-05-07T13:55:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.400+0000 7fb44d963640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb448117f10 0x7fb4481a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.400+0000 7fb44d963640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb448117f10 0x7fb4481a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:33242/0 (socket says 172.21.15.50:33242) 2024-05-07T13:55:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.400+0000 7fb44d963640 1 -- 172.21.15.50:0/1960945205 learned_addr learned my addr 172.21.15.50:0/1960945205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:30.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.400+0000 7fb44d963640 1 -- 172.21.15.50:0/1960945205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4481a6f30 con 0x7fb448117f10 2024-05-07T13:55:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.400+0000 7fb44d963640 1 --2- 172.21.15.50:0/1960945205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb448117f10 0x7fb4481a69f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb44400c4a0 tx=0x7fb44400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.400+0000 7fb43e7fc640 1 -- 172.21.15.50:0/1960945205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb444017070 con 0x7fb448117f10 2024-05-07T13:55:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.400+0000 7fb43e7fc640 1 -- 172.21.15.50:0/1960945205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb444005c10 con 0x7fb448117f10 2024-05-07T13:55:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.401+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1960945205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4481a7220 con 0x7fb448117f10 2024-05-07T13:55:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.401+0000 7fb43e7fc640 1 -- 172.21.15.50:0/1960945205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb444007070 con 0x7fb448117f10 2024-05-07T13:55:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.401+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1960945205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4481ab2d0 con 0x7fb448117f10 2024-05-07T13:55:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.401+0000 7fb43e7fc640 1 -- 172.21.15.50:0/1960945205 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb44401a070 con 0x7fb448117f10 2024-05-07T13:55:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.401+0000 7fb43e7fc640 1 -- 172.21.15.50:0/1960945205 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb444012400 con 0x7fb448117f10 2024-05-07T13:55:30.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.401+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1960945205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb44804fe40 con 0x7fb448117f10 2024-05-07T13:55:30.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.404+0000 7fb43e7fc640 1 -- 172.21.15.50:0/1960945205 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb44401c440 con 0x7fb448117f10 2024-05-07T13:55:30.416 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:30.427+0000 7fe3dc231040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-07T13:55:30.464 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:30.475+0000 7fe3dc231040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-07T13:55:30.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.478+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1960945205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd new", "uuid": "50061477-74f3-4cad-83da-eeee2d48855f", "id": 1} v 0) -- 0x7fb4481a7450 con 0x7fb448117f10 2024-05-07T13:55:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.479+0000 7fb43e7fc640 1 -- 172.21.15.50:0/1960945205 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50061477-74f3-4cad-83da-eeee2d48855f", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb444007210 con 0x7fb448117f10 2024-05-07T13:55:30.468 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-05-07T13:55:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.480+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1960945205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb448117f10 msgr2=0x7fb4481a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.480+0000 7fb44fbc7640 1 --2- 172.21.15.50:0/1960945205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb448117f10 0x7fb4481a69f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb44400c4a0 tx=0x7fb44400c960 comp rx=0 tx=0).stop 2024-05-07T13:55:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.480+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1960945205 shutdown_connections 2024-05-07T13:55:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.480+0000 7fb44fbc7640 1 --2- 172.21.15.50:0/1960945205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb448117f10 0x7fb4481a69f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.480+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1960945205 >> 172.21.15.50:0/1960945205 conn(0x7fb44806e840 msgr2=0x7fb44811af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.480+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1960945205 shutdown_connections 2024-05-07T13:55:30.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.480+0000 7fb44fbc7640 1 -- 172.21.15.50:0/1960945205 wait complete. 2024-05-07T13:55:30.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 20fbf061-68f0-40bb-8c65-b73c4e479b8f 2 2024-05-07T13:55:30.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.594+0000 7fb8fba9a640 1 Processor -- start 2024-05-07T13:55:30.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.594+0000 7fb8fba9a640 1 -- start start 2024-05-07T13:55:30.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.594+0000 7fb8fba9a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8f4117f10 0x7fb8f41182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:30.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.594+0000 7fb8fba9a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f4118980 con 0x7fb8f4111bf0 2024-05-07T13:55:30.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.594+0000 7fb8fba9a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f41127b0 con 0x7fb8f4117f10 2024-05-07T13:55:30.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.594+0000 7fb8f9836640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8f4117f10 0x7fb8f41182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:30.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.594+0000 7fb8f9035640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb8f4111bf0 0x7fb8f41120a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:54632/0 (socket says 172.21.15.50:54632) 2024-05-07T13:55:30.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.594+0000 7fb8f9035640 1 -- 172.21.15.50:0/792833739 learned_addr learned my addr 172.21.15.50:0/792833739 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:55:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.595+0000 7fb8f8834640 1 -- 172.21.15.50:0/792833739 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1876227556 0 0) 0x7fb8e4001110 con 0x7fb8f4111bf0 2024-05-07T13:55:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.595+0000 7fb8f8834640 1 -- 172.21.15.50:0/792833739 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e0003520 con 0x7fb8f4111bf0 2024-05-07T13:55:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.595+0000 7fb8f9836640 1 -- 172.21.15.50:0/792833739 >> v1:172.21.15.22:6789/0 conn(0x7fb8f4111bf0 legacy=0x7fb8f41120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.595+0000 7fb8f9836640 1 -- 172.21.15.50:0/792833739 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f4112960 con 0x7fb8f4117f10 2024-05-07T13:55:30.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.596+0000 7fb8f9836640 1 --2- 172.21.15.50:0/792833739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4117f10 0x7fb8f41182f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009720 tx=0x7fb8f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f02991bab1aac17 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:30.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.596+0000 7fb8f8834640 1 -- 172.21.15.50:0/792833739 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8f00316d0 con 0x7fb8f4117f10 2024-05-07T13:55:30.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.596+0000 7fb8f8834640 1 -- 172.21.15.50:0/792833739 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f0037070 con 0x7fb8f4117f10 2024-05-07T13:55:30.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.596+0000 7fb8f8834640 1 -- 172.21.15.50:0/792833739 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8f00319c0 con 0x7fb8f4117f10 2024-05-07T13:55:30.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.597+0000 7fb8fba9a640 1 -- 172.21.15.50:0/792833739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4117f10 msgr2=0x7fb8f41182f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.597+0000 7fb8fba9a640 1 --2- 172.21.15.50:0/792833739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4117f10 0x7fb8f41182f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009720 tx=0x7fb8f002b840 comp rx=0 tx=0).stop 2024-05-07T13:55:30.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.597+0000 7fb8fba9a640 1 -- 172.21.15.50:0/792833739 shutdown_connections 2024-05-07T13:55:30.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.597+0000 7fb8fba9a640 1 --2- 172.21.15.50:0/792833739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4117f10 0x7fb8f41182f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.597+0000 7fb8fba9a640 1 -- 172.21.15.50:0/792833739 >> 172.21.15.50:0/792833739 conn(0x7fb8f406e840 msgr2=0x7fb8f410fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.597+0000 7fb8fba9a640 1 -- 172.21.15.50:0/792833739 shutdown_connections 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.597+0000 7fb8fba9a640 1 -- 172.21.15.50:0/792833739 wait complete. 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.597+0000 7fb8fba9a640 1 Processor -- start 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.598+0000 7fb8fba9a640 1 -- start start 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.598+0000 7fb8fba9a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4111bf0 0x7fb8f41ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.598+0000 7fb8fba9a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f411e090 con 0x7fb8f4111bf0 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.598+0000 7fb8f9836640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4111bf0 0x7fb8f41ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.598+0000 7fb8f9836640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4111bf0 0x7fb8f41ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:33264/0 (socket says 172.21.15.50:33264) 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.598+0000 7fb8f9836640 1 -- 172.21.15.50:0/2996704957 learned_addr learned my addr 172.21.15.50:0/2996704957 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.598+0000 7fb8f9836640 1 -- 172.21.15.50:0/2996704957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f41aca90 con 0x7fb8f4111bf0 2024-05-07T13:55:30.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.599+0000 7fb8f9836640 1 --2- 172.21.15.50:0/2996704957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4111bf0 0x7fb8f41ac4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009720 tx=0x7fb8f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.599+0000 7fb8ea7fc640 1 -- 172.21.15.50:0/2996704957 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8f0032560 con 0x7fb8f4111bf0 2024-05-07T13:55:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.599+0000 7fb8ea7fc640 1 -- 172.21.15.50:0/2996704957 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f0032700 con 0x7fb8f4111bf0 2024-05-07T13:55:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.599+0000 7fb8fba9a640 1 -- 172.21.15.50:0/2996704957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f41acd20 con 0x7fb8f4111bf0 2024-05-07T13:55:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.599+0000 7fb8ea7fc640 1 -- 172.21.15.50:0/2996704957 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8f0032a00 con 0x7fb8f4111bf0 2024-05-07T13:55:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.599+0000 7fb8fba9a640 1 -- 172.21.15.50:0/2996704957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f41a6630 con 0x7fb8f4111bf0 2024-05-07T13:55:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.599+0000 7fb8ea7fc640 1 -- 172.21.15.50:0/2996704957 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb8f004c060 con 0x7fb8f4111bf0 2024-05-07T13:55:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.599+0000 7fb8ea7fc640 1 -- 172.21.15.50:0/2996704957 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb8f002f050 con 0x7fb8f4111bf0 2024-05-07T13:55:30.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.600+0000 7fb8fba9a640 1 -- 172.21.15.50:0/2996704957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f404fe40 con 0x7fb8f4111bf0 2024-05-07T13:55:30.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.602+0000 7fb8ea7fc640 1 -- 172.21.15.50:0/2996704957 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb8f0040070 con 0x7fb8f4111bf0 2024-05-07T13:55:30.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.676+0000 7fb8fba9a640 1 -- 172.21.15.50:0/2996704957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd new", "uuid": "20fbf061-68f0-40bb-8c65-b73c4e479b8f", "id": 2} v 0) -- 0x7fb8f41a7c10 con 0x7fb8f4111bf0 2024-05-07T13:55:30.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.677+0000 7fb8ea7fc640 1 -- 172.21.15.50:0/2996704957 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "20fbf061-68f0-40bb-8c65-b73c4e479b8f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb8f0006660 con 0x7fb8f4111bf0 2024-05-07T13:55:30.665 INFO:teuthology.orchestra.run.smithi050.stdout:2 2024-05-07T13:55:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.677+0000 7fb8fba9a640 1 -- 172.21.15.50:0/2996704957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4111bf0 msgr2=0x7fb8f41ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.677+0000 7fb8fba9a640 1 --2- 172.21.15.50:0/2996704957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4111bf0 0x7fb8f41ac4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009720 tx=0x7fb8f00046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.678+0000 7fb8fba9a640 1 -- 172.21.15.50:0/2996704957 shutdown_connections 2024-05-07T13:55:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.678+0000 7fb8fba9a640 1 --2- 172.21.15.50:0/2996704957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f4111bf0 0x7fb8f41ac4c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.678+0000 7fb8fba9a640 1 -- 172.21.15.50:0/2996704957 >> 172.21.15.50:0/2996704957 conn(0x7fb8f406e840 msgr2=0x7fb8f4113df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.678+0000 7fb8fba9a640 1 -- 172.21.15.50:0/2996704957 shutdown_connections 2024-05-07T13:55:30.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.678+0000 7fb8fba9a640 1 -- 172.21.15.50:0/2996704957 wait complete. 2024-05-07T13:55:30.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 8a563741-f524-4dcb-930d-b520f14dc3fd 3 2024-05-07T13:55:30.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.790+0000 7f086cfbd640 1 Processor -- start 2024-05-07T13:55:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.790+0000 7f086cfbd640 1 -- start start 2024-05-07T13:55:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.790+0000 7f086cfbd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0868117f10 0x7f08681182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.790+0000 7f086cfbd640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0868118980 con 0x7f0868111bf0 2024-05-07T13:55:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.790+0000 7f086cfbd640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f08681127b0 con 0x7f0868117f10 2024-05-07T13:55:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.791+0000 7f086659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0868117f10 0x7f08681182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.791+0000 7f0865d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0868111bf0 0x7f08681120a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:54636/0 (socket says 172.21.15.50:54636) 2024-05-07T13:55:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.791+0000 7f0865d9b640 1 -- 172.21.15.50:0/823316596 learned_addr learned my addr 172.21.15.50:0/823316596 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:55:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.791+0000 7f086659c640 1 -- 172.21.15.50:0/823316596 >> v1:172.21.15.22:6789/0 conn(0x7f0868111bf0 legacy=0x7f08681120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.791+0000 7f086659c640 1 -- 172.21.15.50:0/823316596 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0868112960 con 0x7f0868117f10 2024-05-07T13:55:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.792+0000 7f086659c640 1 --2- 172.21.15.50:0/823316596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868117f10 0x7f08681182f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0858009720 tx=0x7f085802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4aa69abcd58042b server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.792+0000 7f086559a640 1 -- 172.21.15.50:0/823316596 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08580316d0 con 0x7f0868117f10 2024-05-07T13:55:30.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.792+0000 7f086559a640 1 -- 172.21.15.50:0/823316596 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0858037070 con 0x7f0868117f10 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.792+0000 7f086559a640 1 -- 172.21.15.50:0/823316596 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08580319c0 con 0x7f0868117f10 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.792+0000 7f086cfbd640 1 -- 172.21.15.50:0/823316596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868117f10 msgr2=0x7f08681182f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.792+0000 7f086cfbd640 1 --2- 172.21.15.50:0/823316596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868117f10 0x7f08681182f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0858009720 tx=0x7f085802b840 comp rx=0 tx=0).stop 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.793+0000 7f086cfbd640 1 -- 172.21.15.50:0/823316596 shutdown_connections 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.793+0000 7f086cfbd640 1 --2- 172.21.15.50:0/823316596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868117f10 0x7f08681182f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.793+0000 7f086cfbd640 1 -- 172.21.15.50:0/823316596 >> 172.21.15.50:0/823316596 conn(0x7f086806e840 msgr2=0x7f086810fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.793+0000 7f086cfbd640 1 -- 172.21.15.50:0/823316596 shutdown_connections 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.793+0000 7f086cfbd640 1 -- 172.21.15.50:0/823316596 wait complete. 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.793+0000 7f086cfbd640 1 Processor -- start 2024-05-07T13:55:30.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.794+0000 7f086cfbd640 1 -- start start 2024-05-07T13:55:30.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.794+0000 7f086cfbd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868111bf0 0x7f08681a6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:30.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.794+0000 7f086cfbd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f086811e090 con 0x7f0868111bf0 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.794+0000 7f086659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868111bf0 0x7f08681a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.794+0000 7f086659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868111bf0 0x7f08681a6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:33286/0 (socket says 172.21.15.50:33286) 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.794+0000 7f086659c640 1 -- 172.21.15.50:0/1742448823 learned_addr learned my addr 172.21.15.50:0/1742448823 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.794+0000 7f086659c640 1 -- 172.21.15.50:0/1742448823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08681a6ed0 con 0x7f0868111bf0 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.795+0000 7f086659c640 1 --2- 172.21.15.50:0/1742448823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868111bf0 0x7f08681a6990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0858009720 tx=0x7f08580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.795+0000 7f0856ffd640 1 -- 172.21.15.50:0/1742448823 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0858032770 con 0x7f0868111bf0 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.795+0000 7f0856ffd640 1 -- 172.21.15.50:0/1742448823 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0858032910 con 0x7f0868111bf0 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.795+0000 7f086cfbd640 1 -- 172.21.15.50:0/1742448823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08681a7160 con 0x7f0868111bf0 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.795+0000 7f0856ffd640 1 -- 172.21.15.50:0/1742448823 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0858032bf0 con 0x7f0868111bf0 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.795+0000 7f086cfbd640 1 -- 172.21.15.50:0/1742448823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08681ab110 con 0x7f0868111bf0 2024-05-07T13:55:30.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.795+0000 7f0856ffd640 1 -- 172.21.15.50:0/1742448823 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f085804c060 con 0x7f0868111bf0 2024-05-07T13:55:30.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.795+0000 7f0856ffd640 1 -- 172.21.15.50:0/1742448823 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f085802f050 con 0x7f0868111bf0 2024-05-07T13:55:30.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.796+0000 7f086cfbd640 1 -- 172.21.15.50:0/1742448823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f086804fe40 con 0x7f0868111bf0 2024-05-07T13:55:30.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.798+0000 7f0856ffd640 1 -- 172.21.15.50:0/1742448823 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0858040070 con 0x7f0868111bf0 2024-05-07T13:55:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.872+0000 7f086cfbd640 1 -- 172.21.15.50:0/1742448823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8a563741-f524-4dcb-930d-b520f14dc3fd", "id": 3} v 0) -- 0x7f0868117f10 con 0x7f0868111bf0 2024-05-07T13:55:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.874+0000 7f0856ffd640 1 -- 172.21.15.50:0/1742448823 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a563741-f524-4dcb-930d-b520f14dc3fd", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f085804e7e0 con 0x7f0868111bf0 2024-05-07T13:55:30.862 INFO:teuthology.orchestra.run.smithi050.stdout:3 2024-05-07T13:55:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.875+0000 7f086cfbd640 1 -- 172.21.15.50:0/1742448823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868111bf0 msgr2=0x7f08681a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.875+0000 7f086cfbd640 1 --2- 172.21.15.50:0/1742448823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868111bf0 0x7f08681a6990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0858009720 tx=0x7f08580046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.875+0000 7f086cfbd640 1 -- 172.21.15.50:0/1742448823 shutdown_connections 2024-05-07T13:55:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.875+0000 7f086cfbd640 1 --2- 172.21.15.50:0/1742448823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0868111bf0 0x7f08681a6990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.875+0000 7f086cfbd640 1 -- 172.21.15.50:0/1742448823 >> 172.21.15.50:0/1742448823 conn(0x7f086806e840 msgr2=0x7f0868113df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.875+0000 7f086cfbd640 1 -- 172.21.15.50:0/1742448823 shutdown_connections 2024-05-07T13:55:30.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:30.875+0000 7f086cfbd640 1 -- 172.21.15.50:0/1742448823 wait complete. 2024-05-07T13:55:30.875 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-07T13:55:30.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-07T13:55:30.878 INFO:tasks.ceph.osd.0:Started 2024-05-07T13:55:30.879 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-07T13:55:30.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-07T13:55:30.882 INFO:tasks.ceph.osd.1:Started 2024-05-07T13:55:30.882 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-07T13:55:30.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-07T13:55:30.885 INFO:tasks.ceph.osd.2:Started 2024-05-07T13:55:30.885 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-07T13:55:30.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-07T13:55:30.888 INFO:tasks.ceph.osd.3:Started 2024-05-07T13:55:30.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T13:55:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.016+0000 7f6158031640 1 Processor -- start 2024-05-07T13:55:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.016+0000 7f6158031640 1 -- start start 2024-05-07T13:55:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.016+0000 7f6158031640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f615012e460 0x7f6150130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.016+0000 7f6158031640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6150071020 con 0x7f6150127ea0 2024-05-07T13:55:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.016+0000 7f6158031640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f6150071780 con 0x7f615012e460 2024-05-07T13:55:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.016+0000 7f61555cc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f615012e460 0x7f6150130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.016+0000 7f6155dcd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6150127ea0 0x7f6150128280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60116/0 (socket says 172.21.15.22:60116) 2024-05-07T13:55:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.017+0000 7f6155dcd640 1 -- 172.21.15.22:0/2744323633 learned_addr learned my addr 172.21.15.22:0/2744323633 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:31.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.017+0000 7f61555cc640 1 -- 172.21.15.22:0/2744323633 >> v1:172.21.15.22:6789/0 conn(0x7f6150127ea0 legacy=0x7f6150128280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:31.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.017+0000 7f61555cc640 1 -- 172.21.15.22:0/2744323633 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615006e6e0 con 0x7f615012e460 2024-05-07T13:55:31.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f61555cc640 1 --2- 172.21.15.22:0/2744323633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615012e460 0x7f6150130850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6140009720 tx=0x7f614002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7474176a118bc256 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:31.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6154dcb640 1 -- 172.21.15.22:0/2744323633 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6140035020 con 0x7f615012e460 2024-05-07T13:55:31.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6154dcb640 1 -- 172.21.15.22:0/2744323633 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6140031760 con 0x7f615012e460 2024-05-07T13:55:31.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6154dcb640 1 -- 172.21.15.22:0/2744323633 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6140031a60 con 0x7f615012e460 2024-05-07T13:55:31.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6158031640 1 -- 172.21.15.22:0/2744323633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615012e460 msgr2=0x7f6150130850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:31.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6158031640 1 --2- 172.21.15.22:0/2744323633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615012e460 0x7f6150130850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6140009720 tx=0x7f614002b8d0 comp rx=0 tx=0).stop 2024-05-07T13:55:31.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6158031640 1 -- 172.21.15.22:0/2744323633 shutdown_connections 2024-05-07T13:55:31.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6158031640 1 --2- 172.21.15.22:0/2744323633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615012e460 0x7f6150130850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:31.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6158031640 1 -- 172.21.15.22:0/2744323633 >> 172.21.15.22:0/2744323633 conn(0x7f6150099380 msgr2=0x7f6150099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:31.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6158031640 1 -- 172.21.15.22:0/2744323633 shutdown_connections 2024-05-07T13:55:31.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.018+0000 7f6158031640 1 -- 172.21.15.22:0/2744323633 wait complete. 2024-05-07T13:55:31.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.019+0000 7f6158031640 1 Processor -- start 2024-05-07T13:55:31.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.019+0000 7f6158031640 1 -- start start 2024-05-07T13:55:31.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f6158031640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6150127ea0 0x7f61501225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:31.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f6158031640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61500725d0 con 0x7f6150127ea0 2024-05-07T13:55:31.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f6155dcd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6150127ea0 0x7f61501225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:31.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f6155dcd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6150127ea0 0x7f61501225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58478/0 (socket says 172.21.15.22:58478) 2024-05-07T13:55:31.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f6155dcd640 1 -- 172.21.15.22:0/3551064272 learned_addr learned my addr 172.21.15.22:0/3551064272 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:31.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f6155dcd640 1 -- 172.21.15.22:0/3551064272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615012b0a0 con 0x7f6150127ea0 2024-05-07T13:55:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f6155dcd640 1 --2- 172.21.15.22:0/3551064272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6150127ea0 0x7f61501225d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c4a0 tx=0x7f614c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f61467fc640 1 -- 172.21.15.22:0/3551064272 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c017070 con 0x7f6150127ea0 2024-05-07T13:55:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f61467fc640 1 -- 172.21.15.22:0/3551064272 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c005c10 con 0x7f6150127ea0 2024-05-07T13:55:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f6158031640 1 -- 172.21.15.22:0/3551064272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615012b860 con 0x7f6150127ea0 2024-05-07T13:55:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f61467fc640 1 -- 172.21.15.22:0/3551064272 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c007070 con 0x7f6150127ea0 2024-05-07T13:55:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.020+0000 7f6158031640 1 -- 172.21.15.22:0/3551064272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6150122b10 con 0x7f6150127ea0 2024-05-07T13:55:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.021+0000 7f61467fc640 1 -- 172.21.15.22:0/3551064272 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f614c01a070 con 0x7f6150127ea0 2024-05-07T13:55:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.021+0000 7f61467fc640 1 -- 172.21.15.22:0/3551064272 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f614c01c440 con 0x7f6150127ea0 2024-05-07T13:55:31.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.021+0000 7f6158031640 1 -- 172.21.15.22:0/3551064272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6150124e00 con 0x7f6150127ea0 2024-05-07T13:55:31.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.023+0000 7f61467fc640 1 -- 172.21.15.22:0/3551064272 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f614c01cb50 con 0x7f6150127ea0 2024-05-07T13:55:31.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.085+0000 7f6158031640 1 -- 172.21.15.22:0/3551064272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6150062e90 con 0x7f6150127ea0 2024-05-07T13:55:31.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.086+0000 7f61467fc640 1 -- 172.21.15.22:0/3551064272 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f614c01cd30 con 0x7f6150127ea0 2024-05-07T13:55:31.073 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:31.074 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":6,"fsid":"454556b8-fea2-4140-96b4-1e350fef55bd","created":"2024-05-07T13:55:29.783021+0000","modified":"2024-05-07T13:55:30.874816+0000","last_up_change":"0.000000","last_in_change":"2024-05-07T13:55:30.874816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dfafa174-71f4-467c-a8c9-5a236b7ce235","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"50061477-74f3-4cad-83da-eeee2d48855f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"20fbf061-68f0-40bb-8c65-b73c4e479b8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8a563741-f524-4dcb-930d-b520f14dc3fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T13:55:31.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.086+0000 7f6158031640 1 -- 172.21.15.22:0/3551064272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6150127ea0 msgr2=0x7f61501225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:31.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.086+0000 7f6158031640 1 --2- 172.21.15.22:0/3551064272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6150127ea0 0x7f61501225d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c4a0 tx=0x7f614c00c960 comp rx=0 tx=0).stop 2024-05-07T13:55:31.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.086+0000 7f6158031640 1 -- 172.21.15.22:0/3551064272 shutdown_connections 2024-05-07T13:55:31.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.086+0000 7f6158031640 1 --2- 172.21.15.22:0/3551064272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6150127ea0 0x7f61501225d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:31.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.086+0000 7f6158031640 1 -- 172.21.15.22:0/3551064272 >> 172.21.15.22:0/3551064272 conn(0x7f6150099380 msgr2=0x7f615006fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:31.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.086+0000 7f6158031640 1 -- 172.21.15.22:0/3551064272 shutdown_connections 2024-05-07T13:55:31.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:31.086+0000 7f6158031640 1 -- 172.21.15.22:0/3551064272 wait complete. 2024-05-07T13:55:31.085 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-07T13:55:31.085 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-07T13:55:31.234 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:31.246+0000 7fe3dc231040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-07T13:55:31.326 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:31.337+0000 7fe3dc231040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-07T13:55:31.370 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:31.382+0000 7fe3dc231040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-07T13:55:31.480 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-05-07T13:55:31.492+0000 7fc234901640 -1 Falling back to public interface 2024-05-07T13:55:31.483 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-05-07T13:55:31.494+0000 7f123d207640 -1 Falling back to public interface 2024-05-07T13:55:31.486 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-05-07T13:55:31.498+0000 7f01dbf80640 -1 Falling back to public interface 2024-05-07T13:55:31.488 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-07T13:55:31.489 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-05-07T13:55:31.499+0000 7f93ef60c640 -1 Falling back to public interface 2024-05-07T13:55:31.546 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:31.558+0000 7fe3dc231040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-07T13:55:31.585 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.596+0000 7f389f04a640 1 Processor -- start 2024-05-07T13:55:31.585 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f389f04a640 1 -- start start 2024-05-07T13:55:31.585 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f389f04a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3898094560 0x7f3898094940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:31.585 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f389f04a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3898095f50 con 0x7f3898094e80 2024-05-07T13:55:31.585 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f389f04a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f3898093e90 con 0x7f3898094560 2024-05-07T13:55:31.585 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f389cde6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3898094560 0x7f3898094940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:31.585 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f3897fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3898094e80 0x7f3898132df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60124/0 (socket says 172.21.15.22:60124) 2024-05-07T13:55:31.585 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f3897fff640 1 -- 172.21.15.22:0/2311540998 learned_addr learned my addr 172.21.15.22:0/2311540998 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:31.585 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f389cde6640 1 -- 172.21.15.22:0/2311540998 >> v1:172.21.15.22:6789/0 conn(0x7f3898094e80 legacy=0x7f3898132df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:31.586 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f38977fe640 1 -- 172.21.15.22:0/2311540998 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314718011 0 0) 0x7f3898095f50 con 0x7f3898094e80 2024-05-07T13:55:31.586 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.597+0000 7f389cde6640 1 -- 172.21.15.22:0/2311540998 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3898095d00 con 0x7f3898094560 2024-05-07T13:55:31.587 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.598+0000 7f389cde6640 1 --2- 172.21.15.22:0/2311540998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 0x7f3898094940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3888009720 tx=0x7f388802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb9236c54a836c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:31.587 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.598+0000 7f38977fe640 1 -- 172.21.15.22:0/2311540998 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38880316d0 con 0x7f3898094560 2024-05-07T13:55:31.587 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.598+0000 7f38977fe640 1 -- 172.21.15.22:0/2311540998 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888037070 con 0x7f3898094560 2024-05-07T13:55:31.587 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.598+0000 7f38977fe640 1 -- 172.21.15.22:0/2311540998 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38880319c0 con 0x7f3898094560 2024-05-07T13:55:31.587 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.599+0000 7f389f04a640 1 -- 172.21.15.22:0/2311540998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 msgr2=0x7f3898094940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:31.587 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.599+0000 7f389f04a640 1 --2- 172.21.15.22:0/2311540998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 0x7f3898094940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3888009720 tx=0x7f388802b840 comp rx=0 tx=0).stop 2024-05-07T13:55:31.588 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.599+0000 7f389f04a640 1 -- 172.21.15.22:0/2311540998 shutdown_connections 2024-05-07T13:55:31.588 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.599+0000 7f389f04a640 1 --2- 172.21.15.22:0/2311540998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 0x7f3898094940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:31.588 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.599+0000 7f389f04a640 1 -- 172.21.15.22:0/2311540998 >> 172.21.15.22:0/2311540998 conn(0x7f389809d060 msgr2=0x7f389809d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:31.588 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.599+0000 7f389f04a640 1 -- 172.21.15.22:0/2311540998 shutdown_connections 2024-05-07T13:55:31.588 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.599+0000 7f389f04a640 1 -- 172.21.15.22:0/2311540998 wait complete. 2024-05-07T13:55:31.588 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.600+0000 7f389f04a640 1 Processor -- start 2024-05-07T13:55:31.588 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.600+0000 7f389f04a640 1 -- start start 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.600+0000 7f389f04a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 0x7f38981bf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.600+0000 7f389f04a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f38980967b0 con 0x7f3898094560 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.600+0000 7f389cde6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 0x7f38981bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f389cde6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 0x7f38981bf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58488/0 (socket says 172.21.15.22:58488) 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f389cde6640 1 -- 172.21.15.22:0/2682550917 learned_addr learned my addr 172.21.15.22:0/2682550917 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f389cde6640 1 -- 172.21.15.22:0/2682550917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38981aac20 con 0x7f3898094560 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f389cde6640 1 --2- 172.21.15.22:0/2682550917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 0x7f38981bf990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3888034040 tx=0x7f38880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f38957fa640 1 -- 172.21.15.22:0/2682550917 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3888032770 con 0x7f3898094560 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f38957fa640 1 -- 172.21.15.22:0/2682550917 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888032910 con 0x7f3898094560 2024-05-07T13:55:31.590 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f389f04a640 1 -- 172.21.15.22:0/2682550917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38981a91e0 con 0x7f3898094560 2024-05-07T13:55:31.591 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f38957fa640 1 -- 172.21.15.22:0/2682550917 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3888032c30 con 0x7f3898094560 2024-05-07T13:55:31.591 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f389f04a640 1 -- 172.21.15.22:0/2682550917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38981aaec0 con 0x7f3898094560 2024-05-07T13:55:31.591 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f38957fa640 1 -- 172.21.15.22:0/2682550917 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f388804c060 con 0x7f3898094560 2024-05-07T13:55:31.591 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.601+0000 7f38957fa640 1 -- 172.21.15.22:0/2682550917 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f388802f050 con 0x7f3898094560 2024-05-07T13:55:31.591 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.602+0000 7f389f04a640 1 -- 172.21.15.22:0/2682550917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3898062e90 con 0x7f3898094560 2024-05-07T13:55:31.591 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.604+0000 7f38957fa640 1 -- 172.21.15.22:0/2682550917 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3888064dd0 con 0x7f3898094560 2024-05-07T13:55:31.599 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:31.607+0000 7fe3dc231040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-07T13:55:31.652 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:31.663+0000 7fe3dc231040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-07T13:55:31.653 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.666+0000 7f389f04a640 1 -- 172.21.15.22:0/2682550917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38981a8a30 con 0x7f3898094560 2024-05-07T13:55:31.653 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.666+0000 7f38957fa640 1 -- 172.21.15.22:0/2682550917 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f3888053030 con 0x7f3898094560 2024-05-07T13:55:31.653 INFO:teuthology.misc.health.smithi022.stdout: 2024-05-07T13:55:31.654 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":6,"fsid":"454556b8-fea2-4140-96b4-1e350fef55bd","created":"2024-05-07T13:55:29.783021+0000","modified":"2024-05-07T13:55:30.874816+0000","last_up_change":"0.000000","last_in_change":"2024-05-07T13:55:30.874816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dfafa174-71f4-467c-a8c9-5a236b7ce235","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"50061477-74f3-4cad-83da-eeee2d48855f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"20fbf061-68f0-40bb-8c65-b73c4e479b8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8a563741-f524-4dcb-930d-b520f14dc3fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T13:55:31.655 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.667+0000 7f389f04a640 1 -- 172.21.15.22:0/2682550917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 msgr2=0x7f38981bf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:31.655 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.667+0000 7f389f04a640 1 --2- 172.21.15.22:0/2682550917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 0x7f38981bf990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3888034040 tx=0x7f38880046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:31.655 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.667+0000 7f389f04a640 1 -- 172.21.15.22:0/2682550917 shutdown_connections 2024-05-07T13:55:31.655 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.667+0000 7f389f04a640 1 --2- 172.21.15.22:0/2682550917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3898094560 0x7f38981bf990 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:31.655 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.667+0000 7f389f04a640 1 -- 172.21.15.22:0/2682550917 >> 172.21.15.22:0/2682550917 conn(0x7f389809d060 msgr2=0x7f38980915d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:31.655 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.667+0000 7f389f04a640 1 -- 172.21.15.22:0/2682550917 shutdown_connections 2024-05-07T13:55:31.655 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:31.667+0000 7f389f04a640 1 -- 172.21.15.22:0/2682550917 wait complete. 2024-05-07T13:55:31.663 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-07T13:55:31.769 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:31.781+0000 7fe3dc231040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-07T13:55:32.171 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:32.183+0000 7fe3dc231040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-07T13:55:32.444 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:32.455+0000 7fe3dc231040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-07T13:55:32.499 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:32.510+0000 7fe3dc231040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-07T13:55:32.621 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:32.633+0000 7fe3dc231040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-07T13:55:32.928 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:32.940+0000 7fe3dc231040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-07T13:55:32.979 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:32.990+0000 7fe3dc231040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-07T13:55:33.143 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:33.155+0000 7fe3dc231040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-07T13:55:33.288 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:33.299+0000 7fe3dc231040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-07T13:55:33.340 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:33.352+0000 7fe3dc231040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-07T13:55:33.414 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:33.425+0000 7fe3dc231040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-07T13:55:33.462 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:33.473+0000 7fe3dc231040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-07T13:55:33.963 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:33.975+0000 7fe3dc231040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-07T13:55:34.084 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:34.096+0000 7fe3dc231040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-07T13:55:34.929 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-05-07T13:55:34.942+0000 7fc234901640 -1 osd.0 0 log_to_monitors true 2024-05-07T13:55:34.956 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-05-07T13:55:34.968+0000 7f93ef60c640 -1 osd.3 0 log_to_monitors true 2024-05-07T13:55:34.979 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-05-07T13:55:34.990+0000 7f123d207640 -1 osd.1 0 log_to_monitors true 2024-05-07T13:55:34.995 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-05-07T13:55:35.006+0000 7f01dbf80640 -1 osd.2 0 log_to_monitors true 2024-05-07T13:55:35.094 INFO:tasks.ceph.mgr.x.smithi050.stderr:2024-05-07T13:55:35.105+0000 7fe37c659640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-07T13:55:37.019 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-05-07T13:55:37.031+0000 7fc230074640 -1 osd.0 0 waiting for initial osdmap 2024-05-07T13:55:37.038 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-05-07T13:55:37.050+0000 7fc2286a6640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T13:55:37.312 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-05-07T13:55:37.323+0000 7f93ebed6640 -1 osd.3 0 waiting for initial osdmap 2024-05-07T13:55:37.325 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-05-07T13:55:37.337+0000 7f93e2cd0640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T13:55:37.336 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-05-07T13:55:37.347+0000 7f123897a640 -1 osd.1 0 waiting for initial osdmap 2024-05-07T13:55:37.346 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-05-07T13:55:37.358+0000 7f1230fac640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T13:55:37.699 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-05-07T13:55:37.711+0000 7f01d76f3640 -1 osd.2 0 waiting for initial osdmap 2024-05-07T13:55:37.710 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-05-07T13:55:37.722+0000 7f01cfd25640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T13:55:38.068 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-07T13:55:38.175 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.186+0000 7f3a7075b640 1 Processor -- start 2024-05-07T13:55:38.175 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.186+0000 7f3a7075b640 1 -- start start 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.187+0000 7f3a7075b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a68093770 0x7f3a68093b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.187+0000 7f3a7075b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a68092d50 con 0x7f3a68094c30 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.187+0000 7f3a7075b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f3a6806b510 con 0x7f3a68093770 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.187+0000 7f3a6e4f7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a68093770 0x7f3a68093b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.187+0000 7f3a6dcf6640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3a68094c30 0x7f3a6812c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51828/0 (socket says 172.21.15.22:51828) 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.187+0000 7f3a6dcf6640 1 -- 172.21.15.22:0/3843917274 learned_addr learned my addr 172.21.15.22:0/3843917274 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.187+0000 7f3a6e4f7640 1 -- 172.21.15.22:0/3843917274 >> v1:172.21.15.22:6789/0 conn(0x7f3a68094c30 legacy=0x7f3a6812c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.188+0000 7f3a6e4f7640 1 -- 172.21.15.22:0/3843917274 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a680925f0 con 0x7f3a68093770 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.188+0000 7f3a6d4f5640 1 -- 172.21.15.22:0/3843917274 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062457086 0 0) 0x7f3a68092d50 con 0x7f3a68094c30 2024-05-07T13:55:38.177 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.188+0000 7f3a6e4f7640 1 --2- 172.21.15.22:0/3843917274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 0x7f3a68093b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009d90 tx=0x7f3a6402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f54dff31d23cfaf server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:38.178 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.188+0000 7f3a6d4f5640 1 -- 172.21.15.22:0/3843917274 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a64039070 con 0x7f3a68093770 2024-05-07T13:55:38.178 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.189+0000 7f3a6d4f5640 1 -- 172.21.15.22:0/3843917274 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6402cb10 con 0x7f3a68093770 2024-05-07T13:55:38.178 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.189+0000 7f3a6d4f5640 1 -- 172.21.15.22:0/3843917274 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a6402ce10 con 0x7f3a68093770 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.189+0000 7f3a7075b640 1 -- 172.21.15.22:0/3843917274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 msgr2=0x7f3a68093b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.189+0000 7f3a7075b640 1 --2- 172.21.15.22:0/3843917274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 0x7f3a68093b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009d90 tx=0x7f3a6402beb0 comp rx=0 tx=0).stop 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.189+0000 7f3a7075b640 1 -- 172.21.15.22:0/3843917274 shutdown_connections 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.189+0000 7f3a7075b640 1 --2- 172.21.15.22:0/3843917274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 0x7f3a68093b50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.189+0000 7f3a7075b640 1 -- 172.21.15.22:0/3843917274 >> 172.21.15.22:0/3843917274 conn(0x7f3a6809a170 msgr2=0x7f3a6809a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.189+0000 7f3a7075b640 1 -- 172.21.15.22:0/3843917274 shutdown_connections 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.189+0000 7f3a7075b640 1 -- 172.21.15.22:0/3843917274 wait complete. 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.190+0000 7f3a7075b640 1 Processor -- start 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.190+0000 7f3a7075b640 1 -- start start 2024-05-07T13:55:38.180 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.190+0000 7f3a7075b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 0x7f3a6808e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.190+0000 7f3a7075b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68094420 con 0x7f3a68093770 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a6e4f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 0x7f3a6808e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a6e4f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 0x7f3a6808e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45712/0 (socket says 172.21.15.22:45712) 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a6e4f7640 1 -- 172.21.15.22:0/573337851 learned_addr learned my addr 172.21.15.22:0/573337851 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a6e4f7640 1 -- 172.21.15.22:0/573337851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a68090920 con 0x7f3a68093770 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a6e4f7640 1 --2- 172.21.15.22:0/573337851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 0x7f3a6808e240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3a64037040 tx=0x7f3a64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a5effd640 1 -- 172.21.15.22:0/573337851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a64044030 con 0x7f3a68093770 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a5effd640 1 -- 172.21.15.22:0/573337851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6403f5a0 con 0x7f3a68093770 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6808fdc0 con 0x7f3a68093770 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a5effd640 1 -- 172.21.15.22:0/573337851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a64039040 con 0x7f3a68093770 2024-05-07T13:55:38.181 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.191+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a68091f50 con 0x7f3a68093770 2024-05-07T13:55:38.182 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.192+0000 7f3a5effd640 1 -- 172.21.15.22:0/573337851 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f3a64047070 con 0x7f3a68093770 2024-05-07T13:55:38.182 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.192+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a68062e90 con 0x7f3a68093770 2024-05-07T13:55:38.182 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.192+0000 7f3a5effd640 1 --2- 172.21.15.22:0/573337851 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3a4c037fd0 0x7f3a4c03a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:38.182 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.192+0000 7f3a5effd640 1 -- 172.21.15.22:0/573337851 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7f3a64045070 con 0x7f3a68093770 2024-05-07T13:55:38.182 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.193+0000 7f3a6dcf6640 1 --2- 172.21.15.22:0/573337851 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3a4c037fd0 0x7f3a4c03a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:38.182 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.193+0000 7f3a6dcf6640 1 --2- 172.21.15.22:0/573337851 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3a4c037fd0 0x7f3a4c03a490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3a58000c00 tx=0x7f3a58007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:38.186 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.198+0000 7f3a5effd640 1 -- 172.21.15.22:0/573337851 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3a6404e070 con 0x7f3a68093770 2024-05-07T13:55:38.370 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.382+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a6804f5f0 con 0x7f3a68093770 2024-05-07T13:55:38.371 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.383+0000 7f3a5effd640 1 -- 172.21.15.22:0/573337851 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+6068 (secure 0 0 0) 0x7f3a640462c0 con 0x7f3a68093770 2024-05-07T13:55:38.371 INFO:teuthology.misc.health.smithi022.stdout: 2024-05-07T13:55:38.371 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":9,"fsid":"454556b8-fea2-4140-96b4-1e350fef55bd","created":"2024-05-07T13:55:29.783021+0000","modified":"2024-05-07T13:55:38.033428+0000","last_up_change":"2024-05-07T13:55:38.033428+0000","last_in_change":"2024-05-07T13:55:30.874816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dfafa174-71f4-467c-a8c9-5a236b7ce235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6801","nonce":2215278347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6803","nonce":2215278347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6807","nonce":2215278347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6805","nonce":2215278347}]},"public_addr":"172.21.15.22:6801/2215278347","cluster_addr":"172.21.15.22:6803/2215278347","heartbeat_back_addr":"172.21.15.22:6807/2215278347","heartbeat_front_addr":"172.21.15.22:6805/2215278347","state":["exists","up"]},{"osd":1,"uuid":"50061477-74f3-4cad-83da-eeee2d48855f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6801","nonce":3441257969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6803","nonce":3441257969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6807","nonce":3441257969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6805","nonce":3441257969}]},"public_addr":"172.21.15.50:6801/3441257969","cluster_addr":"172.21.15.50:6803/3441257969","heartbeat_back_addr":"172.21.15.50:6807/3441257969","heartbeat_front_addr":"172.21.15.50:6805/3441257969","state":["exists","up"]},{"osd":2,"uuid":"20fbf061-68f0-40bb-8c65-b73c4e479b8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6809","nonce":2034796854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6811","nonce":2034796854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6817","nonce":2034796854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6813","nonce":2034796854}]},"public_addr":"172.21.15.50:6809/2034796854","cluster_addr":"172.21.15.50:6811/2034796854","heartbeat_back_addr":"172.21.15.50:6817/2034796854","heartbeat_front_addr":"172.21.15.50:6813/2034796854","state":["exists","up"]},{"osd":3,"uuid":"8a563741-f524-4dcb-930d-b520f14dc3fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6816","nonce":3553060046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6819","nonce":3553060046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6823","nonce":3553060046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6821","nonce":3553060046}]},"public_addr":"172.21.15.50:6816/3553060046","cluster_addr":"172.21.15.50:6819/3553060046","heartbeat_back_addr":"172.21.15.50:6823/3553060046","heartbeat_front_addr":"172.21.15.50:6821/3553060046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T13:55:38.373 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.384+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3a4c037fd0 msgr2=0x7f3a4c03a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:38.373 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.384+0000 7f3a7075b640 1 --2- 172.21.15.22:0/573337851 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3a4c037fd0 0x7f3a4c03a490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3a58000c00 tx=0x7f3a58007970 comp rx=0 tx=0).stop 2024-05-07T13:55:38.373 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.384+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 msgr2=0x7f3a6808e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:38.373 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.384+0000 7f3a7075b640 1 --2- 172.21.15.22:0/573337851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 0x7f3a6808e240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3a64037040 tx=0x7f3a64004a40 comp rx=0 tx=0).stop 2024-05-07T13:55:38.373 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.384+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 shutdown_connections 2024-05-07T13:55:38.373 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.384+0000 7f3a7075b640 1 --2- 172.21.15.22:0/573337851 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3a4c037fd0 0x7f3a4c03a490 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:38.374 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.384+0000 7f3a7075b640 1 --2- 172.21.15.22:0/573337851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a68093770 0x7f3a6808e240 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:38.374 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.384+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 >> 172.21.15.22:0/573337851 conn(0x7f3a6809a170 msgr2=0x7f3a681b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:38.374 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.385+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 shutdown_connections 2024-05-07T13:55:38.374 INFO:teuthology.misc.health.smithi022.stderr:2024-05-07T13:55:38.385+0000 7f3a7075b640 1 -- 172.21.15.22:0/573337851 wait complete. 2024-05-07T13:55:38.382 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-05-07T13:55:38.383 INFO:tasks.ceph:Creating RBD pool 2024-05-07T13:55:38.383 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.496+0000 7fb0aaf80640 1 Processor -- start 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.496+0000 7fb0aaf80640 1 -- start start 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.497+0000 7fb0aaf80640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb0a406d480 0x7fb0a406d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.497+0000 7fb0aaf80640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a4098840 con 0x7fb0a40710f0 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.497+0000 7fb0aaf80640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a4072040 con 0x7fb0a406d480 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.497+0000 7fb0a8d1c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb0a406d480 0x7fb0a406d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.497+0000 7fb0a3fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb0a40710f0 0x7fb0a4096090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51834/0 (socket says 172.21.15.22:51834) 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.497+0000 7fb0a3fff640 1 -- 172.21.15.22:0/1631556103 learned_addr learned my addr 172.21.15.22:0/1631556103 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.497+0000 7fb0a8d1c640 1 -- 172.21.15.22:0/1631556103 >> v1:172.21.15.22:6789/0 conn(0x7fb0a40710f0 legacy=0x7fb0a4096090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.497+0000 7fb0a8d1c640 1 -- 172.21.15.22:0/1631556103 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a4070b20 con 0x7fb0a406d480 2024-05-07T13:55:38.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.497+0000 7fb0a37fe640 1 -- 172.21.15.22:0/1631556103 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3154097523 0 0) 0x7fb0a4098840 con 0x7fb0a40710f0 2024-05-07T13:55:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.498+0000 7fb0a8d1c640 1 --2- 172.21.15.22:0/1631556103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 0x7fb0a406d860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb094009720 tx=0x7fb09402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe08fe1388a1847f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.498+0000 7fb0a37fe640 1 -- 172.21.15.22:0/1631556103 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0940316d0 con 0x7fb0a406d480 2024-05-07T13:55:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.498+0000 7fb0a37fe640 1 -- 172.21.15.22:0/1631556103 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb094037070 con 0x7fb0a406d480 2024-05-07T13:55:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.498+0000 7fb0a37fe640 1 -- 172.21.15.22:0/1631556103 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0940319c0 con 0x7fb0a406d480 2024-05-07T13:55:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.498+0000 7fb0aaf80640 1 -- 172.21.15.22:0/1631556103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 msgr2=0x7fb0a406d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.498+0000 7fb0aaf80640 1 --2- 172.21.15.22:0/1631556103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 0x7fb0a406d860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb094009720 tx=0x7fb09402b840 comp rx=0 tx=0).stop 2024-05-07T13:55:38.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.499+0000 7fb0aaf80640 1 -- 172.21.15.22:0/1631556103 shutdown_connections 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.499+0000 7fb0aaf80640 1 --2- 172.21.15.22:0/1631556103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 0x7fb0a406d860 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.499+0000 7fb0aaf80640 1 -- 172.21.15.22:0/1631556103 >> 172.21.15.22:0/1631556103 conn(0x7fb0a40996c0 msgr2=0x7fb0a4099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.499+0000 7fb0aaf80640 1 -- 172.21.15.22:0/1631556103 shutdown_connections 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.499+0000 7fb0aaf80640 1 -- 172.21.15.22:0/1631556103 wait complete. 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.499+0000 7fb0aaf80640 1 Processor -- start 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.499+0000 7fb0aaf80640 1 -- start start 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.500+0000 7fb0aaf80640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 0x7fb0a406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.500+0000 7fb0aaf80640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a406df20 con 0x7fb0a406d480 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.500+0000 7fb0a8d1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 0x7fb0a406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.500+0000 7fb0a8d1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 0x7fb0a406e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45742/0 (socket says 172.21.15.22:45742) 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.500+0000 7fb0a8d1c640 1 -- 172.21.15.22:0/2380617079 learned_addr learned my addr 172.21.15.22:0/2380617079 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.500+0000 7fb0a8d1c640 1 -- 172.21.15.22:0/2380617079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a4070140 con 0x7fb0a406d480 2024-05-07T13:55:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.501+0000 7fb0a8d1c640 1 --2- 172.21.15.22:0/2380617079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 0x7fb0a406e5c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb09402b880 tx=0x7fb0940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.501+0000 7fb0a17fa640 1 -- 172.21.15.22:0/2380617079 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094004160 con 0x7fb0a406d480 2024-05-07T13:55:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.501+0000 7fb0a17fa640 1 -- 172.21.15.22:0/2380617079 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb094004300 con 0x7fb0a406d480 2024-05-07T13:55:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.501+0000 7fb0a17fa640 1 -- 172.21.15.22:0/2380617079 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094032640 con 0x7fb0a406d480 2024-05-07T13:55:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.501+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a41253e0 con 0x7fb0a406d480 2024-05-07T13:55:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.501+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a406ece0 con 0x7fb0a406d480 2024-05-07T13:55:38.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.502+0000 7fb0a17fa640 1 -- 172.21.15.22:0/2380617079 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7fb0940327e0 con 0x7fb0a406d480 2024-05-07T13:55:38.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.502+0000 7fb0a17fa640 1 --2- 172.21.15.22:0/2380617079 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090037fd0 0x7fb09003a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:38.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.502+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a4062e90 con 0x7fb0a406d480 2024-05-07T13:55:38.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.502+0000 7fb0a17fa640 1 -- 172.21.15.22:0/2380617079 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7fb09402f050 con 0x7fb0a406d480 2024-05-07T13:55:38.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.502+0000 7fb0a3fff640 1 --2- 172.21.15.22:0/2380617079 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090037fd0 0x7fb09003a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:38.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.503+0000 7fb0a3fff640 1 --2- 172.21.15.22:0/2380617079 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090037fd0 0x7fb09003a490 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb098000c00 tx=0x7fb098007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:38.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.507+0000 7fb0a17fa640 1 -- 172.21.15.22:0/2380617079 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb094041070 con 0x7fb0a406d480 2024-05-07T13:55:38.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:38.688+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fb0a40008d0 con 0x7fb0a406d480 2024-05-07T13:55:39.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.034+0000 7fb0a17fa640 1 -- 172.21.15.22:0/2380617079 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) ==== 109+0+0 (secure 0 0 0) 0x7fb094003610 con 0x7fb0a406d480 2024-05-07T13:55:39.022 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'rbd' created 2024-05-07T13:55:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090037fd0 msgr2=0x7fb09003a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 --2- 172.21.15.22:0/2380617079 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090037fd0 0x7fb09003a490 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb098000c00 tx=0x7fb098007910 comp rx=0 tx=0).stop 2024-05-07T13:55:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 msgr2=0x7fb0a406e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 --2- 172.21.15.22:0/2380617079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 0x7fb0a406e5c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb09402b880 tx=0x7fb0940046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 shutdown_connections 2024-05-07T13:55:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 --2- 172.21.15.22:0/2380617079 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090037fd0 0x7fb09003a490 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 --2- 172.21.15.22:0/2380617079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0a406d480 0x7fb0a406e5c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 >> 172.21.15.22:0/2380617079 conn(0x7fb0a40996c0 msgr2=0x7fb0a4128880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 shutdown_connections 2024-05-07T13:55:39.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.036+0000 7fb0aaf80640 1 -- 172.21.15.22:0/2380617079 wait complete. 2024-05-07T13:55:39.037 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-07T13:55:39.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.156+0000 7f915cae6640 1 Processor -- start 2024-05-07T13:55:39.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.156+0000 7f915cae6640 1 -- start start 2024-05-07T13:55:39.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.156+0000 7f915cae6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9158128f40 0x7f9158129320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:39.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.156+0000 7f915cae6640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91581230b0 con 0x7f915812bfd0 2024-05-07T13:55:39.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.156+0000 7f915cae6640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f91580722f0 con 0x7f9158128f40 2024-05-07T13:55:39.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.157+0000 7f915659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9158128f40 0x7f9158129320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:39.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.157+0000 7f9155d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f915812bfd0 0x7f915812c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51850/0 (socket says 172.21.15.22:51850) 2024-05-07T13:55:39.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.157+0000 7f9155d9b640 1 -- 172.21.15.22:0/873294485 learned_addr learned my addr 172.21.15.22:0/873294485 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:39.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.157+0000 7f915659c640 1 -- 172.21.15.22:0/873294485 >> v1:172.21.15.22:6789/0 conn(0x7f915812bfd0 legacy=0x7f915812c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:39.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.157+0000 7f915659c640 1 -- 172.21.15.22:0/873294485 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915806f970 con 0x7f9158128f40 2024-05-07T13:55:39.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915659c640 1 --2- 172.21.15.22:0/873294485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 0x7f9158129320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9148009720 tx=0x7f914802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28be55c52d1b8a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:39.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915559a640 1 -- 172.21.15.22:0/873294485 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91480316d0 con 0x7f9158128f40 2024-05-07T13:55:39.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915559a640 1 -- 172.21.15.22:0/873294485 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9148037070 con 0x7f9158128f40 2024-05-07T13:55:39.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915559a640 1 -- 172.21.15.22:0/873294485 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91480319c0 con 0x7f9158128f40 2024-05-07T13:55:39.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915cae6640 1 -- 172.21.15.22:0/873294485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 msgr2=0x7f9158129320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:39.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915cae6640 1 --2- 172.21.15.22:0/873294485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 0x7f9158129320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9148009720 tx=0x7f914802b840 comp rx=0 tx=0).stop 2024-05-07T13:55:39.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915cae6640 1 -- 172.21.15.22:0/873294485 shutdown_connections 2024-05-07T13:55:39.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915cae6640 1 --2- 172.21.15.22:0/873294485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 0x7f9158129320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:39.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915cae6640 1 -- 172.21.15.22:0/873294485 >> 172.21.15.22:0/873294485 conn(0x7f91580991a0 msgr2=0x7f91580995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:39.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915cae6640 1 -- 172.21.15.22:0/873294485 shutdown_connections 2024-05-07T13:55:39.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.158+0000 7f915cae6640 1 -- 172.21.15.22:0/873294485 wait complete. 2024-05-07T13:55:39.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.159+0000 7f915cae6640 1 Processor -- start 2024-05-07T13:55:39.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.159+0000 7f915cae6640 1 -- start start 2024-05-07T13:55:39.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.160+0000 7f915cae6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 0x7f91581c1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:39.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.160+0000 7f915cae6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9158113980 con 0x7f9158128f40 2024-05-07T13:55:39.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.160+0000 7f915659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 0x7f91581c1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:39.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.160+0000 7f915659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 0x7f91581c1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45764/0 (socket says 172.21.15.22:45764) 2024-05-07T13:55:39.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.160+0000 7f915659c640 1 -- 172.21.15.22:0/494839688 learned_addr learned my addr 172.21.15.22:0/494839688 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:39.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.160+0000 7f915659c640 1 -- 172.21.15.22:0/494839688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9158118ff0 con 0x7f9158128f40 2024-05-07T13:55:39.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.160+0000 7f915659c640 1 --2- 172.21.15.22:0/494839688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 0x7f91581c1190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9148000c00 tx=0x7f91480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:39.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.160+0000 7f9146ffd640 1 -- 172.21.15.22:0/494839688 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9148032640 con 0x7f9158128f40 2024-05-07T13:55:39.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.161+0000 7f9146ffd640 1 -- 172.21.15.22:0/494839688 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9148032800 con 0x7f9158128f40 2024-05-07T13:55:39.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.161+0000 7f9146ffd640 1 -- 172.21.15.22:0/494839688 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9148032b20 con 0x7f9158128f40 2024-05-07T13:55:39.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.161+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91581194b0 con 0x7f9158128f40 2024-05-07T13:55:39.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.161+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91581c18b0 con 0x7f9158128f40 2024-05-07T13:55:39.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.161+0000 7f9146ffd640 1 -- 172.21.15.22:0/494839688 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f9148032cc0 con 0x7f9158128f40 2024-05-07T13:55:39.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.161+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9158062e90 con 0x7f9158128f40 2024-05-07T13:55:39.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.162+0000 7f9146ffd640 1 --2- 172.21.15.22:0/494839688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9138037fd0 0x7f913803a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:39.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.162+0000 7f9146ffd640 1 -- 172.21.15.22:0/494839688 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 3460+0+0 (secure 0 0 0) 0x7f914802f050 con 0x7f9158128f40 2024-05-07T13:55:39.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.162+0000 7f9155d9b640 1 --2- 172.21.15.22:0/494839688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9138037fd0 0x7f913803a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:39.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.162+0000 7f9155d9b640 1 --2- 172.21.15.22:0/494839688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9138037fd0 0x7f913803a490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f914c007fd0 tx=0x7f914c007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.167+0000 7f9146ffd640 1 -- 172.21.15.22:0/494839688 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9148040070 con 0x7f9158128f40 2024-05-07T13:55:39.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:39.350+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f915809ba80 con 0x7f9158128f40 2024-05-07T13:55:40.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.035+0000 7f9146ffd640 1 -- 172.21.15.22:0/494839688 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) ==== 173+0+0 (secure 0 0 0) 0x7f914804dd90 con 0x7f9158128f40 2024-05-07T13:55:40.023 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-07T13:55:40.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9138037fd0 msgr2=0x7f913803a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 --2- 172.21.15.22:0/494839688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9138037fd0 0x7f913803a490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f914c007fd0 tx=0x7f914c007ac0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 msgr2=0x7f91581c1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 --2- 172.21.15.22:0/494839688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 0x7f91581c1190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9148000c00 tx=0x7f91480046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 shutdown_connections 2024-05-07T13:55:40.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 --2- 172.21.15.22:0/494839688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9138037fd0 0x7f913803a490 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 --2- 172.21.15.22:0/494839688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9158128f40 0x7f91581c1190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 >> 172.21.15.22:0/494839688 conn(0x7f91580991a0 msgr2=0x7f9158127330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:40.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 shutdown_connections 2024-05-07T13:55:40.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.038+0000 7f915cae6640 1 -- 172.21.15.22:0/494839688 wait complete. 2024-05-07T13:55:40.043 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-07T13:55:40.044 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-07T13:55:40.044 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-07T13:55:40.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-07T13:55:40.045 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-07T13:55:40.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.168+0000 7f3756aeb640 1 Processor -- start 2024-05-07T13:55:40.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.168+0000 7f3756aeb640 1 -- start start 2024-05-07T13:55:40.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.168+0000 7f3756aeb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f375012b590 0x7f375012b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:40.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.169+0000 7f3756aeb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3750070f50 con 0x7f375012e3e0 2024-05-07T13:55:40.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.169+0000 7f3756aeb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f37500706e0 con 0x7f375012b590 2024-05-07T13:55:40.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.169+0000 7f3754887640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f375012b590 0x7f375012b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:40.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.169+0000 7f374ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f375012e3e0 0x7f375012e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51854/0 (socket says 172.21.15.22:51854) 2024-05-07T13:55:40.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.169+0000 7f374ffff640 1 -- 172.21.15.22:0/1676915257 learned_addr learned my addr 172.21.15.22:0/1676915257 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:40.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.169+0000 7f3754887640 1 -- 172.21.15.22:0/1676915257 >> v1:172.21.15.22:6789/0 conn(0x7f375012e3e0 legacy=0x7f375012e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.169+0000 7f3754887640 1 -- 172.21.15.22:0/1676915257 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375009dd00 con 0x7f375012b590 2024-05-07T13:55:40.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.170+0000 7f3754887640 1 --2- 172.21.15.22:0/1676915257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 0x7f375012b970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3744009720 tx=0x7f374402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81475a72e2182ee server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:40.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.170+0000 7f374f7fe640 1 -- 172.21.15.22:0/1676915257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37440316d0 con 0x7f375012b590 2024-05-07T13:55:40.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.170+0000 7f374f7fe640 1 -- 172.21.15.22:0/1676915257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3744037070 con 0x7f375012b590 2024-05-07T13:55:40.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.170+0000 7f374f7fe640 1 -- 172.21.15.22:0/1676915257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37440319c0 con 0x7f375012b590 2024-05-07T13:55:40.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.171+0000 7f3756aeb640 1 -- 172.21.15.22:0/1676915257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 msgr2=0x7f375012b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.171+0000 7f3756aeb640 1 --2- 172.21.15.22:0/1676915257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 0x7f375012b970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3744009720 tx=0x7f374402b840 comp rx=0 tx=0).stop 2024-05-07T13:55:40.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.171+0000 7f3756aeb640 1 -- 172.21.15.22:0/1676915257 shutdown_connections 2024-05-07T13:55:40.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.171+0000 7f3756aeb640 1 --2- 172.21.15.22:0/1676915257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 0x7f375012b970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.171+0000 7f3756aeb640 1 -- 172.21.15.22:0/1676915257 >> 172.21.15.22:0/1676915257 conn(0x7f375009ed60 msgr2=0x7f375009f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:40.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.171+0000 7f3756aeb640 1 -- 172.21.15.22:0/1676915257 shutdown_connections 2024-05-07T13:55:40.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.171+0000 7f3756aeb640 1 -- 172.21.15.22:0/1676915257 wait complete. 2024-05-07T13:55:40.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.172+0000 7f3756aeb640 1 Processor -- start 2024-05-07T13:55:40.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.172+0000 7f3756aeb640 1 -- start start 2024-05-07T13:55:40.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.173+0000 7f3756aeb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 0x7f3750119390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:40.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.173+0000 7f3756aeb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f375012beb0 con 0x7f375012b590 2024-05-07T13:55:40.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.173+0000 7f3754887640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 0x7f3750119390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:40.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.173+0000 7f3754887640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 0x7f3750119390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45782/0 (socket says 172.21.15.22:45782) 2024-05-07T13:55:40.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.173+0000 7f3754887640 1 -- 172.21.15.22:0/1835452567 learned_addr learned my addr 172.21.15.22:0/1835452567 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:40.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.173+0000 7f3754887640 1 -- 172.21.15.22:0/1835452567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375011b0f0 con 0x7f375012b590 2024-05-07T13:55:40.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.174+0000 7f3754887640 1 --2- 172.21.15.22:0/1835452567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 0x7f3750119390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3744034040 tx=0x7f37440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:40.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.174+0000 7f374d7fa640 1 -- 172.21.15.22:0/1835452567 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3744032640 con 0x7f375012b590 2024-05-07T13:55:40.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.174+0000 7f374d7fa640 1 -- 172.21.15.22:0/1835452567 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37440327e0 con 0x7f375012b590 2024-05-07T13:55:40.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.174+0000 7f374d7fa640 1 -- 172.21.15.22:0/1835452567 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3744032ac0 con 0x7f375012b590 2024-05-07T13:55:40.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.174+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375011c930 con 0x7f375012b590 2024-05-07T13:55:40.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.174+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3750119ab0 con 0x7f375012b590 2024-05-07T13:55:40.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.175+0000 7f374d7fa640 1 -- 172.21.15.22:0/1835452567 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f374404c060 con 0x7f375012b590 2024-05-07T13:55:40.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.175+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3750062e90 con 0x7f375012b590 2024-05-07T13:55:40.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.175+0000 7f374d7fa640 1 --2- 172.21.15.22:0/1835452567 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3734037fd0 0x7f373403a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:40.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.175+0000 7f374d7fa640 1 -- 172.21.15.22:0/1835452567 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7f374402f050 con 0x7f375012b590 2024-05-07T13:55:40.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.175+0000 7f374ffff640 1 --2- 172.21.15.22:0/1835452567 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3734037fd0 0x7f373403a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:40.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.176+0000 7f374ffff640 1 --2- 172.21.15.22:0/1835452567 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3734037fd0 0x7f373403a490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f373c005880 tx=0x7f373c007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:40.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.180+0000 7f374d7fa640 1 -- 172.21.15.22:0/1835452567 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3744040070 con 0x7f375012b590 2024-05-07T13:55:40.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.412+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3750073fd0 con 0x7f375012b590 2024-05-07T13:55:40.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.414+0000 7f374d7fa640 1 -- 172.21.15.22:0/1835452567 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) ==== 74+0+87103 (secure 0 0 0) 0x7f3744044c00 con 0x7f375012b590 2024-05-07T13:55:40.404 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.416+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3734037fd0 msgr2=0x7f373403a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.416+0000 7f3756aeb640 1 --2- 172.21.15.22:0/1835452567 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3734037fd0 0x7f373403a490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f373c005880 tx=0x7f373c007a80 comp rx=0 tx=0).stop 2024-05-07T13:55:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.416+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 msgr2=0x7f3750119390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.416+0000 7f3756aeb640 1 --2- 172.21.15.22:0/1835452567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 0x7f3750119390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3744034040 tx=0x7f37440046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.416+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 shutdown_connections 2024-05-07T13:55:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.416+0000 7f3756aeb640 1 --2- 172.21.15.22:0/1835452567 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3734037fd0 0x7f373403a490 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.416+0000 7f3756aeb640 1 --2- 172.21.15.22:0/1835452567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f375012b590 0x7f3750119390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.416+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 >> 172.21.15.22:0/1835452567 conn(0x7f375009ed60 msgr2=0x7f37501b6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.416+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 shutdown_connections 2024-05-07T13:55:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.417+0000 7f3756aeb640 1 -- 172.21.15.22:0/1835452567 wait complete. 2024-05-07T13:55:40.416 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":4,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":985543100},{"type":"v1","addr":"172.21.15.50:6825","nonce":985543100}]},"active_addr":"172.21.15.50:6825/985543100","active_change":"2024-05-07T13:55:34.099284+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2920695016}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":996851897}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2088096142}]}]} 2024-05-07T13:55:40.418 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-07T13:55:40.418 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-07T13:55:40.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T13:55:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.532+0000 7f540e9e6640 1 Processor -- start 2024-05-07T13:55:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.532+0000 7f540e9e6640 1 -- start start 2024-05-07T13:55:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.532+0000 7f540e9e6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f540812c5b0 0x7f540812c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.532+0000 7f540e9e6640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5408113dd0 con 0x7f540812ced0 2024-05-07T13:55:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.532+0000 7f540e9e6640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f5408072290 con 0x7f540812c5b0 2024-05-07T13:55:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.533+0000 7f5407fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f540812c5b0 0x7f540812c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.533+0000 7f54077fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f540812ced0 0x7f540806e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51866/0 (socket says 172.21.15.22:51866) 2024-05-07T13:55:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.533+0000 7f54077fe640 1 -- 172.21.15.22:0/3925031561 learned_addr learned my addr 172.21.15.22:0/3925031561 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.533+0000 7f5407fff640 1 -- 172.21.15.22:0/3925031561 >> v1:172.21.15.22:6789/0 conn(0x7f540812ced0 legacy=0x7f540806e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.533+0000 7f5407fff640 1 -- 172.21.15.22:0/3925031561 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540812c390 con 0x7f540812c5b0 2024-05-07T13:55:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f5407fff640 1 --2- 172.21.15.22:0/3925031561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 0x7f540812c990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009720 tx=0x7f53f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94987a4dfaaba883 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f5406ffd640 1 -- 172.21.15.22:0/3925031561 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f80316d0 con 0x7f540812c5b0 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f5406ffd640 1 -- 172.21.15.22:0/3925031561 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f8037070 con 0x7f540812c5b0 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f5406ffd640 1 -- 172.21.15.22:0/3925031561 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f80319c0 con 0x7f540812c5b0 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f540e9e6640 1 -- 172.21.15.22:0/3925031561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 msgr2=0x7f540812c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f540e9e6640 1 --2- 172.21.15.22:0/3925031561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 0x7f540812c990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009720 tx=0x7f53f802b840 comp rx=0 tx=0).stop 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f540e9e6640 1 -- 172.21.15.22:0/3925031561 shutdown_connections 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f540e9e6640 1 --2- 172.21.15.22:0/3925031561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 0x7f540812c990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f540e9e6640 1 -- 172.21.15.22:0/3925031561 >> 172.21.15.22:0/3925031561 conn(0x7f5408099380 msgr2=0x7f5408099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f540e9e6640 1 -- 172.21.15.22:0/3925031561 shutdown_connections 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.534+0000 7f540e9e6640 1 -- 172.21.15.22:0/3925031561 wait complete. 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.535+0000 7f540e9e6640 1 Processor -- start 2024-05-07T13:55:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.535+0000 7f540e9e6640 1 -- start start 2024-05-07T13:55:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f540e9e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 0x7f54081c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f540e9e6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5408113b10 con 0x7f540812c5b0 2024-05-07T13:55:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f5407fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 0x7f54081c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f5407fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 0x7f54081c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45806/0 (socket says 172.21.15.22:45806) 2024-05-07T13:55:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f5407fff640 1 -- 172.21.15.22:0/4168264438 learned_addr learned my addr 172.21.15.22:0/4168264438 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f5407fff640 1 -- 172.21.15.22:0/4168264438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5408118a00 con 0x7f540812c5b0 2024-05-07T13:55:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f5407fff640 1 --2- 172.21.15.22:0/4168264438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 0x7f54081c13b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53f802b880 tx=0x7f53f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f5404ff9640 1 -- 172.21.15.22:0/4168264438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f8032770 con 0x7f540812c5b0 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f5404ff9640 1 -- 172.21.15.22:0/4168264438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f8032910 con 0x7f540812c5b0 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f5404ff9640 1 -- 172.21.15.22:0/4168264438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f8032bf0 con 0x7f540812c5b0 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540812b650 con 0x7f540812c5b0 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.536+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5408119870 con 0x7f540812c5b0 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.537+0000 7f5404ff9640 1 -- 172.21.15.22:0/4168264438 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f53f804d3f0 con 0x7f540812c5b0 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.537+0000 7f5404ff9640 1 --2- 172.21.15.22:0/4168264438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f53f4037fd0 0x7f53f403a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.537+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5408062e90 con 0x7f540812c5b0 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.538+0000 7f5404ff9640 1 -- 172.21.15.22:0/4168264438 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7f53f802f050 con 0x7f540812c5b0 2024-05-07T13:55:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.538+0000 7f54077fe640 1 --2- 172.21.15.22:0/4168264438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f53f4037fd0 0x7f53f403a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.538+0000 7f54077fe640 1 --2- 172.21.15.22:0/4168264438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f53f4037fd0 0x7f53f403a490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53fc000f60 tx=0x7f53fc007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:40.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.542+0000 7f5404ff9640 1 -- 172.21.15.22:0/4168264438 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5408119870 con 0x7f540812c5b0 2024-05-07T13:55:40.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.728+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f540811a1a0 con 0x7f540812c5b0 2024-05-07T13:55:40.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.728+0000 7f5404ff9640 1 -- 172.21.15.22:0/4168264438 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+9745 (secure 0 0 0) 0x7f53f8053020 con 0x7f540812c5b0 2024-05-07T13:55:40.717 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:40.717 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":11,"fsid":"454556b8-fea2-4140-96b4-1e350fef55bd","created":"2024-05-07T13:55:29.783021+0000","modified":"2024-05-07T13:55:40.035311+0000","last_up_change":"2024-05-07T13:55:38.033428+0000","last_in_change":"2024-05-07T13:55:30.874816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T13:55:38.145424+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T13:55:38.719622+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfafa174-71f4-467c-a8c9-5a236b7ce235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6801","nonce":2215278347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6803","nonce":2215278347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6807","nonce":2215278347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6805","nonce":2215278347}]},"public_addr":"172.21.15.22:6801/2215278347","cluster_addr":"172.21.15.22:6803/2215278347","heartbeat_back_addr":"172.21.15.22:6807/2215278347","heartbeat_front_addr":"172.21.15.22:6805/2215278347","state":["exists","up"]},{"osd":1,"uuid":"50061477-74f3-4cad-83da-eeee2d48855f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6801","nonce":3441257969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6803","nonce":3441257969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6807","nonce":3441257969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6805","nonce":3441257969}]},"public_addr":"172.21.15.50:6801/3441257969","cluster_addr":"172.21.15.50:6803/3441257969","heartbeat_back_addr":"172.21.15.50:6807/3441257969","heartbeat_front_addr":"172.21.15.50:6805/3441257969","state":["exists","up"]},{"osd":2,"uuid":"20fbf061-68f0-40bb-8c65-b73c4e479b8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6809","nonce":2034796854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6811","nonce":2034796854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6817","nonce":2034796854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6813","nonce":2034796854}]},"public_addr":"172.21.15.50:6809/2034796854","cluster_addr":"172.21.15.50:6811/2034796854","heartbeat_back_addr":"172.21.15.50:6817/2034796854","heartbeat_front_addr":"172.21.15.50:6813/2034796854","state":["exists","up"]},{"osd":3,"uuid":"8a563741-f524-4dcb-930d-b520f14dc3fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6816","nonce":3553060046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6819","nonce":3553060046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6823","nonce":3553060046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6821","nonce":3553060046}]},"public_addr":"172.21.15.50:6816/3553060046","cluster_addr":"172.21.15.50:6819/3553060046","heartbeat_back_addr":"172.21.15.50:6823/3553060046","heartbeat_front_addr":"172.21.15.50:6821/3553060046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.939423+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.996698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.961901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.953145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T13:55:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.730+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f53f4037fd0 msgr2=0x7f53f403a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.730+0000 7f540e9e6640 1 --2- 172.21.15.22:0/4168264438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f53f4037fd0 0x7f53f403a490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f53fc000f60 tx=0x7f53fc007a80 comp rx=0 tx=0).stop 2024-05-07T13:55:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.731+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 msgr2=0x7f54081c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.731+0000 7f540e9e6640 1 --2- 172.21.15.22:0/4168264438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 0x7f54081c13b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53f802b880 tx=0x7f53f80046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.731+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 shutdown_connections 2024-05-07T13:55:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.731+0000 7f540e9e6640 1 --2- 172.21.15.22:0/4168264438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f53f4037fd0 0x7f53f403a490 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.731+0000 7f540e9e6640 1 --2- 172.21.15.22:0/4168264438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f540812c5b0 0x7f54081c13b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.731+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 >> 172.21.15.22:0/4168264438 conn(0x7f5408099380 msgr2=0x7f540809b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.731+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 shutdown_connections 2024-05-07T13:55:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.731+0000 7f540e9e6640 1 -- 172.21.15.22:0/4168264438 wait complete. 2024-05-07T13:55:40.730 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-07T13:55:40.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T13:55:40.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.844+0000 7f5849932640 1 Processor -- start 2024-05-07T13:55:40.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.844+0000 7f5849932640 1 -- start start 2024-05-07T13:55:40.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.844+0000 7f5849932640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f584412f580 0x7f5844131970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.844+0000 7f5849932640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5844113dd0 con 0x7f584412c5b0 2024-05-07T13:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.844+0000 7f5849932640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f5844072290 con 0x7f584412f580 2024-05-07T13:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.845+0000 7f583bfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f584412f580 0x7f5844131970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.845+0000 7f5842ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f584412c5b0 0x7f584412c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51882/0 (socket says 172.21.15.22:51882) 2024-05-07T13:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.845+0000 7f5842ffd640 1 -- 172.21.15.22:0/184688155 learned_addr learned my addr 172.21.15.22:0/184688155 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.845+0000 7f583bfff640 1 -- 172.21.15.22:0/184688155 >> v1:172.21.15.22:6789/0 conn(0x7f584412c5b0 legacy=0x7f584412c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.845+0000 7f583bfff640 1 -- 172.21.15.22:0/184688155 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584412c390 con 0x7f584412f580 2024-05-07T13:55:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f583bfff640 1 --2- 172.21.15.22:0/184688155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412f580 0x7f5844131970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f582c009720 tx=0x7f582c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6738a2e251ba6d73 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f58427fc640 1 -- 172.21.15.22:0/184688155 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0316d0 con 0x7f584412f580 2024-05-07T13:55:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f58427fc640 1 -- 172.21.15.22:0/184688155 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c037070 con 0x7f584412f580 2024-05-07T13:55:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f58427fc640 1 -- 172.21.15.22:0/184688155 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0319c0 con 0x7f584412f580 2024-05-07T13:55:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f5849932640 1 -- 172.21.15.22:0/184688155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412f580 msgr2=0x7f5844131970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f5849932640 1 --2- 172.21.15.22:0/184688155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412f580 0x7f5844131970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f582c009720 tx=0x7f582c02b840 comp rx=0 tx=0).stop 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f5849932640 1 -- 172.21.15.22:0/184688155 shutdown_connections 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f5849932640 1 --2- 172.21.15.22:0/184688155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412f580 0x7f5844131970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f5849932640 1 -- 172.21.15.22:0/184688155 >> 172.21.15.22:0/184688155 conn(0x7f5844099380 msgr2=0x7f5844099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f5849932640 1 -- 172.21.15.22:0/184688155 shutdown_connections 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.846+0000 7f5849932640 1 -- 172.21.15.22:0/184688155 wait complete. 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.847+0000 7f5849932640 1 Processor -- start 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.847+0000 7f5849932640 1 -- start start 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5849932640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412c5b0 0x7f5844127e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5849932640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5844113990 con 0x7f584412c5b0 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5842ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412c5b0 0x7f5844127e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5842ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412c5b0 0x7f5844127e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45824/0 (socket says 172.21.15.22:45824) 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5842ffd640 1 -- 172.21.15.22:0/2381078152 learned_addr learned my addr 172.21.15.22:0/2381078152 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5842ffd640 1 -- 172.21.15.22:0/2381078152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5844071a10 con 0x7f584412c5b0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5842ffd640 1 --2- 172.21.15.22:0/2381078152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412c5b0 0x7f5844127e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f583400c4a0 tx=0x7f583400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5840ff9640 1 -- 172.21.15.22:0/2381078152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5834017070 con 0x7f584412c5b0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5840ff9640 1 -- 172.21.15.22:0/2381078152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5834005c10 con 0x7f584412c5b0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5844131980 con 0x7f584412c5b0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5840ff9640 1 -- 172.21.15.22:0/2381078152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5834007070 con 0x7f584412c5b0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.848+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5844070b50 con 0x7f584412c5b0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.849+0000 7f5840ff9640 1 -- 172.21.15.22:0/2381078152 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f583401a070 con 0x7f584412c5b0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.849+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f584406ef60 con 0x7f584412c5b0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.850+0000 7f5840ff9640 1 --2- 172.21.15.22:0/2381078152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5824037fd0 0x7f582403a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.850+0000 7f5840ff9640 1 -- 172.21.15.22:0/2381078152 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7f583404a0f0 con 0x7f584412c5b0 2024-05-07T13:55:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.850+0000 7f583bfff640 1 --2- 172.21.15.22:0/2381078152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5824037fd0 0x7f582403a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:40.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.851+0000 7f583bfff640 1 --2- 172.21.15.22:0/2381078152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5824037fd0 0x7f582403a490 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f582c036000 tx=0x7f582c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:40.855+0000 7f5840ff9640 1 -- 172.21.15.22:0/2381078152 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f584406ef60 con 0x7f584412c5b0 2024-05-07T13:55:41.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.038+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5844070e40 con 0x7f584412c5b0 2024-05-07T13:55:41.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.039+0000 7f5840ff9640 1 -- 172.21.15.22:0/2381078152 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+9719 (secure 0 0 0) 0x7f5844070e40 con 0x7f584412c5b0 2024-05-07T13:55:41.028 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:41.028 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"fsid":"454556b8-fea2-4140-96b4-1e350fef55bd","created":"2024-05-07T13:55:29.783021+0000","modified":"2024-05-07T13:55:41.036444+0000","last_up_change":"2024-05-07T13:55:38.033428+0000","last_in_change":"2024-05-07T13:55:30.874816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T13:55:38.145424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T13:55:38.719622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfafa174-71f4-467c-a8c9-5a236b7ce235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6801","nonce":2215278347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6803","nonce":2215278347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6807","nonce":2215278347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6805","nonce":2215278347}]},"public_addr":"172.21.15.22:6801/2215278347","cluster_addr":"172.21.15.22:6803/2215278347","heartbeat_back_addr":"172.21.15.22:6807/2215278347","heartbeat_front_addr":"172.21.15.22:6805/2215278347","state":["exists","up"]},{"osd":1,"uuid":"50061477-74f3-4cad-83da-eeee2d48855f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6801","nonce":3441257969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6803","nonce":3441257969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6807","nonce":3441257969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6805","nonce":3441257969}]},"public_addr":"172.21.15.50:6801/3441257969","cluster_addr":"172.21.15.50:6803/3441257969","heartbeat_back_addr":"172.21.15.50:6807/3441257969","heartbeat_front_addr":"172.21.15.50:6805/3441257969","state":["exists","up"]},{"osd":2,"uuid":"20fbf061-68f0-40bb-8c65-b73c4e479b8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6809","nonce":2034796854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6811","nonce":2034796854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6817","nonce":2034796854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6813","nonce":2034796854}]},"public_addr":"172.21.15.50:6809/2034796854","cluster_addr":"172.21.15.50:6811/2034796854","heartbeat_back_addr":"172.21.15.50:6817/2034796854","heartbeat_front_addr":"172.21.15.50:6813/2034796854","state":["exists","up"]},{"osd":3,"uuid":"8a563741-f524-4dcb-930d-b520f14dc3fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6816","nonce":3553060046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6819","nonce":3553060046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6823","nonce":3553060046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6821","nonce":3553060046}]},"public_addr":"172.21.15.50:6816/3553060046","cluster_addr":"172.21.15.50:6819/3553060046","heartbeat_back_addr":"172.21.15.50:6823/3553060046","heartbeat_front_addr":"172.21.15.50:6821/3553060046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.939423+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.996698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.961901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.953145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5824037fd0 msgr2=0x7f582403a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 --2- 172.21.15.22:0/2381078152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5824037fd0 0x7f582403a490 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f582c036000 tx=0x7f582c008030 comp rx=0 tx=0).stop 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412c5b0 msgr2=0x7f5844127e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 --2- 172.21.15.22:0/2381078152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412c5b0 0x7f5844127e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f583400c4a0 tx=0x7f583400c960 comp rx=0 tx=0).stop 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 shutdown_connections 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 --2- 172.21.15.22:0/2381078152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5824037fd0 0x7f582403a490 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 --2- 172.21.15.22:0/2381078152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f584412c5b0 0x7f5844127e10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 >> 172.21.15.22:0/2381078152 conn(0x7f5844099380 msgr2=0x7f584412ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 shutdown_connections 2024-05-07T13:55:41.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.041+0000 7f5849932640 1 -- 172.21.15.22:0/2381078152 wait complete. 2024-05-07T13:55:41.041 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-07T13:55:41.041 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-07T13:55:41.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-07T13:55:41.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-07T13:55:41.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7f704788f640 1 Processor -- start 2024-05-07T13:55:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7fdaf564e640 1 Processor -- start 2024-05-07T13:55:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7f1135d79640 1 Processor -- start 2024-05-07T13:55:41.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7efe6e952640 1 Processor -- start 2024-05-07T13:55:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7fdaf564e640 1 -- start start 2024-05-07T13:55:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7f1135d79640 1 -- start start 2024-05-07T13:55:41.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7f704788f640 1 -- start start 2024-05-07T13:55:41.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7efe6e952640 1 -- start start 2024-05-07T13:55:41.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7f704788f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f704006d810 0x7f704006dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7f1135d79640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f113012b2e0 0x7f113012b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7efe6e952640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe68132d10 0x7efe681330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7f1135d79640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1130098840 con 0x7f113012bc00 2024-05-07T13:55:41.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7fdaf564e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdaf012f490 0x7fdaf0131880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7fdaf564e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf0097ee0 con 0x7fdaf00973f0 2024-05-07T13:55:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.163+0000 7fdaf564e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf0070b60 con 0x7fdaf012f490 2024-05-07T13:55:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f704788f640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704006f380 con 0x7f704006e130 2024-05-07T13:55:41.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7efe6e952640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe68096e60 con 0x7efe68089fd0 2024-05-07T13:55:41.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f704788f640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f704006edd0 con 0x7f704006d810 2024-05-07T13:55:41.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7efe6e952640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7efe6808c0e0 con 0x7efe68132d10 2024-05-07T13:55:41.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7efe67fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe68132d10 0x7efe681330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f1135d79640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f113006f9a0 con 0x7f113012b2e0 2024-05-07T13:55:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7efe67fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe68132d10 0x7efe681330f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45834/0 (socket says 172.21.15.22:45834) 2024-05-07T13:55:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7efe67fff640 1 -- 172.21.15.22:0/558195241 learned_addr learned my addr 172.21.15.22:0/558195241 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7efe677fe640 1 --1- 172.21.15.22:0/558195241 >> v1:172.21.15.22:6789/0 conn(0x7efe68089fd0 0x7efe6808a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51884/0 (socket says 172.21.15.22:51884) 2024-05-07T13:55:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f704562b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f704006d810 0x7f704006dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f7044e2a640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f704006e130 0x7f704012e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51896/0 (socket says 172.21.15.22:51896) 2024-05-07T13:55:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f7044e2a640 1 -- 172.21.15.22:0/3399731636 learned_addr learned my addr 172.21.15.22:0/3399731636 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7fdaee7fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdaf012f490 0x7fdaf0131880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7fdaee7fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdaf012f490 0x7fdaf0131880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45852/0 (socket says 172.21.15.22:45852) 2024-05-07T13:55:41.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7fdaee7fc640 1 -- 172.21.15.22:0/3039974870 learned_addr learned my addr 172.21.15.22:0/3039974870 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f112effd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f113012bc00 0x7f113006e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51908/0 (socket says 172.21.15.22:51908) 2024-05-07T13:55:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f112effd640 1 -- 172.21.15.22:0/1759748540 learned_addr learned my addr 172.21.15.22:0/1759748540 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f112f7fe640 1 --2- 172.21.15.22:0/1759748540 >> v2:172.21.15.22:3300/0 conn(0x7f113012b2e0 0x7f113012b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7fdaee7fc640 1 -- 172.21.15.22:0/3039974870 >> v1:172.21.15.22:6789/0 conn(0x7fdaf00973f0 legacy=0x7fdaf00977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7fdaee7fc640 1 -- 172.21.15.22:0/3039974870 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf00996b0 con 0x7fdaf012f490 2024-05-07T13:55:41.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f704562b640 1 -- 172.21.15.22:0/3399731636 >> v1:172.21.15.22:6789/0 conn(0x7f704006e130 legacy=0x7f704012e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f704562b640 1 -- 172.21.15.22:0/3399731636 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704006e580 con 0x7f704006d810 2024-05-07T13:55:41.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f112f7fe640 1 -- 172.21.15.22:0/1759748540 >> v1:172.21.15.22:6789/0 conn(0x7f113012bc00 legacy=0x7f113006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7f112f7fe640 1 -- 172.21.15.22:0/1759748540 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11300707f0 con 0x7f113012b2e0 2024-05-07T13:55:41.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7efe67fff640 1 -- 172.21.15.22:0/558195241 >> v1:172.21.15.22:6789/0 conn(0x7efe68089fd0 legacy=0x7efe6808a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.164+0000 7efe66ffd640 1 -- 172.21.15.22:0/558195241 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366724099 0 0) 0x7efe68096e60 con 0x7efe68089fd0 2024-05-07T13:55:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.165+0000 7efe67fff640 1 -- 172.21.15.22:0/558195241 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6808b810 con 0x7efe68132d10 2024-05-07T13:55:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.165+0000 7fdaee7fc640 1 --2- 172.21.15.22:0/3039974870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf012f490 0x7fdaf0131880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdae40097f0 tx=0x7fdae402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9bbf4c6dea320e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.165+0000 7f704562b640 1 --2- 172.21.15.22:0/3399731636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 0x7f704006dbf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f703c009720 tx=0x7f703c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d324aa98ce30ad server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.165+0000 7f112f7fe640 1 --2- 172.21.15.22:0/1759748540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 0x7f113012b6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f112000b9c0 tx=0x7f112002e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315ea0a6319017ec server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.165+0000 7efe67fff640 1 --2- 172.21.15.22:0/558195241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68132d10 0x7efe681330f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe580097f0 tx=0x7efe5802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2741389738d04c36 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f7037fff640 1 -- 172.21.15.22:0/3399731636 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f703c0316d0 con 0x7f704006d810 2024-05-07T13:55:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f7037fff640 1 -- 172.21.15.22:0/3399731636 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f703c037070 con 0x7f704006d810 2024-05-07T13:55:41.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f7037fff640 1 -- 172.21.15.22:0/3399731636 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f703c0319c0 con 0x7f704006d810 2024-05-07T13:55:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.165+0000 7fdaedffb640 1 -- 172.21.15.22:0/3039974870 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae4035020 con 0x7fdaf012f490 2024-05-07T13:55:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.165+0000 7fdaedffb640 1 -- 172.21.15.22:0/3039974870 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae40317a0 con 0x7fdaf012f490 2024-05-07T13:55:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7fdaedffb640 1 -- 172.21.15.22:0/3039974870 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae4031aa0 con 0x7fdaf012f490 2024-05-07T13:55:41.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f112e7fc640 1 -- 172.21.15.22:0/1759748540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112003b070 con 0x7f113012b2e0 2024-05-07T13:55:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f112e7fc640 1 -- 172.21.15.22:0/1759748540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112002ecf0 con 0x7f113012b2e0 2024-05-07T13:55:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7efe66ffd640 1 -- 172.21.15.22:0/558195241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe58035020 con 0x7efe68132d10 2024-05-07T13:55:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7efe66ffd640 1 -- 172.21.15.22:0/558195241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe580317a0 con 0x7efe68132d10 2024-05-07T13:55:41.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f112e7fc640 1 -- 172.21.15.22:0/1759748540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1120036440 con 0x7f113012b2e0 2024-05-07T13:55:41.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7efe66ffd640 1 -- 172.21.15.22:0/558195241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe58031aa0 con 0x7efe68132d10 2024-05-07T13:55:41.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7fdaf564e640 1 -- 172.21.15.22:0/3039974870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf012f490 msgr2=0x7fdaf0131880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7fdaf564e640 1 --2- 172.21.15.22:0/3039974870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf012f490 0x7fdaf0131880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdae40097f0 tx=0x7fdae402b910 comp rx=0 tx=0).stop 2024-05-07T13:55:41.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f704788f640 1 -- 172.21.15.22:0/3399731636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 msgr2=0x7f704006dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f704788f640 1 --2- 172.21.15.22:0/3399731636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 0x7f704006dbf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f703c009720 tx=0x7f703c02b840 comp rx=0 tx=0).stop 2024-05-07T13:55:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7fdaf564e640 1 -- 172.21.15.22:0/3039974870 shutdown_connections 2024-05-07T13:55:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f704788f640 1 -- 172.21.15.22:0/3399731636 shutdown_connections 2024-05-07T13:55:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f704788f640 1 --2- 172.21.15.22:0/3399731636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 0x7f704006dbf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7f704788f640 1 -- 172.21.15.22:0/3399731636 >> 172.21.15.22:0/3399731636 conn(0x7f70400a0d20 msgr2=0x7f70400a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7fdaf564e640 1 --2- 172.21.15.22:0/3039974870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf012f490 0x7fdaf0131880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7fdaf564e640 1 -- 172.21.15.22:0/3039974870 >> 172.21.15.22:0/3039974870 conn(0x7fdaf009a6a0 msgr2=0x7fdaf009aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7efe6e952640 1 -- 172.21.15.22:0/558195241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68132d10 msgr2=0x7efe681330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.166+0000 7efe6e952640 1 --2- 172.21.15.22:0/558195241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68132d10 0x7efe681330f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe580097f0 tx=0x7efe5802b910 comp rx=0 tx=0).stop 2024-05-07T13:55:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7fdaf564e640 1 -- 172.21.15.22:0/3039974870 shutdown_connections 2024-05-07T13:55:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7efe6e952640 1 -- 172.21.15.22:0/558195241 shutdown_connections 2024-05-07T13:55:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7efe6e952640 1 --2- 172.21.15.22:0/558195241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68132d10 0x7efe681330f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7efe6e952640 1 -- 172.21.15.22:0/558195241 >> 172.21.15.22:0/558195241 conn(0x7efe680996c0 msgr2=0x7efe68099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7f704788f640 1 -- 172.21.15.22:0/3399731636 shutdown_connections 2024-05-07T13:55:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7f1135d79640 1 -- 172.21.15.22:0/1759748540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 msgr2=0x7f113012b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7f704788f640 1 -- 172.21.15.22:0/3399731636 wait complete. 2024-05-07T13:55:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7f1135d79640 1 --2- 172.21.15.22:0/1759748540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 0x7f113012b6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f112000b9c0 tx=0x7f112002e010 comp rx=0 tx=0).stop 2024-05-07T13:55:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7efe6e952640 1 -- 172.21.15.22:0/558195241 shutdown_connections 2024-05-07T13:55:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7efe6e952640 1 -- 172.21.15.22:0/558195241 wait complete. 2024-05-07T13:55:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7fdaf564e640 1 -- 172.21.15.22:0/3039974870 wait complete. 2024-05-07T13:55:41.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7f1135d79640 1 -- 172.21.15.22:0/1759748540 shutdown_connections 2024-05-07T13:55:41.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7f1135d79640 1 --2- 172.21.15.22:0/1759748540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 0x7f113012b6c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7f1135d79640 1 -- 172.21.15.22:0/1759748540 >> 172.21.15.22:0/1759748540 conn(0x7f11300996c0 msgr2=0x7f1130099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7f1135d79640 1 -- 172.21.15.22:0/1759748540 shutdown_connections 2024-05-07T13:55:41.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.167+0000 7f1135d79640 1 -- 172.21.15.22:0/1759748540 wait complete. 2024-05-07T13:55:41.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7f704788f640 1 Processor -- start 2024-05-07T13:55:41.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7f704788f640 1 -- start start 2024-05-07T13:55:41.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7efe6e952640 1 Processor -- start 2024-05-07T13:55:41.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7fdaf564e640 1 Processor -- start 2024-05-07T13:55:41.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7efe6e952640 1 -- start start 2024-05-07T13:55:41.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7fdaf564e640 1 -- start start 2024-05-07T13:55:41.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7f704788f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 0x7f70401c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7f1135d79640 1 Processor -- start 2024-05-07T13:55:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7f704788f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f704012ea00 con 0x7f704006d810 2024-05-07T13:55:41.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7f704562b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 0x7f70401c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7fdaf564e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf00973f0 0x7fdaf006e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7f704562b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 0x7f70401c3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45870/0 (socket says 172.21.15.22:45870) 2024-05-07T13:55:41.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7f704562b640 1 -- 172.21.15.22:0/4095659715 learned_addr learned my addr 172.21.15.22:0/4095659715 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7fdaf564e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf00718a0 con 0x7fdaf00973f0 2024-05-07T13:55:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7efe6e952640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68089fd0 0x7efe681c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7efe6e952640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efe68133630 con 0x7efe68089fd0 2024-05-07T13:55:41.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7fdaeeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf00973f0 0x7fdaf006e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7fdaeeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf00973f0 0x7fdaf006e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45884/0 (socket says 172.21.15.22:45884) 2024-05-07T13:55:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7fdaeeffd640 1 -- 172.21.15.22:0/3912536962 learned_addr learned my addr 172.21.15.22:0/3912536962 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.168+0000 7f1135d79640 1 -- start start 2024-05-07T13:55:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7fdaeeffd640 1 -- 172.21.15.22:0/3912536962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf0124400 con 0x7fdaf00973f0 2024-05-07T13:55:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7f1135d79640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 0x7f1130089fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7f1135d79640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f113006ee20 con 0x7f113012b2e0 2024-05-07T13:55:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7efe67fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68089fd0 0x7efe681c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7efe67fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68089fd0 0x7efe681c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45890/0 (socket says 172.21.15.22:45890) 2024-05-07T13:55:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7efe67fff640 1 -- 172.21.15.22:0/2888504484 learned_addr learned my addr 172.21.15.22:0/2888504484 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7fdaeeffd640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf00973f0 0x7fdaf006e640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdae000c380 tx=0x7fdae000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7f704562b640 1 -- 172.21.15.22:0/4095659715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7040090ab0 con 0x7f704006d810 2024-05-07T13:55:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.169+0000 7f112f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 0x7f1130089fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7f112f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 0x7f1130089fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45902/0 (socket says 172.21.15.22:45902) 2024-05-07T13:55:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7efe67fff640 1 -- 172.21.15.22:0/2888504484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe681260c0 con 0x7efe68089fd0 2024-05-07T13:55:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7f112f7fe640 1 -- 172.21.15.22:0/1001860193 learned_addr learned my addr 172.21.15.22:0/1001860193 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7fdad77fe640 1 -- 172.21.15.22:0/3912536962 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae0017070 con 0x7fdaf00973f0 2024-05-07T13:55:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf006fcb0 con 0x7fdaf00973f0 2024-05-07T13:55:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7f704562b640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 0x7f70401c3190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f703c009720 tx=0x7f703c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7fdad77fe640 1 -- 172.21.15.22:0/3912536962 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae0005200 con 0x7fdaf00973f0 2024-05-07T13:55:41.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf0124c60 con 0x7fdaf00973f0 2024-05-07T13:55:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7efe67fff640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68089fd0 0x7efe681c79d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe580090b0 tx=0x7efe580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7fdad77fe640 1 -- 172.21.15.22:0/3912536962 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae0017070 con 0x7fdaf00973f0 2024-05-07T13:55:41.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7efe64ff9640 1 -- 172.21.15.22:0/2888504484 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe58031950 con 0x7efe68089fd0 2024-05-07T13:55:41.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe68130790 con 0x7efe68089fd0 2024-05-07T13:55:41.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.170+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe681c7f10 con 0x7efe68089fd0 2024-05-07T13:55:41.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7efe64ff9640 1 -- 172.21.15.22:0/2888504484 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe580317a0 con 0x7efe68089fd0 2024-05-07T13:55:41.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7efe64ff9640 1 -- 172.21.15.22:0/2888504484 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe58052060 con 0x7efe68089fd0 2024-05-07T13:55:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7f7035ffb640 1 -- 172.21.15.22:0/4095659715 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f703c032770 con 0x7f704006d810 2024-05-07T13:55:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7f7035ffb640 1 -- 172.21.15.22:0/4095659715 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f703c032910 con 0x7f704006d810 2024-05-07T13:55:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70401c36d0 con 0x7f704006d810 2024-05-07T13:55:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7f7035ffb640 1 -- 172.21.15.22:0/4095659715 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f703c032bf0 con 0x7f704006d810 2024-05-07T13:55:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7f112f7fe640 1 -- 172.21.15.22:0/1001860193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1130127890 con 0x7f113012b2e0 2024-05-07T13:55:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7fdad77fe640 1 -- 172.21.15.22:0/3912536962 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7fdae001a070 con 0x7fdaf00973f0 2024-05-07T13:55:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7fdad77fe640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdadc038160 0x7fdadc03a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdaf0062e90 con 0x7fdaf00973f0 2024-05-07T13:55:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70401c3ba0 con 0x7f704006d810 2024-05-07T13:55:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.171+0000 7f112f7fe640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 0x7f1130089fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f112000bae0 tx=0x7f1120004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7efe64ff9640 1 -- 172.21.15.22:0/2888504484 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7efe58038020 con 0x7efe68089fd0 2024-05-07T13:55:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7fdad77fe640 1 -- 172.21.15.22:0/3912536962 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fdae0049ed0 con 0x7fdaf00973f0 2024-05-07T13:55:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7efe64ff9640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efe54037fd0 0x7efe5403a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7efe64ff9640 1 -- 172.21.15.22:0/2888504484 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7efe5806d420 con 0x7efe68089fd0 2024-05-07T13:55:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7fdad77fe640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7fdadc03d8e0 0x7fdadc03fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7fdad77fe640 1 -- 172.21.15.22:0/3912536962 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdae0009e50 con 0x7fdadc03d8e0 2024-05-07T13:55:41.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7efe677fe640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efe54037fd0 0x7efe5403a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7040091550 con 0x7f704006d810 2024-05-07T13:55:41.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7f1117fff640 1 -- 172.21.15.22:0/1001860193 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112003b040 con 0x7f113012b2e0 2024-05-07T13:55:41.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7efe6e952640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efe48001650 0x7efe48003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe48006b00 con 0x7efe48001650 2024-05-07T13:55:41.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7fdad77fe640 1 -- 172.21.15.22:0/3912536962 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7fdae0003b10 con 0x7fdaf00973f0 2024-05-07T13:55:41.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7f1117fff640 1 -- 172.21.15.22:0/1001860193 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1120046070 con 0x7f113012b2e0 2024-05-07T13:55:41.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7fdaee7fc640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdadc038160 0x7fdadc03a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113008be80 con 0x7f113012b2e0 2024-05-07T13:55:41.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7fdaef7fe640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7fdadc03d8e0 0x7fdadc03fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113008c2c0 con 0x7f113012b2e0 2024-05-07T13:55:41.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.172+0000 7efe6ceef640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efe48001650 0x7efe48003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7f7035ffb640 1 -- 172.21.15.22:0/4095659715 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f703c04c060 con 0x7f704006d810 2024-05-07T13:55:41.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7fdaee7fc640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdadc038160 0x7fdadc03a620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdae4036000 tx=0x7fdae4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7efe677fe640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efe54037fd0 0x7efe5403a490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe5c000c00 tx=0x7efe5c007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7f7035ffb640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024038020 0x7f702403a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7fdaef7fe640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7fdadc03d8e0 0x7fdadc03fd20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7f7035ffb640 1 -- 172.21.15.22:0/4095659715 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f703c02f050 con 0x7f704006d810 2024-05-07T13:55:41.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7efe6ceef640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efe48001650 0x7efe48003b10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7f1117fff640 1 -- 172.21.15.22:0/1001860193 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200415b0 con 0x7f113012b2e0 2024-05-07T13:55:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7f7035ffb640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f702403d7a0 0x7f702403fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7f7035ffb640 1 -- 172.21.15.22:0/4095659715 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70240402b0 con 0x7f702403d7a0 2024-05-07T13:55:41.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7f7044e2a640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024038020 0x7f702403a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7f7045e2c640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f702403d7a0 0x7f702403fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.173+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1110000f80 con 0x7f113012b2e0 2024-05-07T13:55:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7f7035ffb640 1 -- 172.21.15.22:0/4095659715 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f703c073050 con 0x7f704006d810 2024-05-07T13:55:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7f7044e2a640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024038020 0x7f702403a4e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7030007fd0 tx=0x7f7030007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7f7045e2c640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f702403d7a0 0x7f702403fbe0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7fdad77fe640 1 -- 172.21.15.22:0/3912536962 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdae0009e50 con 0x7fdadc03d8e0 2024-05-07T13:55:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7efe64ff9640 1 -- 172.21.15.22:0/2888504484 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe48006b00 con 0x7efe48001650 2024-05-07T13:55:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7f1117fff640 1 -- 172.21.15.22:0/1001860193 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f1120041750 con 0x7f113012b2e0 2024-05-07T13:55:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7f1117fff640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f111c038070 0x7f111c03a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7f1117fff640 1 -- 172.21.15.22:0/1001860193 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f112006d630 con 0x7f113012b2e0 2024-05-07T13:55:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7f1117fff640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f111c03d870 0x7f111c03fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7f1117fff640 1 -- 172.21.15.22:0/1001860193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f111c040380 con 0x7f111c03d870 2024-05-07T13:55:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.174+0000 7f1117fff640 1 -- 172.21.15.22:0/1001860193 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f1120074050 con 0x7f113012b2e0 2024-05-07T13:55:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.175+0000 7f112ffff640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f111c03d870 0x7f111c03fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.175+0000 7f112effd640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f111c038070 0x7f111c03a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.175+0000 7f7035ffb640 1 -- 172.21.15.22:0/4095659715 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70240402b0 con 0x7f702403d7a0 2024-05-07T13:55:41.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.175+0000 7f112ffff640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f111c03d870 0x7f111c03fcb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.175+0000 7f112effd640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f111c038070 0x7f111c03a530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1124007fd0 tx=0x7f1124007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.176+0000 7f1117fff640 1 -- 172.21.15.22:0/1001860193 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f111c040380 con 0x7f111c03d870 2024-05-07T13:55:41.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.188+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdaf0124120 con 0x7fdadc03d8e0 2024-05-07T13:55:41.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe48005be0 con 0x7efe48001650 2024-05-07T13:55:41.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7fdad77fe640 1 -- 172.21.15.22:0/3912536962 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdaf0124120 con 0x7fdadc03d8e0 2024-05-07T13:55:41.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7efe64ff9640 1 -- 172.21.15.22:0/2888504484 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efe48005be0 con 0x7efe48001650 2024-05-07T13:55:41.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7fdadc03d8e0 msgr2=0x7fdadc03fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7fdaf564e640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7fdadc03d8e0 0x7fdadc03fd20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdadc038160 msgr2=0x7fdadc03a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7fdaf564e640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdadc038160 0x7fdadc03a620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdae4036000 tx=0x7fdae4008030 comp rx=0 tx=0).stop 2024-05-07T13:55:41.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf00973f0 msgr2=0x7fdaf006e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7fdaf564e640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf00973f0 0x7fdaf006e640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdae000c380 tx=0x7fdae000c840 comp rx=0 tx=0).stop 2024-05-07T13:55:41.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efe48001650 msgr2=0x7efe48003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efe48001650 0x7efe48003b10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 shutdown_connections 2024-05-07T13:55:41.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.189+0000 7fdaf564e640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7fdadc03d8e0 0x7fdadc03fd20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7fdaf564e640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdadc038160 0x7fdadc03a620 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7fdaf564e640 1 --2- 172.21.15.22:0/3912536962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf00973f0 0x7fdaf006e640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 >> 172.21.15.22:0/3912536962 conn(0x7fdaf009a6a0 msgr2=0x7fdaf01b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 shutdown_connections 2024-05-07T13:55:41.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efe54037fd0 msgr2=0x7efe5403a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efe54037fd0 0x7efe5403a490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe5c000c00 tx=0x7efe5c007a40 comp rx=0 tx=0).stop 2024-05-07T13:55:41.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7fdaf564e640 1 -- 172.21.15.22:0/3912536962 wait complete. 2024-05-07T13:55:41.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68089fd0 msgr2=0x7efe681c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68089fd0 0x7efe681c79d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe580090b0 tx=0x7efe580046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7040090850 con 0x7f702403d7a0 2024-05-07T13:55:41.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 shutdown_connections 2024-05-07T13:55:41.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efe48001650 0x7efe48003b10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efe54037fd0 0x7efe5403a490 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 --2- 172.21.15.22:0/2888504484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe68089fd0 0x7efe681c79d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 >> 172.21.15.22:0/2888504484 conn(0x7efe680996c0 msgr2=0x7efe68131200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7f7035ffb640 1 -- 172.21.15.22:0/4095659715 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7040090850 con 0x7f702403d7a0 2024-05-07T13:55:41.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 shutdown_connections 2024-05-07T13:55:41.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.190+0000 7efe6e952640 1 -- 172.21.15.22:0/2888504484 wait complete. 2024-05-07T13:55:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f702403d7a0 msgr2=0x7f702403fbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f702403d7a0 0x7f702403fbe0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024038020 msgr2=0x7f702403a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024038020 0x7f702403a4e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7030007fd0 tx=0x7f7030007ac0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 msgr2=0x7f70401c3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 0x7f70401c3190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f703c009720 tx=0x7f703c0046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 shutdown_connections 2024-05-07T13:55:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f702403d7a0 0x7f702403fbe0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024038020 0x7f702403a4e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 --2- 172.21.15.22:0/4095659715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f704006d810 0x7f70401c3190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 >> 172.21.15.22:0/4095659715 conn(0x7f70400a0d20 msgr2=0x7f704009b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1110002c70 con 0x7f111c03d870 2024-05-07T13:55:41.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.191+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 shutdown_connections 2024-05-07T13:55:41.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1117fff640 1 -- 172.21.15.22:0/1001860193 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1110002c70 con 0x7f111c03d870 2024-05-07T13:55:41.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f704788f640 1 -- 172.21.15.22:0/4095659715 wait complete. 2024-05-07T13:55:41.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f111c03d870 msgr2=0x7f111c03fcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f111c03d870 0x7f111c03fcb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f111c038070 msgr2=0x7f111c03a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f111c038070 0x7f111c03a530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1124007fd0 tx=0x7f1124007ac0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 msgr2=0x7f1130089fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 0x7f1130089fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f112000bae0 tx=0x7f1120004730 comp rx=0 tx=0).stop 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 shutdown_connections 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f111c03d870 0x7f111c03fcb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f111c038070 0x7f111c03a530 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 --2- 172.21.15.22:0/1001860193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113012b2e0 0x7f1130089fd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.192+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 >> 172.21.15.22:0/1001860193 conn(0x7f11300996c0 msgr2=0x7f11300968b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.193+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 shutdown_connections 2024-05-07T13:55:41.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.193+0000 7f1135d79640 1 -- 172.21.15.22:0/1001860193 wait complete. 2024-05-07T13:55:41.224 INFO:teuthology.orchestra.run.smithi022.stdout:38654705667 2024-05-07T13:55:41.224 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-07T13:55:41.225 INFO:teuthology.orchestra.run.smithi022.stdout:38654705667 2024-05-07T13:55:41.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T13:55:41.226 INFO:teuthology.orchestra.run.smithi022.stdout:38654705667 2024-05-07T13:55:41.227 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T13:55:41.227 INFO:teuthology.orchestra.run.smithi022.stdout:38654705667 2024-05-07T13:55:41.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T13:55:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.385+0000 7f8547c4e640 1 Processor -- start 2024-05-07T13:55:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.385+0000 7fd664960640 1 Processor -- start 2024-05-07T13:55:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.385+0000 7fd664960640 1 -- start start 2024-05-07T13:55:41.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.385+0000 7fd772cac640 1 Processor -- start 2024-05-07T13:55:41.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.385+0000 7fd772cac640 1 -- start start 2024-05-07T13:55:41.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.385+0000 7f8547c4e640 1 -- start start 2024-05-07T13:55:41.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.385+0000 7f7e8c3bd640 1 Processor -- start 2024-05-07T13:55:41.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.385+0000 7f7e8c3bd640 1 -- start start 2024-05-07T13:55:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.385+0000 7fd772cac640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd76c12b2e0 0x7fd76c12b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd772cac640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76c098840 con 0x7fd76c12bc00 2024-05-07T13:55:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd772cac640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd76c06f9a0 con 0x7fd76c12b2e0 2024-05-07T13:55:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd76c12bc00 0x7fd76c06e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51920/0 (socket says 172.21.15.22:51920) 2024-05-07T13:55:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76bfff640 1 -- 172.21.15.22:0/725647294 learned_addr learned my addr 172.21.15.22:0/725647294 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd770a48640 1 --2- 172.21.15.22:0/725647294 >> v2:172.21.15.22:3300/0 conn(0x7fd76c12b2e0 0x7fd76c12b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f8547c4e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f854006f370 0x7f854006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f8547c4e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854006c670 con 0x7f854006de40 2024-05-07T13:55:41.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f8547c4e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8540072490 con 0x7f854006f370 2024-05-07T13:55:41.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd664960640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd66012e340 0x7fd660130730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd664960640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd660098840 con 0x7fd66012b2e0 2024-05-07T13:55:41.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd664960640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd66006f9a0 con 0x7fd66012e340 2024-05-07T13:55:41.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd65e59c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd66012b2e0 0x7fd66012b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51922/0 (socket says 172.21.15.22:51922) 2024-05-07T13:55:41.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395229958 0 0) 0x7fd76c098840 con 0x7fd76c12bc00 2024-05-07T13:55:41.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75c003520 con 0x7fd76c12bc00 2024-05-07T13:55:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd65e59c640 1 -- 172.21.15.22:0/3222167001 learned_addr learned my addr 172.21.15.22:0/3222167001 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f7e8c3bd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e8406e7f0 0x7f7e8406ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f85459ea640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f854006de40 0x7f854006e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51936/0 (socket says 172.21.15.22:51936) 2024-05-07T13:55:41.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f85459ea640 1 -- 172.21.15.22:0/1743829087 learned_addr learned my addr 172.21.15.22:0/1743829087 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2230534505 0 0) 0x7fd75c003520 con 0x7fd76c12bc00 2024-05-07T13:55:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 >> v2:172.21.15.22:3300/0 conn(0x7fd76c12b2e0 msgr2=0x7fd76c12b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-07T13:55:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76b7fe640 1 --2- 172.21.15.22:0/725647294 >> v2:172.21.15.22:3300/0 conn(0x7fd76c12b2e0 0x7fd76c12b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c0707f0 con 0x7fd76c12bc00 2024-05-07T13:55:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f7e8c3bd640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e8406cfa0 con 0x7f7e8406f110 2024-05-07T13:55:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f7e8c3bd640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7e84070250 con 0x7f7e8406e7f0 2024-05-07T13:55:41.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1735563264 0 0) 0x7fd7580015a0 con 0x7fd76c12bc00 2024-05-07T13:55:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f85451e9640 1 --2- 172.21.15.22:0/1743829087 >> v2:172.21.15.22:3300/0 conn(0x7f854006f370 0x7f854006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 >> v1:172.21.15.22:6789/0 conn(0x7fd76c12bc00 legacy=0x7fd76c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd76b7fe640 1 --2- 172.21.15.22:0/725647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd75c003a30 0x7fd75c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c0044f0 con 0x7fd75c003a30 2024-05-07T13:55:41.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7f7e89958640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7e8406f110 0x7f7e84132af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51938/0 (socket says 172.21.15.22:51938) 2024-05-07T13:55:41.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7f7e89958640 1 -- 172.21.15.22:0/3492651117 learned_addr learned my addr 172.21.15.22:0/3492651117 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:41.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7f7e8a159640 1 --2- 172.21.15.22:0/3492651117 >> v2:172.21.15.22:3300/0 conn(0x7f7e8406e7f0 0x7f7e8406ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd65dd9b640 1 --2- 172.21.15.22:0/3222167001 >> v2:172.21.15.22:3300/0 conn(0x7fd66012e340 0x7fd660130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.386+0000 7fd65d59a640 1 -- 172.21.15.22:0/3222167001 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261382830 0 0) 0x7fd660098840 con 0x7fd66012b2e0 2024-05-07T13:55:41.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7fd65d59a640 1 -- 172.21.15.22:0/3222167001 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd648007930 con 0x7fd66012b2e0 2024-05-07T13:55:41.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7fd65dd9b640 1 -- 172.21.15.22:0/3222167001 >> v1:172.21.15.22:6789/0 conn(0x7fd66012b2e0 legacy=0x7fd66012b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7fd65dd9b640 1 -- 172.21.15.22:0/3222167001 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66012bdd0 con 0x7fd66012e340 2024-05-07T13:55:41.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7f85451e9640 1 -- 172.21.15.22:0/1743829087 >> v1:172.21.15.22:6789/0 conn(0x7f854006de40 legacy=0x7f854006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7f85451e9640 1 -- 172.21.15.22:0/1743829087 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854009bb00 con 0x7f854006f370 2024-05-07T13:55:41.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7fd770a48640 1 --2- 172.21.15.22:0/725647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd75c003a30 0x7fd75c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7f7e8a159640 1 -- 172.21.15.22:0/3492651117 >> v1:172.21.15.22:6789/0 conn(0x7f7e8406f110 legacy=0x7f7e84132af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7f7e8a159640 1 -- 172.21.15.22:0/3492651117 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8406d220 con 0x7f7e8406e7f0 2024-05-07T13:55:41.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.387+0000 7fd770a48640 1 -- 172.21.15.22:0/725647294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c003520 con 0x7fd75c003a30 2024-05-07T13:55:41.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7fd65dd9b640 1 --2- 172.21.15.22:0/3222167001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012e340 0x7fd660130730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd65400b800 tx=0x7fd65402be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ca94df4abf2a3a server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7f85451e9640 1 --2- 172.21.15.22:0/1743829087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006f370 0x7f854006e930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8530009720 tx=0x7f853002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6255547e16e89388 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7f7e8a159640 1 --2- 172.21.15.22:0/3492651117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 0x7f7e8406ebd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009750 tx=0x7f7e8002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7d86212dec4809 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7f7e89157640 1 -- 172.21.15.22:0/3492651117 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e800316d0 con 0x7f7e8406e7f0 2024-05-07T13:55:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7fd65d59a640 1 -- 172.21.15.22:0/3222167001 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd654039070 con 0x7fd66012e340 2024-05-07T13:55:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7f7e89157640 1 -- 172.21.15.22:0/3492651117 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e80037070 con 0x7f7e8406e7f0 2024-05-07T13:55:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7f7e89157640 1 -- 172.21.15.22:0/3492651117 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e800319c0 con 0x7f7e8406e7f0 2024-05-07T13:55:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7fd65d59a640 1 -- 172.21.15.22:0/3222167001 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65402cae0 con 0x7fd66012e340 2024-05-07T13:55:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7fd65d59a640 1 -- 172.21.15.22:0/3222167001 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65402cdc0 con 0x7fd66012e340 2024-05-07T13:55:41.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7f85449e8640 1 -- 172.21.15.22:0/1743829087 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85300316d0 con 0x7f854006f370 2024-05-07T13:55:41.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7f85449e8640 1 -- 172.21.15.22:0/1743829087 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8530037070 con 0x7f854006f370 2024-05-07T13:55:41.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7f85449e8640 1 -- 172.21.15.22:0/1743829087 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85300319c0 con 0x7f854006f370 2024-05-07T13:55:41.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.388+0000 7fd770a48640 1 --2- 172.21.15.22:0/725647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd75c003a30 0x7fd75c003e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd760009a20 tx=0x7fd75c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1715f72ee9d6d9eb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f8547c4e640 1 -- 172.21.15.22:0/1743829087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006f370 msgr2=0x7f854006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f8547c4e640 1 --2- 172.21.15.22:0/1743829087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006f370 0x7f854006e930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8530009720 tx=0x7f853002b840 comp rx=0 tx=0).stop 2024-05-07T13:55:41.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f8547c4e640 1 -- 172.21.15.22:0/1743829087 shutdown_connections 2024-05-07T13:55:41.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f8547c4e640 1 --2- 172.21.15.22:0/1743829087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006f370 0x7f854006e930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f8547c4e640 1 -- 172.21.15.22:0/1743829087 >> 172.21.15.22:0/1743829087 conn(0x7f854009ccf0 msgr2=0x7f854009d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd664960640 1 -- 172.21.15.22:0/3222167001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012e340 msgr2=0x7fd660130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd664960640 1 --2- 172.21.15.22:0/3222167001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012e340 0x7fd660130730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd65400b800 tx=0x7fd65402be00 comp rx=0 tx=0).stop 2024-05-07T13:55:41.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd760039070 con 0x7fd75c003a30 2024-05-07T13:55:41.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76002c9a0 con 0x7fd75c003a30 2024-05-07T13:55:41.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd76b7fe640 1 -- 172.21.15.22:0/725647294 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd760009670 con 0x7fd75c003a30 2024-05-07T13:55:41.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/3492651117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 msgr2=0x7f7e8406ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f7e8c3bd640 1 --2- 172.21.15.22:0/3492651117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 0x7f7e8406ebd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009750 tx=0x7f7e8002b840 comp rx=0 tx=0).stop 2024-05-07T13:55:41.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f8547c4e640 1 -- 172.21.15.22:0/1743829087 shutdown_connections 2024-05-07T13:55:41.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f8547c4e640 1 -- 172.21.15.22:0/1743829087 wait complete. 2024-05-07T13:55:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd664960640 1 -- 172.21.15.22:0/3222167001 shutdown_connections 2024-05-07T13:55:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd664960640 1 --2- 172.21.15.22:0/3222167001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012e340 0x7fd660130730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd664960640 1 -- 172.21.15.22:0/3222167001 >> 172.21.15.22:0/3222167001 conn(0x7fd6600996c0 msgr2=0x7fd660099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd664960640 1 -- 172.21.15.22:0/3222167001 shutdown_connections 2024-05-07T13:55:41.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7fd664960640 1 -- 172.21.15.22:0/3222167001 wait complete. 2024-05-07T13:55:41.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/3492651117 shutdown_connections 2024-05-07T13:55:41.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f7e8c3bd640 1 --2- 172.21.15.22:0/3492651117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 0x7f7e8406ebd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.389+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/3492651117 >> 172.21.15.22:0/3492651117 conn(0x7f7e8409d950 msgr2=0x7f7e8409dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/3492651117 shutdown_connections 2024-05-07T13:55:41.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/3492651117 wait complete. 2024-05-07T13:55:41.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7fd772cac640 1 -- 172.21.15.22:0/725647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd75c003a30 msgr2=0x7fd75c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7fd772cac640 1 --2- 172.21.15.22:0/725647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd75c003a30 0x7fd75c003e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd760009a20 tx=0x7fd75c005830 comp rx=0 tx=0).stop 2024-05-07T13:55:41.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7fd772cac640 1 -- 172.21.15.22:0/725647294 shutdown_connections 2024-05-07T13:55:41.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7fd772cac640 1 --2- 172.21.15.22:0/725647294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd75c003a30 0x7fd75c003e30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7fd772cac640 1 --2- 172.21.15.22:0/725647294 >> v2:172.21.15.22:3300/0 conn(0x7fd76c12b2e0 0x7fd76c12b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7fd772cac640 1 -- 172.21.15.22:0/725647294 >> 172.21.15.22:0/725647294 conn(0x7fd76c0996c0 msgr2=0x7fd76c099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7fd772cac640 1 -- 172.21.15.22:0/725647294 shutdown_connections 2024-05-07T13:55:41.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7fd772cac640 1 -- 172.21.15.22:0/725647294 wait complete. 2024-05-07T13:55:41.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.390+0000 7f8547c4e640 1 Processor -- start 2024-05-07T13:55:41.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7f8547c4e640 1 -- start start 2024-05-07T13:55:41.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7f8547c4e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006de40 0x7f8540121530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7f8547c4e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8540133b50 con 0x7f854006de40 2024-05-07T13:55:41.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7fd664960640 1 Processor -- start 2024-05-07T13:55:41.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7f85459ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006de40 0x7f8540121530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7f85459ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006de40 0x7f8540121530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45936/0 (socket says 172.21.15.22:45936) 2024-05-07T13:55:41.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7f85459ea640 1 -- 172.21.15.22:0/768109856 learned_addr learned my addr 172.21.15.22:0/768109856 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7fd664960640 1 -- start start 2024-05-07T13:55:41.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7f7e8c3bd640 1 Processor -- start 2024-05-07T13:55:41.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7f7e8c3bd640 1 -- start start 2024-05-07T13:55:41.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.391+0000 7fd772cac640 1 Processor -- start 2024-05-07T13:55:41.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7fd772cac640 1 -- start start 2024-05-07T13:55:41.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f85459ea640 1 -- 172.21.15.22:0/768109856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8540122700 con 0x7f854006de40 2024-05-07T13:55:41.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7fd664960640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012b2e0 0x7fd660122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f85459ea640 1 --2- 172.21.15.22:0/768109856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006de40 0x7f8540121530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c480 tx=0x7f853c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7fd664960640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd660070190 con 0x7fd66012b2e0 2024-05-07T13:55:41.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f7e8c3bd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 0x7f7e841a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7fd65e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012b2e0 0x7fd660122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f7e8c3bd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8406f560 con 0x7f7e8406e7f0 2024-05-07T13:55:41.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7fd65e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012b2e0 0x7fd660122ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45948/0 (socket says 172.21.15.22:45948) 2024-05-07T13:55:41.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7fd65e59c640 1 -- 172.21.15.22:0/3532933599 learned_addr learned my addr 172.21.15.22:0/3532933599 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f85367fc640 1 -- 172.21.15.22:0/768109856 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853c017070 con 0x7f854006de40 2024-05-07T13:55:41.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f85367fc640 1 -- 172.21.15.22:0/768109856 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c005c10 con 0x7f854006de40 2024-05-07T13:55:41.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f85367fc640 1 -- 172.21.15.22:0/768109856 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853c0070d0 con 0x7f854006de40 2024-05-07T13:55:41.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f7e8a159640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 0x7f7e841a79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f7e8a159640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 0x7f7e841a79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45958/0 (socket says 172.21.15.22:45958) 2024-05-07T13:55:41.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f7e8a159640 1 -- 172.21.15.22:0/663168141 learned_addr learned my addr 172.21.15.22:0/663168141 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854009b1d0 con 0x7f854006de40 2024-05-07T13:55:41.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd65e59c640 1 -- 172.21.15.22:0/3532933599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd660124b40 con 0x7fd66012b2e0 2024-05-07T13:55:41.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7f7e8a159640 1 -- 172.21.15.22:0/663168141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e841aab70 con 0x7f7e8406e7f0 2024-05-07T13:55:41.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd65e59c640 1 --2- 172.21.15.22:0/3532933599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012b2e0 0x7fd660122ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c480 tx=0x7fd65000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd772cac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd76c12b2e0 0x7fd76c125d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.392+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8540123aa0 con 0x7f854006de40 2024-05-07T13:55:41.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7f7e8a159640 1 --2- 172.21.15.22:0/663168141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 0x7f7e841a79c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e80034040 tx=0x7f7e800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd770a48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd76c12b2e0 0x7fd76c125d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd770a48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd76c12b2e0 0x7fd76c125d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45960/0 (socket says 172.21.15.22:45960) 2024-05-07T13:55:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd64effd640 1 -- 172.21.15.22:0/3532933599 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650017070 con 0x7fd66012b2e0 2024-05-07T13:55:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd770a48640 1 -- 172.21.15.22:0/1823626090 learned_addr learned my addr 172.21.15.22:0/1823626090 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c06ee20 con 0x7fd76c12b2e0 2024-05-07T13:55:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd64effd640 1 -- 172.21.15.22:0/3532933599 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650005c10 con 0x7fd66012b2e0 2024-05-07T13:55:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd66009c260 con 0x7fd66012b2e0 2024-05-07T13:55:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd64effd640 1 -- 172.21.15.22:0/3532933599 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650007070 con 0x7fd66012b2e0 2024-05-07T13:55:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7f7e7affd640 1 -- 172.21.15.22:0/663168141 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e80032870 con 0x7f7e8406e7f0 2024-05-07T13:55:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.394+0000 7f85367fc640 1 -- 172.21.15.22:0/768109856 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f853c01a070 con 0x7f854006de40 2024-05-07T13:55:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.394+0000 7fd770a48640 1 -- 172.21.15.22:0/1823626090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c127b70 con 0x7fd76c12b2e0 2024-05-07T13:55:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd66008a810 con 0x7fd66012b2e0 2024-05-07T13:55:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.394+0000 7f85367fc640 1 --2- 172.21.15.22:0/768109856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8524038070 0x7f852403a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.394+0000 7f85367fc640 1 -- 172.21.15.22:0/768109856 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f853c04a110 con 0x7f854006de40 2024-05-07T13:55:41.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.394+0000 7fd770a48640 1 --2- 172.21.15.22:0/1823626090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd76c12b2e0 0x7fd76c125d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd760009a20 tx=0x7fd760004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.394+0000 7f85451e9640 1 --2- 172.21.15.22:0/768109856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8524038070 0x7f852403a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7f7e7affd640 1 -- 172.21.15.22:0/663168141 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e80032a10 con 0x7f7e8406e7f0 2024-05-07T13:55:41.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.393+0000 7f7e7affd640 1 -- 172.21.15.22:0/663168141 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e80032cf0 con 0x7f7e8406e7f0 2024-05-07T13:55:41.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.394+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e841b75b0 con 0x7f7e8406e7f0 2024-05-07T13:55:41.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.394+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e841a7f00 con 0x7f7e8406e7f0 2024-05-07T13:55:41.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd7697fa640 1 -- 172.21.15.22:0/1823626090 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd760039050 con 0x7fd76c12b2e0 2024-05-07T13:55:41.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd64effd640 1 -- 172.21.15.22:0/3532933599 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7fd65001a070 con 0x7fd66012b2e0 2024-05-07T13:55:41.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76c08a3d0 con 0x7fd76c12b2e0 2024-05-07T13:55:41.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6601243f0 con 0x7fd66012b2e0 2024-05-07T13:55:41.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76c1262d0 con 0x7fd76c12b2e0 2024-05-07T13:55:41.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8540062e90 con 0x7f854006de40 2024-05-07T13:55:41.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7f85451e9640 1 --2- 172.21.15.22:0/768109856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8524038070 0x7f852403a530 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8530036000 tx=0x7f8530008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd64effd640 1 --2- 172.21.15.22:0/3532933599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd640037f80 0x7fd64003a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd64effd640 1 -- 172.21.15.22:0/3532933599 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fd65004b450 con 0x7fd66012b2e0 2024-05-07T13:55:41.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e841aa360 con 0x7f7e8406e7f0 2024-05-07T13:55:41.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd65dd9b640 1 --2- 172.21.15.22:0/3532933599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd640037f80 0x7fd64003a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd7697fa640 1 -- 172.21.15.22:0/1823626090 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd760045070 con 0x7fd76c12b2e0 2024-05-07T13:55:41.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.395+0000 7fd7697fa640 1 -- 172.21.15.22:0/1823626090 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd760034c40 con 0x7fd76c12b2e0 2024-05-07T13:55:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.396+0000 7f7e7affd640 1 -- 172.21.15.22:0/663168141 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f7e8004d3f0 con 0x7f7e8406e7f0 2024-05-07T13:55:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.396+0000 7f7e7affd640 1 --2- 172.21.15.22:0/663168141 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7e68038020 0x7f7e6803a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.396+0000 7f7e7affd640 1 -- 172.21.15.22:0/663168141 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f7e8002f050 con 0x7f7e8406e7f0 2024-05-07T13:55:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.396+0000 7fd65dd9b640 1 --2- 172.21.15.22:0/3532933599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd640037f80 0x7fd64003a440 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd65400b800 tx=0x7fd654030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.396+0000 7f7e89958640 1 --2- 172.21.15.22:0/663168141 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7e68038020 0x7f7e6803a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.396+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd76c062e90 con 0x7fd76c12b2e0 2024-05-07T13:55:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.397+0000 7f7e89958640 1 --2- 172.21.15.22:0/663168141 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7e68038020 0x7f7e6803a4e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e74007fd0 tx=0x7f7e74007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.400+0000 7fd64effd640 1 -- 172.21.15.22:0/3532933599 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd66009c260 con 0x7fd66012b2e0 2024-05-07T13:55:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.405+0000 7f85367fc640 1 -- 172.21.15.22:0/768109856 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f853c01a520 con 0x7f854006de40 2024-05-07T13:55:41.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.409+0000 7f7e7affd640 1 -- 172.21.15.22:0/663168141 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7e80040070 con 0x7f7e8406e7f0 2024-05-07T13:55:41.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.410+0000 7fd7697fa640 1 -- 172.21.15.22:0/1823626090 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7fd76004a460 con 0x7fd76c12b2e0 2024-05-07T13:55:41.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.410+0000 7fd7697fa640 1 --2- 172.21.15.22:0/1823626090 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd750037fd0 0x7fd75003a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:41.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.410+0000 7fd7697fa640 1 -- 172.21.15.22:0/1823626090 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fd76000f040 con 0x7fd76c12b2e0 2024-05-07T13:55:41.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.411+0000 7fd76bfff640 1 --2- 172.21.15.22:0/1823626090 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd750037fd0 0x7fd75003a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:41.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.411+0000 7fd76bfff640 1 --2- 172.21.15.22:0/1823626090 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd750037fd0 0x7fd75003a490 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd758007810 tx=0x7fd7580014b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:41.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.418+0000 7fd7697fa640 1 -- 172.21.15.22:0/1823626090 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd76004f020 con 0x7fd76c12b2e0 2024-05-07T13:55:41.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.585+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd660062e90 con 0x7fd66012b2e0 2024-05-07T13:55:41.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.585+0000 7fd64effd640 1 -- 172.21.15.22:0/3532933599 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd65001ac60 con 0x7fd66012b2e0 2024-05-07T13:55:41.574 INFO:teuthology.orchestra.run.smithi022.stdout:38654705666 2024-05-07T13:55:41.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd640037f80 msgr2=0x7fd64003a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 --2- 172.21.15.22:0/3532933599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd640037f80 0x7fd64003a440 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd65400b800 tx=0x7fd654030000 comp rx=0 tx=0).stop 2024-05-07T13:55:41.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012b2e0 msgr2=0x7fd660122ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 --2- 172.21.15.22:0/3532933599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012b2e0 0x7fd660122ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c480 tx=0x7fd65000c940 comp rx=0 tx=0).stop 2024-05-07T13:55:41.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 shutdown_connections 2024-05-07T13:55:41.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 --2- 172.21.15.22:0/3532933599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd640037f80 0x7fd64003a440 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 --2- 172.21.15.22:0/3532933599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd66012b2e0 0x7fd660122ce0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 >> 172.21.15.22:0/3532933599 conn(0x7fd6600996c0 msgr2=0x7fd66006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 shutdown_connections 2024-05-07T13:55:41.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.588+0000 7fd664960640 1 -- 172.21.15.22:0/3532933599 wait complete. 2024-05-07T13:55:41.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.2 2024-05-07T13:55:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.608+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7e84062e90 con 0x7f7e8406e7f0 2024-05-07T13:55:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.609+0000 7f7e7affd640 1 -- 172.21.15.22:0/663168141 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7e8003b3f0 con 0x7f7e8406e7f0 2024-05-07T13:55:41.597 INFO:teuthology.orchestra.run.smithi022.stdout:38654705666 2024-05-07T13:55:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.610+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8540122e30 con 0x7f854006de40 2024-05-07T13:55:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.610+0000 7f85367fc640 1 -- 172.21.15.22:0/768109856 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f853c007270 con 0x7f854006de40 2024-05-07T13:55:41.599 INFO:teuthology.orchestra.run.smithi022.stdout:38654705666 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7e68038020 msgr2=0x7f7e6803a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 --2- 172.21.15.22:0/663168141 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7e68038020 0x7f7e6803a4e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e74007fd0 tx=0x7f7e74007ac0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 msgr2=0x7f7e841a79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 --2- 172.21.15.22:0/663168141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 0x7f7e841a79c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e80034040 tx=0x7f7e800046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 shutdown_connections 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 --2- 172.21.15.22:0/663168141 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7e68038020 0x7f7e6803a4e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 --2- 172.21.15.22:0/663168141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e8406e7f0 0x7f7e841a79c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 >> 172.21.15.22:0/663168141 conn(0x7f7e8409d950 msgr2=0x7f7e840903f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 shutdown_connections 2024-05-07T13:55:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.611+0000 7f7e8c3bd640 1 -- 172.21.15.22:0/663168141 wait complete. 2024-05-07T13:55:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8524038070 msgr2=0x7f852403a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 --2- 172.21.15.22:0/768109856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8524038070 0x7f852403a530 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8530036000 tx=0x7f8530008030 comp rx=0 tx=0).stop 2024-05-07T13:55:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006de40 msgr2=0x7f8540121530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 --2- 172.21.15.22:0/768109856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006de40 0x7f8540121530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c480 tx=0x7f853c00c940 comp rx=0 tx=0).stop 2024-05-07T13:55:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 shutdown_connections 2024-05-07T13:55:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 --2- 172.21.15.22:0/768109856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8524038070 0x7f852403a530 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 --2- 172.21.15.22:0/768109856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f854006de40 0x7f8540121530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 >> 172.21.15.22:0/768109856 conn(0x7f854009ccf0 msgr2=0x7f85401328f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 shutdown_connections 2024-05-07T13:55:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.612+0000 7f8547c4e640 1 -- 172.21.15.22:0/768109856 wait complete. 2024-05-07T13:55:41.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.621+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd76c073fd0 con 0x7fd76c12b2e0 2024-05-07T13:55:41.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.621+0000 7fd7697fa640 1 -- 172.21.15.22:0/1823626090 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7600493c0 con 0x7fd76c12b2e0 2024-05-07T13:55:41.610 INFO:teuthology.orchestra.run.smithi022.stdout:38654705666 2024-05-07T13:55:41.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.1 2024-05-07T13:55:41.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd750037fd0 msgr2=0x7fd75003a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 --2- 172.21.15.22:0/1823626090 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd750037fd0 0x7fd75003a490 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd758007810 tx=0x7fd7580014b0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd76c12b2e0 msgr2=0x7fd76c125d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:41.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 --2- 172.21.15.22:0/1823626090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd76c12b2e0 0x7fd76c125d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd760009a20 tx=0x7fd760004730 comp rx=0 tx=0).stop 2024-05-07T13:55:41.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 shutdown_connections 2024-05-07T13:55:41.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 --2- 172.21.15.22:0/1823626090 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd750037fd0 0x7fd75003a490 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 --2- 172.21.15.22:0/1823626090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd76c12b2e0 0x7fd76c125d90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:41.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 >> 172.21.15.22:0/1823626090 conn(0x7fd76c0996c0 msgr2=0x7fd76c1b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:41.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 shutdown_connections 2024-05-07T13:55:41.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:41.624+0000 7fd772cac640 1 -- 172.21.15.22:0/1823626090 wait complete. 2024-05-07T13:55:41.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2024-05-07T13:55:41.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.3 2024-05-07T13:55:42.593 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T13:55:42.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T13:55:42.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T13:55:42.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-07T13:55:42.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.725+0000 7f0ad2a4e640 1 Processor -- start 2024-05-07T13:55:42.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.726+0000 7f0ad2a4e640 1 -- start start 2024-05-07T13:55:42.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.726+0000 7f0ad2a4e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0acc06d810 0x7f0acc06dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.726+0000 7f0ad2a4e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0acc06f380 con 0x7f0acc06e130 2024-05-07T13:55:42.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.726+0000 7f0ad2a4e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0acc06edd0 con 0x7f0acc06d810 2024-05-07T13:55:42.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.726+0000 7f0acbfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0acc06d810 0x7f0acc06dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.726+0000 7f0acb7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0acc06e130 0x7f0acc12e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51940/0 (socket says 172.21.15.22:51940) 2024-05-07T13:55:42.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.726+0000 7f0acb7fe640 1 -- 172.21.15.22:0/3982772937 learned_addr learned my addr 172.21.15.22:0/3982772937 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:42.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.727+0000 7f0acbfff640 1 -- 172.21.15.22:0/3982772937 >> v1:172.21.15.22:6789/0 conn(0x7f0acc06e130 legacy=0x7f0acc12e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.727+0000 7f0acaffd640 1 -- 172.21.15.22:0/3982772937 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965142025 0 0) 0x7f0acc06f380 con 0x7f0acc06e130 2024-05-07T13:55:42.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.727+0000 7f0acbfff640 1 -- 172.21.15.22:0/3982772937 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0acc06e580 con 0x7f0acc06d810 2024-05-07T13:55:42.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.728+0000 7f0acbfff640 1 --2- 172.21.15.22:0/3982772937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 0x7f0acc06dbf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009720 tx=0x7f0abc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7987a7e00c1feba7 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.728+0000 7f0acaffd640 1 -- 172.21.15.22:0/3982772937 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc0316d0 con 0x7f0acc06d810 2024-05-07T13:55:42.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.728+0000 7f0acaffd640 1 -- 172.21.15.22:0/3982772937 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc037070 con 0x7f0acc06d810 2024-05-07T13:55:42.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.728+0000 7f0acaffd640 1 -- 172.21.15.22:0/3982772937 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc0319c0 con 0x7f0acc06d810 2024-05-07T13:55:42.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.728+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/3982772937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 msgr2=0x7f0acc06dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.728+0000 7f0ad2a4e640 1 --2- 172.21.15.22:0/3982772937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 0x7f0acc06dbf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009720 tx=0x7f0abc02b840 comp rx=0 tx=0).stop 2024-05-07T13:55:42.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.729+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/3982772937 shutdown_connections 2024-05-07T13:55:42.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.729+0000 7f0ad2a4e640 1 --2- 172.21.15.22:0/3982772937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 0x7f0acc06dbf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.729+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/3982772937 >> 172.21.15.22:0/3982772937 conn(0x7f0acc0a0d20 msgr2=0x7f0acc0a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:42.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.729+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/3982772937 shutdown_connections 2024-05-07T13:55:42.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.729+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/3982772937 wait complete. 2024-05-07T13:55:42.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.730+0000 7f0ad2a4e640 1 Processor -- start 2024-05-07T13:55:42.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.730+0000 7f0ad2a4e640 1 -- start start 2024-05-07T13:55:42.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.730+0000 7f0ad2a4e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 0x7f0acc1c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.730+0000 7f0ad2a4e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc12ea00 con 0x7f0acc06d810 2024-05-07T13:55:42.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.730+0000 7f0acbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 0x7f0acc1c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.731+0000 7f0acbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 0x7f0acc1c3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45990/0 (socket says 172.21.15.22:45990) 2024-05-07T13:55:42.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.731+0000 7f0acbfff640 1 -- 172.21.15.22:0/577936148 learned_addr learned my addr 172.21.15.22:0/577936148 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:42.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.731+0000 7f0acbfff640 1 -- 172.21.15.22:0/577936148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0acc08faf0 con 0x7f0acc06d810 2024-05-07T13:55:42.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.731+0000 7f0acbfff640 1 --2- 172.21.15.22:0/577936148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 0x7f0acc1c3190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009720 tx=0x7f0abc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.731+0000 7f0ac8ff9640 1 -- 172.21.15.22:0/577936148 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc032770 con 0x7f0acc06d810 2024-05-07T13:55:42.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.731+0000 7f0ac8ff9640 1 -- 172.21.15.22:0/577936148 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc032910 con 0x7f0acc06d810 2024-05-07T13:55:42.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.731+0000 7f0ac8ff9640 1 -- 172.21.15.22:0/577936148 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc032bf0 con 0x7f0acc06d810 2024-05-07T13:55:42.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.731+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0acc090590 con 0x7f0acc06d810 2024-05-07T13:55:42.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.732+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0acc0911c0 con 0x7f0acc06d810 2024-05-07T13:55:42.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.733+0000 7f0ac8ff9640 1 -- 172.21.15.22:0/577936148 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0abc04c060 con 0x7f0acc06d810 2024-05-07T13:55:42.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.733+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0acc090c30 con 0x7f0acc06d810 2024-05-07T13:55:42.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.733+0000 7f0ac8ff9640 1 --2- 172.21.15.22:0/577936148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0ab8038060 0x7f0ab803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.733+0000 7f0ac8ff9640 1 -- 172.21.15.22:0/577936148 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f0abc02f050 con 0x7f0acc06d810 2024-05-07T13:55:42.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.734+0000 7f0acb7fe640 1 --2- 172.21.15.22:0/577936148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0ab8038060 0x7f0ab803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.734+0000 7f0acb7fe640 1 --2- 172.21.15.22:0/577936148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0ab8038060 0x7f0ab803a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0000c00 tx=0x7f0ac0007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.742+0000 7f0ac8ff9640 1 -- 172.21.15.22:0/577936148 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0acc090c30 con 0x7f0acc06d810 2024-05-07T13:55:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.764+0000 7f55ac627640 1 Processor -- start 2024-05-07T13:55:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.764+0000 7f55ac627640 1 -- start start 2024-05-07T13:55:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.764+0000 7fcf89d38640 1 Processor -- start 2024-05-07T13:55:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.764+0000 7fcf89d38640 1 -- start start 2024-05-07T13:55:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.764+0000 7fcf89d38640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcf8406e300 0x7fcf84133610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.764+0000 7fcf89d38640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf8406f380 con 0x7fcf8406d810 2024-05-07T13:55:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.764+0000 7fcf89d38640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fcf8406edd0 con 0x7fcf8406e300 2024-05-07T13:55:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7fcf82ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcf8406e300 0x7fcf84133610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7fcf82ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcf8406e300 0x7fcf84133610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46006/0 (socket says 172.21.15.22:46006) 2024-05-07T13:55:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7fcf82ffd640 1 -- 172.21.15.22:0/729231828 learned_addr learned my addr 172.21.15.22:0/729231828 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.764+0000 7f55ac627640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55a412b440 0x7f55a412b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55ac627640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a40723d0 con 0x7f55a412c170 2024-05-07T13:55:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55ac627640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f55a4072920 con 0x7f55a412b440 2024-05-07T13:55:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55aa3c3640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55a412b440 0x7f55a412b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55a9bc2640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f55a412c170 0x7f55a412c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51954/0 (socket says 172.21.15.22:51954) 2024-05-07T13:55:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55a9bc2640 1 -- 172.21.15.22:0/3531061265 learned_addr learned my addr 172.21.15.22:0/3531061265 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7fcf82ffd640 1 -- 172.21.15.22:0/729231828 >> v1:172.21.15.22:6789/0 conn(0x7fcf8406d810 legacy=0x7fcf8406dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-07T13:55:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7fcf82ffd640 1 -- 172.21.15.22:0/729231828 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8406fde0 con 0x7fcf8406e300 2024-05-07T13:55:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807403544 0 0) 0x7f55a40723d0 con 0x7f55a412c170 2024-05-07T13:55:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5590003520 con 0x7f55a412c170 2024-05-07T13:55:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2684417056 0 0) 0x7f5590003520 con 0x7f55a412c170 2024-05-07T13:55:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 >> v2:172.21.15.22:3300/0 conn(0x7f55a412b440 msgr2=0x7f55a412b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-07T13:55:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55a93c1640 1 --2- 172.21.15.22:0/3531061265 >> v2:172.21.15.22:3300/0 conn(0x7f55a412b440 0x7f55a412b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.765+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a4071510 con 0x7f55a412c170 2024-05-07T13:55:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1735563264 0 0) 0x7f55940015a0 con 0x7f55a412c170 2024-05-07T13:55:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 >> v1:172.21.15.22:6789/0 conn(0x7f55a412c170 legacy=0x7f55a412c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7f55a93c1640 1 --2- 172.21.15.22:0/3531061265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f5590003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5590004470 con 0x7f55900039b0 2024-05-07T13:55:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7f55aa3c3640 1 --2- 172.21.15.22:0/3531061265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f5590003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7fcf82ffd640 1 --2- 172.21.15.22:0/729231828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406e300 0x7fcf84133610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf780097f0 tx=0x7fcf7802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0925bc68f71ba5 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7fcf827fc640 1 -- 172.21.15.22:0/729231828 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf7802e070 con 0x7fcf8406e300 2024-05-07T13:55:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7fcf827fc640 1 -- 172.21.15.22:0/729231828 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf78037070 con 0x7fcf8406e300 2024-05-07T13:55:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7fcf827fc640 1 -- 172.21.15.22:0/729231828 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf78031730 con 0x7fcf8406e300 2024-05-07T13:55:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.766+0000 7f55aa3c3640 1 -- 172.21.15.22:0/3531061265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5590003520 con 0x7f55900039b0 2024-05-07T13:55:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7fcf89d38640 1 -- 172.21.15.22:0/729231828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406e300 msgr2=0x7fcf84133610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7fcf89d38640 1 --2- 172.21.15.22:0/729231828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406e300 0x7fcf84133610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf780097f0 tx=0x7fcf7802b880 comp rx=0 tx=0).stop 2024-05-07T13:55:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7fcf89d38640 1 -- 172.21.15.22:0/729231828 shutdown_connections 2024-05-07T13:55:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7fcf89d38640 1 --2- 172.21.15.22:0/729231828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406e300 0x7fcf84133610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7fcf89d38640 1 -- 172.21.15.22:0/729231828 >> 172.21.15.22:0/729231828 conn(0x7fcf840a0d20 msgr2=0x7fcf840a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7fcf89d38640 1 -- 172.21.15.22:0/729231828 shutdown_connections 2024-05-07T13:55:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7f1749af2640 1 Processor -- start 2024-05-07T13:55:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7fcf89d38640 1 -- 172.21.15.22:0/729231828 wait complete. 2024-05-07T13:55:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7f1749af2640 1 -- start start 2024-05-07T13:55:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.767+0000 7f55aa3c3640 1 --2- 172.21.15.22:0/3531061265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f5590003db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009a20 tx=0x7f5590005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbffdcba85ecaf90 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0039070 con 0x7f55900039b0 2024-05-07T13:55:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f1749af2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f174406d4f0 0x7f174406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a002c9a0 con 0x7f55900039b0 2024-05-07T13:55:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f55a93c1640 1 -- 172.21.15.22:0/3531061265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0039070 con 0x7f55900039b0 2024-05-07T13:55:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f1749af2640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17440720b0 con 0x7f174406de10 2024-05-07T13:55:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f1749af2640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f174406f6b0 con 0x7f174406d4f0 2024-05-07T13:55:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f1742ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f174406de10 0x7f174409a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51958/0 (socket says 172.21.15.22:51958) 2024-05-07T13:55:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f1742ffd640 1 -- 172.21.15.22:0/2783896312 learned_addr learned my addr 172.21.15.22:0/2783896312 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f17437fe640 1 --2- 172.21.15.22:0/2783896312 >> v2:172.21.15.22:3300/0 conn(0x7f174406d4f0 0x7f174406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7fcf89d38640 1 Processor -- start 2024-05-07T13:55:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f17427fc640 1 -- 172.21.15.22:0/2783896312 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211329453 0 0) 0x7f17440720b0 con 0x7f174406de10 2024-05-07T13:55:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f17427fc640 1 -- 172.21.15.22:0/2783896312 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f172c003520 con 0x7f174406de10 2024-05-07T13:55:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f17437fe640 1 -- 172.21.15.22:0/2783896312 >> v1:172.21.15.22:6789/0 conn(0x7f174406de10 legacy=0x7f174409a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.768+0000 7f17437fe640 1 -- 172.21.15.22:0/2783896312 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174406e710 con 0x7f174406d4f0 2024-05-07T13:55:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7fcf89d38640 1 -- start start 2024-05-07T13:55:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7f55ac627640 1 -- 172.21.15.22:0/3531061265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 msgr2=0x7f5590003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7f55ac627640 1 --2- 172.21.15.22:0/3531061265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f5590003db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009a20 tx=0x7f5590005830 comp rx=0 tx=0).stop 2024-05-07T13:55:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7f55ac627640 1 -- 172.21.15.22:0/3531061265 shutdown_connections 2024-05-07T13:55:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7f55ac627640 1 --2- 172.21.15.22:0/3531061265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f5590003db0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7f55ac627640 1 --2- 172.21.15.22:0/3531061265 >> v2:172.21.15.22:3300/0 conn(0x7f55a412b440 0x7f55a412b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7f55ac627640 1 -- 172.21.15.22:0/3531061265 >> 172.21.15.22:0/3531061265 conn(0x7f55a409b7f0 msgr2=0x7f55a409bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7f55ac627640 1 -- 172.21.15.22:0/3531061265 shutdown_connections 2024-05-07T13:55:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7f55ac627640 1 -- 172.21.15.22:0/3531061265 wait complete. 2024-05-07T13:55:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7fcf89d38640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406d810 0x7fcf8409a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7fcf89d38640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcf84133cd0 con 0x7fcf8406d810 2024-05-07T13:55:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7fcf837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406d810 0x7fcf8409a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7fcf837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406d810 0x7fcf8409a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46050/0 (socket says 172.21.15.22:46050) 2024-05-07T13:55:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7fcf837fe640 1 -- 172.21.15.22:0/3806068051 learned_addr learned my addr 172.21.15.22:0/3806068051 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.769+0000 7f17437fe640 1 --2- 172.21.15.22:0/2783896312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 0x7f174406d8d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1734009980 tx=0x7f173402bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88173ae93a18cfb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7f17427fc640 1 -- 172.21.15.22:0/2783896312 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f173402d590 con 0x7f174406d4f0 2024-05-07T13:55:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7f17427fc640 1 -- 172.21.15.22:0/2783896312 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173402d730 con 0x7f174406d4f0 2024-05-07T13:55:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7f17427fc640 1 -- 172.21.15.22:0/2783896312 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f173402da30 con 0x7f174406d4f0 2024-05-07T13:55:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7fcf837fe640 1 -- 172.21.15.22:0/3806068051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf841309c0 con 0x7fcf8406d810 2024-05-07T13:55:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7fcf837fe640 1 --2- 172.21.15.22:0/3806068051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406d810 0x7fcf8409a710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400c3b0 tx=0x7fcf7400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7fcf6bfff640 1 -- 172.21.15.22:0/3806068051 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf740116c0 con 0x7fcf8406d810 2024-05-07T13:55:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7fcf6bfff640 1 -- 172.21.15.22:0/3806068051 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf74017070 con 0x7fcf8406d810 2024-05-07T13:55:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7fcf6bfff640 1 -- 172.21.15.22:0/3806068051 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf740119d0 con 0x7fcf8406d810 2024-05-07T13:55:42.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf84131bd0 con 0x7fcf8406d810 2024-05-07T13:55:42.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8409ae30 con 0x7fcf8406d810 2024-05-07T13:55:42.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7f55ac627640 1 Processor -- start 2024-05-07T13:55:42.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.770+0000 7f55ac627640 1 -- start start 2024-05-07T13:55:42.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f1749af2640 1 -- 172.21.15.22:0/2783896312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 msgr2=0x7f174406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f1749af2640 1 --2- 172.21.15.22:0/2783896312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 0x7f174406d8d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1734009980 tx=0x7f173402bab0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f55ac627640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f55a411b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f55ac627640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f55a412bd60 con 0x7f55900039b0 2024-05-07T13:55:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f1749af2640 1 -- 172.21.15.22:0/2783896312 shutdown_connections 2024-05-07T13:55:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f1749af2640 1 --2- 172.21.15.22:0/2783896312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 0x7f174406d8d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f1749af2640 1 -- 172.21.15.22:0/2783896312 >> 172.21.15.22:0/2783896312 conn(0x7f174409d750 msgr2=0x7f174409db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:42.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f55aa3c3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f55a411b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f55aa3c3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f55a411b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46058/0 (socket says 172.21.15.22:46058) 2024-05-07T13:55:42.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f55aa3c3640 1 -- 172.21.15.22:0/1934086152 learned_addr learned my addr 172.21.15.22:0/1934086152 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:42.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7fcf6bfff640 1 -- 172.21.15.22:0/3806068051 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcf74011b70 con 0x7fcf8406d810 2024-05-07T13:55:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.771+0000 7f1749af2640 1 -- 172.21.15.22:0/2783896312 shutdown_connections 2024-05-07T13:55:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.772+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf84062e90 con 0x7fcf8406d810 2024-05-07T13:55:42.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.772+0000 7f1749af2640 1 -- 172.21.15.22:0/2783896312 wait complete. 2024-05-07T13:55:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.772+0000 7f55aa3c3640 1 -- 172.21.15.22:0/1934086152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a411d980 con 0x7f55900039b0 2024-05-07T13:55:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.772+0000 7fcf6bfff640 1 --2- 172.21.15.22:0/3806068051 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcf70038060 0x7fcf7003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.772+0000 7fcf6bfff640 1 -- 172.21.15.22:0/3806068051 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fcf7404a7e0 con 0x7fcf8406d810 2024-05-07T13:55:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.772+0000 7f55aa3c3640 1 --2- 172.21.15.22:0/1934086152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f55a411b470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009b40 tx=0x7f55a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.772+0000 7fcf82ffd640 1 --2- 172.21.15.22:0/3806068051 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcf70038060 0x7fcf7003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.773+0000 7f1749af2640 1 Processor -- start 2024-05-07T13:55:42.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.773+0000 7fcf82ffd640 1 --2- 172.21.15.22:0/3806068051 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcf70038060 0x7fcf7003a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf78036000 tx=0x7fcf78008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.773+0000 7f1749af2640 1 -- start start 2024-05-07T13:55:42.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.773+0000 7f1749af2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 0x7f17441292a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.773+0000 7f1749af2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f174406ed30 con 0x7f174406d4f0 2024-05-07T13:55:42.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.773+0000 7f17437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 0x7f17441292a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.773+0000 7f17437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 0x7f17441292a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46074/0 (socket says 172.21.15.22:46074) 2024-05-07T13:55:42.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.773+0000 7f17437fe640 1 -- 172.21.15.22:0/542653698 learned_addr learned my addr 172.21.15.22:0/542653698 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:42.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.774+0000 7f17437fe640 1 -- 172.21.15.22:0/542653698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174408eb40 con 0x7f174406d4f0 2024-05-07T13:55:42.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.774+0000 7f17437fe640 1 --2- 172.21.15.22:0/542653698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 0x7f17441292a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1734009aa0 tx=0x7f17340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.776+0000 7f559affd640 1 -- 172.21.15.22:0/1934086152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0042070 con 0x7f55900039b0 2024-05-07T13:55:42.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.776+0000 7f559affd640 1 -- 172.21.15.22:0/1934086152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a0034d90 con 0x7f55900039b0 2024-05-07T13:55:42.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.776+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a411deb0 con 0x7f55900039b0 2024-05-07T13:55:42.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.776+0000 7f559affd640 1 -- 172.21.15.22:0/1934086152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0039070 con 0x7f55900039b0 2024-05-07T13:55:42.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.777+0000 7f172bfff640 1 -- 172.21.15.22:0/542653698 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f173402ebc0 con 0x7f174406d4f0 2024-05-07T13:55:42.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.777+0000 7f172bfff640 1 -- 172.21.15.22:0/542653698 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1734047070 con 0x7f174406d4f0 2024-05-07T13:55:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.777+0000 7f172bfff640 1 -- 172.21.15.22:0/542653698 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1734042470 con 0x7f174406d4f0 2024-05-07T13:55:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.777+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174408ede0 con 0x7f174406d4f0 2024-05-07T13:55:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.777+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17441297e0 con 0x7f174406d4f0 2024-05-07T13:55:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.777+0000 7fcf6bfff640 1 -- 172.21.15.22:0/3806068051 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcf74020020 con 0x7fcf8406d810 2024-05-07T13:55:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.777+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a411bb90 con 0x7f55900039b0 2024-05-07T13:55:42.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.778+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a409cf90 con 0x7f55900039b0 2024-05-07T13:55:42.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.778+0000 7f559affd640 1 -- 172.21.15.22:0/1934086152 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f55a0045070 con 0x7f55900039b0 2024-05-07T13:55:42.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.778+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1744062e90 con 0x7f174406d4f0 2024-05-07T13:55:42.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.778+0000 7f559affd640 1 --2- 172.21.15.22:0/1934086152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5588038090 0x7f558803a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.778+0000 7f559affd640 1 -- 172.21.15.22:0/1934086152 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f55a000f040 con 0x7f55900039b0 2024-05-07T13:55:42.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.778+0000 7f55a9bc2640 1 --2- 172.21.15.22:0/1934086152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5588038090 0x7f558803a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.779+0000 7f172bfff640 1 -- 172.21.15.22:0/542653698 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1734042610 con 0x7f174406d4f0 2024-05-07T13:55:42.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.779+0000 7f172bfff640 1 --2- 172.21.15.22:0/542653698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f17300380b0 0x7f173003a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:42.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.779+0000 7f172bfff640 1 -- 172.21.15.22:0/542653698 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f173406de50 con 0x7f174406d4f0 2024-05-07T13:55:42.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.779+0000 7f55a9bc2640 1 --2- 172.21.15.22:0/1934086152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5588038090 0x7f558803a550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5594000ff0 tx=0x7f5594001160 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.779+0000 7f1742ffd640 1 --2- 172.21.15.22:0/542653698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f17300380b0 0x7f173003a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:42.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.780+0000 7f1742ffd640 1 --2- 172.21.15.22:0/542653698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f17300380b0 0x7f173003a570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1738007fd0 tx=0x7f17380010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:42.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.787+0000 7f559affd640 1 -- 172.21.15.22:0/1934086152 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f55a409cf90 con 0x7f55900039b0 2024-05-07T13:55:42.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.796+0000 7f172bfff640 1 -- 172.21.15.22:0/542653698 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f174408eb40 con 0x7f174406d4f0 2024-05-07T13:55:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.973+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcf84131da0 con 0x7fcf8406d810 2024-05-07T13:55:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.974+0000 7fcf6bfff640 1 -- 172.21.15.22:0/3806068051 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf74019310 con 0x7fcf8406d810 2024-05-07T13:55:42.963 INFO:teuthology.orchestra.run.smithi022.stdout:38654705667 2024-05-07T13:55:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.975+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f55a4062e90 con 0x7f55900039b0 2024-05-07T13:55:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.975+0000 7f559affd640 1 -- 172.21.15.22:0/1934086152 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f55a004f350 con 0x7f55900039b0 2024-05-07T13:55:42.964 INFO:teuthology.orchestra.run.smithi022.stdout:38654705667 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcf70038060 msgr2=0x7fcf7003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 --2- 172.21.15.22:0/3806068051 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcf70038060 0x7fcf7003a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf78036000 tx=0x7fcf78008030 comp rx=0 tx=0).stop 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406d810 msgr2=0x7fcf8409a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 --2- 172.21.15.22:0/3806068051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406d810 0x7fcf8409a710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400c3b0 tx=0x7fcf7400c870 comp rx=0 tx=0).stop 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 shutdown_connections 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 --2- 172.21.15.22:0/3806068051 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcf70038060 0x7fcf7003a520 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 --2- 172.21.15.22:0/3806068051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf8406d810 0x7fcf8409a710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 >> 172.21.15.22:0/3806068051 conn(0x7fcf840a0d20 msgr2=0x7fcf8409d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 shutdown_connections 2024-05-07T13:55:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.976+0000 7fcf89d38640 1 -- 172.21.15.22:0/3806068051 wait complete. 2024-05-07T13:55:42.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.977+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5588038090 msgr2=0x7f558803a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.977+0000 7f55ac627640 1 --2- 172.21.15.22:0/1934086152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5588038090 0x7f558803a550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5594000ff0 tx=0x7f5594001160 comp rx=0 tx=0).stop 2024-05-07T13:55:42.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.977+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 msgr2=0x7f55a411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.977+0000 7f55ac627640 1 --2- 172.21.15.22:0/1934086152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f55a411b470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009b40 tx=0x7f55a0004730 comp rx=0 tx=0).stop 2024-05-07T13:55:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.978+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 shutdown_connections 2024-05-07T13:55:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.978+0000 7f55ac627640 1 --2- 172.21.15.22:0/1934086152 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5588038090 0x7f558803a550 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.978+0000 7f55ac627640 1 --2- 172.21.15.22:0/1934086152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55900039b0 0x7f55a411b470 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.978+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 >> 172.21.15.22:0/1934086152 conn(0x7f55a409b7f0 msgr2=0x7f55a41b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.978+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 shutdown_connections 2024-05-07T13:55:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.978+0000 7f55ac627640 1 -- 172.21.15.22:0/1934086152 wait complete. 2024-05-07T13:55:42.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.984+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f174412a400 con 0x7f174406d4f0 2024-05-07T13:55:42.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.985+0000 7f172bfff640 1 -- 172.21.15.22:0/542653698 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1734033030 con 0x7f174406d4f0 2024-05-07T13:55:42.973 INFO:teuthology.orchestra.run.smithi022.stdout:38654705667 2024-05-07T13:55:42.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f17300380b0 msgr2=0x7f173003a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 --2- 172.21.15.22:0/542653698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f17300380b0 0x7f173003a570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1738007fd0 tx=0x7f17380010a0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 msgr2=0x7f17441292a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:42.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 --2- 172.21.15.22:0/542653698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 0x7f17441292a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1734009aa0 tx=0x7f17340046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 shutdown_connections 2024-05-07T13:55:42.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 --2- 172.21.15.22:0/542653698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f17300380b0 0x7f173003a570 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 --2- 172.21.15.22:0/542653698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f174406d4f0 0x7f17441292a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:42.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 >> 172.21.15.22:0/542653698 conn(0x7f174409d750 msgr2=0x7f17441b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:42.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 shutdown_connections 2024-05-07T13:55:42.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:42.987+0000 7f1749af2640 1 -- 172.21.15.22:0/542653698 wait complete. 2024-05-07T13:55:42.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.0 2024-05-07T13:55:42.978 DEBUG:teuthology.parallel:result is None 2024-05-07T13:55:42.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.3 2024-05-07T13:55:42.979 DEBUG:teuthology.parallel:result is None 2024-05-07T13:55:42.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.1 2024-05-07T13:55:42.987 DEBUG:teuthology.parallel:result is None 2024-05-07T13:55:43.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.020+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0acc062e90 con 0x7f0acc06d810 2024-05-07T13:55:43.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.020+0000 7f0ac8ff9640 1 -- 172.21.15.22:0/577936148 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0abc040070 con 0x7f0acc06d810 2024-05-07T13:55:43.009 INFO:teuthology.orchestra.run.smithi022.stdout:38654705667 2024-05-07T13:55:43.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0ab8038060 msgr2=0x7f0ab803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 --2- 172.21.15.22:0/577936148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0ab8038060 0x7f0ab803a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0000c00 tx=0x7f0ac0007910 comp rx=0 tx=0).stop 2024-05-07T13:55:43.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 msgr2=0x7f0acc1c3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 --2- 172.21.15.22:0/577936148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 0x7f0acc1c3190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009720 tx=0x7f0abc0046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 shutdown_connections 2024-05-07T13:55:43.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 --2- 172.21.15.22:0/577936148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0ab8038060 0x7f0ab803a520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 --2- 172.21.15.22:0/577936148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0acc06d810 0x7f0acc1c3190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 >> 172.21.15.22:0/577936148 conn(0x7f0acc0a0d20 msgr2=0x7f0acc09ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:43.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 shutdown_connections 2024-05-07T13:55:43.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.023+0000 7f0ad2a4e640 1 -- 172.21.15.22:0/577936148 wait complete. 2024-05-07T13:55:43.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.2 2024-05-07T13:55:43.023 DEBUG:teuthology.parallel:result is None 2024-05-07T13:55:43.023 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-07T13:55:43.024 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T13:55:43.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.179+0000 7f011e0e6640 1 Processor -- start 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.179+0000 7f011e0e6640 1 -- start start 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.180+0000 7f011e0e6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f01180723d0 0x7f011812ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.180+0000 7f011e0e6640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011812a9b0 con 0x7f011812b320 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.180+0000 7f011e0e6640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0118070f10 con 0x7f01180723d0 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.180+0000 7f01177fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f01180723d0 0x7f011812ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.180+0000 7f0116ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f011812b320 0x7f01181273a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51966/0 (socket says 172.21.15.22:51966) 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.180+0000 7f0116ffd640 1 -- 172.21.15.22:0/291851631 learned_addr learned my addr 172.21.15.22:0/291851631 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.180+0000 7f01177fe640 1 -- 172.21.15.22:0/291851631 >> v1:172.21.15.22:6789/0 conn(0x7f011812b320 legacy=0x7f01181273a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.180+0000 7f01167fc640 1 -- 172.21.15.22:0/291851631 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137584301 0 0) 0x7f011812a9b0 con 0x7f011812b320 2024-05-07T13:55:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.180+0000 7f01177fe640 1 -- 172.21.15.22:0/291851631 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0118070740 con 0x7f01180723d0 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.181+0000 7f01177fe640 1 --2- 172.21.15.22:0/291851631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 0x7f011812ade0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0100009720 tx=0x7f010002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f7fc0887ab797 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.181+0000 7f01167fc640 1 -- 172.21.15.22:0/291851631 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0100035020 con 0x7f01180723d0 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.181+0000 7f01167fc640 1 -- 172.21.15.22:0/291851631 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0100031760 con 0x7f01180723d0 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.181+0000 7f01167fc640 1 -- 172.21.15.22:0/291851631 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0100031a60 con 0x7f01180723d0 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.182+0000 7f011e0e6640 1 -- 172.21.15.22:0/291851631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 msgr2=0x7f011812ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.182+0000 7f011e0e6640 1 --2- 172.21.15.22:0/291851631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 0x7f011812ade0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0100009720 tx=0x7f010002b8d0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.182+0000 7f011e0e6640 1 -- 172.21.15.22:0/291851631 shutdown_connections 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.182+0000 7f011e0e6640 1 --2- 172.21.15.22:0/291851631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 0x7f011812ade0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.182+0000 7f011e0e6640 1 -- 172.21.15.22:0/291851631 >> 172.21.15.22:0/291851631 conn(0x7f0118099380 msgr2=0x7f0118099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.182+0000 7f011e0e6640 1 -- 172.21.15.22:0/291851631 shutdown_connections 2024-05-07T13:55:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.182+0000 7f011e0e6640 1 -- 172.21.15.22:0/291851631 wait complete. 2024-05-07T13:55:43.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.183+0000 7f011e0e6640 1 Processor -- start 2024-05-07T13:55:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.183+0000 7f011e0e6640 1 -- start start 2024-05-07T13:55:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.183+0000 7f011e0e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 0x7f0118119620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.183+0000 7f011e0e6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0118071e00 con 0x7f01180723d0 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.183+0000 7f01177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 0x7f0118119620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.183+0000 7f01177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 0x7f0118119620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46102/0 (socket says 172.21.15.22:46102) 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.183+0000 7f01177fe640 1 -- 172.21.15.22:0/1974172324 learned_addr learned my addr 172.21.15.22:0/1974172324 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.184+0000 7f01177fe640 1 -- 172.21.15.22:0/1974172324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0118121be0 con 0x7f01180723d0 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.184+0000 7f01177fe640 1 --2- 172.21.15.22:0/1974172324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 0x7f0118119620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0100034040 tx=0x7f01000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.184+0000 7f010ffff640 1 -- 172.21.15.22:0/1974172324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010003a970 con 0x7f01180723d0 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.184+0000 7f010ffff640 1 -- 172.21.15.22:0/1974172324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010003ab30 con 0x7f01180723d0 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.184+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011811ae70 con 0x7f01180723d0 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.184+0000 7f010ffff640 1 -- 172.21.15.22:0/1974172324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010003ae50 con 0x7f01180723d0 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.184+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0118119b60 con 0x7f01180723d0 2024-05-07T13:55:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.185+0000 7f010ffff640 1 -- 172.21.15.22:0/1974172324 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f010004b060 con 0x7f01180723d0 2024-05-07T13:55:43.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.185+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0118062e90 con 0x7f01180723d0 2024-05-07T13:55:43.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.185+0000 7f010ffff640 1 --2- 172.21.15.22:0/1974172324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f00f80381b0 0x7f00f803a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:43.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.185+0000 7f010ffff640 1 -- 172.21.15.22:0/1974172324 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f010006cc50 con 0x7f01180723d0 2024-05-07T13:55:43.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.186+0000 7f0116ffd640 1 --2- 172.21.15.22:0/1974172324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f00f80381b0 0x7f00f803a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:43.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.186+0000 7f0116ffd640 1 --2- 172.21.15.22:0/1974172324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f00f80381b0 0x7f00f803a670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0108000c00 tx=0x7f0108007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.190+0000 7f010ffff640 1 -- 172.21.15.22:0/1974172324 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f010003f070 con 0x7f01180723d0 2024-05-07T13:55:43.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.373+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0118099c20 con 0x7f00f80381b0 2024-05-07T13:55:43.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.375+0000 7f010ffff640 1 -- 172.21.15.22:0/1974172324 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31815 (secure 0 0 0) 0x7f0118099c20 con 0x7f00f80381b0 2024-05-07T13:55:43.364 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:43.364 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T13:55:43.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f00f80381b0 msgr2=0x7f00f803a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 --2- 172.21.15.22:0/1974172324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f00f80381b0 0x7f00f803a670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0108000c00 tx=0x7f0108007970 comp rx=0 tx=0).stop 2024-05-07T13:55:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 msgr2=0x7f0118119620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 --2- 172.21.15.22:0/1974172324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 0x7f0118119620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0100034040 tx=0x7f01000046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 shutdown_connections 2024-05-07T13:55:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 --2- 172.21.15.22:0/1974172324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f00f80381b0 0x7f00f803a670 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 --2- 172.21.15.22:0/1974172324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01180723d0 0x7f0118119620 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 >> 172.21.15.22:0/1974172324 conn(0x7f0118099380 msgr2=0x7f011809a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 shutdown_connections 2024-05-07T13:55:43.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.377+0000 7f011e0e6640 1 -- 172.21.15.22:0/1974172324 wait complete. 2024-05-07T13:55:43.376 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-05-07T13:55:42.104658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135836,"kb_used_data":1552,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351524,"statfs":{"total":386547056640,"available":386407960576,"internally_reserved":0,"allocated":1589248,"data_stored":1291770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040281+0000","last_change":"2024-05-07T13:55:40.043788+0000","last_active":"2024-05-07T13:55:41.040281+0000","last_peered":"2024-05-07T13:55:41.040281+0000","last_clean":"2024-05-07T13:55:41.040281+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T13:55:41.040281+0000","last_undegraded":"2024-05-07T13:55:41.040281+0000","last_fullsized":"2024-05-07T13:55:41.040281+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:00.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T13:55:40.045984+0000","last_change":"2024-05-07T13:55:40.045556+0000","last_active":"2024-05-07T13:55:40.045984+0000","last_peered":"2024-05-07T13:55:40.045984+0000","last_clean":"2024-05-07T13:55:40.045984+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:55:40.045984+0000","last_undegraded":"2024-05-07T13:55:40.045984+0000","last_fullsized":"2024-05-07T13:55:40.045984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:44.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040268+0000","last_change":"2024-05-07T13:55:40.044124+0000","last_active":"2024-05-07T13:55:41.040268+0000","last_peered":"2024-05-07T13:55:41.040268+0000","last_clean":"2024-05-07T13:55:41.040268+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T13:55:41.040268+0000","last_undegraded":"2024-05-07T13:55:41.040268+0000","last_fullsized":"2024-05-07T13:55:41.040268+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:38.642853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T13:55:40.044055+0000","last_change":"2024-05-07T13:55:40.043241+0000","last_active":"2024-05-07T13:55:40.044055+0000","last_peered":"2024-05-07T13:55:40.044055+0000","last_clean":"2024-05-07T13:55:40.044055+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:55:40.044055+0000","last_undegraded":"2024-05-07T13:55:40.044055+0000","last_fullsized":"2024-05-07T13:55:40.044055+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:11:16.179864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040287+0000","last_change":"2024-05-07T13:55:40.044279+0000","last_active":"2024-05-07T13:55:41.040287+0000","last_peered":"2024-05-07T13:55:41.040287+0000","last_clean":"2024-05-07T13:55:41.040287+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T13:55:41.040287+0000","last_undegraded":"2024-05-07T13:55:41.040287+0000","last_fullsized":"2024-05-07T13:55:41.040287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:05:53.554681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T13:55:40.044938+0000","last_change":"2024-05-07T13:55:40.043522+0000","last_active":"2024-05-07T13:55:40.044938+0000","last_peered":"2024-05-07T13:55:40.044938+0000","last_clean":"2024-05-07T13:55:40.044938+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:55:40.044938+0000","last_undegraded":"2024-05-07T13:55:40.044938+0000","last_fullsized":"2024-05-07T13:55:40.044938+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:11:16.179864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040335+0000","last_change":"2024-05-07T13:55:40.043428+0000","last_active":"2024-05-07T13:55:41.040335+0000","last_peered":"2024-05-07T13:55:41.040335+0000","last_clean":"2024-05-07T13:55:41.040335+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T13:55:41.040335+0000","last_undegraded":"2024-05-07T13:55:41.040335+0000","last_fullsized":"2024-05-07T13:55:41.040335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:34.894187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040291+0000","last_change":"2024-05-07T13:55:40.045474+0000","last_active":"2024-05-07T13:55:41.040291+0000","last_peered":"2024-05-07T13:55:41.040291+0000","last_clean":"2024-05-07T13:55:41.040291+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T13:55:41.040291+0000","last_undegraded":"2024-05-07T13:55:41.040291+0000","last_fullsized":"2024-05-07T13:55:41.040291+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:03.440717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":159,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T13:55:40.734543+0000","last_change":"2024-05-07T13:55:40.043635+0000","last_active":"2024-05-07T13:55:40.734543+0000","last_peered":"2024-05-07T13:55:40.734543+0000","last_clean":"2024-05-07T13:55:40.734543+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:55:40.734543+0000","last_undegraded":"2024-05-07T13:55:40.734543+0000","last_fullsized":"2024-05-07T13:55:40.734543+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:11:16.179864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":106496,"data_stored":31051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T13:55:43.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T13:55:43.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.492+0000 7f8b662e0640 1 Processor -- start 2024-05-07T13:55:43.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.492+0000 7f8b662e0640 1 -- start start 2024-05-07T13:55:43.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.492+0000 7f8b662e0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8b601316e0 0x7f8b60133ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:43.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.492+0000 7f8b662e0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b60072290 con 0x7f8b6006d9d0 2024-05-07T13:55:43.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.492+0000 7f8b662e0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6006e4c0 con 0x7f8b601316e0 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.493+0000 7f8b57fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8b601316e0 0x7f8b60133ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.493+0000 7f8b5ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8b6006d9d0 0x7f8b6006ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51978/0 (socket says 172.21.15.22:51978) 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.493+0000 7f8b5ffff640 1 -- 172.21.15.22:0/655696649 learned_addr learned my addr 172.21.15.22:0/655696649 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.493+0000 7f8b57fff640 1 -- 172.21.15.22:0/655696649 >> v1:172.21.15.22:6789/0 conn(0x7f8b6006d9d0 legacy=0x7f8b6006ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.493+0000 7f8b5f7fe640 1 -- 172.21.15.22:0/655696649 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2042164166 0 0) 0x7f8b60072290 con 0x7f8b6006d9d0 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.493+0000 7f8b57fff640 1 -- 172.21.15.22:0/655696649 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6006eec0 con 0x7f8b601316e0 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.494+0000 7f8b57fff640 1 --2- 172.21.15.22:0/655696649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b601316e0 0x7f8b60133ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009720 tx=0x7f8b4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810fff41fe40df02 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.494+0000 7f8b5f7fe640 1 -- 172.21.15.22:0/655696649 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b48035020 con 0x7f8b601316e0 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.494+0000 7f8b5f7fe640 1 -- 172.21.15.22:0/655696649 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b48031760 con 0x7f8b601316e0 2024-05-07T13:55:43.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.494+0000 7f8b5f7fe640 1 -- 172.21.15.22:0/655696649 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b48031a60 con 0x7f8b601316e0 2024-05-07T13:55:43.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.495+0000 7f8b662e0640 1 -- 172.21.15.22:0/655696649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b601316e0 msgr2=0x7f8b60133ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.495+0000 7f8b662e0640 1 --2- 172.21.15.22:0/655696649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b601316e0 0x7f8b60133ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009720 tx=0x7f8b4802b8d0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.495+0000 7f8b662e0640 1 -- 172.21.15.22:0/655696649 shutdown_connections 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.495+0000 7f8b662e0640 1 --2- 172.21.15.22:0/655696649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b601316e0 0x7f8b60133ad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.495+0000 7f8b662e0640 1 -- 172.21.15.22:0/655696649 >> 172.21.15.22:0/655696649 conn(0x7f8b6009d750 msgr2=0x7f8b6009db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.495+0000 7f8b662e0640 1 -- 172.21.15.22:0/655696649 shutdown_connections 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.495+0000 7f8b662e0640 1 -- 172.21.15.22:0/655696649 wait complete. 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.496+0000 7f8b662e0640 1 Processor -- start 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.496+0000 7f8b662e0640 1 -- start start 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.496+0000 7f8b662e0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b6006d9d0 0x7f8b6012d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.496+0000 7f8b662e0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6006f920 con 0x7f8b6006d9d0 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.496+0000 7f8b5ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b6006d9d0 0x7f8b6012d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.496+0000 7f8b5ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b6006d9d0 0x7f8b6012d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46124/0 (socket says 172.21.15.22:46124) 2024-05-07T13:55:43.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.496+0000 7f8b5ffff640 1 -- 172.21.15.22:0/3885668664 learned_addr learned my addr 172.21.15.22:0/3885668664 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.497+0000 7f8b5ffff640 1 -- 172.21.15.22:0/3885668664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6008e800 con 0x7f8b6006d9d0 2024-05-07T13:55:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.497+0000 7f8b5ffff640 1 --2- 172.21.15.22:0/3885668664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b6006d9d0 0x7f8b6012d9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c420 tx=0x7f8b5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.497+0000 7f8b5d7fa640 1 -- 172.21.15.22:0/3885668664 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50018070 con 0x7f8b6006d9d0 2024-05-07T13:55:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.497+0000 7f8b5d7fa640 1 -- 172.21.15.22:0/3885668664 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b500074d0 con 0x7f8b6006d9d0 2024-05-07T13:55:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.497+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b60090040 con 0x7f8b6006d9d0 2024-05-07T13:55:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.497+0000 7f8b5d7fa640 1 -- 172.21.15.22:0/3885668664 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50004950 con 0x7f8b6006d9d0 2024-05-07T13:55:43.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.497+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6012df10 con 0x7f8b6006d9d0 2024-05-07T13:55:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.498+0000 7f8b5d7fa640 1 -- 172.21.15.22:0/3885668664 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b5001b070 con 0x7f8b6006d9d0 2024-05-07T13:55:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.498+0000 7f8b5d7fa640 1 --2- 172.21.15.22:0/3885668664 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b40038060 0x7f8b4003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.498+0000 7f8b5d7fa640 1 -- 172.21.15.22:0/3885668664 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f8b5004a2a0 con 0x7f8b6006d9d0 2024-05-07T13:55:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.499+0000 7f8b57fff640 1 --2- 172.21.15.22:0/3885668664 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b40038060 0x7f8b4003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.499+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6009b8c0 con 0x7f8b6006d9d0 2024-05-07T13:55:43.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.499+0000 7f8b57fff640 1 --2- 172.21.15.22:0/3885668664 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b40038060 0x7f8b4003a520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8b48036000 tx=0x7f8b48008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:43.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.503+0000 7f8b5d7fa640 1 -- 172.21.15.22:0/3885668664 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8b6009b8c0 con 0x7f8b6006d9d0 2024-05-07T13:55:43.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.693+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b6008e600 con 0x7f8b40038060 2024-05-07T13:55:43.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.695+0000 7f8b5d7fa640 1 -- 172.21.15.22:0/3885668664 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31815 (secure 0 0 0) 0x7f8b480093c0 con 0x7f8b40038060 2024-05-07T13:55:43.684 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:43.684 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b40038060 msgr2=0x7f8b4003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 --2- 172.21.15.22:0/3885668664 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b40038060 0x7f8b4003a520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8b48036000 tx=0x7f8b48008030 comp rx=0 tx=0).stop 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b6006d9d0 msgr2=0x7f8b6012d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 --2- 172.21.15.22:0/3885668664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b6006d9d0 0x7f8b6012d9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c420 tx=0x7f8b5000c8e0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 shutdown_connections 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 --2- 172.21.15.22:0/3885668664 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b40038060 0x7f8b4003a520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 --2- 172.21.15.22:0/3885668664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b6006d9d0 0x7f8b6012d9d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 >> 172.21.15.22:0/3885668664 conn(0x7f8b6009d750 msgr2=0x7f8b60125d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 shutdown_connections 2024-05-07T13:55:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.697+0000 7f8b662e0640 1 -- 172.21.15.22:0/3885668664 wait complete. 2024-05-07T13:55:43.696 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-05-07T13:55:42.104658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135836,"kb_used_data":1552,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351524,"statfs":{"total":386547056640,"available":386407960576,"internally_reserved":0,"allocated":1589248,"data_stored":1291770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040281+0000","last_change":"2024-05-07T13:55:40.043788+0000","last_active":"2024-05-07T13:55:41.040281+0000","last_peered":"2024-05-07T13:55:41.040281+0000","last_clean":"2024-05-07T13:55:41.040281+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T13:55:41.040281+0000","last_undegraded":"2024-05-07T13:55:41.040281+0000","last_fullsized":"2024-05-07T13:55:41.040281+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:00.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T13:55:40.045984+0000","last_change":"2024-05-07T13:55:40.045556+0000","last_active":"2024-05-07T13:55:40.045984+0000","last_peered":"2024-05-07T13:55:40.045984+0000","last_clean":"2024-05-07T13:55:40.045984+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:55:40.045984+0000","last_undegraded":"2024-05-07T13:55:40.045984+0000","last_fullsized":"2024-05-07T13:55:40.045984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:44.224841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040268+0000","last_change":"2024-05-07T13:55:40.044124+0000","last_active":"2024-05-07T13:55:41.040268+0000","last_peered":"2024-05-07T13:55:41.040268+0000","last_clean":"2024-05-07T13:55:41.040268+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T13:55:41.040268+0000","last_undegraded":"2024-05-07T13:55:41.040268+0000","last_fullsized":"2024-05-07T13:55:41.040268+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:38.642853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T13:55:40.044055+0000","last_change":"2024-05-07T13:55:40.043241+0000","last_active":"2024-05-07T13:55:40.044055+0000","last_peered":"2024-05-07T13:55:40.044055+0000","last_clean":"2024-05-07T13:55:40.044055+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:55:40.044055+0000","last_undegraded":"2024-05-07T13:55:40.044055+0000","last_fullsized":"2024-05-07T13:55:40.044055+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:11:16.179864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040287+0000","last_change":"2024-05-07T13:55:40.044279+0000","last_active":"2024-05-07T13:55:41.040287+0000","last_peered":"2024-05-07T13:55:41.040287+0000","last_clean":"2024-05-07T13:55:41.040287+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T13:55:41.040287+0000","last_undegraded":"2024-05-07T13:55:41.040287+0000","last_fullsized":"2024-05-07T13:55:41.040287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:05:53.554681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T13:55:40.044938+0000","last_change":"2024-05-07T13:55:40.043522+0000","last_active":"2024-05-07T13:55:40.044938+0000","last_peered":"2024-05-07T13:55:40.044938+0000","last_clean":"2024-05-07T13:55:40.044938+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:55:40.044938+0000","last_undegraded":"2024-05-07T13:55:40.044938+0000","last_fullsized":"2024-05-07T13:55:40.044938+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:11:16.179864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040335+0000","last_change":"2024-05-07T13:55:40.043428+0000","last_active":"2024-05-07T13:55:41.040335+0000","last_peered":"2024-05-07T13:55:41.040335+0000","last_clean":"2024-05-07T13:55:41.040335+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T13:55:41.040335+0000","last_undegraded":"2024-05-07T13:55:41.040335+0000","last_fullsized":"2024-05-07T13:55:41.040335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:34.894187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-07T13:55:41.040291+0000","last_change":"2024-05-07T13:55:40.045474+0000","last_active":"2024-05-07T13:55:41.040291+0000","last_peered":"2024-05-07T13:55:41.040291+0000","last_clean":"2024-05-07T13:55:41.040291+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T13:55:41.040291+0000","last_undegraded":"2024-05-07T13:55:41.040291+0000","last_fullsized":"2024-05-07T13:55:41.040291+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:03.440717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":159,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-07T13:55:40.734543+0000","last_change":"2024-05-07T13:55:40.043635+0000","last_active":"2024-05-07T13:55:40.734543+0000","last_peered":"2024-05-07T13:55:40.734543+0000","last_clean":"2024-05-07T13:55:40.734543+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:55:40.734543+0000","last_undegraded":"2024-05-07T13:55:40.734543+0000","last_fullsized":"2024-05-07T13:55:40.734543+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:11:16.179864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":106496,"data_stored":31051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T13:55:43.698 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-07T13:55:43.698 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-07T13:55:43.698 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-07T13:55:43.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-07T13:55:43.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.811+0000 7fe76dcba640 1 Processor -- start 2024-05-07T13:55:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.811+0000 7fe76dcba640 1 -- start start 2024-05-07T13:55:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.812+0000 7fe76dcba640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe76806f540 0x7fe76806f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.812+0000 7fe76dcba640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7680720e0 con 0x7fe76809e040 2024-05-07T13:55:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.812+0000 7fe76dcba640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe768070f50 con 0x7fe76806f540 2024-05-07T13:55:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.812+0000 7fe7677fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe76806f540 0x7fe76806f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.812+0000 7fe766ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe76809e040 0x7fe76812b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49818/0 (socket says 172.21.15.22:49818) 2024-05-07T13:55:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.812+0000 7fe766ffd640 1 -- 172.21.15.22:0/2587161281 learned_addr learned my addr 172.21.15.22:0/2587161281 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:55:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.812+0000 7fe7677fe640 1 -- 172.21.15.22:0/2587161281 >> v1:172.21.15.22:6789/0 conn(0x7fe76809e040 legacy=0x7fe76812b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.812+0000 7fe7677fe640 1 -- 172.21.15.22:0/2587161281 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe768071790 con 0x7fe76806f540 2024-05-07T13:55:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.813+0000 7fe7677fe640 1 --2- 172.21.15.22:0/2587161281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 0x7fe76806f920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe758009720 tx=0x7fe75802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98309a1edd21e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.813+0000 7fe7667fc640 1 -- 172.21.15.22:0/2587161281 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580316d0 con 0x7fe76806f540 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.813+0000 7fe7667fc640 1 -- 172.21.15.22:0/2587161281 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe758037070 con 0x7fe76806f540 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.813+0000 7fe7667fc640 1 -- 172.21.15.22:0/2587161281 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580319c0 con 0x7fe76806f540 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.814+0000 7fe76dcba640 1 -- 172.21.15.22:0/2587161281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 msgr2=0x7fe76806f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.814+0000 7fe76dcba640 1 --2- 172.21.15.22:0/2587161281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 0x7fe76806f920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe758009720 tx=0x7fe75802b840 comp rx=0 tx=0).stop 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.814+0000 7fe76dcba640 1 -- 172.21.15.22:0/2587161281 shutdown_connections 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.814+0000 7fe76dcba640 1 --2- 172.21.15.22:0/2587161281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 0x7fe76806f920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.814+0000 7fe76dcba640 1 -- 172.21.15.22:0/2587161281 >> 172.21.15.22:0/2587161281 conn(0x7fe7680a0a40 msgr2=0x7fe7680a0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.814+0000 7fe76dcba640 1 -- 172.21.15.22:0/2587161281 shutdown_connections 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.814+0000 7fe76dcba640 1 -- 172.21.15.22:0/2587161281 wait complete. 2024-05-07T13:55:43.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.814+0000 7fe76dcba640 1 Processor -- start 2024-05-07T13:55:43.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.815+0000 7fe76dcba640 1 -- start start 2024-05-07T13:55:43.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.815+0000 7fe76dcba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 0x7fe768119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:43.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.815+0000 7fe76dcba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe7680701f0 con 0x7fe76806f540 2024-05-07T13:55:43.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.815+0000 7fe7677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 0x7fe768119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:43.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.815+0000 7fe7677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 0x7fe768119db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40218/0 (socket says 172.21.15.22:40218) 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.815+0000 7fe7677fe640 1 -- 172.21.15.22:0/1197564092 learned_addr learned my addr 172.21.15.22:0/1197564092 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.816+0000 7fe7677fe640 1 -- 172.21.15.22:0/1197564092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76811b6c0 con 0x7fe76806f540 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.816+0000 7fe7677fe640 1 --2- 172.21.15.22:0/1197564092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 0x7fe768119db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe758034040 tx=0x7fe7580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.816+0000 7fe75ffff640 1 -- 172.21.15.22:0/1197564092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe758032770 con 0x7fe76806f540 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.816+0000 7fe75ffff640 1 -- 172.21.15.22:0/1197564092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe758032910 con 0x7fe76806f540 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.816+0000 7fe75ffff640 1 -- 172.21.15.22:0/1197564092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe758032c30 con 0x7fe76806f540 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.816+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76811d3a0 con 0x7fe76806f540 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.816+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe768129900 con 0x7fe76806f540 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.817+0000 7fe75ffff640 1 -- 172.21.15.22:0/1197564092 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe75804c060 con 0x7fe76806f540 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.817+0000 7fe75ffff640 1 --2- 172.21.15.22:0/1197564092 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe748038060 0x7fe74803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.817+0000 7fe75ffff640 1 -- 172.21.15.22:0/1197564092 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fe75802f050 con 0x7fe76806f540 2024-05-07T13:55:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.817+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe768062e90 con 0x7fe76806f540 2024-05-07T13:55:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.817+0000 7fe766ffd640 1 --2- 172.21.15.22:0/1197564092 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe748038060 0x7fe74803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.818+0000 7fe766ffd640 1 --2- 172.21.15.22:0/1197564092 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe748038060 0x7fe74803a520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe750007fd0 tx=0x7fe750007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:43.822+0000 7fe75ffff640 1 -- 172.21.15.22:0/1197564092 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe758040070 con 0x7fe76806f540 2024-05-07T13:55:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.063+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe76811c6f0 con 0x7fe76806f540 2024-05-07T13:55:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.063+0000 7fe75ffff640 1 -- 172.21.15.22:0/1197564092 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe758032dd0 con 0x7fe76806f540 2024-05-07T13:55:44.052 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:55:44.052 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-07T13:55:44.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.065+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe748038060 msgr2=0x7fe74803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.065+0000 7fe76dcba640 1 --2- 172.21.15.22:0/1197564092 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe748038060 0x7fe74803a520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe750007fd0 tx=0x7fe750007ac0 comp rx=0 tx=0).stop 2024-05-07T13:55:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.065+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 msgr2=0x7fe768119db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.065+0000 7fe76dcba640 1 --2- 172.21.15.22:0/1197564092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 0x7fe768119db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe758034040 tx=0x7fe7580046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.065+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 shutdown_connections 2024-05-07T13:55:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.065+0000 7fe76dcba640 1 --2- 172.21.15.22:0/1197564092 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe748038060 0x7fe74803a520 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.065+0000 7fe76dcba640 1 --2- 172.21.15.22:0/1197564092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe76806f540 0x7fe768119db0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.065+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 >> 172.21.15.22:0/1197564092 conn(0x7fe7680a0a40 msgr2=0x7fe768129e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.065+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 shutdown_connections 2024-05-07T13:55:44.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:55:44.066+0000 7fe76dcba640 1 -- 172.21.15.22:0/1197564092 wait complete. 2024-05-07T13:55:44.065 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-07T13:55:44.065 INFO:teuthology.run_tasks:Running task rgw... 2024-05-07T13:55:44.081 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-07T13:55:44.081 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-07T13:55:44.081 INFO:tasks.rgw:Creating data pools 2024-05-07T13:55:44.081 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-07T13:55:44.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-05-07T13:55:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.211+0000 7fdf1d62c640 1 Processor -- start 2024-05-07T13:55:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.211+0000 7fdf1d62c640 1 -- start start 2024-05-07T13:55:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.212+0000 7fdf1d62c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdf1811ab90 0x7fdf1811cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.212+0000 7fdf1d62c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf1811d550 con 0x7fdf18117f10 2024-05-07T13:55:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.212+0000 7fdf1d62c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fdf1811e750 con 0x7fdf1811ab90 2024-05-07T13:55:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.212+0000 7fdf167fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdf1811ab90 0x7fdf1811cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.212+0000 7fdf16ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdf18117f10 0x7fdf181182f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:42972/0 (socket says 172.21.15.50:42972) 2024-05-07T13:55:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.212+0000 7fdf16ffd640 1 -- 172.21.15.50:0/3353052887 learned_addr learned my addr 172.21.15.50:0/3353052887 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:55:44.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.212+0000 7fdf167fc640 1 -- 172.21.15.50:0/3353052887 >> v1:172.21.15.22:6789/0 conn(0x7fdf18117f10 legacy=0x7fdf181182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:44.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.212+0000 7fdf167fc640 1 -- 172.21.15.50:0/3353052887 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1811e900 con 0x7fdf1811ab90 2024-05-07T13:55:44.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.213+0000 7fdf167fc640 1 --2- 172.21.15.50:0/3353052887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf1811ab90 0x7fdf1811cf80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009d90 tx=0x7fdf0c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8babe28d58afdb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:44.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.213+0000 7fdf15ffb640 1 -- 172.21.15.50:0/3353052887 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf0c039070 con 0x7fdf1811ab90 2024-05-07T13:55:44.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.213+0000 7fdf15ffb640 1 -- 172.21.15.50:0/3353052887 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf0c02cb10 con 0x7fdf1811ab90 2024-05-07T13:55:44.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.213+0000 7fdf15ffb640 1 -- 172.21.15.50:0/3353052887 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf0c02ce10 con 0x7fdf1811ab90 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.214+0000 7fdf1d62c640 1 -- 172.21.15.50:0/3353052887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf1811ab90 msgr2=0x7fdf1811cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.214+0000 7fdf1d62c640 1 --2- 172.21.15.50:0/3353052887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf1811ab90 0x7fdf1811cf80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009d90 tx=0x7fdf0c02beb0 comp rx=0 tx=0).stop 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.214+0000 7fdf1d62c640 1 -- 172.21.15.50:0/3353052887 shutdown_connections 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.214+0000 7fdf1d62c640 1 --2- 172.21.15.50:0/3353052887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf1811ab90 0x7fdf1811cf80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.214+0000 7fdf1d62c640 1 -- 172.21.15.50:0/3353052887 >> 172.21.15.50:0/3353052887 conn(0x7fdf1806e840 msgr2=0x7fdf1810fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.214+0000 7fdf1d62c640 1 -- 172.21.15.50:0/3353052887 shutdown_connections 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.214+0000 7fdf1d62c640 1 -- 172.21.15.50:0/3353052887 wait complete. 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.215+0000 7fdf1d62c640 1 Processor -- start 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.215+0000 7fdf1d62c640 1 -- start start 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.215+0000 7fdf1d62c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf18117f10 0x7fdf181a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:44.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.215+0000 7fdf1d62c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1811dc40 con 0x7fdf18117f10 2024-05-07T13:55:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.215+0000 7fdf16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf18117f10 0x7fdf181a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.215+0000 7fdf16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf18117f10 0x7fdf181a6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:36306/0 (socket says 172.21.15.50:36306) 2024-05-07T13:55:44.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.215+0000 7fdf16ffd640 1 -- 172.21.15.50:0/2043024622 learned_addr learned my addr 172.21.15.50:0/2043024622 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.216+0000 7fdf16ffd640 1 -- 172.21.15.50:0/2043024622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf181a6ff0 con 0x7fdf18117f10 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.216+0000 7fdf16ffd640 1 --2- 172.21.15.50:0/2043024622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf18117f10 0x7fdf181a6ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800c380 tx=0x7fdf0800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.216+0000 7fdeff7fe640 1 -- 172.21.15.50:0/2043024622 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf08005c10 con 0x7fdf18117f10 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.216+0000 7fdeff7fe640 1 -- 172.21.15.50:0/2043024622 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf08005db0 con 0x7fdf18117f10 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.216+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf181a7280 con 0x7fdf18117f10 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.216+0000 7fdeff7fe640 1 -- 172.21.15.50:0/2043024622 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf08004930 con 0x7fdf18117f10 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.216+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf181ab1b0 con 0x7fdf18117f10 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.217+0000 7fdeff7fe640 1 -- 172.21.15.50:0/2043024622 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdf0801a020 con 0x7fdf18117f10 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.217+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf1804fe40 con 0x7fdf18117f10 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.217+0000 7fdeff7fe640 1 --2- 172.21.15.50:0/2043024622 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdf040380b0 0x7fdf0403a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.217+0000 7fdeff7fe640 1 -- 172.21.15.50:0/2043024622 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fdf0804a7d0 con 0x7fdf18117f10 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.217+0000 7fdf167fc640 1 --2- 172.21.15.50:0/2043024622 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdf040380b0 0x7fdf0403a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:44.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.218+0000 7fdf167fc640 1 --2- 172.21.15.50:0/2043024622 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdf040380b0 0x7fdf0403a570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c036000 tx=0x7fdf0c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:44.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.222+0000 7fdeff7fe640 1 -- 172.21.15.50:0/2043024622 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdf080127f0 con 0x7fdf18117f10 2024-05-07T13:55:44.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:44.413+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7fdf1811ab90 con 0x7fdf18117f10 2024-05-07T13:55:45.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.280+0000 7fdeff7fe640 1 -- 172.21.15.50:0/2043024622 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v13) ==== 171+0+0 (secure 0 0 0) 0x7fdf08012a50 con 0x7fdf18117f10 2024-05-07T13:55:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdf040380b0 msgr2=0x7fdf0403a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 --2- 172.21.15.50:0/2043024622 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdf040380b0 0x7fdf0403a570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c036000 tx=0x7fdf0c030000 comp rx=0 tx=0).stop 2024-05-07T13:55:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf18117f10 msgr2=0x7fdf181a6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 --2- 172.21.15.50:0/2043024622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf18117f10 0x7fdf181a6ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800c380 tx=0x7fdf0800c840 comp rx=0 tx=0).stop 2024-05-07T13:55:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 shutdown_connections 2024-05-07T13:55:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 --2- 172.21.15.50:0/2043024622 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdf040380b0 0x7fdf0403a570 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 --2- 172.21.15.50:0/2043024622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf18117f10 0x7fdf181a6ab0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:45.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 >> 172.21.15.50:0/2043024622 conn(0x7fdf1806e840 msgr2=0x7fdf1811af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:45.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 shutdown_connections 2024-05-07T13:55:45.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.283+0000 7fdf1d62c640 1 -- 172.21.15.50:0/2043024622 wait complete. 2024-05-07T13:55:45.285 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.409+0000 7fa7c5ee0640 1 Processor -- start 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.409+0000 7fa7c5ee0640 1 -- start start 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.410+0000 7fa7c5ee0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa7c01189a0 0x7fa7c011ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.410+0000 7fa7c5ee0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c011b2d0 con 0x7fa7c010e000 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.410+0000 7fa7c5ee0640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c011c4b0 con 0x7fa7c01189a0 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.410+0000 7fa7b7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa7c01189a0 0x7fa7c011ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.410+0000 7fa7b7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa7c01189a0 0x7fa7c011ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:36312/0 (socket says 172.21.15.50:36312) 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.410+0000 7fa7b7fff640 1 -- 172.21.15.50:0/1097908917 learned_addr learned my addr 172.21.15.50:0/1097908917 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.410+0000 7fa7bf7fe640 1 --1- 172.21.15.50:0/1097908917 >> v1:172.21.15.22:6789/0 conn(0x7fa7c010e000 0x7fa7c010e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:42982/0 (socket says 172.21.15.50:42982) 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.410+0000 7fa7b7fff640 1 -- 172.21.15.50:0/1097908917 >> v1:172.21.15.22:6789/0 conn(0x7fa7c010e000 legacy=0x7fa7c010e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:45.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.410+0000 7fa7b7fff640 1 -- 172.21.15.50:0/1097908917 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c011c630 con 0x7fa7c01189a0 2024-05-07T13:55:45.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.411+0000 7fa7b7fff640 1 --2- 172.21.15.50:0/1097908917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c01189a0 0x7fa7c011ad90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80097f0 tx=0x7fa7a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430e8dfed4df9272 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:45.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.411+0000 7fa7beffd640 1 -- 172.21.15.50:0/1097908917 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7a8035020 con 0x7fa7c01189a0 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.411+0000 7fa7beffd640 1 -- 172.21.15.50:0/1097908917 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a80317a0 con 0x7fa7c01189a0 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.411+0000 7fa7beffd640 1 -- 172.21.15.50:0/1097908917 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7a8031aa0 con 0x7fa7c01189a0 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.412+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/1097908917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c01189a0 msgr2=0x7fa7c011ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.412+0000 7fa7c5ee0640 1 --2- 172.21.15.50:0/1097908917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c01189a0 0x7fa7c011ad90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80097f0 tx=0x7fa7a802b910 comp rx=0 tx=0).stop 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.412+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/1097908917 shutdown_connections 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.412+0000 7fa7c5ee0640 1 --2- 172.21.15.50:0/1097908917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c01189a0 0x7fa7c011ad90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.412+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/1097908917 >> 172.21.15.50:0/1097908917 conn(0x7fa7c006f660 msgr2=0x7fa7c0071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.412+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/1097908917 shutdown_connections 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.412+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/1097908917 wait complete. 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.412+0000 7fa7c5ee0640 1 Processor -- start 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.413+0000 7fa7c5ee0640 1 -- start start 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.413+0000 7fa7c5ee0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c010e000 0x7fa7c010f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:45.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.413+0000 7fa7c5ee0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c011b9c0 con 0x7fa7c010e000 2024-05-07T13:55:45.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.413+0000 7fa7bf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c010e000 0x7fa7c010f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:45.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.413+0000 7fa7bf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c010e000 0x7fa7c010f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:36322/0 (socket says 172.21.15.50:36322) 2024-05-07T13:55:45.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.413+0000 7fa7bf7fe640 1 -- 172.21.15.50:0/2537327673 learned_addr learned my addr 172.21.15.50:0/2537327673 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:45.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.413+0000 7fa7bf7fe640 1 -- 172.21.15.50:0/2537327673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c010fd40 con 0x7fa7c010e000 2024-05-07T13:55:45.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.413+0000 7fa7bf7fe640 1 --2- 172.21.15.50:0/2537327673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c010e000 0x7fa7c010f800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c3d0 tx=0x7fa7b000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:45.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.414+0000 7fa7bcff9640 1 -- 172.21.15.50:0/2537327673 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7b0007410 con 0x7fa7c010e000 2024-05-07T13:55:45.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.414+0000 7fa7bcff9640 1 -- 172.21.15.50:0/2537327673 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b00075b0 con 0x7fa7c010e000 2024-05-07T13:55:45.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.414+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c010ff70 con 0x7fa7c010e000 2024-05-07T13:55:45.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.414+0000 7fa7bcff9640 1 -- 172.21.15.50:0/2537327673 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7b0004910 con 0x7fa7c010e000 2024-05-07T13:55:45.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.414+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c01104c0 con 0x7fa7c010e000 2024-05-07T13:55:45.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.415+0000 7fa7bcff9640 1 -- 172.21.15.50:0/2537327673 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa7b001a020 con 0x7fa7c010e000 2024-05-07T13:55:45.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.415+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c004fe40 con 0x7fa7c010e000 2024-05-07T13:55:45.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.415+0000 7fa7bcff9640 1 --2- 172.21.15.50:0/2537327673 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa7a0038060 0x7fa7a003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:45.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.415+0000 7fa7bcff9640 1 -- 172.21.15.50:0/2537327673 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3797+0+0 (secure 0 0 0) 0x7fa7b004a840 con 0x7fa7c010e000 2024-05-07T13:55:45.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.415+0000 7fa7b7fff640 1 --2- 172.21.15.50:0/2537327673 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa7a0038060 0x7fa7a003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:45.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.415+0000 7fa7b7fff640 1 --2- 172.21.15.50:0/2537327673 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa7a0038060 0x7fa7a003a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8036000 tx=0x7fa7a8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:45.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.420+0000 7fa7bcff9640 1 -- 172.21.15.50:0/2537327673 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa7b001b9a0 con 0x7fa7c010e000 2024-05-07T13:55:45.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:45.609+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fa7c01189a0 con 0x7fa7c010e000 2024-05-07T13:55:47.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.285+0000 7fa7bcff9640 1 -- 172.21.15.50:0/2537327673 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v15) ==== 227+0+0 (secure 0 0 0) 0x7fa7b001bc00 con 0x7fa7c010e000 2024-05-07T13:55:47.273 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'default.rgw.buckets.data' created 2024-05-07T13:55:47.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.287+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa7a0038060 msgr2=0x7fa7a003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:47.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.287+0000 7fa7c5ee0640 1 --2- 172.21.15.50:0/2537327673 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa7a0038060 0x7fa7a003a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8036000 tx=0x7fa7a8008030 comp rx=0 tx=0).stop 2024-05-07T13:55:47.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.287+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c010e000 msgr2=0x7fa7c010f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:47.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.287+0000 7fa7c5ee0640 1 --2- 172.21.15.50:0/2537327673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c010e000 0x7fa7c010f800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c3d0 tx=0x7fa7b000c890 comp rx=0 tx=0).stop 2024-05-07T13:55:47.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.288+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 shutdown_connections 2024-05-07T13:55:47.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.288+0000 7fa7c5ee0640 1 --2- 172.21.15.50:0/2537327673 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa7a0038060 0x7fa7a003a520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:47.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.288+0000 7fa7c5ee0640 1 --2- 172.21.15.50:0/2537327673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7c010e000 0x7fa7c010f800 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:47.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.288+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 >> 172.21.15.50:0/2537327673 conn(0x7fa7c006f660 msgr2=0x7fa7c00718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:47.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.288+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 shutdown_connections 2024-05-07T13:55:47.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.288+0000 7fa7c5ee0640 1 -- 172.21.15.50:0/2537327673 wait complete. 2024-05-07T13:55:47.300 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-07T13:55:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.420+0000 7f664ab9d640 1 Processor -- start 2024-05-07T13:55:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.420+0000 7f664ab9d640 1 -- start start 2024-05-07T13:55:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.420+0000 7f664ab9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f664410e000 0x7f664410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.420+0000 7f664ab9d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664410eb30 con 0x7f6644117990 2024-05-07T13:55:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.420+0000 7f664ab9d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f664411c4b0 con 0x7f664410e000 2024-05-07T13:55:47.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.421+0000 7f6648939640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f664410e000 0x7f664410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.421+0000 7f6643fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6644117990 0x7f6644119d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:42992/0 (socket says 172.21.15.50:42992) 2024-05-07T13:55:47.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.421+0000 7f6643fff640 1 -- 172.21.15.50:0/1897087795 learned_addr learned my addr 172.21.15.50:0/1897087795 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:55:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.421+0000 7f6648939640 1 -- 172.21.15.50:0/1897087795 >> v1:172.21.15.22:6789/0 conn(0x7f6644117990 legacy=0x7f6644119d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.421+0000 7f6648939640 1 -- 172.21.15.50:0/1897087795 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664411c630 con 0x7f664410e000 2024-05-07T13:55:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.422+0000 7f6648939640 1 --2- 172.21.15.50:0/1897087795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 0x7f664410e3e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6638009720 tx=0x7f663802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58375057ce50f97 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.422+0000 7f66437fe640 1 -- 172.21.15.50:0/1897087795 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66380316d0 con 0x7f664410e000 2024-05-07T13:55:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.422+0000 7f66437fe640 1 -- 172.21.15.50:0/1897087795 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6638037070 con 0x7f664410e000 2024-05-07T13:55:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.422+0000 7f66437fe640 1 -- 172.21.15.50:0/1897087795 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66380319c0 con 0x7f664410e000 2024-05-07T13:55:47.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.422+0000 7f664ab9d640 1 -- 172.21.15.50:0/1897087795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 msgr2=0x7f664410e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.422+0000 7f664ab9d640 1 --2- 172.21.15.50:0/1897087795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 0x7f664410e3e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6638009720 tx=0x7f663802b840 comp rx=0 tx=0).stop 2024-05-07T13:55:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.422+0000 7f664ab9d640 1 -- 172.21.15.50:0/1897087795 shutdown_connections 2024-05-07T13:55:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.423+0000 7f664ab9d640 1 --2- 172.21.15.50:0/1897087795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 0x7f664410e3e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.423+0000 7f664ab9d640 1 -- 172.21.15.50:0/1897087795 >> 172.21.15.50:0/1897087795 conn(0x7f664406f430 msgr2=0x7f6644071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.423+0000 7f664ab9d640 1 -- 172.21.15.50:0/1897087795 shutdown_connections 2024-05-07T13:55:47.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.423+0000 7f664ab9d640 1 -- 172.21.15.50:0/1897087795 wait complete. 2024-05-07T13:55:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.423+0000 7f664ab9d640 1 Processor -- start 2024-05-07T13:55:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.423+0000 7f664ab9d640 1 -- start start 2024-05-07T13:55:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.424+0000 7f664ab9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 0x7f66441aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.424+0000 7f664ab9d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f664411b9c0 con 0x7f664410e000 2024-05-07T13:55:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.424+0000 7f6648939640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 0x7f66441aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.424+0000 7f6648939640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 0x7f66441aa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:36330/0 (socket says 172.21.15.50:36330) 2024-05-07T13:55:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.424+0000 7f6648939640 1 -- 172.21.15.50:0/3165155081 learned_addr learned my addr 172.21.15.50:0/3165155081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.424+0000 7f6648939640 1 -- 172.21.15.50:0/3165155081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66441aa820 con 0x7f664410e000 2024-05-07T13:55:47.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.425+0000 7f6648939640 1 --2- 172.21.15.50:0/3165155081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 0x7f66441aa250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6638034040 tx=0x7f66380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.425+0000 7f66417fa640 1 -- 172.21.15.50:0/3165155081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6638032770 con 0x7f664410e000 2024-05-07T13:55:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.425+0000 7f66417fa640 1 -- 172.21.15.50:0/3165155081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6638032910 con 0x7f664410e000 2024-05-07T13:55:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.425+0000 7f66417fa640 1 -- 172.21.15.50:0/3165155081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6638032c10 con 0x7f664410e000 2024-05-07T13:55:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.425+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66441aaa50 con 0x7f664410e000 2024-05-07T13:55:47.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.425+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66441a4360 con 0x7f664410e000 2024-05-07T13:55:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.426+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f664404fe40 con 0x7f664410e000 2024-05-07T13:55:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.426+0000 7f66417fa640 1 -- 172.21.15.50:0/3165155081 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f663804c060 con 0x7f664410e000 2024-05-07T13:55:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.426+0000 7f66417fa640 1 --2- 172.21.15.50:0/3165155081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6628038010 0x7f662803a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.426+0000 7f66417fa640 1 -- 172.21.15.50:0/3165155081 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4272+0+0 (secure 0 0 0) 0x7f663802f050 con 0x7f664410e000 2024-05-07T13:55:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.426+0000 7f6643fff640 1 --2- 172.21.15.50:0/3165155081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6628038010 0x7f662803a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:47.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.426+0000 7f6643fff640 1 --2- 172.21.15.50:0/3165155081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6628038010 0x7f662803a4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6630000f60 tx=0x7f6630007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:47.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.431+0000 7f66417fa640 1 -- 172.21.15.50:0/3165155081 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6638040070 con 0x7f664410e000 2024-05-07T13:55:47.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:47.615+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f6644117990 con 0x7f664410e000 2024-05-07T13:55:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.290+0000 7f66417fa640 1 -- 172.21.15.50:0/3165155081 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v16) ==== 185+0+0 (secure 0 0 0) 0x7f663804de20 con 0x7f664410e000 2024-05-07T13:55:48.278 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6628038010 msgr2=0x7f662803a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 --2- 172.21.15.50:0/3165155081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6628038010 0x7f662803a4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6630000f60 tx=0x7f6630007a80 comp rx=0 tx=0).stop 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 msgr2=0x7f66441aa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 --2- 172.21.15.50:0/3165155081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 0x7f66441aa250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6638034040 tx=0x7f66380046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 shutdown_connections 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 --2- 172.21.15.50:0/3165155081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6628038010 0x7f662803a4d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 --2- 172.21.15.50:0/3165155081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f664410e000 0x7f66441aa250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 >> 172.21.15.50:0/3165155081 conn(0x7f664406f430 msgr2=0x7f664406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 shutdown_connections 2024-05-07T13:55:48.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.293+0000 7f664ab9d640 1 -- 172.21.15.50:0/3165155081 wait complete. 2024-05-07T13:55:48.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-07T13:55:48.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.443+0000 7f28a75fb640 1 Processor -- start 2024-05-07T13:55:48.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.444+0000 7f28a75fb640 1 -- start start 2024-05-07T13:55:48.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.444+0000 7f28a75fb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28a01178c0 0x7f28a0119cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:48.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.444+0000 7f28a75fb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a011a1f0 con 0x7f28a010f9a0 2024-05-07T13:55:48.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.444+0000 7f28a75fb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f28a011b3d0 con 0x7f28a01178c0 2024-05-07T13:55:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.444+0000 7f28a4b96640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28a01178c0 0x7f28a0119cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.444+0000 7f28a5397640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f28a010f9a0 0x7f28a010fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:42994/0 (socket says 172.21.15.50:42994) 2024-05-07T13:55:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.444+0000 7f28a5397640 1 -- 172.21.15.50:0/98689156 learned_addr learned my addr 172.21.15.50:0/98689156 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:55:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.445+0000 7f2897fff640 1 -- 172.21.15.50:0/98689156 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689796778 0 0) 0x7f28a011a1f0 con 0x7f28a010f9a0 2024-05-07T13:55:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.445+0000 7f2897fff640 1 -- 172.21.15.50:0/98689156 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f288c003520 con 0x7f28a010f9a0 2024-05-07T13:55:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.445+0000 7f28a4b96640 1 -- 172.21.15.50:0/98689156 >> v1:172.21.15.22:6789/0 conn(0x7f28a010f9a0 legacy=0x7f28a010fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:48.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.445+0000 7f28a4b96640 1 -- 172.21.15.50:0/98689156 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a011b550 con 0x7f28a01178c0 2024-05-07T13:55:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.445+0000 7f28a4b96640 1 --2- 172.21.15.50:0/98689156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a01178c0 0x7f28a0119cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2890009720 tx=0x7f289002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae0b45e614441e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f2897fff640 1 -- 172.21.15.50:0/98689156 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28900316d0 con 0x7f28a01178c0 2024-05-07T13:55:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f2897fff640 1 -- 172.21.15.50:0/98689156 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2890037070 con 0x7f28a01178c0 2024-05-07T13:55:48.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f2897fff640 1 -- 172.21.15.50:0/98689156 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28900319c0 con 0x7f28a01178c0 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f28a75fb640 1 -- 172.21.15.50:0/98689156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a01178c0 msgr2=0x7f28a0119cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f28a75fb640 1 --2- 172.21.15.50:0/98689156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a01178c0 0x7f28a0119cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2890009720 tx=0x7f289002b840 comp rx=0 tx=0).stop 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f28a75fb640 1 -- 172.21.15.50:0/98689156 shutdown_connections 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f28a75fb640 1 --2- 172.21.15.50:0/98689156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a01178c0 0x7f28a0119cb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f28a75fb640 1 -- 172.21.15.50:0/98689156 >> 172.21.15.50:0/98689156 conn(0x7f28a006f430 msgr2=0x7f28a0071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f28a75fb640 1 -- 172.21.15.50:0/98689156 shutdown_connections 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.446+0000 7f28a75fb640 1 -- 172.21.15.50:0/98689156 wait complete. 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.447+0000 7f28a75fb640 1 Processor -- start 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.447+0000 7f28a75fb640 1 -- start start 2024-05-07T13:55:48.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.447+0000 7f28a75fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a010f9a0 0x7f28a01aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.447+0000 7f28a75fb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f28a011a8b0 con 0x7f28a010f9a0 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.447+0000 7f28a5397640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a010f9a0 0x7f28a01aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.447+0000 7f28a5397640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a010f9a0 0x7f28a01aa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:36350/0 (socket says 172.21.15.50:36350) 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.447+0000 7f28a5397640 1 -- 172.21.15.50:0/3781569623 learned_addr learned my addr 172.21.15.50:0/3781569623 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.448+0000 7f28a5397640 1 -- 172.21.15.50:0/3781569623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a01aa770 con 0x7f28a010f9a0 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.448+0000 7f28a5397640 1 --2- 172.21.15.50:0/3781569623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a010f9a0 0x7f28a01aa1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c450 tx=0x7f289c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.448+0000 7f2895ffb640 1 -- 172.21.15.50:0/3781569623 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c017070 con 0x7f28a010f9a0 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.448+0000 7f2895ffb640 1 -- 172.21.15.50:0/3781569623 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c005cd0 con 0x7f28a010f9a0 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.448+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a01aaa00 con 0x7f28a010f9a0 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.448+0000 7f2895ffb640 1 -- 172.21.15.50:0/3781569623 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c007200 con 0x7f28a010f9a0 2024-05-07T13:55:48.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.448+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a01a4410 con 0x7f28a010f9a0 2024-05-07T13:55:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.449+0000 7f2895ffb640 1 -- 172.21.15.50:0/3781569623 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f289c01a070 con 0x7f28a010f9a0 2024-05-07T13:55:48.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.449+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a004fe40 con 0x7f28a010f9a0 2024-05-07T13:55:48.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.449+0000 7f2895ffb640 1 --2- 172.21.15.50:0/3781569623 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2884038090 0x7f288403a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:48.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.449+0000 7f2895ffb640 1 -- 172.21.15.50:0/3781569623 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4283+0+0 (secure 0 0 0) 0x7f289c04a590 con 0x7f28a010f9a0 2024-05-07T13:55:48.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.449+0000 7f28a4b96640 1 --2- 172.21.15.50:0/3781569623 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2884038090 0x7f288403a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:48.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.450+0000 7f28a4b96640 1 --2- 172.21.15.50:0/3781569623 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2884038090 0x7f288403a550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2890036000 tx=0x7f2890008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:48.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.455+0000 7f2895ffb640 1 -- 172.21.15.50:0/3781569623 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f289c0106d0 con 0x7f28a010f9a0 2024-05-07T13:55:48.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:48.638+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f28a01aac30 con 0x7f28a010f9a0 2024-05-07T13:55:49.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.295+0000 7f2895ffb640 1 -- 172.21.15.50:0/3781569623 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v17) ==== 169+0+0 (secure 0 0 0) 0x7f289c010930 con 0x7f28a010f9a0 2024-05-07T13:55:49.283 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'default.rgw.buckets.index' created 2024-05-07T13:55:49.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.297+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2884038090 msgr2=0x7f288403a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:49.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.297+0000 7f28a75fb640 1 --2- 172.21.15.50:0/3781569623 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2884038090 0x7f288403a550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2890036000 tx=0x7f2890008030 comp rx=0 tx=0).stop 2024-05-07T13:55:49.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.298+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a010f9a0 msgr2=0x7f28a01aa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:49.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.298+0000 7f28a75fb640 1 --2- 172.21.15.50:0/3781569623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a010f9a0 0x7f28a01aa1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c450 tx=0x7f289c00c910 comp rx=0 tx=0).stop 2024-05-07T13:55:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.298+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 shutdown_connections 2024-05-07T13:55:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.298+0000 7f28a75fb640 1 --2- 172.21.15.50:0/3781569623 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2884038090 0x7f288403a550 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2890036000 tx=0x7f2890008030 comp rx=0 tx=0).stop 2024-05-07T13:55:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.298+0000 7f28a75fb640 1 --2- 172.21.15.50:0/3781569623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28a010f9a0 0x7f28a01aa1a0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c450 tx=0x7f289c00c910 comp rx=0 tx=0).stop 2024-05-07T13:55:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.298+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 >> 172.21.15.50:0/3781569623 conn(0x7f28a006f430 msgr2=0x7f28a010eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.299+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 shutdown_connections 2024-05-07T13:55:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.299+0000 7f28a75fb640 1 -- 172.21.15.50:0/3781569623 wait complete. 2024-05-07T13:55:49.308 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-07T13:55:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.430+0000 7f387b950640 1 Processor -- start 2024-05-07T13:55:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.430+0000 7f387b950640 1 -- start start 2024-05-07T13:55:49.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.430+0000 7f387b950640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3874117c50 0x7f3874118030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.430+0000 7f387b950640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38741186f0 con 0x7f3874111a90 2024-05-07T13:55:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.431+0000 7f387b950640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f3874112630 con 0x7f3874117c50 2024-05-07T13:55:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.431+0000 7f38796ec640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3874117c50 0x7f3874118030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.431+0000 7f3878eeb640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3874111a90 0x7f3874111f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:42998/0 (socket says 172.21.15.50:42998) 2024-05-07T13:55:49.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.431+0000 7f3878eeb640 1 -- 172.21.15.50:0/3789029734 learned_addr learned my addr 172.21.15.50:0/3789029734 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.431+0000 7f38796ec640 1 -- 172.21.15.50:0/3789029734 >> v1:172.21.15.22:6789/0 conn(0x7f3874111a90 legacy=0x7f3874111f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.431+0000 7f38796ec640 1 -- 172.21.15.50:0/3789029734 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38741127e0 con 0x7f3874117c50 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.432+0000 7f38796ec640 1 --2- 172.21.15.50:0/3789029734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874117c50 0x7f3874118030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3870009720 tx=0x7f387002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4539e800a4b6fe server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.432+0000 7f386bfff640 1 -- 172.21.15.50:0/3789029734 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38700316d0 con 0x7f3874117c50 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.432+0000 7f386bfff640 1 -- 172.21.15.50:0/3789029734 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3870037070 con 0x7f3874117c50 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.432+0000 7f386bfff640 1 -- 172.21.15.50:0/3789029734 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38700319c0 con 0x7f3874117c50 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.433+0000 7f387b950640 1 -- 172.21.15.50:0/3789029734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874117c50 msgr2=0x7f3874118030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.433+0000 7f387b950640 1 --2- 172.21.15.50:0/3789029734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874117c50 0x7f3874118030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3870009720 tx=0x7f387002b840 comp rx=0 tx=0).stop 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.433+0000 7f387b950640 1 -- 172.21.15.50:0/3789029734 shutdown_connections 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.433+0000 7f387b950640 1 --2- 172.21.15.50:0/3789029734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874117c50 0x7f3874118030 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.433+0000 7f387b950640 1 -- 172.21.15.50:0/3789029734 >> 172.21.15.50:0/3789029734 conn(0x7f387406e8d0 msgr2=0x7f387410fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.433+0000 7f387b950640 1 -- 172.21.15.50:0/3789029734 shutdown_connections 2024-05-07T13:55:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.433+0000 7f387b950640 1 -- 172.21.15.50:0/3789029734 wait complete. 2024-05-07T13:55:49.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.434+0000 7f387b950640 1 Processor -- start 2024-05-07T13:55:49.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.434+0000 7f387b950640 1 -- start start 2024-05-07T13:55:49.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.434+0000 7f387b950640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874111a90 0x7f38741a6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:49.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.434+0000 7f387b950640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f387411deb0 con 0x7f3874111a90 2024-05-07T13:55:49.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.434+0000 7f38796ec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874111a90 0x7f38741a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:49.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.434+0000 7f38796ec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874111a90 0x7f38741a6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:36362/0 (socket says 172.21.15.50:36362) 2024-05-07T13:55:49.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.434+0000 7f38796ec640 1 -- 172.21.15.50:0/975860381 learned_addr learned my addr 172.21.15.50:0/975860381 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:55:49.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.435+0000 7f38796ec640 1 -- 172.21.15.50:0/975860381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38741a6f60 con 0x7f3874111a90 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.435+0000 7f38796ec640 1 --2- 172.21.15.50:0/975860381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874111a90 0x7f38741a6990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3870034040 tx=0x7f38700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.435+0000 7f3869ffb640 1 -- 172.21.15.50:0/975860381 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3870032770 con 0x7f3874111a90 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.435+0000 7f3869ffb640 1 -- 172.21.15.50:0/975860381 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3870032910 con 0x7f3874111a90 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.435+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38741a71f0 con 0x7f3874111a90 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.435+0000 7f3869ffb640 1 -- 172.21.15.50:0/975860381 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3870032c30 con 0x7f3874111a90 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.435+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38741ab250 con 0x7f3874111a90 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.436+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387404fe40 con 0x7f3874111a90 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.436+0000 7f3869ffb640 1 -- 172.21.15.50:0/975860381 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f387004c060 con 0x7f3874111a90 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.436+0000 7f3869ffb640 1 --2- 172.21.15.50:0/975860381 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3858038010 0x7f385803a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.437+0000 7f3869ffb640 1 -- 172.21.15.50:0/975860381 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4647+0+0 (secure 0 0 0) 0x7f387002f050 con 0x7f3874111a90 2024-05-07T13:55:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.437+0000 7f3878eeb640 1 --2- 172.21.15.50:0/975860381 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3858038010 0x7f385803a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:55:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.437+0000 7f3878eeb640 1 --2- 172.21.15.50:0/975860381 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3858038010 0x7f385803a4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3864007fd0 tx=0x7f3864007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:55:49.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.442+0000 7f3869ffb640 1 -- 172.21.15.50:0/975860381 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3870040070 con 0x7f3874111a90 2024-05-07T13:55:49.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:49.626+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f38741a73c0 con 0x7f3874111a90 2024-05-07T13:55:50.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.298+0000 7f3869ffb640 1 -- 172.21.15.50:0/975860381 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v18) ==== 187+0+0 (secure 0 0 0) 0x7f387003a380 con 0x7f3874111a90 2024-05-07T13:55:50.286 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-07T13:55:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.303+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3858038010 msgr2=0x7f385803a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.303+0000 7f387b950640 1 --2- 172.21.15.50:0/975860381 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3858038010 0x7f385803a4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3864007fd0 tx=0x7f3864007ac0 comp rx=0 tx=0).stop 2024-05-07T13:55:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.303+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874111a90 msgr2=0x7f38741a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:55:50.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.303+0000 7f387b950640 1 --2- 172.21.15.50:0/975860381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874111a90 0x7f38741a6990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3870034040 tx=0x7f38700046c0 comp rx=0 tx=0).stop 2024-05-07T13:55:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.304+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 shutdown_connections 2024-05-07T13:55:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.304+0000 7f387b950640 1 --2- 172.21.15.50:0/975860381 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3858038010 0x7f385803a4d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.304+0000 7f387b950640 1 --2- 172.21.15.50:0/975860381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3874111a90 0x7f38741a6990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:55:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.304+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 >> 172.21.15.50:0/975860381 conn(0x7f387406e8d0 msgr2=0x7f3874119050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:55:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.304+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 shutdown_connections 2024-05-07T13:55:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:55:50.304+0000 7f387b950640 1 -- 172.21.15.50:0/975860381 wait complete. 2024-05-07T13:55:50.317 DEBUG:tasks.rgw:Pools created 2024-05-07T13:55:50.317 INFO:tasks.rgw:Starting rgw... 2024-05-07T13:55:50.317 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-07T13:55:50.318 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-07T13:55:50.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo echo -n http://smithi050.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-07T13:55:50.347 INFO:teuthology.orchestra.run.smithi050.stdout:http://smithi050.front.sepia.ceph.com:80 2024-05-07T13:55:50.347 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-07T13:55:50.415 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-07T13:55:50.416 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-07T13:55:50.458 INFO:tasks.rgw.client.0:Started 2024-05-07T13:55:50.458 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi050.front.sepia.ceph.com:80/ 2024-05-07T13:55:50.458 DEBUG:teuthology.orchestra.run.smithi050:> curl http://smithi050.front.sepia.ceph.com:80/ 2024-05-07T13:55:50.516 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-07T13:55:50.517 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T13:55:50.517 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-05-07T13:55:50.517 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-07T13:55:50.517 INFO:teuthology.orchestra.run.smithi050.stderr:curl: (7) Failed to connect to smithi050.front.sepia.ceph.com port 80: Connection refused 2024-05-07T13:55:51.518 DEBUG:teuthology.orchestra.run.smithi050:> curl http://smithi050.front.sepia.ceph.com:80/ 2024-05-07T13:55:51.542 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T13:55:51.543 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-05-07T13:55:51.544 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-07T13:55:51.545 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-07T13:55:51.545 INFO:teuthology.orchestra.run.smithi050.stderr:curl: (7) Failed to connect to smithi050.front.sepia.ceph.com port 80: Connection refused 2024-05-07T13:55:53.546 DEBUG:teuthology.orchestra.run.smithi050:> curl http://smithi050.front.sepia.ceph.com:80/ 2024-05-07T13:55:53.571 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T13:55:53.571 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-05-07T13:55:53.573 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-07T13:55:53.573 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-07T13:55:53.573 INFO:teuthology.orchestra.run.smithi050.stderr:curl: (7) Failed to connect to smithi050.front.sepia.ceph.com port 80: Connection refused 2024-05-07T13:55:57.575 DEBUG:teuthology.orchestra.run.smithi050:> curl http://smithi050.front.sepia.ceph.com:80/ 2024-05-07T13:55:57.600 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T13:55:57.600 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-05-07T13:55:57.602 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-07T13:55:57.603 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-07T13:55:57.603 INFO:teuthology.orchestra.run.smithi050.stderr:curl: (7) Failed to connect to smithi050.front.sepia.ceph.com port 80: Connection refused 2024-05-07T13:55:59.391 INFO:tasks.rgw.client.0.smithi050.stdout:2024-05-07T13:55:59.404+0000 7f9e4a8c7880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-07T13:56:05.604 DEBUG:teuthology.orchestra.run.smithi050:> curl http://smithi050.front.sepia.ceph.com:80/ 2024-05-07T13:56:05.630 INFO:teuthology.orchestra.run.smithi050.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T13:56:05.630 INFO:teuthology.orchestra.run.smithi050.stderr: Dload Upload Total Spent Left Speed 2024-05-07T13:56:05.631 INFO:teuthology.orchestra.run.smithi050.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-05-07T13:56:05.632 INFO:teuthology.orchestra.run.smithi050.stdout:anonymous 2024-05-07T13:56:05.632 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-05-07T13:56:07.492 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-05-07T13:56:07.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-07T13:56:07.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-07T13:56:07.492 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-07T13:56:07.543 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:07.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.556+0000 7f19e2737800 1 Processor -- start 2024-05-07T13:56:07.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.556+0000 7f19e2737800 1 -- start start 2024-05-07T13:56:07.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.556+0000 7f19e2737800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b936f5a450 0x55b936f5c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.556+0000 7f19e2737800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b936f5ce10 con 0x55b936f55fc0 2024-05-07T13:56:07.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.556+0000 7f19e2737800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55b936de8050 con 0x55b936f5a450 2024-05-07T13:56:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.557+0000 7f19ddcf8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b936f5a450 0x55b936f5c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.557+0000 7f19de4f9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55b936f55fc0 0x55b936f563e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39426/0 (socket says 172.21.15.50:39426) 2024-05-07T13:56:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.557+0000 7f19de4f9640 1 -- 172.21.15.50:0/4146138869 learned_addr learned my addr 172.21.15.50:0/4146138869 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.557+0000 7f19ddcf8640 1 -- 172.21.15.50:0/4146138869 >> v1:172.21.15.22:6789/0 conn(0x55b936f55fc0 legacy=0x55b936f563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.557+0000 7f19ddcf8640 1 -- 172.21.15.50:0/4146138869 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b936f5e040 con 0x55b936f5a450 2024-05-07T13:56:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.559+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/4146138869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f5a450 0x55b936f5c840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f19d400a470 tx=0x7f19d401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b9162393d5ddda server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.559+0000 7f19dd4f7640 1 -- 172.21.15.50:0/4146138869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d4057070 con 0x55b936f5a450 2024-05-07T13:56:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.559+0000 7f19dd4f7640 1 -- 172.21.15.50:0/4146138869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d4052570 con 0x55b936f5a450 2024-05-07T13:56:07.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.559+0000 7f19dd4f7640 1 -- 172.21.15.50:0/4146138869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d4052870 con 0x55b936f5a450 2024-05-07T13:56:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.560+0000 7f19e2737800 1 -- 172.21.15.50:0/4146138869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f5a450 msgr2=0x55b936f5c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.560+0000 7f19e2737800 1 --2- 172.21.15.50:0/4146138869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f5a450 0x55b936f5c840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f19d400a470 tx=0x7f19d401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.560+0000 7f19e2737800 1 -- 172.21.15.50:0/4146138869 shutdown_connections 2024-05-07T13:56:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.560+0000 7f19e2737800 1 --2- 172.21.15.50:0/4146138869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f5a450 0x55b936f5c840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.560+0000 7f19e2737800 1 -- 172.21.15.50:0/4146138869 >> 172.21.15.50:0/4146138869 conn(0x55b936f515a0 msgr2=0x55b936f539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.560+0000 7f19e2737800 1 -- 172.21.15.50:0/4146138869 shutdown_connections 2024-05-07T13:56:07.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.560+0000 7f19e2737800 1 -- 172.21.15.50:0/4146138869 wait complete. 2024-05-07T13:56:07.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.577+0000 7f19e2737800 1 Processor -- start 2024-05-07T13:56:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.577+0000 7f19e2737800 1 -- start start 2024-05-07T13:56:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.577+0000 7f19e2737800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b936f61e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.577+0000 7f19e2737800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b936ea21c0 con 0x55b936f55fc0 2024-05-07T13:56:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.578+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b936f61e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.578+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b936f61e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44220/0 (socket says 172.21.15.50:44220) 2024-05-07T13:56:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.578+0000 7f19de4f9640 1 -- 172.21.15.50:0/3574351506 learned_addr learned my addr 172.21.15.50:0/3574351506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.578+0000 7f19de4f9640 1 -- 172.21.15.50:0/3574351506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b936f603f0 con 0x55b936f55fc0 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.578+0000 7f19de4f9640 1 --2- 172.21.15.50:0/3574351506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b936f61e30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f19d0001d80 tx=0x7f19d0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d952f3e645e321 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.579+0000 7f18cc608640 1 -- 172.21.15.50:0/3574351506 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d0013030 con 0x55b936f55fc0 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.579+0000 7f18cc608640 1 -- 172.21.15.50:0/3574351506 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d000e470 con 0x55b936f55fc0 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.579+0000 7f18cc608640 1 -- 172.21.15.50:0/3574351506 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d000e810 con 0x55b936f55fc0 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.579+0000 7f19e2737800 1 -- 172.21.15.50:0/3574351506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 msgr2=0x55b936f61e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.579+0000 7f19e2737800 1 --2- 172.21.15.50:0/3574351506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b936f61e30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f19d0001d80 tx=0x7f19d0001e70 comp rx=0 tx=0).stop 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.579+0000 7f19e2737800 1 -- 172.21.15.50:0/3574351506 shutdown_connections 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.579+0000 7f19e2737800 1 --2- 172.21.15.50:0/3574351506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b936f61e30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.579+0000 7f19e2737800 1 -- 172.21.15.50:0/3574351506 >> 172.21.15.50:0/3574351506 conn(0x55b936f515a0 msgr2=0x55b937043fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.580+0000 7f19e2737800 1 -- 172.21.15.50:0/3574351506 shutdown_connections 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.580+0000 7f19e2737800 1 -- 172.21.15.50:0/3574351506 wait complete. 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.580+0000 7f19e2737800 1 Processor -- start 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.580+0000 7f19e2737800 1 -- start start 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.580+0000 7f19e2737800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b937052480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.580+0000 7f19e2737800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b936f5d2e0 con 0x55b936f55fc0 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.580+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b937052480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.580+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b937052480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44230/0 (socket says 172.21.15.50:44230) 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.580+0000 7f19de4f9640 1 -- 172.21.15.50:0/2003398820 learned_addr learned my addr 172.21.15.50:0/2003398820 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.581+0000 7f19de4f9640 1 -- 172.21.15.50:0/2003398820 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9370529c0 con 0x55b936f55fc0 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.581+0000 7f19de4f9640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b937052480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f19d0004000 tx=0x7f19d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.581+0000 7f18cae05640 1 -- 172.21.15.50:0/2003398820 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d0027070 con 0x55b936f55fc0 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.581+0000 7f18cae05640 1 -- 172.21.15.50:0/2003398820 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0001400 con 0x55b936f55fc0 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.581+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b937052c50 con 0x55b936f55fc0 2024-05-07T13:56:07.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.581+0000 7f18cae05640 1 -- 172.21.15.50:0/2003398820 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d0019a70 con 0x55b936f55fc0 2024-05-07T13:56:07.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.581+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b937055900 con 0x55b936f55fc0 2024-05-07T13:56:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.582+0000 7f18cae05640 1 -- 172.21.15.50:0/2003398820 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f19d002a070 con 0x55b936f55fc0 2024-05-07T13:56:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.582+0000 7f18cae05640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18c4036900 0x7f18c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.582+0000 7f18cae05640 1 -- 172.21.15.50:0/2003398820 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f19d001f070 con 0x55b936f55fc0 2024-05-07T13:56:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.583+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18c4036900 0x7f18c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.583+0000 7f19e2737800 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b936f5a450 0x55b9370596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.583+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937059c50 con 0x55b936f5a450 2024-05-07T13:56:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.583+0000 7f19decfa640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b936f5a450 0x55b9370596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.583+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18c4036900 0x7f18c4038dc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f19d4054000 tx=0x7f19d404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.583+0000 7f19decfa640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b936f5a450 0x55b9370596c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.584+0000 7f19decfa640 1 -- 172.21.15.50:0/2003398820 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b936f5a450 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.584+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937056c90 con 0x55b936f5a450 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.584+0000 7f19decfa640 1 -- 172.21.15.50:0/2003398820 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b936f5a450 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.584+0000 7f19e2737800 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b93705bfa0 0x55b93705e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.584+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b93705ea80 con 0x55b93705bfa0 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.584+0000 7f19de4f9640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b93705bfa0 0x55b93705e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.585+0000 7f19de4f9640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b93705bfa0 0x55b93705e390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.585+0000 7f19de4f9640 1 -- 172.21.15.50:0/2003398820 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f19d0029030 con 0x55b93705bfa0 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.585+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b93705af50 con 0x55b936f5a450 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.585+0000 7f19decfa640 1 -- 172.21.15.50:0/2003398820 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b936f5a450 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.585+0000 7f19e2737800 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b93705ff30 0x55b937062380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.585+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937062ae0 con 0x55b93705ff30 2024-05-07T13:56:07.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.586+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b93705ff30 0x55b937062380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.586+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b93705ff30 0x55b937062380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.587+0000 7f19ddcf8640 1 -- 172.21.15.50:0/2003398820 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f19d405a040 con 0x55b93705ff30 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.587+0000 7f19e2737800 1 Processor -- start 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.587+0000 7f19e2737800 1 -- start start 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.587+0000 7f19e2737800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b937070ed0 0x55b9370712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.587+0000 7f19e2737800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b936e48cf0 con 0x55b937070ed0 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b937070ed0 0x55b9370712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b937070ed0 0x55b9370712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44244/0 (socket says 172.21.15.50:44244) 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f19de4f9640 1 -- 172.21.15.50:0/3445494523 learned_addr learned my addr 172.21.15.50:0/3445494523 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f19de4f9640 1 -- 172.21.15.50:0/3445494523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b937071830 con 0x55b937070ed0 2024-05-07T13:56:07.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f19de4f9640 1 --2- 172.21.15.50:0/3445494523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b937070ed0 0x55b9370712f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19d004ad70 tx=0x7f19d0019f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f18c3fff640 1 -- 172.21.15.50:0/3445494523 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d00444e0 con 0x55b937070ed0 2024-05-07T13:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f18c3fff640 1 -- 172.21.15.50:0/3445494523 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0044840 con 0x55b937070ed0 2024-05-07T13:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f19e2737800 1 -- 172.21.15.50:0/3445494523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9370722a0 con 0x55b937070ed0 2024-05-07T13:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f18c3fff640 1 -- 172.21.15.50:0/3445494523 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d0044b40 con 0x55b937070ed0 2024-05-07T13:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.588+0000 7f19e2737800 1 -- 172.21.15.50:0/3445494523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9370727a0 con 0x55b937070ed0 2024-05-07T13:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.589+0000 7f18c3fff640 1 -- 172.21.15.50:0/3445494523 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f19d0016070 con 0x55b937070ed0 2024-05-07T13:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.589+0000 7f18c3fff640 1 --2- 172.21.15.50:0/3445494523 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18b8036950 0x7f18b8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.589+0000 7f18c3fff640 1 -- 172.21.15.50:0/3445494523 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f19d0014070 con 0x55b937070ed0 2024-05-07T13:56:07.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.589+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/3445494523 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18b8036950 0x7f18b8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.590+0000 7f19e2737800 1 Processor -- start 2024-05-07T13:56:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.590+0000 7f19e2737800 1 -- start start 2024-05-07T13:56:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.590+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/3445494523 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18b8036950 0x7f18b8038e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55b93705a550 tx=0x7f19d4005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.590+0000 7f19e2737800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b93707e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.590+0000 7f19e2737800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b936f60770 con 0x55b93707e110 2024-05-07T13:56:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.590+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b93707e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.590+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b93707e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44258/0 (socket says 172.21.15.50:44258) 2024-05-07T13:56:07.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.591+0000 7f19de4f9640 1 -- 172.21.15.50:0/1848937853 learned_addr learned my addr 172.21.15.50:0/1848937853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.591+0000 7f19de4f9640 1 -- 172.21.15.50:0/1848937853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93707eae0 con 0x55b93707e110 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.591+0000 7f19de4f9640 1 --2- 172.21.15.50:0/1848937853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b93707e510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19d0019640 tx=0x7f19d0047da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242ffe3b04f85679 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.591+0000 7f18c1ffb640 1 -- 172.21.15.50:0/1848937853 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d0060070 con 0x55b93707e110 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.591+0000 7f18c1ffb640 1 -- 172.21.15.50:0/1848937853 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0041ce0 con 0x55b93707e110 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.591+0000 7f18c1ffb640 1 -- 172.21.15.50:0/1848937853 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d0057040 con 0x55b93707e110 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 -- 172.21.15.50:0/1848937853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 msgr2=0x55b93707e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 --2- 172.21.15.50:0/1848937853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b93707e510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19d0019640 tx=0x7f19d0047da0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 -- 172.21.15.50:0/1848937853 shutdown_connections 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 --2- 172.21.15.50:0/1848937853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b93707e510 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 -- 172.21.15.50:0/1848937853 >> 172.21.15.50:0/1848937853 conn(0x55b93707a3e0 msgr2=0x55b937078440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 -- 172.21.15.50:0/1848937853 shutdown_connections 2024-05-07T13:56:07.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 -- 172.21.15.50:0/1848937853 wait complete. 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 Processor -- start 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 -- start start 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b937085450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.592+0000 7f19e2737800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b93707f1d0 con 0x55b93707e110 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.593+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b937085450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.593+0000 7f19de4f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b937085450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44264/0 (socket says 172.21.15.50:44264) 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.593+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 learned_addr learned my addr 172.21.15.50:0/1815527200 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.593+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b937085990 con 0x55b93707e110 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.593+0000 7f19de4f9640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b937085450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f19d004ed80 tx=0x7f19d002df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.593+0000 7f18affff640 1 -- 172.21.15.50:0/1815527200 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d006a020 con 0x55b93707e110 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.593+0000 7f18affff640 1 -- 172.21.15.50:0/1815527200 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0044ce0 con 0x55b93707e110 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.594+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b937085990 con 0x55b93707e110 2024-05-07T13:56:07.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.594+0000 7f18affff640 1 -- 172.21.15.50:0/1815527200 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19d0060040 con 0x55b93707e110 2024-05-07T13:56:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.594+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b937085990 con 0x55b93707e110 2024-05-07T13:56:07.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.594+0000 7f18affff640 1 -- 172.21.15.50:0/1815527200 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f19d006d020 con 0x55b93707e110 2024-05-07T13:56:07.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.595+0000 7f18affff640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18a8036950 0x7f18a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.595+0000 7f18affff640 1 -- 172.21.15.50:0/1815527200 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f19d0070c60 con 0x55b93707e110 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.595+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18a8036950 0x7f18a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.595+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.595+0000 7f19e2737800 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b937090bf0 0x55b9370930b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.595+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937093800 con 0x55b937090bf0 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.595+0000 7f19decfa640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b937090bf0 0x55b9370930b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.595+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18a8036950 0x7f18a8038e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x55b937062ee0 tx=0x7f19d404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19decfa640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b937090bf0 0x55b9370930b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 20 realm 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937093c10 con 0x55b937090bf0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b9370944e0 con 0x55b937090bf0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.596+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x55b937090bf0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19e2737800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19e2737800 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b937095370 0x55b937097760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937097ec0 con 0x55b937095370 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19de4f9640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b937095370 0x55b937097760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19de4f9640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b937095370 0x55b937097760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19e2737800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19e2737800 20 searching for the correct realm 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.597+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937099890 con 0x55b937095370 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.598+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.598+0000 7f19de4f9640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f19d006f020 0x7f19d002a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.598+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937099890 con 0x7f19d006f020 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.598+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f19d006f020 0x7f19d002a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.599+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f19d006f020 0x7f19d002a580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.599+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.599+0000 7f19ddcf8640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f19d4074040 0x7f19d4081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.599+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937099890 con 0x7f19d4074040 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.599+0000 7f19decfa640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f19d4074040 0x7f19d4081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.600+0000 7f19decfa640 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f19d4074040 0x7f19d4081410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.600+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.600+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x55b937090bf0 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.600+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.600+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x55b937090bf0 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.600+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.600+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x7f19d4074040 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.601+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.601+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x7f19d4074040 2024-05-07T13:56:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.601+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.601+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x7f19d006f020 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.601+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.602+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x55b937095370 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.602+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.602+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x55b937090bf0 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.602+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.602+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x7f19d4074040 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.602+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.603+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x55b937090bf0 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.603+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.603+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937094880 con 0x7f19d006f020 2024-05-07T13:56:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.603+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.603+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937095370 2024-05-07T13:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.603+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.603+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937095370 2024-05-07T13:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.604+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.604+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x7f19d4074040 2024-05-07T13:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.604+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.604+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937095370 2024-05-07T13:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.604+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.604+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937095370 2024-05-07T13:56:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.605+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.605+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937090bf0 2024-05-07T13:56:07.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.605+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.605+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937090bf0 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.605+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.605+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x7f19d4074040 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.606+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.606+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937095370 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.606+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.606+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x7f19d006f020 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.606+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.606+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937090bf0 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.606+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.606+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x7f19d4074040 2024-05-07T13:56:07.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.607+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.607+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937095370 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.607+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.607+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x7f19d4074040 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.608+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.608+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x7f19d006f020 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.608+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.608+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937095370 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.608+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.608+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x7f19d4074040 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x55b937090bf0 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d408e060 con 0x7f19d006f020 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937098860 con 0x55b937090bf0 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.609+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937098c50 con 0x55b937090bf0 2024-05-07T13:56:07.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937098c50 con 0x7f19d4074040 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 20 zone default found 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 4 Realm: () 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 20 zonegroup default 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937099070 con 0x7f19d4074040 2024-05-07T13:56:07.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.610+0000 7f19e2737800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b937099070 con 0x55b937095370 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19e2737800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19e2737800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b93709b740 con 0x55b937095370 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19e2737800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19e2737800 20 started sync module instance, tier type = 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19e2737800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.611+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b937098400 con 0x7f19d006f020 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.612+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.612+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253980691632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709bae0 con 0x7f19d006f020 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.612+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709c5e0 con 0x55b937090bf0 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.614+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94253980691632] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.614+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.614+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94253980696784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709ca00 con 0x55b937090bf0 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.614+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709d3c0 con 0x55b937095370 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.615+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.615+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94253980700432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709dc60 con 0x55b937095370 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.615+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709e740 con 0x7f19d006f020 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.615+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94253980696784] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.616+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.616+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94253980705360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x7f19d006f020 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.617+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709f590 con 0x55b937090bf0 2024-05-07T13:56:07.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.617+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94253980700432] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.618+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.618+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94253980702640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709f9b0 con 0x55b937090bf0 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.618+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94253980705360] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.618+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709b180 con 0x7f19d4074040 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.619+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.619+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253980712640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709b180 con 0x7f19d4074040 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.619+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94253980702640] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.619+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b9370a0db0 con 0x7f19d4074040 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.620+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94253980712640] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.620+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.620+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94253980713696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b9370a0900 con 0x7f19d4074040 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.620+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b9370a1650 con 0x7f19d4074040 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.621+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94253980713696] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.622+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.622+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94253980709024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b9370a0900 con 0x7f19d4074040 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.622+0000 7f19e2737800 20 add_watcher() i=0 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.622+0000 7f19e2737800 20 add_watcher() i=1 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.622+0000 7f19e2737800 20 add_watcher() i=2 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.622+0000 7f19e2737800 20 add_watcher() i=3 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.622+0000 7f19e2737800 20 add_watcher() i=4 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.622+0000 7f19e2737800 20 add_watcher() i=5 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.622+0000 7f19e2737800 20 add_watcher() i=6 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.623+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94253980709024] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x7f19d4074040 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.623+0000 7f19e2737800 20 add_watcher() i=7 2024-05-07T13:56:07.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.623+0000 7f19e2737800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.623+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b9370a4680 con 0x55b937090bf0 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.623+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.623+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94253980717312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b9370a1af0 con 0x55b937090bf0 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.624+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94253980717312] v27'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.624+0000 7f1894fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.624+0000 7f19e2737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.624+0000 7f19e2737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.624+0000 7f19e2737800 5 note: GC not initialized 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.625+0000 7f180f7fe640 20 reqs_thread_entry: start 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.625+0000 7f19e2737800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.625+0000 7f19e2737800 20 Filter name: none 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.625+0000 7f180d7fa640 20 reqs_thread_entry: start 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.625+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b9370d7370 con 0x55b937095370 2024-05-07T13:56:07.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.626+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.626+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709d3c0 con 0x55b937095370 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.626+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.626+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709d3c0 con 0x55b937090bf0 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.626+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(64 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.626+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937098860 con 0x55b937090bf0 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.626+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.626+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b937098860 con 0x7f19d006f020 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.627+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.627+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x55b937095370 2024-05-07T13:56:07.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.627+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.627+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x55b937090bf0 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.627+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d800a4a0 con 0x55b937090bf0 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.627+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x55b937095370 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.628+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.628+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x7f19d006f020 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.628+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.628+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x55b937095370 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.628+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.628+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x55b937090bf0 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.628+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x55b937090bf0 2024-05-07T13:56:07.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.628+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x7f19d4074040 2024-05-07T13:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.629+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.629+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x7f19d4074040 2024-05-07T13:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.629+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.629+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x55b937095370 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.629+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.629+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d4074040 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.630+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.630+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d4074040 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.630+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.630+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d4074040 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.630+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.630+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x55b937095370 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.630+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.630+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d006f020 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.631+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(80 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.631+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x55b937090bf0 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.631+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x55b937090bf0 2024-05-07T13:56:07.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.631+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x55b937090bf0 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.631+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x55b937090bf0 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.631+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x55b937095370 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.631+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.632+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d006f020 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.632+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.632+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d4074040 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.632+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.632+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x55b937090bf0 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.632+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x55b937090bf0 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.632+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d4074040 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.633+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.633+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x55b937095370 2024-05-07T13:56:07.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.633+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(88 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.633+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d006f020 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.633+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.633+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d4074040 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.634+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.634+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x55b937090bf0 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.634+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d803f040 con 0x55b937090bf0 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.634+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x55b937095370 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.634+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.634+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f19d8044040 con 0x7f19d006f020 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.635+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(93 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.635+0000 7f1894fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.636+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94253980717312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709d3c0 con 0x55b937090bf0 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.637+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94253980717312] v27'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19d803f040 con 0x55b937090bf0 2024-05-07T13:56:07.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.637+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94253980691632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x7f19d006f020 2024-05-07T13:56:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.638+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94253980691632] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.638+0000 7f19e2737800 20 remove_watcher() i=0 2024-05-07T13:56:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.638+0000 7f19e2737800 2 removed watcher, disabling cache 2024-05-07T13:56:07.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.638+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94253980696784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b937098860 con 0x55b937090bf0 2024-05-07T13:56:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.639+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94253980696784] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d803f040 con 0x55b937090bf0 2024-05-07T13:56:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.639+0000 7f19e2737800 20 remove_watcher() i=1 2024-05-07T13:56:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.639+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94253980700432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b93709eb30 con 0x55b937095370 2024-05-07T13:56:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.640+0000 7f19de4f9640 1 -- 172.21.15.50:0/1815527200 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94253980700432] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d0063040 con 0x55b937095370 2024-05-07T13:56:07.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.640+0000 7f19e2737800 20 remove_watcher() i=2 2024-05-07T13:56:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.640+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94253980705360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b937098860 con 0x7f19d006f020 2024-05-07T13:56:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.641+0000 7f19ddcf8640 1 -- 172.21.15.50:0/1815527200 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94253980705360] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d407f070 con 0x7f19d006f020 2024-05-07T13:56:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.641+0000 7f19e2737800 20 remove_watcher() i=3 2024-05-07T13:56:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.641+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94253980702640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b937098860 con 0x55b937090bf0 2024-05-07T13:56:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.643+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94253980702640] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d803f040 con 0x55b937090bf0 2024-05-07T13:56:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.643+0000 7f19e2737800 20 remove_watcher() i=4 2024-05-07T13:56:07.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.643+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94253980712640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b937098860 con 0x7f19d4074040 2024-05-07T13:56:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.644+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94253980712640] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.644+0000 7f19e2737800 20 remove_watcher() i=5 2024-05-07T13:56:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.644+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94253980713696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b937098860 con 0x7f19d4074040 2024-05-07T13:56:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.645+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94253980713696] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.645+0000 7f19e2737800 20 remove_watcher() i=6 2024-05-07T13:56:07.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.645+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94253980709024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b937098860 con 0x7f19d4074040 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94253980709024] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19d803f040 con 0x7f19d4074040 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 20 remove_watcher() i=7 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f19d4074040 msgr2=0x7f19d4081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f19d4074040 0x7f19d4081410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b937090bf0 msgr2=0x55b9370930b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b937090bf0 0x55b9370930b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f19d006f020 msgr2=0x7f19d002a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f19d006f020 0x7f19d002a580 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b937095370 msgr2=0x55b937097760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b937095370 0x55b937097760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18a8036950 msgr2=0x7f18a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18a8036950 0x7f18a8038e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x55b937062ee0 tx=0x7f19d404f000 comp rx=0 tx=0).stop 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 msgr2=0x55b937085450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19decfa640 1 -- 172.21.15.50:0/1815527200 reap_dead start 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.646+0000 7f19e2737800 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b937085450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f19d004ed80 tx=0x7f19d002df90 comp rx=0 tx=0).stop 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 shutdown_connections 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 --2- 172.21.15.50:0/1815527200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b93707e110 0x55b937085450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 >> 172.21.15.50:0/1815527200 conn(0x55b93707a3e0 msgr2=0x55b937077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 shutdown_connections 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/1815527200 wait complete. 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/3445494523 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18b8036950 msgr2=0x7f18b8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 --2- 172.21.15.50:0/3445494523 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18b8036950 0x7f18b8038e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55b93705a550 tx=0x7f19d4005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/3445494523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b937070ed0 msgr2=0x55b9370712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 --2- 172.21.15.50:0/3445494523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b937070ed0 0x55b9370712f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19d004ad70 tx=0x7f19d0019f00 comp rx=0 tx=0).stop 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/3445494523 shutdown_connections 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 --2- 172.21.15.50:0/3445494523 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18b8036950 0x7f18b8038e10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 --2- 172.21.15.50:0/3445494523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b937070ed0 0x55b9370712f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/3445494523 >> 172.21.15.50:0/3445494523 conn(0x55b937064f70 msgr2=0x55b937065370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/3445494523 shutdown_connections 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/3445494523 wait complete. 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b93705ff30 msgr2=0x55b937062380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b93705ff30 0x55b937062380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b936f5a450 msgr2=0x55b9370596c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b936f5a450 0x55b9370596c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b93705bfa0 msgr2=0x55b93705e390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.647+0000 7f19e2737800 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b93705bfa0 0x55b93705e390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.648+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18c4036900 msgr2=0x7f18c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.648+0000 7f19e2737800 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18c4036900 0x7f18c4038dc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f19d4054000 tx=0x7f19d404e000 comp rx=0 tx=0).stop 2024-05-07T13:56:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.648+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 msgr2=0x55b937052480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.648+0000 7f19e2737800 1 --2- 172.21.15.50:0/2003398820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b936f55fc0 0x55b937052480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f19d0004000 tx=0x7f19d0000bc0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.648+0000 7f19decfa640 1 -- 172.21.15.50:0/2003398820 reap_dead start 2024-05-07T13:56:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.648+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 shutdown_connections 2024-05-07T13:56:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.648+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 >> 172.21.15.50:0/2003398820 conn(0x55b936f515a0 msgr2=0x55b936f60cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.648+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 shutdown_connections 2024-05-07T13:56:07.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.648+0000 7f19e2737800 1 -- 172.21.15.50:0/2003398820 wait complete. 2024-05-07T13:56:07.657 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-05-07T13:56:07.657 DEBUG:tasks.util.rgw: json result: [] 2024-05-07T13:56:07.658 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-05-07T13:56:07.658 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-05-07T13:56:07.658 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-05-07T13:56:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:07.704 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.716+0000 7f179491f800 1 Processor -- start 2024-05-07T13:56:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.716+0000 7f179491f800 1 -- start start 2024-05-07T13:56:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.716+0000 7f179491f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e9a6652c40 0x55e9a6655030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.716+0000 7f179491f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e9a6659080 con 0x55e9a6655570 2024-05-07T13:56:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.716+0000 7f179491f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55e9a64e3050 con 0x55e9a6652c40 2024-05-07T13:56:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.717+0000 7f17905ca640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e9a6652c40 0x55e9a6655030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.717+0000 7f178fdc9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55e9a6655570 0x55e9a6657960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39440/0 (socket says 172.21.15.50:39440) 2024-05-07T13:56:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.717+0000 7f17905ca640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e9a6652c40 0x55e9a6655030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44268/0 (socket says 172.21.15.50:44268) 2024-05-07T13:56:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.717+0000 7f178fdc9640 1 -- 172.21.15.50:0/1407270494 learned_addr learned my addr 172.21.15.50:0/1407270494 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.717+0000 7f17905ca640 1 -- 172.21.15.50:0/1407270494 >> v1:172.21.15.22:6789/0 conn(0x55e9a6655570 legacy=0x55e9a6657960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.717+0000 7f17905ca640 1 -- 172.21.15.50:0/1407270494 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a665a260 con 0x55e9a6652c40 2024-05-07T13:56:07.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.719+0000 7f17905ca640 1 --2- 172.21.15.50:0/1407270494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a6655030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f178000a470 tx=0x7f178001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c3200345ca6701 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.719+0000 7f178f5c8640 1 -- 172.21.15.50:0/1407270494 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780057070 con 0x55e9a6652c40 2024-05-07T13:56:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.719+0000 7f178f5c8640 1 -- 172.21.15.50:0/1407270494 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780052570 con 0x55e9a6652c40 2024-05-07T13:56:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.719+0000 7f178f5c8640 1 -- 172.21.15.50:0/1407270494 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780052870 con 0x55e9a6652c40 2024-05-07T13:56:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.720+0000 7f179491f800 1 -- 172.21.15.50:0/1407270494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 msgr2=0x55e9a6655030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.720+0000 7f179491f800 1 --2- 172.21.15.50:0/1407270494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a6655030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f178000a470 tx=0x7f178001ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.720+0000 7f179491f800 1 -- 172.21.15.50:0/1407270494 shutdown_connections 2024-05-07T13:56:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.720+0000 7f179491f800 1 --2- 172.21.15.50:0/1407270494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a6655030 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.720+0000 7f179491f800 1 -- 172.21.15.50:0/1407270494 >> 172.21.15.50:0/1407270494 conn(0x55e9a664c5b0 msgr2=0x55e9a664e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.720+0000 7f179491f800 1 -- 172.21.15.50:0/1407270494 shutdown_connections 2024-05-07T13:56:07.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.720+0000 7f179491f800 1 -- 172.21.15.50:0/1407270494 wait complete. 2024-05-07T13:56:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.734+0000 7f179491f800 1 Processor -- start 2024-05-07T13:56:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.735+0000 7f179491f800 1 -- start start 2024-05-07T13:56:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.735+0000 7f179491f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a6652580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.735+0000 7f179491f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e9a659d1d0 con 0x55e9a6652c40 2024-05-07T13:56:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.735+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a6652580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.735+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a6652580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44276/0 (socket says 172.21.15.50:44276) 2024-05-07T13:56:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.735+0000 7f17905ca640 1 -- 172.21.15.50:0/598779125 learned_addr learned my addr 172.21.15.50:0/598779125 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.735+0000 7f17905ca640 1 -- 172.21.15.50:0/598779125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a6650b40 con 0x55e9a6652c40 2024-05-07T13:56:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.736+0000 7f17905ca640 1 --2- 172.21.15.50:0/598779125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a6652580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f178001ced0 tx=0x7f178004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df5d0e6b2f55aa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.736+0000 7f167e60c640 1 -- 172.21.15.50:0/598779125 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780057040 con 0x55e9a6652c40 2024-05-07T13:56:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.736+0000 7f167e60c640 1 -- 172.21.15.50:0/598779125 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800529a0 con 0x55e9a6652c40 2024-05-07T13:56:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.736+0000 7f167e60c640 1 -- 172.21.15.50:0/598779125 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780052cc0 con 0x55e9a6652c40 2024-05-07T13:56:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 -- 172.21.15.50:0/598779125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 msgr2=0x55e9a6652580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 --2- 172.21.15.50:0/598779125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a6652580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f178001ced0 tx=0x7f178004c000 comp rx=0 tx=0).stop 2024-05-07T13:56:07.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 -- 172.21.15.50:0/598779125 shutdown_connections 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 --2- 172.21.15.50:0/598779125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a6652580 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 -- 172.21.15.50:0/598779125 >> 172.21.15.50:0/598779125 conn(0x55e9a664c5b0 msgr2=0x55e9a673efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 -- 172.21.15.50:0/598779125 shutdown_connections 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 -- 172.21.15.50:0/598779125 wait complete. 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 Processor -- start 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 -- start start 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a674d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f179491f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e9a6659490 con 0x55e9a6652c40 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a674d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a674d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44278/0 (socket says 172.21.15.50:44278) 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.737+0000 7f17905ca640 1 -- 172.21.15.50:0/3838808761 learned_addr learned my addr 172.21.15.50:0/3838808761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.738+0000 7f17905ca640 1 -- 172.21.15.50:0/3838808761 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a674d780 con 0x55e9a6652c40 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.738+0000 7f17905ca640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a674d240 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1780052740 tx=0x7f1780003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.738+0000 7f167ce09640 1 -- 172.21.15.50:0/3838808761 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780073070 con 0x55e9a6652c40 2024-05-07T13:56:07.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.738+0000 7f167ce09640 1 -- 172.21.15.50:0/3838808761 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178005d860 con 0x55e9a6652c40 2024-05-07T13:56:07.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.738+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9a674da10 con 0x55e9a6652c40 2024-05-07T13:56:07.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.738+0000 7f167ce09640 1 -- 172.21.15.50:0/3838808761 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780057070 con 0x55e9a6652c40 2024-05-07T13:56:07.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.738+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9a67506c0 con 0x55e9a6652c40 2024-05-07T13:56:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.739+0000 7f167ce09640 1 -- 172.21.15.50:0/3838808761 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1780076070 con 0x55e9a6652c40 2024-05-07T13:56:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.739+0000 7f167ce09640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1678036950 0x7f1678038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.739+0000 7f167ce09640 1 -- 172.21.15.50:0/3838808761 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f178008e0e0 con 0x55e9a6652c40 2024-05-07T13:56:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.740+0000 7f178fdc9640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1678036950 0x7f1678038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.740+0000 7f179491f800 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a6655570 0x55e9a6754480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.740+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6754aa0 con 0x55e9a6655570 2024-05-07T13:56:07.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.740+0000 7f1790dcb640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a6655570 0x55e9a6754480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.740+0000 7f178fdc9640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1678036950 0x7f1678038e10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1784000f60 tx=0x7f17840012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.740+0000 7f1790dcb640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a6655570 0x55e9a6754480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.740+0000 7f1790dcb640 1 -- 172.21.15.50:0/3838808761 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a6655570 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.740+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6751a50 con 0x55e9a6655570 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.741+0000 7f1790dcb640 1 -- 172.21.15.50:0/3838808761 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a6655570 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.741+0000 7f179491f800 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6756db0 0x55e9a67591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.741+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6759840 con 0x55e9a6756db0 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.741+0000 7f17905ca640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6756db0 0x55e9a67591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.741+0000 7f17905ca640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6756db0 0x55e9a67591a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.741+0000 7f17905ca640 1 -- 172.21.15.50:0/3838808761 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1780075030 con 0x55e9a6756db0 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.741+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6755d60 con 0x55e9a6655570 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.742+0000 7f1790dcb640 1 -- 172.21.15.50:0/3838808761 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a6655570 2024-05-07T13:56:07.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.742+0000 7f179491f800 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e9a675acf0 0x55e9a675d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.742+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a675d8a0 con 0x55e9a675acf0 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.742+0000 7f178fdc9640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e9a675acf0 0x55e9a675d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.743+0000 7f178fdc9640 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e9a675acf0 0x55e9a675d140 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.743+0000 7f178fdc9640 1 -- 172.21.15.50:0/3838808761 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1784009050 con 0x55e9a675acf0 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.743+0000 7f179491f800 1 Processor -- start 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.743+0000 7f179491f800 1 -- start start 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.744+0000 7f179491f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a676bd00 0x55e9a676c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.744+0000 7f179491f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e9a6543cf0 con 0x55e9a676bd00 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.744+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a676bd00 0x55e9a676c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.744+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a676bd00 0x55e9a676c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44284/0 (socket says 172.21.15.50:44284) 2024-05-07T13:56:07.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.744+0000 7f17905ca640 1 -- 172.21.15.50:0/1408059351 learned_addr learned my addr 172.21.15.50:0/1408059351 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.744+0000 7f17905ca640 1 -- 172.21.15.50:0/1408059351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a676c660 con 0x55e9a676bd00 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.744+0000 7f17905ca640 1 --2- 172.21.15.50:0/1408059351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a676bd00 0x55e9a676c120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f178008c470 tx=0x7f1780076f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.744+0000 7f16767fc640 1 -- 172.21.15.50:0/1408059351 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780006700 con 0x55e9a676bd00 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.744+0000 7f16767fc640 1 -- 172.21.15.50:0/1408059351 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800068a0 con 0x55e9a676bd00 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.745+0000 7f179491f800 1 -- 172.21.15.50:0/1408059351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9a676d0d0 con 0x55e9a676bd00 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.745+0000 7f16767fc640 1 -- 172.21.15.50:0/1408059351 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17800773b0 con 0x55e9a676bd00 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.745+0000 7f179491f800 1 -- 172.21.15.50:0/1408059351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9a676d5d0 con 0x55e9a676bd00 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.745+0000 7f16767fc640 1 -- 172.21.15.50:0/1408059351 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1780077570 con 0x55e9a676bd00 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.745+0000 7f16767fc640 1 --2- 172.21.15.50:0/1408059351 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1668036950 0x7f1668038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.746+0000 7f16767fc640 1 -- 172.21.15.50:0/1408059351 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1780098c50 con 0x55e9a676bd00 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.746+0000 7f178fdc9640 1 --2- 172.21.15.50:0/1408059351 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1668036950 0x7f1668038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.746+0000 7f179491f800 1 Processor -- start 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.746+0000 7f179491f800 1 -- start start 2024-05-07T13:56:07.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.746+0000 7f178fdc9640 1 --2- 172.21.15.50:0/1408059351 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1668036950 0x7f1668038e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f178400bf50 tx=0x7f178400f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.746+0000 7f179491f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.746+0000 7f179491f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e9a6650e00 con 0x55e9a6778eb0 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.746+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.747+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67792d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44298/0 (socket says 172.21.15.50:44298) 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.747+0000 7f17905ca640 1 -- 172.21.15.50:0/55901495 learned_addr learned my addr 172.21.15.50:0/55901495 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.747+0000 7f17905ca640 1 -- 172.21.15.50:0/55901495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a67798a0 con 0x55e9a6778eb0 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.747+0000 7f17905ca640 1 --2- 172.21.15.50:0/55901495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67792d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1780052d70 tx=0x7f17800644e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d023a00fe537da9d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.747+0000 7f166f7fe640 1 -- 172.21.15.50:0/55901495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780008140 con 0x55e9a6778eb0 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.747+0000 7f166f7fe640 1 -- 172.21.15.50:0/55901495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780078860 con 0x55e9a6778eb0 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.747+0000 7f166f7fe640 1 -- 172.21.15.50:0/55901495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780076360 con 0x55e9a6778eb0 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 -- 172.21.15.50:0/55901495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 msgr2=0x55e9a67792d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 --2- 172.21.15.50:0/55901495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67792d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1780052d70 tx=0x7f17800644e0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 -- 172.21.15.50:0/55901495 shutdown_connections 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 --2- 172.21.15.50:0/55901495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67792d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 -- 172.21.15.50:0/55901495 >> 172.21.15.50:0/55901495 conn(0x55e9a6775180 msgr2=0x55e9a67731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 -- 172.21.15.50:0/55901495 shutdown_connections 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 -- 172.21.15.50:0/55901495 wait complete. 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 Processor -- start 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 -- start start 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67801f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f179491f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e9a6779f00 con 0x55e9a6778eb0 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.748+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.749+0000 7f17905ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67801f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44304/0 (socket says 172.21.15.50:44304) 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.749+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 learned_addr learned my addr 172.21.15.50:0/3451064446 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.749+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a6780730 con 0x55e9a6778eb0 2024-05-07T13:56:07.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.749+0000 7f17905ca640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67801f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1780064a80 tx=0x7f178006af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.749+0000 7f166dffb640 1 -- 172.21.15.50:0/3451064446 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780076880 con 0x55e9a6778eb0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.749+0000 7f166dffb640 1 -- 172.21.15.50:0/3451064446 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780076a20 con 0x55e9a6778eb0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.749+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9a6780730 con 0x55e9a6778eb0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.749+0000 7f166dffb640 1 -- 172.21.15.50:0/3451064446 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1780077860 con 0x55e9a6778eb0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.749+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9a6780730 con 0x55e9a6778eb0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.750+0000 7f166dffb640 1 -- 172.21.15.50:0/3451064446 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1780082780 con 0x55e9a6778eb0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.750+0000 7f166dffb640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1658036950 0x7f1658038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.750+0000 7f166dffb640 1 -- 172.21.15.50:0/3451064446 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f17800c2c50 con 0x55e9a6778eb0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.750+0000 7f178fdc9640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1658036950 0x7f1658038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.751+0000 7f178fdc9640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1658036950 0x7f1658038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1784001b60 tx=0x7f1784010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.751+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.751+0000 7f179491f800 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a678b830 0x55e9a678dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.751+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678e440 con 0x55e9a678b830 2024-05-07T13:56:07.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.751+0000 7f1790dcb640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a678b830 0x55e9a678dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f1790dcb640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a678b830 0x55e9a678dcf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a678b830 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 20 realm 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678e850 con 0x55e9a678b830 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a678b830 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:07.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f120 con 0x55e9a678b830 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a678b830 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a678b830 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.752+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a678b830 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f179491f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f179491f800 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6790220 0x55e9a6792610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6792c20 con 0x55e9a6790220 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f17905ca640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6790220 0x55e9a6792610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f17905ca640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6790220 0x55e9a6792610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f179491f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f179491f800 20 searching for the correct realm 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.753+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6794550 con 0x55e9a6790220 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.754+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.754+0000 7f17905ca640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f17800af040 0x7f17800c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.754+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6794550 con 0x7f17800af040 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.754+0000 7f178fdc9640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f17800af040 0x7f17800c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.754+0000 7f178fdc9640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f17800af040 0x7f17800c23f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.755+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784009050 con 0x7f17800af040 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.755+0000 7f178fdc9640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1784038040 0x7f178401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.755+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6794550 con 0x7f1784038040 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.755+0000 7f1790dcb640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1784038040 0x7f178401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.755+0000 7f1790dcb640 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1784038040 0x7f178401bab0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.756+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178800a4a0 con 0x7f1784038040 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.756+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a678b830 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.756+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a678b830 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.756+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a678b830 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.756+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a678b830 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.756+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f1784038040 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.757+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178800a4a0 con 0x7f1784038040 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.757+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f1784038040 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.757+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f178800a4a0 con 0x7f1784038040 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.757+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f17800af040 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.757+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784009050 con 0x7f17800af040 2024-05-07T13:56:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.757+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a6790220 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.757+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.757+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a678b830 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.758+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a678b830 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.758+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f1784038040 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.758+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178800a4a0 con 0x7f1784038040 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.758+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a678b830 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.758+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a678b830 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.758+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f17800af040 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.759+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1784009050 con 0x7f17800af040 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.759+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a6790220 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.759+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.759+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a6790220 2024-05-07T13:56:07.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.759+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.759+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f1784038040 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.759+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178800a4a0 con 0x7f1784038040 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.759+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a6790220 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.760+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.760+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a6790220 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.760+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.760+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a678b830 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.760+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178800a4a0 con 0x55e9a678b830 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.760+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a678b830 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.760+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.760+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f1784038040 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.761+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.761+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a6790220 2024-05-07T13:56:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.761+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.761+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f17800af040 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.761+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784009050 con 0x7f17800af040 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.761+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a678b830 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.762+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.762+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f1784038040 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.762+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.762+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a6790220 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.762+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.762+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f1784038040 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.762+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.763+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f17800af040 2024-05-07T13:56:07.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.763+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784009050 con 0x7f17800af040 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.763+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a6790220 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.763+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.763+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f1784038040 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.763+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.763+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x55e9a678b830 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e9a678f4c0 con 0x7f17800af040 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:07.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67934e0 con 0x55e9a678b830 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.764+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67938d0 con 0x55e9a678b830 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67938d0 con 0x7f1784038040 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 20 zone default found 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 4 Realm: () 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 20 zonegroup default 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67949d0 con 0x7f1784038040 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.765+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67963b0 con 0x55e9a6790220 2024-05-07T13:56:07.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.766+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.766+0000 7f179491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.766+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.766+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6796750 con 0x55e9a6790220 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.766+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.766+0000 7f179491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.766+0000 7f179491f800 20 started sync module instance, tier type = 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.766+0000 7f179491f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.766+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6795850 con 0x7f17800af040 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.767+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.767+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94462008710048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6796af0 con 0x7f17800af040 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.767+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6797380 con 0x55e9a678b830 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.768+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94462008710048] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.768+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.768+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94462008712256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6797770 con 0x55e9a678b830 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.768+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67981d0 con 0x55e9a6790220 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.770+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94462008712256] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.770+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.770+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94462008716944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67985c0 con 0x55e9a6790220 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.770+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6798fe0 con 0x7f17800af040 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.771+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94462008716944] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.771+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.771+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94462008720560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67998b0 con 0x7f17800af040 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.771+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679a270 con 0x55e9a678b830 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.772+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.772+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94462008729504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679aa10 con 0x55e9a678b830 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.772+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679b530 con 0x7f1784038040 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.772+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94462008720560] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.774+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.774+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94462008733696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679b4f0 con 0x7f1784038040 2024-05-07T13:56:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.774+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679bf60 con 0x7f1784038040 2024-05-07T13:56:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.774+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94462008729504] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.775+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.775+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94462008736400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679bf60 con 0x7f1784038040 2024-05-07T13:56:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.775+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c920 con 0x7f1784038040 2024-05-07T13:56:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.775+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94462008733696] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94462008726528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c920 con 0x7f1784038040 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f179491f800 20 add_watcher() i=0 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f179491f800 20 add_watcher() i=1 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f179491f800 20 add_watcher() i=2 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f179491f800 20 add_watcher() i=3 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f179491f800 20 add_watcher() i=4 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f179491f800 20 add_watcher() i=5 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94462008736400] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.776+0000 7f179491f800 20 add_watcher() i=6 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.777+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94462008726528] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.777+0000 7f179491f800 20 add_watcher() i=7 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.777+0000 7f179491f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.777+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c920 con 0x55e9a678b830 2024-05-07T13:56:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.777+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.777+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94462008738928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c890 con 0x55e9a678b830 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.779+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94462008738928] v27'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.779+0000 7f16467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.779+0000 7f179491f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.779+0000 7f179491f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.779+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67a8130 con 0x55e9a678b830 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.780+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.780+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67a8780 con 0x7f1784038040 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.781+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.781+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67a8be0 con 0x55e9a6790220 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.782+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.783+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67a9080 con 0x55e9a678b830 2024-05-07T13:56:07.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.783+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.784+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67a94e0 con 0x7f17800af040 2024-05-07T13:56:07.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.785+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.785+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67a9f00 con 0x55e9a6790220 2024-05-07T13:56:07.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.786+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.786+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67a9f00 con 0x55e9a678b830 2024-05-07T13:56:07.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.787+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.787+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67a9f00 con 0x7f1784038040 2024-05-07T13:56:07.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.788+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.789+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aa000 con 0x7f17800af040 2024-05-07T13:56:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.790+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.790+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aa660 con 0x55e9a6790220 2024-05-07T13:56:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.791+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.791+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aa660 con 0x7f17800af040 2024-05-07T13:56:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.792+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.792+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aabd0 con 0x7f1784038040 2024-05-07T13:56:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.793+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.793+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aabd0 con 0x7f17800af040 2024-05-07T13:56:07.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.794+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.794+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aaa90 con 0x7f1784038040 2024-05-07T13:56:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.796+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.796+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aaa90 con 0x55e9a678b830 2024-05-07T13:56:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.797+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.797+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aaa90 con 0x55e9a6790220 2024-05-07T13:56:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.798+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.798+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aaa90 con 0x7f17800af040 2024-05-07T13:56:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.799+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.799+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a6790220 2024-05-07T13:56:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.800+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.800+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a678b830 2024-05-07T13:56:07.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.801+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.801+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a678b830 2024-05-07T13:56:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.802+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.802+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a6790220 2024-05-07T13:56:07.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.803+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'15 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.803+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x7f17800af040 2024-05-07T13:56:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.804+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.804+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a6790220 2024-05-07T13:56:07.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.805+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.805+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a6790220 2024-05-07T13:56:07.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.806+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.807+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a6790220 2024-05-07T13:56:07.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.808+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.808+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a6790220 2024-05-07T13:56:07.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.809+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'14 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.809+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x7f1784038040 2024-05-07T13:56:07.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.810+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.810+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a6790220 2024-05-07T13:56:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.811+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.811+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x7f1784038040 2024-05-07T13:56:07.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.813+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.813+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x55e9a6790220 2024-05-07T13:56:07.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.814+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.814+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x7f1784038040 2024-05-07T13:56:07.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.815+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.815+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67aab20 con 0x7f17800af040 2024-05-07T13:56:07.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.816+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.816+0000 7f16457e2640 20 reqs_thread_entry: start 2024-05-07T13:56:07.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.816+0000 7f179491f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.816+0000 7f179491f800 20 Filter name: none 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.816+0000 7f15b6ffd640 20 reqs_thread_entry: start 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.817+0000 7f179491f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.817+0000 7f179491f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.817+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67d5cd0 con 0x7f17800af040 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.817+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.817+0000 7f179491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.817+0000 7f179491f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:could not remove user: 2024-05-07T13:56:07.817+0000 7f179491f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-07T13:56:07.806 INFO:teuthology.orchestra.run.smithi050.stderr:unable to remove user, user does not exist 2024-05-07T13:56:07.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.818+0000 7f16467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:07.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.818+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94462008738928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a67a5e20 con 0x55e9a678b830 2024-05-07T13:56:07.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.819+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94462008738928] v27'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.819+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94462008710048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c470 con 0x7f17800af040 2024-05-07T13:56:07.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.820+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94462008710048] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.820+0000 7f179491f800 20 remove_watcher() i=0 2024-05-07T13:56:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.820+0000 7f179491f800 2 removed watcher, disabling cache 2024-05-07T13:56:07.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.820+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94462008712256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c470 con 0x55e9a678b830 2024-05-07T13:56:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.821+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94462008712256] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.821+0000 7f179491f800 20 remove_watcher() i=1 2024-05-07T13:56:07.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.821+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94462008716944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c470 con 0x55e9a6790220 2024-05-07T13:56:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.822+0000 7f17905ca640 1 -- 172.21.15.50:0/3451064446 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94462008716944] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17800be020 con 0x55e9a6790220 2024-05-07T13:56:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.822+0000 7f179491f800 20 remove_watcher() i=2 2024-05-07T13:56:07.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.822+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94462008720560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c470 con 0x7f17800af040 2024-05-07T13:56:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.824+0000 7f178fdc9640 1 -- 172.21.15.50:0/3451064446 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94462008720560] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1784045040 con 0x7f17800af040 2024-05-07T13:56:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.824+0000 7f179491f800 20 remove_watcher() i=3 2024-05-07T13:56:07.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.824+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94462008729504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c470 con 0x55e9a678b830 2024-05-07T13:56:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.825+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94462008729504] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x55e9a678b830 2024-05-07T13:56:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.825+0000 7f179491f800 20 remove_watcher() i=4 2024-05-07T13:56:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.825+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94462008733696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a6799fa0 con 0x7f1784038040 2024-05-07T13:56:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.826+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94462008733696] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.826+0000 7f179491f800 20 remove_watcher() i=5 2024-05-07T13:56:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.826+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94462008736400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679c470 con 0x7f1784038040 2024-05-07T13:56:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.827+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94462008736400] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.827+0000 7f179491f800 20 remove_watcher() i=6 2024-05-07T13:56:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.827+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94462008726528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e9a679b000 con 0x7f1784038040 2024-05-07T13:56:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.828+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94462008726528] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178802f060 con 0x7f1784038040 2024-05-07T13:56:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.828+0000 7f179491f800 20 remove_watcher() i=7 2024-05-07T13:56:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1784038040 msgr2=0x7f178401bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1784038040 0x7f178401bab0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a678b830 msgr2=0x55e9a678dcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a678b830 0x55e9a678dcf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f17800af040 msgr2=0x7f17800c23f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f17800af040 0x7f17800c23f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6790220 msgr2=0x55e9a6792610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6790220 0x55e9a6792610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1658036950 msgr2=0x7f1658038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1658036950 0x7f1658038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1784001b60 tx=0x7f1784010000 comp rx=0 tx=0).stop 2024-05-07T13:56:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 msgr2=0x55e9a67801f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/3451064446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6778eb0 0x55e9a67801f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1780064a80 tx=0x7f178006af10 comp rx=0 tx=0).stop 2024-05-07T13:56:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 reap_dead start 2024-05-07T13:56:07.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f1790dcb640 1 -- 172.21.15.50:0/3451064446 reap_dead start 2024-05-07T13:56:07.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 shutdown_connections 2024-05-07T13:56:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 >> 172.21.15.50:0/3451064446 conn(0x55e9a6775180 msgr2=0x55e9a67727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 shutdown_connections 2024-05-07T13:56:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/3451064446 wait complete. 2024-05-07T13:56:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/1408059351 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1668036950 msgr2=0x7f1668038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/1408059351 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1668036950 0x7f1668038e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f178400bf50 tx=0x7f178400f000 comp rx=0 tx=0).stop 2024-05-07T13:56:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/1408059351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a676bd00 msgr2=0x55e9a676c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/1408059351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a676bd00 0x55e9a676c120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f178008c470 tx=0x7f1780076f50 comp rx=0 tx=0).stop 2024-05-07T13:56:07.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/1408059351 shutdown_connections 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/1408059351 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1668036950 0x7f1668038e10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 --2- 172.21.15.50:0/1408059351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a676bd00 0x55e9a676c120 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/1408059351 >> 172.21.15.50:0/1408059351 conn(0x55e9a675fda0 msgr2=0x55e9a67601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/1408059351 shutdown_connections 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.829+0000 7f179491f800 1 -- 172.21.15.50:0/1408059351 wait complete. 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e9a675acf0 msgr2=0x55e9a675d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e9a675acf0 0x55e9a675d140 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a6655570 msgr2=0x55e9a6754480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e9a6655570 0x55e9a6754480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6756db0 msgr2=0x55e9a67591a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e9a6756db0 0x55e9a67591a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1678036950 msgr2=0x7f1678038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1678036950 0x7f1678038e10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1784000f60 tx=0x7f17840012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 msgr2=0x55e9a674d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 --2- 172.21.15.50:0/3838808761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9a6652c40 0x55e9a674d240 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1780052740 tx=0x7f1780003020 comp rx=0 tx=0).stop 2024-05-07T13:56:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f1790dcb640 1 -- 172.21.15.50:0/3838808761 reap_dead start 2024-05-07T13:56:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 shutdown_connections 2024-05-07T13:56:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 >> 172.21.15.50:0/3838808761 conn(0x55e9a664c5b0 msgr2=0x55e9a673eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 shutdown_connections 2024-05-07T13:56:07.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.830+0000 7f179491f800 1 -- 172.21.15.50:0/3838808761 wait complete. 2024-05-07T13:56:07.827 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-07T13:56:07.827 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-05-07T13:56:07.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-05-07T13:56:07.828 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-05-07T13:56:07.873 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.886+0000 7f77f8719800 1 Processor -- start 2024-05-07T13:56:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.886+0000 7f77f8719800 1 -- start start 2024-05-07T13:56:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.886+0000 7f77f8719800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5622d58ce5d0 0x5622d5962fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.886+0000 7f77f8719800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5622d58ceaf0 con 0x5622d58cf9b0 2024-05-07T13:56:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.886+0000 7f77f8719800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5622d57eb050 con 0x5622d58ce5d0 2024-05-07T13:56:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.886+0000 7f77f5a17640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5622d58ce5d0 0x5622d5962fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.886+0000 7f77f6218640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5622d58cf9b0 0x5622d58cdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39456/0 (socket says 172.21.15.50:39456) 2024-05-07T13:56:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.886+0000 7f77f6218640 1 -- 172.21.15.50:0/2113734504 learned_addr learned my addr 172.21.15.50:0/2113734504 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.887+0000 7f77f5a17640 1 -- 172.21.15.50:0/2113734504 >> v1:172.21.15.22:6789/0 conn(0x5622d58cf9b0 legacy=0x5622d58cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.887+0000 7f77f5a17640 1 -- 172.21.15.50:0/2113734504 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d5964530 con 0x5622d58ce5d0 2024-05-07T13:56:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.888+0000 7f77f5a17640 1 --2- 172.21.15.50:0/2113734504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5962fe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f77e000a470 tx=0x7f77e001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72749568be64628 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f5216640 1 -- 172.21.15.50:0/2113734504 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e0057070 con 0x5622d58ce5d0 2024-05-07T13:56:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f5216640 1 -- 172.21.15.50:0/2113734504 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e0052570 con 0x5622d58ce5d0 2024-05-07T13:56:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f5216640 1 -- 172.21.15.50:0/2113734504 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e0052870 con 0x5622d58ce5d0 2024-05-07T13:56:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f8719800 1 -- 172.21.15.50:0/2113734504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 msgr2=0x5622d5962fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f8719800 1 --2- 172.21.15.50:0/2113734504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5962fe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f77e000a470 tx=0x7f77e001ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f8719800 1 -- 172.21.15.50:0/2113734504 shutdown_connections 2024-05-07T13:56:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f8719800 1 --2- 172.21.15.50:0/2113734504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5962fe0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f8719800 1 -- 172.21.15.50:0/2113734504 >> 172.21.15.50:0/2113734504 conn(0x5622d5955780 msgr2=0x5622d5957ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f8719800 1 -- 172.21.15.50:0/2113734504 shutdown_connections 2024-05-07T13:56:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.889+0000 7f77f8719800 1 -- 172.21.15.50:0/2113734504 wait complete. 2024-05-07T13:56:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.904+0000 7f77f8719800 1 Processor -- start 2024-05-07T13:56:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.904+0000 7f77f8719800 1 -- start start 2024-05-07T13:56:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.904+0000 7f77f8719800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a4d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.904+0000 7f77f8719800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5622d58a51d0 con 0x5622d58ce5d0 2024-05-07T13:56:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.905+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a4d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.905+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a4d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44320/0 (socket says 172.21.15.50:44320) 2024-05-07T13:56:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.905+0000 7f77f6218640 1 -- 172.21.15.50:0/3474671939 learned_addr learned my addr 172.21.15.50:0/3474671939 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.905+0000 7f77f6218640 1 -- 172.21.15.50:0/3474671939 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d5a4de70 con 0x5622d58ce5d0 2024-05-07T13:56:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.905+0000 7f77f6218640 1 --2- 172.21.15.50:0/3474671939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a4d8a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77e8001dd0 tx=0x7f77e800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6dff66257d51d48 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.905+0000 7f76e4608640 1 -- 172.21.15.50:0/3474671939 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e8012020 con 0x5622d58ce5d0 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.906+0000 7f76e4608640 1 -- 172.21.15.50:0/3474671939 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e800e5a0 con 0x5622d58ce5d0 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.906+0000 7f76e4608640 1 -- 172.21.15.50:0/3474671939 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e800e900 con 0x5622d58ce5d0 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.906+0000 7f77f8719800 1 -- 172.21.15.50:0/3474671939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 msgr2=0x5622d5a4d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.906+0000 7f77f8719800 1 --2- 172.21.15.50:0/3474671939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a4d8a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77e8001dd0 tx=0x7f77e800b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.906+0000 7f77f8719800 1 -- 172.21.15.50:0/3474671939 shutdown_connections 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.906+0000 7f77f8719800 1 --2- 172.21.15.50:0/3474671939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a4d8a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.906+0000 7f77f8719800 1 -- 172.21.15.50:0/3474671939 >> 172.21.15.50:0/3474671939 conn(0x5622d5955780 msgr2=0x5622d5a491c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.906+0000 7f77f8719800 1 -- 172.21.15.50:0/3474671939 shutdown_connections 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.906+0000 7f77f8719800 1 -- 172.21.15.50:0/3474671939 wait complete. 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.907+0000 7f77f8719800 1 Processor -- start 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.907+0000 7f77f8719800 1 -- start start 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.907+0000 7f77f8719800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a55410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.907+0000 7f77f8719800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5622d5963760 con 0x5622d58ce5d0 2024-05-07T13:56:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.907+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a55410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.907+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a55410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44334/0 (socket says 172.21.15.50:44334) 2024-05-07T13:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.907+0000 7f77f6218640 1 -- 172.21.15.50:0/3652651906 learned_addr learned my addr 172.21.15.50:0/3652651906 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.907+0000 7f77f6218640 1 -- 172.21.15.50:0/3652651906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d5a55950 con 0x5622d58ce5d0 2024-05-07T13:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.907+0000 7f77f6218640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a55410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f77e8001dd0 tx=0x7f77e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.908+0000 7f76e2e05640 1 -- 172.21.15.50:0/3652651906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e8012030 con 0x5622d58ce5d0 2024-05-07T13:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.908+0000 7f76e2e05640 1 -- 172.21.15.50:0/3652651906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e801a7a0 con 0x5622d58ce5d0 2024-05-07T13:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.908+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622d5a55be0 con 0x5622d58ce5d0 2024-05-07T13:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.908+0000 7f76e2e05640 1 -- 172.21.15.50:0/3652651906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e801a990 con 0x5622d58ce5d0 2024-05-07T13:56:07.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.908+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d5a58890 con 0x5622d58ce5d0 2024-05-07T13:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.909+0000 7f76e2e05640 1 -- 172.21.15.50:0/3652651906 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f77e8015020 con 0x5622d58ce5d0 2024-05-07T13:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.909+0000 7f76e2e05640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76dc036950 0x7f76dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.909+0000 7f76e2e05640 1 -- 172.21.15.50:0/3652651906 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f77e8020030 con 0x5622d58ce5d0 2024-05-07T13:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.909+0000 7f77f5a17640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76dc036950 0x7f76dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.909+0000 7f77f8719800 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d58cf9b0 0x5622d5a5c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.909+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a5cb90 con 0x5622d58cf9b0 2024-05-07T13:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.909+0000 7f77f6a19640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d58cf9b0 0x5622d5a5c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.909+0000 7f77f5a17640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76dc036950 0x7f76dc038e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77e0054000 tx=0x7f77e004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.910+0000 7f77f6a19640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d58cf9b0 0x5622d5a5c650 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.910+0000 7f77f6a19640 1 -- 172.21.15.50:0/3652651906 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d58cf9b0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.910+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a59c20 con 0x5622d58cf9b0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.910+0000 7f77f6a19640 1 -- 172.21.15.50:0/3652651906 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d58cf9b0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.910+0000 7f77f8719800 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a5eec0 0x5622d5a612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.910+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a619a0 con 0x5622d5a5eec0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.910+0000 7f77f6218640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a5eec0 0x5622d5a612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.910+0000 7f77f6218640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a5eec0 0x5622d5a612b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.911+0000 7f77f6218640 1 -- 172.21.15.50:0/3652651906 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a5eec0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.911+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a5de70 con 0x5622d58cf9b0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.911+0000 7f77f6a19640 1 -- 172.21.15.50:0/3652651906 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d58cf9b0 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.911+0000 7f77f8719800 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5622d5a62e50 0x5622d5a652a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.911+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a65a00 con 0x5622d5a62e50 2024-05-07T13:56:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.911+0000 7f77f5a17640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5622d5a62e50 0x5622d5a652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.912+0000 7f77f5a17640 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5622d5a62e50 0x5622d5a652a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.912+0000 7f77f5a17640 1 -- 172.21.15.50:0/3652651906 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f77e005a040 con 0x5622d5a62e50 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.912+0000 7f77f8719800 1 Processor -- start 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f77f8719800 1 -- start start 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f77f8719800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a73e60 0x5622d5a74280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f77f8719800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5622d584bcf0 con 0x5622d5a73e60 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a73e60 0x5622d5a74280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a73e60 0x5622d5a74280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44346/0 (socket says 172.21.15.50:44346) 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f77f6218640 1 -- 172.21.15.50:0/4268711476 learned_addr learned my addr 172.21.15.50:0/4268711476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f77f6218640 1 -- 172.21.15.50:0/4268711476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d5a747c0 con 0x5622d5a73e60 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f77f6218640 1 --2- 172.21.15.50:0/4268711476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a73e60 0x5622d5a74280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77e804ad80 tx=0x7f77e800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f76dbfff640 1 -- 172.21.15.50:0/4268711476 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e803d070 con 0x5622d5a73e60 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.913+0000 7f76dbfff640 1 -- 172.21.15.50:0/4268711476 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e80445c0 con 0x5622d5a73e60 2024-05-07T13:56:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.914+0000 7f76dbfff640 1 -- 172.21.15.50:0/4268711476 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e80448a0 con 0x5622d5a73e60 2024-05-07T13:56:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.914+0000 7f77f8719800 1 -- 172.21.15.50:0/4268711476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622d5a75230 con 0x5622d5a73e60 2024-05-07T13:56:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.914+0000 7f77f8719800 1 -- 172.21.15.50:0/4268711476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d5a75730 con 0x5622d5a73e60 2024-05-07T13:56:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.914+0000 7f76dbfff640 1 -- 172.21.15.50:0/4268711476 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f77e804c160 con 0x5622d5a73e60 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f76dbfff640 1 --2- 172.21.15.50:0/4268711476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76d0036950 0x7f76d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f76dbfff640 1 -- 172.21.15.50:0/4268711476 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f77e802ebf0 con 0x5622d5a73e60 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f77f5a17640 1 --2- 172.21.15.50:0/4268711476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76d0036950 0x7f76d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f77f8719800 1 Processor -- start 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f77f8719800 1 -- start start 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f77f5a17640 1 --2- 172.21.15.50:0/4268711476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76d0036950 0x7f76d0038e10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x5622d5a5d470 tx=0x7f77e0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f77f8719800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a81450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f77f8719800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5622d5a4e1f0 con 0x5622d5a81030 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a81450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a81450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44350/0 (socket says 172.21.15.50:44350) 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.915+0000 7f77f6218640 1 -- 172.21.15.50:0/1866071601 learned_addr learned my addr 172.21.15.50:0/1866071601 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.916+0000 7f77f6218640 1 -- 172.21.15.50:0/1866071601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d5a81a20 con 0x5622d5a81030 2024-05-07T13:56:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.916+0000 7f77f6218640 1 --2- 172.21.15.50:0/1866071601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a81450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f77e8038500 tx=0x7f77e8038530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ba7492258db860 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.916+0000 7f76d9ffb640 1 -- 172.21.15.50:0/1866071601 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e8038690 con 0x5622d5a81030 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.916+0000 7f76d9ffb640 1 -- 172.21.15.50:0/1866071601 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e80165e0 con 0x5622d5a81030 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.916+0000 7f76d9ffb640 1 -- 172.21.15.50:0/1866071601 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e80100d0 con 0x5622d5a81030 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.916+0000 7f77f8719800 1 -- 172.21.15.50:0/1866071601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 msgr2=0x5622d5a81450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.916+0000 7f77f8719800 1 --2- 172.21.15.50:0/1866071601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a81450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f77e8038500 tx=0x7f77e8038530 comp rx=0 tx=0).stop 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f8719800 1 -- 172.21.15.50:0/1866071601 shutdown_connections 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f8719800 1 --2- 172.21.15.50:0/1866071601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a81450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f8719800 1 -- 172.21.15.50:0/1866071601 >> 172.21.15.50:0/1866071601 conn(0x5622d5a7d300 msgr2=0x5622d5a7b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f8719800 1 -- 172.21.15.50:0/1866071601 shutdown_connections 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f8719800 1 -- 172.21.15.50:0/1866071601 wait complete. 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f8719800 1 Processor -- start 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f8719800 1 -- start start 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f8719800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a88350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f8719800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5622d5a82080 con 0x5622d5a81030 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a88350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f6218640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a88350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44352/0 (socket says 172.21.15.50:44352) 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.917+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 learned_addr learned my addr 172.21.15.50:0/98334399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.918+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d5a88890 con 0x5622d5a81030 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.918+0000 7f77f6218640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a88350 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f77e8050fb0 tx=0x7f77e802e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.918+0000 7f76c7fff640 1 -- 172.21.15.50:0/98334399 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e8038690 con 0x5622d5a81030 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.918+0000 7f76c7fff640 1 -- 172.21.15.50:0/98334399 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e804cca0 con 0x5622d5a81030 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.918+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622d5a88890 con 0x5622d5a81030 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.918+0000 7f76c7fff640 1 -- 172.21.15.50:0/98334399 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e8037970 con 0x5622d5a81030 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.918+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d5a88890 con 0x5622d5a81030 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.919+0000 7f76c7fff640 1 -- 172.21.15.50:0/98334399 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f77e8072030 con 0x5622d5a81030 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.919+0000 7f76c7fff640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76c0036950 0x7f76c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.919+0000 7f76c7fff640 1 -- 172.21.15.50:0/98334399 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f77e8070070 con 0x5622d5a81030 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.919+0000 7f77f5a17640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76c0036950 0x7f76c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f5a17640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76c0036950 0x7f76c0038e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5622d5a65e00 tx=0x7f77e004f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f8719800 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d5a93a80 0x5622d5a95f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a96690 con 0x5622d5a93a80 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f6a19640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d5a93a80 0x5622d5a95f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f6a19640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d5a93a80 0x5622d5a95f40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d5a93a80 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f8719800 20 realm 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.920+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a96aa0 con 0x5622d5a93a80 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d5a93a80 2024-05-07T13:56:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97370 con 0x5622d5a93a80 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d5a93a80 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x5622d5a93a80 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d5a93a80 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a98470 0x5622d5a9a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9ae70 con 0x5622d5a98470 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.921+0000 7f77f6218640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a98470 0x5622d5a9a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.922+0000 7f77f6218640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a98470 0x5622d5a9a860 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.922+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.922+0000 7f77f8719800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.922+0000 7f77f8719800 20 searching for the correct realm 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.922+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9c7a0 con 0x5622d5a98470 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.922+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.922+0000 7f77f6218640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f77e8057040 0x7f77e80100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.922+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9c7a0 con 0x7f77e8057040 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.923+0000 7f77f5a17640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f77e8057040 0x7f77e80100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.923+0000 7f77f5a17640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f77e8057040 0x7f77e80100d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.923+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.923+0000 7f77f5a17640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f77e0074040 0x7f77e0081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:07.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.923+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9c7a0 con 0x7f77e0074040 2024-05-07T13:56:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.924+0000 7f77f6a19640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f77e0074040 0x7f77e0081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.924+0000 7f77f6a19640 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f77e0074040 0x7f77e0081410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.924+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f000a4a0 con 0x7f77e0074040 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.924+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x5622d5a93a80 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.924+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d5a93a80 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.924+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x5622d5a93a80 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.925+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d5a93a80 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.925+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x7f77e0074040 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.925+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f000a4a0 con 0x7f77e0074040 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.925+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x7f77e0074040 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.925+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f77f000a4a0 con 0x7f77e0074040 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.925+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x7f77e8057040 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.926+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.926+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x5622d5a98470 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.926+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.926+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x5622d5a93a80 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.926+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d5a93a80 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.926+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x7f77e0074040 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.926+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f000a4a0 con 0x7f77e0074040 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.926+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x5622d5a93a80 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.927+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d5a93a80 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.927+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a97710 con 0x7f77e8057040 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.927+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.927+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a98470 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.927+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.927+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a98470 2024-05-07T13:56:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.927+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.927+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x7f77e0074040 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.928+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f000a4a0 con 0x7f77e0074040 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.928+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a98470 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.928+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.928+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a98470 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.928+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.928+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a93a80 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.929+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f000a4a0 con 0x5622d5a93a80 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.929+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a93a80 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.929+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.929+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x7f77e0074040 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.929+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.929+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a98470 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.929+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.929+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x7f77e8057040 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.930+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.930+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a93a80 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.930+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.930+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x7f77e0074040 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.931+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.931+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a98470 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.931+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.931+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x7f77e0074040 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.931+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.931+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x7f77e8057040 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.931+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.931+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a98470 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.932+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.932+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x7f77e0074040 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.932+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.932+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x5622d5a93a80 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.932+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.932+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f77e008e060 con 0x7f77e8057040 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9b730 con 0x5622d5a93a80 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9bb20 con 0x5622d5a93a80 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.933+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9bb20 con 0x7f77e0074040 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 zone default found 2024-05-07T13:56:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 4 Realm: () 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 zonegroup default 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9cc20 con 0x7f77e0074040 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9e600 con 0x5622d5a98470 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9e9a0 con 0x5622d5a98470 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 started sync module instance, tier type = 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.934+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9daa0 con 0x7f77e8057040 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.936+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.936+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94707613554160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9ed40 con 0x7f77e8057040 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.936+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9f590 con 0x5622d5a93a80 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.937+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94707613554160] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.937+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.937+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94707613561056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9f500 con 0x5622d5a93a80 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.937+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa0450 con 0x5622d5a98470 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.938+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94707613561056] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.938+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.938+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94707613564832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa0840 con 0x5622d5a98470 2024-05-07T13:56:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.938+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa1280 con 0x7f77e8057040 2024-05-07T13:56:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.939+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94707613564832] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.939+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.939+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94707613563264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa1b20 con 0x7f77e8057040 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.939+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa24e0 con 0x5622d5a93a80 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.940+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94707613563264] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.941+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.941+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94707613573168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa2900 con 0x5622d5a93a80 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.941+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa32c0 con 0x7f77e0074040 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.942+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.942+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94707613576720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa3230 con 0x7f77e0074040 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.942+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa4290 con 0x7f77e0074040 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.942+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94707613573168] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.943+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94707613576720] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.943+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.943+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94707613578928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa2450 con 0x7f77e0074040 2024-05-07T13:56:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.943+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa4700 con 0x7f77e0074040 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94707613581904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa4670 con 0x7f77e0074040 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f8719800 20 add_watcher() i=0 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f8719800 20 add_watcher() i=1 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f8719800 20 add_watcher() i=2 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f8719800 20 add_watcher() i=3 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f8719800 20 add_watcher() i=4 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f8719800 20 add_watcher() i=5 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94707613578928] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.944+0000 7f77f8719800 20 add_watcher() i=6 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.945+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94707613581904] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.945+0000 7f77f8719800 20 add_watcher() i=7 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.945+0000 7f77f8719800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.945+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa3d80 con 0x5622d5a93a80 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.945+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.945+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94707613583936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa3d80 con 0x5622d5a93a80 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.946+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94707613583936] v27'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.946+0000 7f76acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.946+0000 7f77f8719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.946+0000 7f77f8719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.947+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab0470 con 0x5622d5a93a80 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.948+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.948+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab0ac0 con 0x7f77e0074040 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.949+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.949+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab0f20 con 0x5622d5a98470 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.950+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.950+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab0e40 con 0x5622d5a93a80 2024-05-07T13:56:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.951+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.951+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab14f0 con 0x7f77e8057040 2024-05-07T13:56:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.952+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.952+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab1a60 con 0x5622d5a98470 2024-05-07T13:56:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.953+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.953+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab1e40 con 0x5622d5a93a80 2024-05-07T13:56:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.954+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.954+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab1e40 con 0x7f77e0074040 2024-05-07T13:56:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.955+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.955+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab1e40 con 0x7f77e8057040 2024-05-07T13:56:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.956+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.956+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab22f0 con 0x5622d5a98470 2024-05-07T13:56:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.957+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.957+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab22f0 con 0x7f77e8057040 2024-05-07T13:56:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.958+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.958+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab22f0 con 0x7f77e0074040 2024-05-07T13:56:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.959+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.959+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x7f77e8057040 2024-05-07T13:56:07.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.960+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.960+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x7f77e0074040 2024-05-07T13:56:07.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.961+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.961+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a93a80 2024-05-07T13:56:07.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.962+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.962+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a98470 2024-05-07T13:56:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.964+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.964+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x7f77e8057040 2024-05-07T13:56:07.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.965+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.965+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a98470 2024-05-07T13:56:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.966+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.966+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a93a80 2024-05-07T13:56:07.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.967+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.967+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a93a80 2024-05-07T13:56:07.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.968+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.968+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a98470 2024-05-07T13:56:07.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.969+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.969+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x7f77e8057040 2024-05-07T13:56:07.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.970+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.970+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a98470 2024-05-07T13:56:07.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.971+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.971+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a98470 2024-05-07T13:56:07.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.972+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.972+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a98470 2024-05-07T13:56:07.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.973+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.973+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a98470 2024-05-07T13:56:07.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.974+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.974+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x7f77e0074040 2024-05-07T13:56:07.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.976+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.976+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a98470 2024-05-07T13:56:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.977+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.977+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x7f77e0074040 2024-05-07T13:56:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.978+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.978+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x5622d5a98470 2024-05-07T13:56:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.979+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.979+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x7f77e0074040 2024-05-07T13:56:07.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.980+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.980+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5ab23c0 con 0x7f77e8057040 2024-05-07T13:56:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.981+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.981+0000 7f76277fe640 20 reqs_thread_entry: start 2024-05-07T13:56:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.982+0000 7f77f8719800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.982+0000 7f77f8719800 20 Filter name: none 2024-05-07T13:56:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.982+0000 7f76257fa640 20 reqs_thread_entry: start 2024-05-07T13:56:07.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.982+0000 7f77f8719800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-07T13:56:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.982+0000 7f77f8719800 20 rados->read ofs=0 len=0 2024-05-07T13:56:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.982+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5622d5add660 con 0x7f77e0074040 2024-05-07T13:56:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.982+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.982+0000 7f77f8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:07.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.983+0000 7f77f8719800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-07T13:56:07.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.983+0000 7f77f8719800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-07T13:56:07.972 INFO:teuthology.orchestra.run.smithi050.stderr:could not remove user: unable to remove user, user does not exist 2024-05-07T13:56:07.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.983+0000 7f76acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:07.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.983+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94707613583936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aae070 con 0x5622d5a93a80 2024-05-07T13:56:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.985+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94707613583936] v27'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.985+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94707613554160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa4a40 con 0x7f77e8057040 2024-05-07T13:56:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.986+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94707613554160] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.986+0000 7f77f8719800 20 remove_watcher() i=0 2024-05-07T13:56:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.986+0000 7f77f8719800 2 removed watcher, disabling cache 2024-05-07T13:56:07.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.986+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94707613561056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa4a40 con 0x5622d5a93a80 2024-05-07T13:56:07.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.987+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94707613561056] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.987+0000 7f77f8719800 20 remove_watcher() i=1 2024-05-07T13:56:07.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.987+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94707613564832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9f0e0 con 0x5622d5a98470 2024-05-07T13:56:07.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.988+0000 7f77f6218640 1 -- 172.21.15.50:0/98334399 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94707613564832] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e8018430 con 0x5622d5a98470 2024-05-07T13:56:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.988+0000 7f77f8719800 20 remove_watcher() i=2 2024-05-07T13:56:07.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.988+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94707613563264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa4a40 con 0x7f77e8057040 2024-05-07T13:56:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.989+0000 7f77f5a17640 1 -- 172.21.15.50:0/98334399 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94707613563264] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e007f070 con 0x7f77e8057040 2024-05-07T13:56:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.989+0000 7f77f8719800 20 remove_watcher() i=3 2024-05-07T13:56:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.989+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94707613573168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9ffa0 con 0x5622d5a93a80 2024-05-07T13:56:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.990+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94707613573168] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x5622d5a93a80 2024-05-07T13:56:07.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.990+0000 7f77f8719800 20 remove_watcher() i=4 2024-05-07T13:56:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.990+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94707613576720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9f0e0 con 0x7f77e0074040 2024-05-07T13:56:07.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.991+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94707613576720] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.991+0000 7f77f8719800 20 remove_watcher() i=5 2024-05-07T13:56:07.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.991+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94707613578928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5aa2030 con 0x7f77e0074040 2024-05-07T13:56:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.992+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94707613578928] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.992+0000 7f77f8719800 20 remove_watcher() i=6 2024-05-07T13:56:07.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.992+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94707613581904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5622d5a9ffa0 con 0x7f77e0074040 2024-05-07T13:56:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94707613581904] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f002f060 con 0x7f77e0074040 2024-05-07T13:56:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 20 remove_watcher() i=7 2024-05-07T13:56:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f77e0074040 msgr2=0x7f77e0081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f77e0074040 0x7f77e0081410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d5a93a80 msgr2=0x5622d5a95f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d5a93a80 0x5622d5a95f40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f77e8057040 msgr2=0x7f77e80100d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f77e8057040 0x7f77e80100d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a98470 msgr2=0x5622d5a9a860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a98470 0x5622d5a9a860 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76c0036950 msgr2=0x7f76c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76c0036950 0x7f76c0038e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5622d5a65e00 tx=0x7f77e004f000 comp rx=0 tx=0).stop 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 msgr2=0x5622d5a88350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f8719800 1 --2- 172.21.15.50:0/98334399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a81030 0x5622d5a88350 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f77e8050fb0 tx=0x7f77e802e830 comp rx=0 tx=0).stop 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.993+0000 7f77f6a19640 1 -- 172.21.15.50:0/98334399 reap_dead start 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 shutdown_connections 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 >> 172.21.15.50:0/98334399 conn(0x5622d5a7d300 msgr2=0x5622d5a7a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 shutdown_connections 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/98334399 wait complete. 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/4268711476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76d0036950 msgr2=0x7f76d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 --2- 172.21.15.50:0/4268711476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76d0036950 0x7f76d0038e10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x5622d5a5d470 tx=0x7f77e0005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/4268711476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a73e60 msgr2=0x5622d5a74280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 --2- 172.21.15.50:0/4268711476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a73e60 0x5622d5a74280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77e804ad80 tx=0x7f77e800db20 comp rx=0 tx=0).stop 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/4268711476 shutdown_connections 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 --2- 172.21.15.50:0/4268711476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76d0036950 0x7f76d0038e10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 --2- 172.21.15.50:0/4268711476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d5a73e60 0x5622d5a74280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/4268711476 >> 172.21.15.50:0/4268711476 conn(0x5622d5a67f00 msgr2=0x5622d5a68300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/4268711476 shutdown_connections 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/4268711476 wait complete. 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5622d5a62e50 msgr2=0x5622d5a652a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5622d5a62e50 0x5622d5a652a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d58cf9b0 msgr2=0x5622d5a5c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5622d58cf9b0 0x5622d5a5c650 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a5eec0 msgr2=0x5622d5a612b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.994+0000 7f77f8719800 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5622d5a5eec0 0x5622d5a612b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.995+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76dc036950 msgr2=0x7f76dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.995+0000 7f77f8719800 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f76dc036950 0x7f76dc038e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77e0054000 tx=0x7f77e004e000 comp rx=0 tx=0).stop 2024-05-07T13:56:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.995+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 msgr2=0x5622d5a55410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.995+0000 7f77f8719800 1 --2- 172.21.15.50:0/3652651906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622d58ce5d0 0x5622d5a55410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f77e8001dd0 tx=0x7f77e8000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.995+0000 7f77f6a19640 1 -- 172.21.15.50:0/3652651906 reap_dead start 2024-05-07T13:56:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.995+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 shutdown_connections 2024-05-07T13:56:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.995+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 >> 172.21.15.50:0/3652651906 conn(0x5622d5955780 msgr2=0x5622d5a479c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.995+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 shutdown_connections 2024-05-07T13:56:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:07.995+0000 7f77f8719800 1 -- 172.21.15.50:0/3652651906 wait complete. 2024-05-07T13:56:07.992 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-07T13:56:07.992 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-07T13:56:07.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-07T13:56:07.993 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-07T13:56:08.038 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:08.039 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc959d23800 1 Processor -- start 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc959d23800 1 -- start start 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc959d23800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5644d70de640 0x5644d70dea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc959d23800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5644d70e7110 con 0x5644d70defa0 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc959d23800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5644d6f6f050 con 0x5644d70de640 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc955ab7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5644d70de640 0x5644d70dea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc94d2b6640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5644d70defa0 0x5644d70e58b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39458/0 (socket says 172.21.15.50:39458) 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc955ab7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5644d70de640 0x5644d70dea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44360/0 (socket says 172.21.15.50:44360) 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc94d2b6640 1 -- 172.21.15.50:0/3329484575 learned_addr learned my addr 172.21.15.50:0/3329484575 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc955ab7640 1 -- 172.21.15.50:0/3329484575 >> v1:172.21.15.22:6789/0 conn(0x5644d70defa0 legacy=0x5644d70e58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.051+0000 7fc955ab7640 1 -- 172.21.15.50:0/3329484575 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d70e8340 con 0x5644d70de640 2024-05-07T13:56:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.053+0000 7fc955ab7640 1 --2- 172.21.15.50:0/3329484575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 0x5644d70dea60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc94800a470 tx=0x7fc94801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978e05317bb83bcf server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.053+0000 7fc9552b6640 1 -- 172.21.15.50:0/3329484575 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948057070 con 0x5644d70de640 2024-05-07T13:56:08.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.054+0000 7fc9552b6640 1 -- 172.21.15.50:0/3329484575 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc948052570 con 0x5644d70de640 2024-05-07T13:56:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.054+0000 7fc9552b6640 1 -- 172.21.15.50:0/3329484575 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948052870 con 0x5644d70de640 2024-05-07T13:56:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.054+0000 7fc959d23800 1 -- 172.21.15.50:0/3329484575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 msgr2=0x5644d70dea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.054+0000 7fc959d23800 1 --2- 172.21.15.50:0/3329484575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 0x5644d70dea60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc94800a470 tx=0x7fc94801ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.054+0000 7fc959d23800 1 -- 172.21.15.50:0/3329484575 shutdown_connections 2024-05-07T13:56:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.054+0000 7fc959d23800 1 --2- 172.21.15.50:0/3329484575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 0x5644d70dea60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.054+0000 7fc959d23800 1 -- 172.21.15.50:0/3329484575 >> 172.21.15.50:0/3329484575 conn(0x5644d70d7d30 msgr2=0x5644d70da150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.054+0000 7fc959d23800 1 -- 172.21.15.50:0/3329484575 shutdown_connections 2024-05-07T13:56:08.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.054+0000 7fc959d23800 1 -- 172.21.15.50:0/3329484575 wait complete. 2024-05-07T13:56:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.069+0000 7fc959d23800 1 Processor -- start 2024-05-07T13:56:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.069+0000 7fc959d23800 1 -- start start 2024-05-07T13:56:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.069+0000 7fc959d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 0x5644d71d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.069+0000 7fc959d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5644d70291d0 con 0x5644d70de640 2024-05-07T13:56:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.070+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 0x5644d71d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.070+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 0x5644d71d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44366/0 (socket says 172.21.15.50:44366) 2024-05-07T13:56:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.070+0000 7fc955ab7640 1 -- 172.21.15.50:0/3275036318 learned_addr learned my addr 172.21.15.50:0/3275036318 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.070+0000 7fc955ab7640 1 -- 172.21.15.50:0/3275036318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d71d1ed0 con 0x5644d70de640 2024-05-07T13:56:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.070+0000 7fc955ab7640 1 --2- 172.21.15.50:0/3275036318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 0x5644d71d1900 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc948055040 tx=0x7fc94804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d062397c828658 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.070+0000 7fc843e07640 1 -- 172.21.15.50:0/3275036318 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948057040 con 0x5644d70de640 2024-05-07T13:56:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.071+0000 7fc843e07640 1 -- 172.21.15.50:0/3275036318 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc948052990 con 0x5644d70de640 2024-05-07T13:56:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.071+0000 7fc843e07640 1 -- 172.21.15.50:0/3275036318 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948052c70 con 0x5644d70de640 2024-05-07T13:56:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.071+0000 7fc959d23800 1 -- 172.21.15.50:0/3275036318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 msgr2=0x5644d71d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.071+0000 7fc959d23800 1 --2- 172.21.15.50:0/3275036318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 0x5644d71d1900 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc948055040 tx=0x7fc94804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.071+0000 7fc959d23800 1 -- 172.21.15.50:0/3275036318 shutdown_connections 2024-05-07T13:56:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.071+0000 7fc959d23800 1 --2- 172.21.15.50:0/3275036318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70de640 0x5644d71d1900 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.071+0000 7fc959d23800 1 -- 172.21.15.50:0/3275036318 >> 172.21.15.50:0/3275036318 conn(0x5644d70d7d30 msgr2=0x5644d71cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.071+0000 7fc959d23800 1 -- 172.21.15.50:0/3275036318 shutdown_connections 2024-05-07T13:56:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.071+0000 7fc959d23800 1 -- 172.21.15.50:0/3275036318 wait complete. 2024-05-07T13:56:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.072+0000 7fc959d23800 1 Processor -- start 2024-05-07T13:56:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.072+0000 7fc959d23800 1 -- start start 2024-05-07T13:56:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.072+0000 7fc959d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70defa0 0x5644d71d95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.072+0000 7fc959d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5644d70e7580 con 0x5644d70defa0 2024-05-07T13:56:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.072+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70defa0 0x5644d71d95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.072+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70defa0 0x5644d71d95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44372/0 (socket says 172.21.15.50:44372) 2024-05-07T13:56:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.072+0000 7fc955ab7640 1 -- 172.21.15.50:0/4286397414 learned_addr learned my addr 172.21.15.50:0/4286397414 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.072+0000 7fc955ab7640 1 -- 172.21.15.50:0/4286397414 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d71d9b10 con 0x5644d70defa0 2024-05-07T13:56:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.072+0000 7fc955ab7640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70defa0 0x5644d71d95d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc94800a470 tx=0x7fc948003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.073+0000 7fc842604640 1 -- 172.21.15.50:0/4286397414 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948073070 con 0x5644d70defa0 2024-05-07T13:56:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.073+0000 7fc842604640 1 -- 172.21.15.50:0/4286397414 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94805d650 con 0x5644d70defa0 2024-05-07T13:56:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.073+0000 7fc842604640 1 -- 172.21.15.50:0/4286397414 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948057070 con 0x5644d70defa0 2024-05-07T13:56:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.073+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644d71d9da0 con 0x5644d70defa0 2024-05-07T13:56:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.073+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d71dca50 con 0x5644d70defa0 2024-05-07T13:56:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.073+0000 7fc842604640 1 -- 172.21.15.50:0/4286397414 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc948076070 con 0x5644d70defa0 2024-05-07T13:56:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.074+0000 7fc842604640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc83c036900 0x7fc83c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.074+0000 7fc842604640 1 -- 172.21.15.50:0/4286397414 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc94808ddd0 con 0x5644d70defa0 2024-05-07T13:56:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.074+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc83c036900 0x7fc83c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.074+0000 7fc959d23800 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d71de800 0x5644d71e0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.074+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d71e1170 con 0x5644d71de800 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.074+0000 7fc9562b8640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d71de800 0x5644d71e0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.074+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc83c036900 0x7fc83c038dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc940000f60 tx=0x7fc9400012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.074+0000 7fc9562b8640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d71de800 0x5644d71e0bf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.075+0000 7fc9562b8640 1 -- 172.21.15.50:0/4286397414 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d71de800 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.075+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d71ddde0 con 0x5644d71de800 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.075+0000 7fc9562b8640 1 -- 172.21.15.50:0/4286397414 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d71de800 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.075+0000 7fc959d23800 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d71e3480 0x5644d71e5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.075+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d71e5f10 con 0x5644d71e3480 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.075+0000 7fc955ab7640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d71e3480 0x5644d71e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.075+0000 7fc955ab7640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d71e3480 0x5644d71e5870 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.076+0000 7fc955ab7640 1 -- 172.21.15.50:0/4286397414 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc948075030 con 0x5644d71e3480 2024-05-07T13:56:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.076+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d71e2430 con 0x5644d71de800 2024-05-07T13:56:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.076+0000 7fc9562b8640 1 -- 172.21.15.50:0/4286397414 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d71de800 2024-05-07T13:56:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.076+0000 7fc959d23800 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5644d71e73c0 0x5644d71e9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.076+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d71e9f70 con 0x5644d71e73c0 2024-05-07T13:56:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.076+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5644d71e73c0 0x5644d71e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.077+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5644d71e73c0 0x5644d71e9810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.077+0000 7fc94d2b6640 1 -- 172.21.15.50:0/4286397414 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc940009050 con 0x5644d71e73c0 2024-05-07T13:56:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.077+0000 7fc959d23800 1 Processor -- start 2024-05-07T13:56:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.077+0000 7fc959d23800 1 -- start start 2024-05-07T13:56:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc959d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d71f83d0 0x5644d71f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc959d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5644d6fcfcf0 con 0x5644d71f83d0 2024-05-07T13:56:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d71f83d0 0x5644d71f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d71f83d0 0x5644d71f87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44378/0 (socket says 172.21.15.50:44378) 2024-05-07T13:56:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc955ab7640 1 -- 172.21.15.50:0/3709450300 learned_addr learned my addr 172.21.15.50:0/3709450300 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc955ab7640 1 -- 172.21.15.50:0/3709450300 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d71f8d30 con 0x5644d71f83d0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc955ab7640 1 --2- 172.21.15.50:0/3709450300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d71f83d0 0x5644d71f87f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc94808c210 tx=0x7fc948076f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc83b7fe640 1 -- 172.21.15.50:0/3709450300 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948006700 con 0x5644d71f83d0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc83b7fe640 1 -- 172.21.15.50:0/3709450300 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9480068a0 con 0x5644d71f83d0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc83b7fe640 1 -- 172.21.15.50:0/3709450300 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94805c3e0 con 0x5644d71f83d0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc959d23800 1 -- 172.21.15.50:0/3709450300 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644d71f97a0 con 0x5644d71f83d0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.078+0000 7fc959d23800 1 -- 172.21.15.50:0/3709450300 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d71f9ca0 con 0x5644d71f83d0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.079+0000 7fc83b7fe640 1 -- 172.21.15.50:0/3709450300 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc94805c580 con 0x5644d71f83d0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.079+0000 7fc83b7fe640 1 --2- 172.21.15.50:0/3709450300 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc830036900 0x7fc830038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.079+0000 7fc83b7fe640 1 -- 172.21.15.50:0/3709450300 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc948094c50 con 0x5644d71f83d0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.079+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/3709450300 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc830036900 0x7fc830038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.080+0000 7fc959d23800 1 Processor -- start 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.080+0000 7fc959d23800 1 -- start start 2024-05-07T13:56:08.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.080+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/3709450300 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc830036900 0x7fc830038dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc94000bf50 tx=0x7fc94000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.080+0000 7fc959d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d72058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.080+0000 7fc959d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5644d71d2190 con 0x5644d72054c0 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.080+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d72058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.080+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d72058e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44380/0 (socket says 172.21.15.50:44380) 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.080+0000 7fc955ab7640 1 -- 172.21.15.50:0/3787909537 learned_addr learned my addr 172.21.15.50:0/3787909537 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.080+0000 7fc955ab7640 1 -- 172.21.15.50:0/3787909537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d7205eb0 con 0x5644d72054c0 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc955ab7640 1 --2- 172.21.15.50:0/3787909537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d72058e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc948073ff0 tx=0x7fc94804bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9d2b10f07b8b5d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc8397fa640 1 -- 172.21.15.50:0/3787909537 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948098070 con 0x5644d72054c0 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc8397fa640 1 -- 172.21.15.50:0/3787909537 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94806c300 con 0x5644d72054c0 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc8397fa640 1 -- 172.21.15.50:0/3787909537 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc948076880 con 0x5644d72054c0 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc959d23800 1 -- 172.21.15.50:0/3787909537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 msgr2=0x5644d72058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc959d23800 1 --2- 172.21.15.50:0/3787909537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d72058e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc948073ff0 tx=0x7fc94804bf40 comp rx=0 tx=0).stop 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc959d23800 1 -- 172.21.15.50:0/3787909537 shutdown_connections 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc959d23800 1 --2- 172.21.15.50:0/3787909537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d72058e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc959d23800 1 -- 172.21.15.50:0/3787909537 >> 172.21.15.50:0/3787909537 conn(0x5644d7201820 msgr2=0x5644d71ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc959d23800 1 -- 172.21.15.50:0/3787909537 shutdown_connections 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.081+0000 7fc959d23800 1 -- 172.21.15.50:0/3787909537 wait complete. 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.082+0000 7fc959d23800 1 Processor -- start 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.082+0000 7fc959d23800 1 -- start start 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.082+0000 7fc959d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d720c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.082+0000 7fc959d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5644d7206560 con 0x5644d72054c0 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.082+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d720c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.082+0000 7fc955ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d720c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44386/0 (socket says 172.21.15.50:44386) 2024-05-07T13:56:08.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.082+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 learned_addr learned my addr 172.21.15.50:0/2422582419 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.082+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d720ce20 con 0x5644d72054c0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.082+0000 7fc955ab7640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d720c8e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc94806fee0 tx=0x7fc948065f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.083+0000 7fc8277fe640 1 -- 172.21.15.50:0/2422582419 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94808ecd0 con 0x5644d72054c0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.083+0000 7fc8277fe640 1 -- 172.21.15.50:0/2422582419 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94806c690 con 0x5644d72054c0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.083+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644d720ce20 con 0x5644d72054c0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.083+0000 7fc8277fe640 1 -- 172.21.15.50:0/2422582419 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc94806c990 con 0x5644d72054c0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.083+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d720ce20 con 0x5644d72054c0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.083+0000 7fc8277fe640 1 -- 172.21.15.50:0/2422582419 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc948078440 con 0x5644d72054c0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.084+0000 7fc8277fe640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc820036900 0x7fc820038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.084+0000 7fc8277fe640 1 -- 172.21.15.50:0/2422582419 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc9480ad190 con 0x5644d72054c0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.084+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc820036900 0x7fc820038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.084+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc820036900 0x7fc820038dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc940001b60 tx=0x7fc940010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc959d23800 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d7217fd0 0x5644d721a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d721abe0 con 0x5644d7217fd0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc9562b8640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d7217fd0 0x5644d721a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc9562b8640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d7217fd0 0x5644d721a490 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d7217fd0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc959d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc959d23800 20 realm 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d721aff0 con 0x5644d7217fd0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d7217fd0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc959d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.085+0000 7fc959d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d721b8c0 con 0x5644d7217fd0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d7217fd0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc959d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d7217fd0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d7217fd0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc959d23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc959d23800 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d721c9c0 0x5644d721edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d721f3c0 con 0x5644d721c9c0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc955ab7640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d721c9c0 0x5644d721edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.086+0000 7fc955ab7640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d721c9c0 0x5644d721edb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.087+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.087+0000 7fc959d23800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.087+0000 7fc959d23800 20 searching for the correct realm 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.087+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d7220cf0 con 0x5644d721c9c0 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.087+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.087+0000 7fc955ab7640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc94805c870 0x7fc9480a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.087+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d7220cf0 con 0x7fc94805c870 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.088+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc94805c870 0x7fc9480a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.088+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc94805c870 0x7fc9480a7440 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.088+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc940009050 con 0x7fc94805c870 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.088+0000 7fc94d2b6640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc940038040 0x7fc94001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.088+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d7220cf0 con 0x7fc940038040 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.088+0000 7fc9562b8640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc940038040 0x7fc94001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.089+0000 7fc9562b8640 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc940038040 0x7fc94001bab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.089+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95000a4a0 con 0x7fc940038040 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.089+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d7217fd0 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.089+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d7217fd0 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.089+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d7217fd0 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.090+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d7217fd0 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.090+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc940038040 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.090+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95000a4a0 con 0x7fc940038040 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.090+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc940038040 2024-05-07T13:56:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.090+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc95000a4a0 con 0x7fc940038040 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.090+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc94805c870 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.090+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc940009050 con 0x7fc94805c870 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.090+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d721c9c0 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.091+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.091+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d7217fd0 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.091+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d7217fd0 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.091+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc940038040 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.091+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95000a4a0 con 0x7fc940038040 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.091+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d7217fd0 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.092+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d7217fd0 2024-05-07T13:56:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.092+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc94805c870 2024-05-07T13:56:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.092+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc940009050 con 0x7fc94805c870 2024-05-07T13:56:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.092+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d721c9c0 2024-05-07T13:56:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.092+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.092+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d721c9c0 2024-05-07T13:56:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.092+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.092+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc940038040 2024-05-07T13:56:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.093+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95000a4a0 con 0x7fc940038040 2024-05-07T13:56:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.093+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d721c9c0 2024-05-07T13:56:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.093+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.093+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d721c9c0 2024-05-07T13:56:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.093+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.093+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d7217fd0 2024-05-07T13:56:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.093+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95000a4a0 con 0x5644d7217fd0 2024-05-07T13:56:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.093+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d7217fd0 2024-05-07T13:56:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.094+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.094+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc940038040 2024-05-07T13:56:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.094+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.094+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d721c9c0 2024-05-07T13:56:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.094+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.094+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc94805c870 2024-05-07T13:56:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.094+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc940009050 con 0x7fc94805c870 2024-05-07T13:56:08.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.094+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d7217fd0 2024-05-07T13:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.095+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.095+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc940038040 2024-05-07T13:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.095+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.095+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d721c9c0 2024-05-07T13:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.095+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.095+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc940038040 2024-05-07T13:56:08.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.096+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.096+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc94805c870 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.096+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc940009050 con 0x7fc94805c870 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.096+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d721c9c0 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.096+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.096+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc940038040 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x5644d7217fd0 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5644d721bc60 con 0x7fc94805c870 2024-05-07T13:56:08.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d721fc80 con 0x5644d7217fd0 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.097+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d7220070 con 0x5644d7217fd0 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d7220070 con 0x7fc940038040 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 20 zone default found 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 4 Realm: () 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:08.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 20 zonegroup default 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d7221170 con 0x7fc940038040 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.098+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d7222b50 con 0x5644d721c9c0 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.099+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.099+0000 7fc959d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.099+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.099+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d7222ef0 con 0x5644d721c9c0 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.099+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.099+0000 7fc959d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.099+0000 7fc959d23800 20 started sync module instance, tier type = 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.099+0000 7fc959d23800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.099+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7221ff0 con 0x7fc94805c870 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.100+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.100+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94853667101504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7223290 con 0x7fc94805c870 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.100+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7223b20 con 0x5644d7217fd0 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.101+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94853667101504] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.101+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.101+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94853667103712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7223f10 con 0x5644d7217fd0 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.101+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d72249b0 con 0x5644d721c9c0 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.103+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.103+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94853667112064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7225250 con 0x5644d721c9c0 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.103+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7225d40 con 0x7fc94805c870 2024-05-07T13:56:08.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.103+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94853667103712] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.104+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94853667112064] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.104+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.104+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94853667117072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7226130 con 0x7fc94805c870 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.104+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d72269c0 con 0x5644d7217fd0 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.105+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.105+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94853667120336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7227260 con 0x5644d7217fd0 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.105+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7227d70 con 0x7fc940038040 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.105+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94853667117072] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.106+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.106+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94853667125280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7227d30 con 0x7fc940038040 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.106+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7228780 con 0x7fc940038040 2024-05-07T13:56:08.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.106+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94853667120336] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.107+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94853667125280] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.107+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.107+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94853667108400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d72282d0 con 0x7fc940038040 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.107+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7228c90 con 0x7fc940038040 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94853667108400] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94853667129312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d72290b0 con 0x7fc940038040 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc959d23800 20 add_watcher() i=0 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc959d23800 20 add_watcher() i=1 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc959d23800 20 add_watcher() i=2 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc959d23800 20 add_watcher() i=3 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc959d23800 20 add_watcher() i=4 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc959d23800 20 add_watcher() i=5 2024-05-07T13:56:08.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.108+0000 7fc959d23800 20 add_watcher() i=6 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.109+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94853667129312] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.109+0000 7fc959d23800 20 add_watcher() i=7 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.109+0000 7fc959d23800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.109+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d72290b0 con 0x5644d7217fd0 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.110+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.110+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94853667130368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7229930 con 0x5644d7217fd0 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.110+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94853667130368] v27'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.111+0000 7fc8077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.111+0000 7fc959d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.111+0000 7fc959d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.111+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7234990 con 0x5644d7217fd0 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.112+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.112+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7235060 con 0x7fc940038040 2024-05-07T13:56:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.113+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.113+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7235480 con 0x5644d721c9c0 2024-05-07T13:56:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.114+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.114+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d72353d0 con 0x5644d7217fd0 2024-05-07T13:56:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.115+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.115+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7235a60 con 0x7fc94805c870 2024-05-07T13:56:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.116+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.116+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7236480 con 0x5644d721c9c0 2024-05-07T13:56:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.117+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.117+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7236480 con 0x5644d7217fd0 2024-05-07T13:56:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.118+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.118+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7236480 con 0x7fc940038040 2024-05-07T13:56:08.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.120+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.120+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7236510 con 0x7fc94805c870 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.121+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.121+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7236a80 con 0x5644d721c9c0 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.122+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.122+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7236a80 con 0x7fc94805c870 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.123+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.123+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7236ff0 con 0x7fc940038040 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.124+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.124+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237080 con 0x7fc94805c870 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.125+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.125+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237110 con 0x7fc940038040 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.126+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.126+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237110 con 0x5644d7217fd0 2024-05-07T13:56:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.127+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.127+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237110 con 0x5644d721c9c0 2024-05-07T13:56:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.128+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.128+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d72371a0 con 0x7fc94805c870 2024-05-07T13:56:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.129+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.129+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d721c9c0 2024-05-07T13:56:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.130+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.130+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d7217fd0 2024-05-07T13:56:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.131+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.131+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d7217fd0 2024-05-07T13:56:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.132+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.132+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d721c9c0 2024-05-07T13:56:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.133+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.133+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x7fc94805c870 2024-05-07T13:56:08.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.134+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.134+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d721c9c0 2024-05-07T13:56:08.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.135+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.135+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d721c9c0 2024-05-07T13:56:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.136+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.136+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d721c9c0 2024-05-07T13:56:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.137+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.137+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d721c9c0 2024-05-07T13:56:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.138+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.138+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x7fc940038040 2024-05-07T13:56:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.139+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.139+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d721c9c0 2024-05-07T13:56:08.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.140+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.140+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x7fc940038040 2024-05-07T13:56:08.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.141+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.141+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x5644d721c9c0 2024-05-07T13:56:08.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.142+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.142+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x7fc940038040 2024-05-07T13:56:08.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.143+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.143+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7237230 con 0x7fc94805c870 2024-05-07T13:56:08.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.144+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.144+0000 7fc8067fc640 20 reqs_thread_entry: start 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.144+0000 7fc959d23800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.145+0000 7fc959d23800 20 Filter name: none 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.145+0000 7fc777fff640 20 reqs_thread_entry: start 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.145+0000 7fc959d23800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.145+0000 7fc959d23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.145+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5644d7262280 con 0x7fc940038040 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.145+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.145+0000 7fc959d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.145+0000 7fc959d23800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.145+0000 7fc959d23800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:56:08.134 INFO:teuthology.orchestra.run.smithi050.stderr:could not remove user: unable to remove user, user does not exist 2024-05-07T13:56:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.146+0000 7fc8077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.146+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94853667130368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d72325d0 con 0x5644d7217fd0 2024-05-07T13:56:08.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.147+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94853667130368] v27'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.147+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94853667101504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d72325d0 con 0x7fc94805c870 2024-05-07T13:56:08.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.148+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94853667101504] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.148+0000 7fc959d23800 20 remove_watcher() i=0 2024-05-07T13:56:08.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.148+0000 7fc959d23800 2 removed watcher, disabling cache 2024-05-07T13:56:08.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.148+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94853667103712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7221b40 con 0x5644d7217fd0 2024-05-07T13:56:08.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.149+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94853667103712] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.149+0000 7fc959d23800 20 remove_watcher() i=1 2024-05-07T13:56:08.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.149+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94853667112064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7221b40 con 0x5644d721c9c0 2024-05-07T13:56:08.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.150+0000 7fc955ab7640 1 -- 172.21.15.50:0/2422582419 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94853667112064] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc94809a070 con 0x5644d721c9c0 2024-05-07T13:56:08.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.150+0000 7fc959d23800 20 remove_watcher() i=2 2024-05-07T13:56:08.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.150+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94853667117072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7221b40 con 0x7fc94805c870 2024-05-07T13:56:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.151+0000 7fc94d2b6640 1 -- 172.21.15.50:0/2422582419 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94853667117072] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc940045040 con 0x7fc94805c870 2024-05-07T13:56:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.151+0000 7fc959d23800 20 remove_watcher() i=3 2024-05-07T13:56:08.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.151+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94853667120336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7221b40 con 0x5644d7217fd0 2024-05-07T13:56:08.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.152+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94853667120336] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x5644d7217fd0 2024-05-07T13:56:08.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.152+0000 7fc959d23800 20 remove_watcher() i=4 2024-05-07T13:56:08.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.152+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94853667125280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7221b40 con 0x7fc940038040 2024-05-07T13:56:08.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.153+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94853667125280] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.153+0000 7fc959d23800 20 remove_watcher() i=5 2024-05-07T13:56:08.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.153+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94853667108400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7227820 con 0x7fc940038040 2024-05-07T13:56:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.154+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94853667108400] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.154+0000 7fc959d23800 20 remove_watcher() i=6 2024-05-07T13:56:08.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.154+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94853667129312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5644d7223630 con 0x7fc940038040 2024-05-07T13:56:08.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94853667129312] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc95002f060 con 0x7fc940038040 2024-05-07T13:56:08.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 20 remove_watcher() i=7 2024-05-07T13:56:08.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc940038040 msgr2=0x7fc94001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc940038040 0x7fc94001bab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d7217fd0 msgr2=0x5644d721a490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d7217fd0 0x5644d721a490 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc94805c870 msgr2=0x7fc9480a7440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc94805c870 0x7fc9480a7440 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d721c9c0 msgr2=0x5644d721edb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d721c9c0 0x5644d721edb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc820036900 msgr2=0x7fc820038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc820036900 0x7fc820038dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc940001b60 tx=0x7fc940010000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 msgr2=0x5644d720c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc959d23800 1 --2- 172.21.15.50:0/2422582419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d72054c0 0x5644d720c8e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc94806fee0 tx=0x7fc948065f10 comp rx=0 tx=0).stop 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.155+0000 7fc9562b8640 1 -- 172.21.15.50:0/2422582419 reap_dead start 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 shutdown_connections 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 >> 172.21.15.50:0/2422582419 conn(0x5644d7201820 msgr2=0x5644d71fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 shutdown_connections 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/2422582419 wait complete. 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/3709450300 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc830036900 msgr2=0x7fc830038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 --2- 172.21.15.50:0/3709450300 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc830036900 0x7fc830038dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc94000bf50 tx=0x7fc94000f000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/3709450300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d71f83d0 msgr2=0x5644d71f87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 --2- 172.21.15.50:0/3709450300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d71f83d0 0x5644d71f87f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc94808c210 tx=0x7fc948076f50 comp rx=0 tx=0).stop 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/3709450300 shutdown_connections 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 --2- 172.21.15.50:0/3709450300 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc830036900 0x7fc830038dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 --2- 172.21.15.50:0/3709450300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d71f83d0 0x5644d71f87f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/3709450300 >> 172.21.15.50:0/3709450300 conn(0x5644d71ec470 msgr2=0x5644d71ec870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/3709450300 shutdown_connections 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/3709450300 wait complete. 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5644d71e73c0 msgr2=0x5644d71e9810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5644d71e73c0 0x5644d71e9810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d71de800 msgr2=0x5644d71e0bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5644d71de800 0x5644d71e0bf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d71e3480 msgr2=0x5644d71e5870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.156+0000 7fc959d23800 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5644d71e3480 0x5644d71e5870 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.157+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc83c036900 msgr2=0x7fc83c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.157+0000 7fc959d23800 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc83c036900 0x7fc83c038dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc940000f60 tx=0x7fc9400012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.157+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70defa0 msgr2=0x5644d71d95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.157+0000 7fc959d23800 1 --2- 172.21.15.50:0/4286397414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644d70defa0 0x5644d71d95d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc94800a470 tx=0x7fc948003020 comp rx=0 tx=0).stop 2024-05-07T13:56:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.157+0000 7fc9562b8640 1 -- 172.21.15.50:0/4286397414 reap_dead start 2024-05-07T13:56:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.157+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 shutdown_connections 2024-05-07T13:56:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.157+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 >> 172.21.15.50:0/4286397414 conn(0x5644d70d7d30 msgr2=0x5644d71cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.157+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 shutdown_connections 2024-05-07T13:56:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.157+0000 7fc959d23800 1 -- 172.21.15.50:0/4286397414 wait complete. 2024-05-07T13:56:08.154 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-07T13:56:08.155 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-07T13:56:08.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-07T13:56:08.155 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-07T13:56:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.213+0000 7f205c12b800 1 Processor -- start 2024-05-07T13:56:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.213+0000 7f205c12b800 1 -- start start 2024-05-07T13:56:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.213+0000 7f205c12b800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5611f3f524a0 0x5611f3f54890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.213+0000 7f205c12b800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611f3f54e60 con 0x5611f3f4e4f0 2024-05-07T13:56:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.213+0000 7f205c12b800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5611f3de0050 con 0x5611f3f524a0 2024-05-07T13:56:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.213+0000 7f204ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5611f3f524a0 0x5611f3f54890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.213+0000 7f2057ec2640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5611f3f4e4f0 0x5611f3f4e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39460/0 (socket says 172.21.15.50:39460) 2024-05-07T13:56:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.213+0000 7f2057ec2640 1 -- 172.21.15.50:0/2006828769 learned_addr learned my addr 172.21.15.50:0/2006828769 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.214+0000 7f204ffff640 1 -- 172.21.15.50:0/2006828769 >> v1:172.21.15.22:6789/0 conn(0x5611f3f4e4f0 legacy=0x5611f3f4e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.214+0000 7f20576c1640 1 -- 172.21.15.50:0/2006828769 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503509792 0 0) 0x5611f3f54e60 con 0x5611f3f4e4f0 2024-05-07T13:56:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.214+0000 7f204ffff640 1 -- 172.21.15.50:0/2006828769 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f3f56040 con 0x5611f3f524a0 2024-05-07T13:56:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f204ffff640 1 --2- 172.21.15.50:0/2006828769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f524a0 0x5611f3f54890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f204000a470 tx=0x7f204001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b912ac458d90279e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f20576c1640 1 -- 172.21.15.50:0/2006828769 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2040057070 con 0x5611f3f524a0 2024-05-07T13:56:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f20576c1640 1 -- 172.21.15.50:0/2006828769 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2040052570 con 0x5611f3f524a0 2024-05-07T13:56:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f20576c1640 1 -- 172.21.15.50:0/2006828769 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2040052870 con 0x5611f3f524a0 2024-05-07T13:56:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f205c12b800 1 -- 172.21.15.50:0/2006828769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f524a0 msgr2=0x5611f3f54890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f205c12b800 1 --2- 172.21.15.50:0/2006828769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f524a0 0x5611f3f54890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f204000a470 tx=0x7f204001ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f205c12b800 1 -- 172.21.15.50:0/2006828769 shutdown_connections 2024-05-07T13:56:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f205c12b800 1 --2- 172.21.15.50:0/2006828769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f524a0 0x5611f3f54890 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f205c12b800 1 -- 172.21.15.50:0/2006828769 >> 172.21.15.50:0/2006828769 conn(0x5611f3f48d30 msgr2=0x5611f3f4b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f205c12b800 1 -- 172.21.15.50:0/2006828769 shutdown_connections 2024-05-07T13:56:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.216+0000 7f205c12b800 1 -- 172.21.15.50:0/2006828769 wait complete. 2024-05-07T13:56:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.231+0000 7f205c12b800 1 Processor -- start 2024-05-07T13:56:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.232+0000 7f205c12b800 1 -- start start 2024-05-07T13:56:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.232+0000 7f205c12b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f403f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.232+0000 7f205c12b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5611f3e9a1d0 con 0x5611f3f4e4f0 2024-05-07T13:56:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.232+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f403f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.232+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f403f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44400/0 (socket says 172.21.15.50:44400) 2024-05-07T13:56:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.232+0000 7f2057ec2640 1 -- 172.21.15.50:0/170287438 learned_addr learned my addr 172.21.15.50:0/170287438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.232+0000 7f2057ec2640 1 -- 172.21.15.50:0/170287438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f403f940 con 0x5611f3f4e4f0 2024-05-07T13:56:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.232+0000 7f2057ec2640 1 --2- 172.21.15.50:0/170287438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f403f370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f204800b210 tx=0x7f204800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1da660eab67f14 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f1f45e0b640 1 -- 172.21.15.50:0/170287438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048008070 con 0x5611f3f4e4f0 2024-05-07T13:56:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f1f45e0b640 1 -- 172.21.15.50:0/170287438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204800d500 con 0x5611f3f4e4f0 2024-05-07T13:56:08.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f1f45e0b640 1 -- 172.21.15.50:0/170287438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f204800d840 con 0x5611f3f4e4f0 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f205c12b800 1 -- 172.21.15.50:0/170287438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 msgr2=0x5611f403f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f205c12b800 1 --2- 172.21.15.50:0/170287438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f403f370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f204800b210 tx=0x7f204800b6d0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f205c12b800 1 -- 172.21.15.50:0/170287438 shutdown_connections 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f205c12b800 1 --2- 172.21.15.50:0/170287438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f403f370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f205c12b800 1 -- 172.21.15.50:0/170287438 >> 172.21.15.50:0/170287438 conn(0x5611f3f48d30 msgr2=0x5611f403ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f205c12b800 1 -- 172.21.15.50:0/170287438 shutdown_connections 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.233+0000 7f205c12b800 1 -- 172.21.15.50:0/170287438 wait complete. 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.234+0000 7f205c12b800 1 Processor -- start 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.234+0000 7f205c12b800 1 -- start start 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.234+0000 7f205c12b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f4046f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.234+0000 7f205c12b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5611f3f55330 con 0x5611f3f4e4f0 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.234+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f4046f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.234+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f4046f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44402/0 (socket says 172.21.15.50:44402) 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.234+0000 7f2057ec2640 1 -- 172.21.15.50:0/1980247955 learned_addr learned my addr 172.21.15.50:0/1980247955 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.234+0000 7f2057ec2640 1 -- 172.21.15.50:0/1980247955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f4047460 con 0x5611f3f4e4f0 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.235+0000 7f2057ec2640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f4046f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2048001e60 tx=0x7f2048000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.235+0000 7f1f3ffff640 1 -- 172.21.15.50:0/1980247955 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048019870 con 0x5611f3f4e4f0 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.235+0000 7f1f3ffff640 1 -- 172.21.15.50:0/1980247955 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2048019a10 con 0x5611f3f4e4f0 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.235+0000 7f1f3ffff640 1 -- 172.21.15.50:0/1980247955 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048019cf0 con 0x5611f3f4e4f0 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.235+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611f40476f0 con 0x5611f3f4e4f0 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.235+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611f404a3a0 con 0x5611f3f4e4f0 2024-05-07T13:56:08.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.236+0000 7f1f3ffff640 1 -- 172.21.15.50:0/1980247955 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2048017040 con 0x5611f3f4e4f0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.236+0000 7f1f3ffff640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f40036950 0x7f1f40038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.236+0000 7f1f3ffff640 1 -- 172.21.15.50:0/1980247955 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f2048015020 con 0x5611f3f4e4f0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.236+0000 7f204ffff640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f40036950 0x7f1f40038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.236+0000 7f205c12b800 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f3f524a0 0x5611f404e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.236+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f404e6e0 con 0x5611f3f524a0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.236+0000 7f20586c3640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f3f524a0 0x5611f404e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.237+0000 7f204ffff640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f40036950 0x7f1f40038e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2040054000 tx=0x7f204004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.237+0000 7f20586c3640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f3f524a0 0x5611f404e160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.237+0000 7f20586c3640 1 -- 172.21.15.50:0/1980247955 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f3f524a0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.237+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f404b730 con 0x5611f3f524a0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.237+0000 7f20586c3640 1 -- 172.21.15.50:0/1980247955 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f3f524a0 2024-05-07T13:56:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.237+0000 7f205c12b800 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f4050a10 0x5611f4052e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.237+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f40534f0 con 0x5611f4050a10 2024-05-07T13:56:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.237+0000 7f2057ec2640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f4050a10 0x5611f4052e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.238+0000 7f2057ec2640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f4050a10 0x5611f4052e00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.238+0000 7f2057ec2640 1 -- 172.21.15.50:0/1980247955 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f204802d070 con 0x5611f4050a10 2024-05-07T13:56:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.238+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f404f9c0 con 0x5611f3f524a0 2024-05-07T13:56:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.238+0000 7f20586c3640 1 -- 172.21.15.50:0/1980247955 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f3f524a0 2024-05-07T13:56:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.238+0000 7f205c12b800 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5611f40549a0 0x5611f4056df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.238+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f4057550 con 0x5611f40549a0 2024-05-07T13:56:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.239+0000 7f204ffff640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5611f40549a0 0x5611f4056df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.239+0000 7f204ffff640 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5611f40549a0 0x5611f4056df0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.239+0000 7f204ffff640 1 -- 172.21.15.50:0/1980247955 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f204005a040 con 0x5611f40549a0 2024-05-07T13:56:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.239+0000 7f205c12b800 1 Processor -- start 2024-05-07T13:56:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.240+0000 7f205c12b800 1 -- start start 2024-05-07T13:56:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.240+0000 7f205c12b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f405b640 0x5611f4059ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.240+0000 7f205c12b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5611f3e40cf0 con 0x5611f405b640 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.240+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f405b640 0x5611f4059ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.240+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f405b640 0x5611f4059ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44412/0 (socket says 172.21.15.50:44412) 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.240+0000 7f2057ec2640 1 -- 172.21.15.50:0/3334226099 learned_addr learned my addr 172.21.15.50:0/3334226099 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.240+0000 7f2057ec2640 1 -- 172.21.15.50:0/3334226099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f4059ff0 con 0x5611f405b640 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.240+0000 7f2057ec2640 1 --2- 172.21.15.50:0/3334226099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f405b640 0x5611f4059ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f204804b370 tx=0x7f204800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.240+0000 7f1f3dffb640 1 -- 172.21.15.50:0/3334226099 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048044b00 con 0x5611f405b640 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.241+0000 7f1f3dffb640 1 -- 172.21.15.50:0/3334226099 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2048044ca0 con 0x5611f405b640 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.241+0000 7f205c12b800 1 -- 172.21.15.50:0/3334226099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611f405a280 con 0x5611f405b640 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.241+0000 7f1f3dffb640 1 -- 172.21.15.50:0/3334226099 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048040850 con 0x5611f405b640 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.241+0000 7f205c12b800 1 -- 172.21.15.50:0/3334226099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611f405a780 con 0x5611f405b640 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.241+0000 7f1f3dffb640 1 -- 172.21.15.50:0/3334226099 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20480409f0 con 0x5611f405b640 2024-05-07T13:56:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.241+0000 7f1f3dffb640 1 --2- 172.21.15.50:0/3334226099 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f30036900 0x7f1f30038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f1f3dffb640 1 -- 172.21.15.50:0/3334226099 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f204803cc50 con 0x5611f405b640 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f204ffff640 1 --2- 172.21.15.50:0/3334226099 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f30036900 0x7f1f30038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f205c12b800 1 Processor -- start 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f205c12b800 1 -- start start 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f204ffff640 1 --2- 172.21.15.50:0/3334226099 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f30036900 0x7f1f30038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5611f404efc0 tx=0x7f2040005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f205c12b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f40764b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f205c12b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5611f403fcc0 con 0x5611f4076090 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f40764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f40764b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44426/0 (socket says 172.21.15.50:44426) 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.242+0000 7f2057ec2640 1 -- 172.21.15.50:0/3257188306 learned_addr learned my addr 172.21.15.50:0/3257188306 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f2057ec2640 1 -- 172.21.15.50:0/3257188306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f4076a80 con 0x5611f4076090 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f2057ec2640 1 --2- 172.21.15.50:0/3257188306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f40764b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2048045fd0 tx=0x7f2048011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51095325323f516a server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f1f36ffd640 1 -- 172.21.15.50:0/3257188306 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048026cc0 con 0x5611f4076090 2024-05-07T13:56:08.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f1f36ffd640 1 -- 172.21.15.50:0/3257188306 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2048025390 con 0x5611f4076090 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f1f36ffd640 1 -- 172.21.15.50:0/3257188306 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048030d50 con 0x5611f4076090 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f205c12b800 1 -- 172.21.15.50:0/3257188306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 msgr2=0x5611f40764b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f205c12b800 1 --2- 172.21.15.50:0/3257188306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f40764b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2048045fd0 tx=0x7f2048011f90 comp rx=0 tx=0).stop 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f205c12b800 1 -- 172.21.15.50:0/3257188306 shutdown_connections 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f205c12b800 1 --2- 172.21.15.50:0/3257188306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f40764b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f205c12b800 1 -- 172.21.15.50:0/3257188306 >> 172.21.15.50:0/3257188306 conn(0x5611f4072310 msgr2=0x5611f4070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f205c12b800 1 -- 172.21.15.50:0/3257188306 shutdown_connections 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.243+0000 7f205c12b800 1 -- 172.21.15.50:0/3257188306 wait complete. 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.244+0000 7f205c12b800 1 Processor -- start 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.244+0000 7f205c12b800 1 -- start start 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.244+0000 7f205c12b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f407d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.244+0000 7f205c12b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5611f40770f0 con 0x5611f4076090 2024-05-07T13:56:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.244+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f407d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.244+0000 7f2057ec2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f407d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44428/0 (socket says 172.21.15.50:44428) 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.244+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 learned_addr learned my addr 172.21.15.50:0/296800526 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.244+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f407d8f0 con 0x5611f4076090 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.245+0000 7f2057ec2640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f407d3b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2048028000 tx=0x7f2048021fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.245+0000 7f1f357fa640 1 -- 172.21.15.50:0/296800526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2048040e10 con 0x5611f4076090 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.245+0000 7f1f357fa640 1 -- 172.21.15.50:0/296800526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2048026430 con 0x5611f4076090 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.245+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611f407d8f0 con 0x5611f4076090 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.245+0000 7f1f357fa640 1 -- 172.21.15.50:0/296800526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f204800faf0 con 0x5611f4076090 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.245+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611f407d8f0 con 0x5611f4076090 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.246+0000 7f1f357fa640 1 -- 172.21.15.50:0/296800526 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f204806c070 con 0x5611f4076090 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.246+0000 7f1f357fa640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f20036950 0x7f1f20038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.246+0000 7f1f357fa640 1 -- 172.21.15.50:0/296800526 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f2048070c80 con 0x5611f4076090 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.246+0000 7f204ffff640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f20036950 0x7f1f20038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.246+0000 7f204ffff640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f20036950 0x7f1f20038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f204001ced0 tx=0x7f204004f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f205c12b800 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f40889d0 0x5611f408ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f408b5e0 con 0x5611f40889d0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f20586c3640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f40889d0 0x5611f408ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f20586c3640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f40889d0 0x5611f408ae90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f40889d0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f205c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f205c12b800 20 realm 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.247+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f408b9f0 con 0x5611f40889d0 2024-05-07T13:56:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f40889d0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c2c0 con 0x5611f40889d0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f40889d0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f40889d0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f40889d0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f408d3c0 0x5611f408f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f408fdc0 con 0x5611f408d3c0 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.248+0000 7f2057ec2640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f408d3c0 0x5611f408f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.249+0000 7f2057ec2640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f408d3c0 0x5611f408f7b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.249+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2048075020 con 0x5611f408d3c0 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.249+0000 7f205c12b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.249+0000 7f205c12b800 20 searching for the correct realm 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.249+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f40916d0 con 0x5611f408d3c0 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.249+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2048075020 con 0x5611f408d3c0 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.249+0000 7f2057ec2640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2048055070 0x7f2048030450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.249+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f40916d0 con 0x7f2048055070 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.250+0000 7f204ffff640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2048055070 0x7f2048030450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.250+0000 7f204ffff640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2048055070 0x7f2048030450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.250+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.250+0000 7f204ffff640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2040083040 0x7f2040075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.250+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f40916d0 con 0x7f2040083040 2024-05-07T13:56:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.251+0000 7f20586c3640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2040083040 0x7f2040075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.251+0000 7f20586c3640 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2040083040 0x7f2040075430 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.251+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205000a4a0 con 0x7f2040083040 2024-05-07T13:56:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.251+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f40889d0 2024-05-07T13:56:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.252+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f40889d0 2024-05-07T13:56:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.252+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f40889d0 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.252+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f40889d0 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.252+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2040083040 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.252+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205000a4a0 con 0x7f2040083040 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.252+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2040083040 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.252+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f205000a4a0 con 0x7f2040083040 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.252+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2048055070 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.253+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.253+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f408d3c0 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.253+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2048075020 con 0x5611f408d3c0 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.253+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f40889d0 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.253+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f40889d0 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.253+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2040083040 2024-05-07T13:56:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.254+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205000a4a0 con 0x7f2040083040 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.254+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f40889d0 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.254+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f40889d0 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.254+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2048055070 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.254+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.254+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f408d3c0 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.254+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2048075020 con 0x5611f408d3c0 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.254+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f408d3c0 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.255+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2048075020 con 0x5611f408d3c0 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.255+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2040083040 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.255+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205000a4a0 con 0x7f2040083040 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.255+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f408d3c0 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.255+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.255+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f408d3c0 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.255+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.255+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f40889d0 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.255+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205000a4a0 con 0x5611f40889d0 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.256+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f40889d0 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.256+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.256+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2040083040 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.256+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.256+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f408d3c0 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.256+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.256+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2048055070 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.257+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.257+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f40889d0 2024-05-07T13:56:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.257+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.257+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2040083040 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.257+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.257+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f408d3c0 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.258+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.258+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2040083040 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.258+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.258+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2048055070 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.258+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.258+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f408d3c0 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.258+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.258+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2040083040 2024-05-07T13:56:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x5611f40889d0 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5611f408c660 con 0x7f2048055070 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f205c12b800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f205c12b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f205c12b800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f205c12b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f205c12b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f205c12b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f4090680 con 0x5611f40889d0 2024-05-07T13:56:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.259+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f4090a70 con 0x5611f40889d0 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f4090a70 con 0x7f2040083040 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 20 zone default found 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 4 Realm: () 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 20 zonegroup default 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f40902e0 con 0x7f2040083040 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.260+0000 7f205c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f40902e0 con 0x5611f408d3c0 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f205c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f40935b0 con 0x5611f408d3c0 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f205c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f205c12b800 20 started sync module instance, tier type = 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f205c12b800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.261+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40929d0 con 0x7f2048055070 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.262+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.262+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94635108675008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4092630 con 0x7f2048055070 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.262+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40944e0 con 0x5611f40889d0 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.263+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.263+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94635108675008] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.263+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94635108679728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4094450 con 0x5611f40889d0 2024-05-07T13:56:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.263+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40953a0 con 0x5611f408d3c0 2024-05-07T13:56:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.264+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94635108679728] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.265+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.265+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94635108683504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4095740 con 0x5611f408d3c0 2024-05-07T13:56:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.265+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4096190 con 0x7f2048055070 2024-05-07T13:56:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.266+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.266+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94635108683504] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.266+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94635108689280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4096e50 con 0x7f2048055070 2024-05-07T13:56:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.266+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4094910 con 0x5611f40889d0 2024-05-07T13:56:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.267+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.267+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94635108692880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4097c60 con 0x5611f40889d0 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.267+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4098690 con 0x7f2040083040 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.267+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94635108689280] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.268+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.268+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94635108690336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4098650 con 0x7f2040083040 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.268+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4099110 con 0x7f2040083040 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.268+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94635108692880] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.269+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94635108690336] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.269+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.269+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94635108693936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40981a0 con 0x7f2040083040 2024-05-07T13:56:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.269+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40997a0 con 0x7f2040083040 2024-05-07T13:56:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94635108693936] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94635108699168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40997a0 con 0x7f2040083040 2024-05-07T13:56:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f205c12b800 20 add_watcher() i=0 2024-05-07T13:56:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f205c12b800 20 add_watcher() i=1 2024-05-07T13:56:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f205c12b800 20 add_watcher() i=2 2024-05-07T13:56:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f205c12b800 20 add_watcher() i=3 2024-05-07T13:56:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f205c12b800 20 add_watcher() i=4 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f205c12b800 20 add_watcher() i=5 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.270+0000 7f205c12b800 20 add_watcher() i=6 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.271+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94635108699168] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.271+0000 7f205c12b800 20 add_watcher() i=7 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.271+0000 7f205c12b800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.271+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f409c960 con 0x5611f40889d0 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.272+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.272+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94635108700912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4099bc0 con 0x5611f40889d0 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.273+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94635108700912] v27'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.273+0000 7f1f0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.273+0000 7f205c12b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.273+0000 7f205c12b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.273+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a52d0 con 0x5611f40889d0 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.274+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.274+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a5920 con 0x7f2040083040 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.275+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.275+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a5d80 con 0x5611f408d3c0 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.276+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.276+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a5c60 con 0x5611f40889d0 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.277+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.277+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a6310 con 0x7f2048055070 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.278+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.278+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a6c00 con 0x5611f408d3c0 2024-05-07T13:56:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.280+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.280+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a6c00 con 0x5611f40889d0 2024-05-07T13:56:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.281+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.281+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a6c90 con 0x7f2040083040 2024-05-07T13:56:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.282+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.282+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a6da0 con 0x7f2048055070 2024-05-07T13:56:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.283+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.283+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7450 con 0x5611f408d3c0 2024-05-07T13:56:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.284+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.284+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7450 con 0x7f2048055070 2024-05-07T13:56:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.285+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.285+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x7f2040083040 2024-05-07T13:56:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.286+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.286+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x7f2048055070 2024-05-07T13:56:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.287+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.287+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x7f2040083040 2024-05-07T13:56:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.288+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.288+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f40889d0 2024-05-07T13:56:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.289+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.289+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f408d3c0 2024-05-07T13:56:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.290+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.290+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x7f2048055070 2024-05-07T13:56:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.291+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.291+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f408d3c0 2024-05-07T13:56:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.292+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.292+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f40889d0 2024-05-07T13:56:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.293+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.294+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f40889d0 2024-05-07T13:56:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.294+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.294+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f408d3c0 2024-05-07T13:56:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.295+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.295+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x7f2048055070 2024-05-07T13:56:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.296+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.296+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f408d3c0 2024-05-07T13:56:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.297+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.297+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f408d3c0 2024-05-07T13:56:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.298+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.298+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f408d3c0 2024-05-07T13:56:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.299+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.299+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f408d3c0 2024-05-07T13:56:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.300+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.300+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x7f2040083040 2024-05-07T13:56:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.302+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.302+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f408d3c0 2024-05-07T13:56:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.303+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.303+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x7f2040083040 2024-05-07T13:56:08.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.304+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.304+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x5611f408d3c0 2024-05-07T13:56:08.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.305+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.306+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x7f2040083040 2024-05-07T13:56:08.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.306+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.306+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a7900 con 0x7f2048055070 2024-05-07T13:56:08.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.308+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.308+0000 7f1f0cfe1640 20 reqs_thread_entry: start 2024-05-07T13:56:08.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.308+0000 7f205c12b800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:08.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.308+0000 7f205c12b800 20 Filter name: none 2024-05-07T13:56:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.308+0000 7f1e867fc640 20 reqs_thread_entry: start 2024-05-07T13:56:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.308+0000 7f205c12b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.308+0000 7f205c12b800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.308+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5611f40d28a0 con 0x5611f40889d0 2024-05-07T13:56:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.309+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.309+0000 7f205c12b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.309+0000 7f205c12b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-07T13:56:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.309+0000 7f205c12b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:could not remove user: unable to remove user, user does not exist 2024-05-07T13:56:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.309+0000 7f1f0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.309+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94635108700912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a2e40 con 0x5611f40889d0 2024-05-07T13:56:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.310+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94635108700912] v27'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.310+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94635108675008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f40a2e40 con 0x7f2048055070 2024-05-07T13:56:08.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.311+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94635108675008] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.311+0000 7f205c12b800 20 remove_watcher() i=0 2024-05-07T13:56:08.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.311+0000 7f205c12b800 2 removed watcher, disabling cache 2024-05-07T13:56:08.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.311+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94635108679728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4092dc0 con 0x5611f40889d0 2024-05-07T13:56:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.313+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94635108679728] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.313+0000 7f205c12b800 20 remove_watcher() i=1 2024-05-07T13:56:08.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.313+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94635108683504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4092dc0 con 0x5611f408d3c0 2024-05-07T13:56:08.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.314+0000 7f2057ec2640 1 -- 172.21.15.50:0/296800526 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94635108683504] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f204808a040 con 0x5611f408d3c0 2024-05-07T13:56:08.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.314+0000 7f205c12b800 20 remove_watcher() i=2 2024-05-07T13:56:08.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.314+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94635108689280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4094ef0 con 0x7f2048055070 2024-05-07T13:56:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.315+0000 7f204ffff640 1 -- 172.21.15.50:0/296800526 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94635108689280] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2040070030 con 0x7f2048055070 2024-05-07T13:56:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.315+0000 7f205c12b800 20 remove_watcher() i=3 2024-05-07T13:56:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.315+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94635108692880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4092dc0 con 0x5611f40889d0 2024-05-07T13:56:08.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.316+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94635108692880] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x5611f40889d0 2024-05-07T13:56:08.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.316+0000 7f205c12b800 20 remove_watcher() i=4 2024-05-07T13:56:08.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.316+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94635108690336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4096580 con 0x7f2040083040 2024-05-07T13:56:08.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.317+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94635108690336] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.317+0000 7f205c12b800 20 remove_watcher() i=5 2024-05-07T13:56:08.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.317+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94635108693936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4094ef0 con 0x7f2040083040 2024-05-07T13:56:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.318+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94635108693936] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.318+0000 7f205c12b800 20 remove_watcher() i=6 2024-05-07T13:56:08.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.318+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94635108699168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5611f4092dc0 con 0x7f2040083040 2024-05-07T13:56:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94635108699168] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205002f060 con 0x7f2040083040 2024-05-07T13:56:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 20 remove_watcher() i=7 2024-05-07T13:56:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2040083040 msgr2=0x7f2040075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2040083040 0x7f2040075430 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f40889d0 msgr2=0x5611f408ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f40889d0 0x5611f408ae90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2048055070 msgr2=0x7f2048030450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2048055070 0x7f2048030450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f408d3c0 msgr2=0x5611f408f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f408d3c0 0x5611f408f7b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f20036950 msgr2=0x7f1f20038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f20036950 0x7f1f20038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f204001ced0 tx=0x7f204004f000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 msgr2=0x5611f407d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f20586c3640 1 -- 172.21.15.50:0/296800526 reap_dead start 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f407d3b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2048028000 tx=0x7f2048021fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 shutdown_connections 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 --2- 172.21.15.50:0/296800526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f4076090 0x5611f407d3b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 >> 172.21.15.50:0/296800526 conn(0x5611f4072310 msgr2=0x5611f406f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 shutdown_connections 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.319+0000 7f205c12b800 1 -- 172.21.15.50:0/296800526 wait complete. 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 -- 172.21.15.50:0/3334226099 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f30036900 msgr2=0x7f1f30038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 --2- 172.21.15.50:0/3334226099 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f30036900 0x7f1f30038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5611f404efc0 tx=0x7f2040005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 -- 172.21.15.50:0/3334226099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f405b640 msgr2=0x5611f4059ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 --2- 172.21.15.50:0/3334226099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f405b640 0x5611f4059ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f204804b370 tx=0x7f204800ed80 comp rx=0 tx=0).stop 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 -- 172.21.15.50:0/3334226099 shutdown_connections 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 --2- 172.21.15.50:0/3334226099 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f30036900 0x7f1f30038dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 --2- 172.21.15.50:0/3334226099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f405b640 0x5611f4059ab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 -- 172.21.15.50:0/3334226099 >> 172.21.15.50:0/3334226099 conn(0x5611f405c010 msgr2=0x5611f405e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 -- 172.21.15.50:0/3334226099 shutdown_connections 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.320+0000 7f205c12b800 1 -- 172.21.15.50:0/3334226099 wait complete. 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5611f40549a0 msgr2=0x5611f4056df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5611f40549a0 0x5611f4056df0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f3f524a0 msgr2=0x5611f404e160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5611f3f524a0 0x5611f404e160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f4050a10 msgr2=0x5611f4052e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5611f4050a10 0x5611f4052e00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f40036950 msgr2=0x7f1f40038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1f40036950 0x7f1f40038e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2040054000 tx=0x7f204004e000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 msgr2=0x5611f4046f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 --2- 172.21.15.50:0/1980247955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611f3f4e4f0 0x5611f4046f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2048001e60 tx=0x7f2048000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f20586c3640 1 -- 172.21.15.50:0/1980247955 reap_dead start 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 shutdown_connections 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 >> 172.21.15.50:0/1980247955 conn(0x5611f3f48d30 msgr2=0x5611f40394d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 shutdown_connections 2024-05-07T13:56:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.321+0000 7f205c12b800 1 -- 172.21.15.50:0/1980247955 wait complete. 2024-05-07T13:56:08.319 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-07T13:56:08.319 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-07T13:56:08.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-07T13:56:08.319 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-07T13:56:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.379+0000 7f8cdd41f800 1 Processor -- start 2024-05-07T13:56:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.379+0000 7f8cdd41f800 1 -- start start 2024-05-07T13:56:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.380+0000 7f8cdd41f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55709ab776f0 0x55709ab79ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.380+0000 7f8cdd41f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55709ab7a020 con 0x55709ab73be0 2024-05-07T13:56:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.380+0000 7f8cdd41f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55709aa04050 con 0x55709ab776f0 2024-05-07T13:56:08.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.380+0000 7f8cda724640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55709ab776f0 0x55709ab79ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.380+0000 7f8cdaf25640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55709ab73be0 0x55709ab75fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39476/0 (socket says 172.21.15.50:39476) 2024-05-07T13:56:08.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.380+0000 7f8cdaf25640 1 -- 172.21.15.50:0/2484277856 learned_addr learned my addr 172.21.15.50:0/2484277856 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:08.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.380+0000 7f8cda724640 1 -- 172.21.15.50:0/2484277856 >> v1:172.21.15.22:6789/0 conn(0x55709ab73be0 legacy=0x55709ab75fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.380+0000 7f8cd9f23640 1 -- 172.21.15.50:0/2484277856 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435159485 0 0) 0x55709ab7a020 con 0x55709ab73be0 2024-05-07T13:56:08.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.380+0000 7f8cda724640 1 -- 172.21.15.50:0/2484277856 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709ab7b200 con 0x55709ab776f0 2024-05-07T13:56:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.382+0000 7f8cda724640 1 --2- 172.21.15.50:0/2484277856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab776f0 0x55709ab79ae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000a470 tx=0x7f8cd001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ff4ecc4f222f5c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.382+0000 7f8cd9f23640 1 -- 172.21.15.50:0/2484277856 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd0057070 con 0x55709ab776f0 2024-05-07T13:56:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.382+0000 7f8cd9f23640 1 -- 172.21.15.50:0/2484277856 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd0052570 con 0x55709ab776f0 2024-05-07T13:56:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.382+0000 7f8cd9f23640 1 -- 172.21.15.50:0/2484277856 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd0052870 con 0x55709ab776f0 2024-05-07T13:56:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.383+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2484277856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab776f0 msgr2=0x55709ab79ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.383+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/2484277856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab776f0 0x55709ab79ae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000a470 tx=0x7f8cd001ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.383+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2484277856 shutdown_connections 2024-05-07T13:56:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.383+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/2484277856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab776f0 0x55709ab79ae0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.383+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2484277856 >> 172.21.15.50:0/2484277856 conn(0x55709ab6d670 msgr2=0x55709ab6fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.383+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2484277856 shutdown_connections 2024-05-07T13:56:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.383+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2484277856 wait complete. 2024-05-07T13:56:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.398+0000 7f8cdd41f800 1 Processor -- start 2024-05-07T13:56:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.399+0000 7f8cdd41f800 1 -- start start 2024-05-07T13:56:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.399+0000 7f8cdd41f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ab73520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.399+0000 7f8cdd41f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55709aabe1f0 con 0x55709ab73be0 2024-05-07T13:56:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.399+0000 7f8cdaf25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ab73520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.399+0000 7f8cdaf25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ab73520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44446/0 (socket says 172.21.15.50:44446) 2024-05-07T13:56:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.399+0000 7f8cdaf25640 1 -- 172.21.15.50:0/1011006377 learned_addr learned my addr 172.21.15.50:0/1011006377 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.399+0000 7f8cdaf25640 1 -- 172.21.15.50:0/1011006377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709ab71ae0 con 0x55709ab73be0 2024-05-07T13:56:08.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.400+0000 7f8cdaf25640 1 --2- 172.21.15.50:0/1011006377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ab73520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00b210 tx=0x7f8ccc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9408a77938f754 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.400+0000 7f8bc8e09640 1 -- 172.21.15.50:0/1011006377 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc008070 con 0x55709ab73be0 2024-05-07T13:56:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.400+0000 7f8bc8e09640 1 -- 172.21.15.50:0/1011006377 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00d500 con 0x55709ab73be0 2024-05-07T13:56:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.400+0000 7f8bc8e09640 1 -- 172.21.15.50:0/1011006377 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc00d840 con 0x55709ab73be0 2024-05-07T13:56:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.400+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1011006377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 msgr2=0x55709ab73520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.400+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/1011006377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ab73520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00b210 tx=0x7f8ccc00b6d0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.400+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1011006377 shutdown_connections 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.400+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/1011006377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ab73520 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.400+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1011006377 >> 172.21.15.50:0/1011006377 conn(0x55709ab6d670 msgr2=0x55709ac5ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.401+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1011006377 shutdown_connections 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.401+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1011006377 wait complete. 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.401+0000 7f8cdd41f800 1 Processor -- start 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.401+0000 7f8cdd41f800 1 -- start start 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.401+0000 7f8cdd41f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ac6e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.401+0000 7f8cdd41f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55709ab7a4f0 con 0x55709ab73be0 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.401+0000 7f8cdaf25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ac6e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.401+0000 7f8cdaf25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ac6e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44452/0 (socket says 172.21.15.50:44452) 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.401+0000 7f8cdaf25640 1 -- 172.21.15.50:0/3604046669 learned_addr learned my addr 172.21.15.50:0/3604046669 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.402+0000 7f8cdaf25640 1 -- 172.21.15.50:0/3604046669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709ac6e8b0 con 0x55709ab73be0 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.402+0000 7f8cdaf25640 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ac6e370 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc001e60 tx=0x7f8ccc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.402+0000 7f8bc7606640 1 -- 172.21.15.50:0/3604046669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc019870 con 0x55709ab73be0 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.402+0000 7f8bc7606640 1 -- 172.21.15.50:0/3604046669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ccc019a10 con 0x55709ab73be0 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.402+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55709ac6eb40 con 0x55709ab73be0 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.402+0000 7f8bc7606640 1 -- 172.21.15.50:0/3604046669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc019cf0 con 0x55709ab73be0 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.402+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709ac717f0 con 0x55709ab73be0 2024-05-07T13:56:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8cdd41f800 1 Processor -- start 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8cdd41f800 1 -- start start 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8bc7606640 1 -- 172.21.15.50:0/3604046669 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8ccc017040 con 0x55709ab73be0 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8cdd41f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac7c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8cdd41f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55709aa64cf0 con 0x55709ac7bc20 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8bc7606640 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bc0036900 0x7f8bc0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8bc7606640 1 -- 172.21.15.50:0/3604046669 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8ccc015020 con 0x55709ab73be0 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8cdb726640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac7c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8cdaf25640 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bc0036900 0x7f8bc0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8cdb726640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac7c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44456/0 (socket says 172.21.15.50:44456) 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8cdb726640 1 -- 172.21.15.50:0/1054068074 learned_addr learned my addr 172.21.15.50:0/1054068074 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.403+0000 7f8cdb726640 1 -- 172.21.15.50:0/1054068074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709ac7c580 con 0x55709ac7bc20 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8cdaf25640 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bc0036900 0x7f8bc0038dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00e910 tx=0x7f8ccc019f50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8cdb726640 1 --2- 172.21.15.50:0/1054068074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac7c040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400a430 tx=0x7f8cd400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffea9b61078e882 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8bc5602640 1 -- 172.21.15.50:0/1054068074 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4015070 con 0x55709ac7bc20 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8bc5602640 1 -- 172.21.15.50:0/1054068074 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd4001670 con 0x55709ac7bc20 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8bc5602640 1 -- 172.21.15.50:0/1054068074 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4001990 con 0x55709ac7bc20 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1054068074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 msgr2=0x55709ac7c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/1054068074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac7c040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400a430 tx=0x7f8cd400a8f0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1054068074 shutdown_connections 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/1054068074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac7c040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1054068074 >> 172.21.15.50:0/1054068074 conn(0x55709ab776f0 msgr2=0x55709ac786c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1054068074 shutdown_connections 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.404+0000 7f8cdd41f800 1 -- 172.21.15.50:0/1054068074 wait complete. 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.405+0000 7f8cdd41f800 1 Processor -- start 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.405+0000 7f8cdd41f800 1 -- start start 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.405+0000 7f8cdd41f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac83180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.405+0000 7f8cdd41f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55709ac7cf10 con 0x55709ac7bc20 2024-05-07T13:56:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.405+0000 7f8cdb726640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac83180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.405+0000 7f8cdb726640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac83180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44470/0 (socket says 172.21.15.50:44470) 2024-05-07T13:56:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.405+0000 7f8cdb726640 1 -- 172.21.15.50:0/818257565 learned_addr learned my addr 172.21.15.50:0/818257565 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.405+0000 7f8cdb726640 1 -- 172.21.15.50:0/818257565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709ac836c0 con 0x55709ac7bc20 2024-05-07T13:56:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.405+0000 7f8cdb726640 1 --2- 172.21.15.50:0/818257565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac83180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400a930 tx=0x7f8cd4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.406+0000 7f8bbf7fe640 1 -- 172.21.15.50:0/818257565 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4020020 con 0x55709ac7bc20 2024-05-07T13:56:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.406+0000 7f8bbf7fe640 1 -- 172.21.15.50:0/818257565 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd40108b0 con 0x55709ac7bc20 2024-05-07T13:56:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.406+0000 7f8cdd41f800 1 -- 172.21.15.50:0/818257565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55709ac83950 con 0x55709ac7bc20 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.406+0000 7f8bbf7fe640 1 -- 172.21.15.50:0/818257565 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4015040 con 0x55709ac7bc20 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.406+0000 7f8cdd41f800 1 -- 172.21.15.50:0/818257565 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709ac86600 con 0x55709ac7bc20 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.406+0000 7f8bbf7fe640 1 -- 172.21.15.50:0/818257565 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8cd4023020 con 0x55709ac7bc20 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.407+0000 7f8bbf7fe640 1 --2- 172.21.15.50:0/818257565 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bb4036950 0x7f8bb4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.407+0000 7f8bbf7fe640 1 -- 172.21.15.50:0/818257565 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8cd404bfc0 con 0x55709ac7bc20 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.407+0000 7f8cda724640 1 --2- 172.21.15.50:0/818257565 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bb4036950 0x7f8bb4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.407+0000 7f8cdd41f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.407+0000 7f8cdd41f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.407+0000 7f8cda724640 1 --2- 172.21.15.50:0/818257565 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bb4036950 0x7f8bb4038e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0054000 tx=0x7f8cd004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.407+0000 7f8cdd41f800 1 Processor -- start 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.408+0000 7f8cdd41f800 1 -- start start 2024-05-07T13:56:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.408+0000 7f8cdd41f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac9d870 0x55709ac9dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.408+0000 7f8cdd41f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55709ab71e60 con 0x55709ac9d870 2024-05-07T13:56:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.408+0000 7f8cdaf25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac9d870 0x55709ac9dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.408+0000 7f8cdaf25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac9d870 0x55709ac9dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44476/0 (socket says 172.21.15.50:44476) 2024-05-07T13:56:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.408+0000 7f8cdaf25640 1 -- 172.21.15.50:0/2758964637 learned_addr learned my addr 172.21.15.50:0/2758964637 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.408+0000 7f8cdaf25640 1 -- 172.21.15.50:0/2758964637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709ac9e1d0 con 0x55709ac9d870 2024-05-07T13:56:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.408+0000 7f8cdaf25640 1 --2- 172.21.15.50:0/2758964637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac9d870 0x55709ac9dc90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc04b3e0 tx=0x7f8ccc01b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.409+0000 7f8b9f7e6640 1 -- 172.21.15.50:0/2758964637 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc00f610 con 0x55709ac9d870 2024-05-07T13:56:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.409+0000 7f8b9f7e6640 1 -- 172.21.15.50:0/2758964637 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00f7b0 con 0x55709ac9d870 2024-05-07T13:56:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.409+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2758964637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55709ac9ec40 con 0x55709ac9d870 2024-05-07T13:56:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.409+0000 7f8b9f7e6640 1 -- 172.21.15.50:0/2758964637 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ccc00cc30 con 0x55709ac9d870 2024-05-07T13:56:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.409+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2758964637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709ac9f140 con 0x55709ac9d870 2024-05-07T13:56:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.409+0000 7f8b9f7e6640 1 -- 172.21.15.50:0/2758964637 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8ccc01c440 con 0x55709ac9d870 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.409+0000 7f8b9f7e6640 1 --2- 172.21.15.50:0/2758964637 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b1c036950 0x7f8b1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.410+0000 7f8b9f7e6640 1 -- 172.21.15.50:0/2758964637 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8ccc043070 con 0x55709ac9d870 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.410+0000 7f8cda724640 1 --2- 172.21.15.50:0/2758964637 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b1c036950 0x7f8b1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.410+0000 7f8b9d7e2640 20 reqs_thread_entry: start 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.410+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55709acab4d0 0x55709acad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.410+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55709acae030 con 0x55709acab4d0 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.410+0000 7f8cda724640 1 --2- 172.21.15.50:0/2758964637 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b1c036950 0x7f8b1c038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0052540 tx=0x7f8cd0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.410+0000 7f8cdb726640 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55709acab4d0 0x55709acad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.410+0000 7f8cdb726640 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55709acab4d0 0x55709acad960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.411+0000 7f8cdb726640 1 -- 172.21.15.50:0/3604046669 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8cd4010d70 con 0x55709acab4d0 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.411+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55709acafe00 0x55709acb21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.411+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:2 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55709acb2930 con 0x55709acafe00 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.411+0000 7f8cdaf25640 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55709acafe00 0x55709acb21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.411+0000 7f8cdaf25640 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55709acafe00 0x55709acb21f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.411+0000 7f8cdaf25640 1 -- 172.21.15.50:0/3604046669 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(2 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ccc02d070 con 0x55709acafe00 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.412+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55709acb77d0 con 0x55709acafe00 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.413+0000 7f8cdaf25640 1 -- 172.21.15.50:0/3604046669 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [stat,call,call,writefull 0~993] v27'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f8ccc02d070 con 0x55709acafe00 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/818257565 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bb4036950 msgr2=0x7f8bb4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/818257565 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bb4036950 0x7f8bb4038e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0054000 tx=0x7f8cd004e000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/818257565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 msgr2=0x55709ac83180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/818257565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac83180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400a930 tx=0x7f8cd4003370 comp rx=0 tx=0).stop 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/818257565 shutdown_connections 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/818257565 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bb4036950 0x7f8bb4038e10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/818257565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac7bc20 0x55709ac83180 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/818257565 >> 172.21.15.50:0/818257565 conn(0x55709ab776f0 msgr2=0x55709ac75d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/818257565 shutdown_connections 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/818257565 wait complete. 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2758964637 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b1c036950 msgr2=0x7f8b1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/2758964637 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b1c036950 0x7f8b1c038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0052540 tx=0x7f8cd0005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2758964637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac9d870 msgr2=0x55709ac9dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/2758964637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac9d870 0x55709ac9dc90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc04b3e0 tx=0x7f8ccc01b540 comp rx=0 tx=0).stop 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2758964637 shutdown_connections 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/2758964637 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8b1c036950 0x7f8b1c038e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/2758964637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ac9d870 0x55709ac9dc90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2758964637 >> 172.21.15.50:0/2758964637 conn(0x55709ac922f0 msgr2=0x55709ac92d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2758964637 shutdown_connections 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.414+0000 7f8cdd41f800 1 -- 172.21.15.50:0/2758964637 wait complete. 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55709acab4d0 msgr2=0x55709acad960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55709acab4d0 0x55709acad960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55709acafe00 msgr2=0x55709acb21f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55709acafe00 0x55709acb21f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bc0036900 msgr2=0x7f8bc0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bc0036900 0x7f8bc0038dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00e910 tx=0x7f8ccc019f50 comp rx=0 tx=0).stop 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 msgr2=0x55709ac6e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ac6e370 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc001e60 tx=0x7f8ccc000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 shutdown_connections 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55709acafe00 0x55709acb21f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55709acab4d0 0x55709acad960 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8bc0036900 0x7f8bc0038dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 --2- 172.21.15.50:0/3604046669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55709ab73be0 0x55709ac6e370 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 >> 172.21.15.50:0/3604046669 conn(0x55709ab6d670 msgr2=0x55709ab723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 shutdown_connections 2024-05-07T13:56:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.415+0000 7f8cdd41f800 1 -- 172.21.15.50:0/3604046669 wait complete. 2024-05-07T13:56:08.414 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-07T13:56:08.414 DEBUG:tasks.util.rgw: json result: {'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-07T13:56:08.415 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-07T13:56:08.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-07T13:56:08.416 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-07T13:56:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.471+0000 7fa001933800 1 Processor -- start 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.471+0000 7fa001933800 1 -- start start 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.472+0000 7fa001933800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558e39fc0570 0x558e39fc2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.472+0000 7fa001933800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e39fc2f30 con 0x558e39fbc130 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.472+0000 7fa001933800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x558e39e4d050 con 0x558e39fc0570 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.472+0000 7f9ffcdd7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558e39fc0570 0x558e39fc2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.472+0000 7f9ffd5d8640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x558e39fbc130 0x558e39fbc550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39488/0 (socket says 172.21.15.50:39488) 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.472+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/1313321420 learned_addr learned my addr 172.21.15.50:0/1313321420 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.472+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/1313321420 >> v1:172.21.15.22:6789/0 conn(0x558e39fbc130 legacy=0x558e39fbc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.472+0000 7f9feffff640 1 -- 172.21.15.50:0/1313321420 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67612616 0 0) 0x558e39fc2f30 con 0x558e39fbc130 2024-05-07T13:56:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.472+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/1313321420 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e39fc4160 con 0x558e39fc0570 2024-05-07T13:56:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.474+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/1313321420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fc0570 0x558e39fc2960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400a470 tx=0x7f9ff401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c840bd2f072c7e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.474+0000 7f9feffff640 1 -- 172.21.15.50:0/1313321420 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff4057070 con 0x558e39fc0570 2024-05-07T13:56:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.474+0000 7f9feffff640 1 -- 172.21.15.50:0/1313321420 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4052570 con 0x558e39fc0570 2024-05-07T13:56:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.474+0000 7f9feffff640 1 -- 172.21.15.50:0/1313321420 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff4052870 con 0x558e39fc0570 2024-05-07T13:56:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.475+0000 7fa001933800 1 -- 172.21.15.50:0/1313321420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fc0570 msgr2=0x558e39fc2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.475+0000 7fa001933800 1 --2- 172.21.15.50:0/1313321420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fc0570 0x558e39fc2960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400a470 tx=0x7f9ff401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.475+0000 7fa001933800 1 -- 172.21.15.50:0/1313321420 shutdown_connections 2024-05-07T13:56:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.475+0000 7fa001933800 1 --2- 172.21.15.50:0/1313321420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fc0570 0x558e39fc2960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.475+0000 7fa001933800 1 -- 172.21.15.50:0/1313321420 >> 172.21.15.50:0/1313321420 conn(0x558e39fb7770 msgr2=0x558e39fb9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.475+0000 7fa001933800 1 -- 172.21.15.50:0/1313321420 shutdown_connections 2024-05-07T13:56:08.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.475+0000 7fa001933800 1 -- 172.21.15.50:0/1313321420 wait complete. 2024-05-07T13:56:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.490+0000 7fa001933800 1 Processor -- start 2024-05-07T13:56:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.490+0000 7fa001933800 1 -- start start 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.490+0000 7fa001933800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.490+0000 7fa001933800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e39f071c0 con 0x558e39fbc130 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.490+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.490+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44484/0 (socket says 172.21.15.50:44484) 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.490+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/2209825308 learned_addr learned my addr 172.21.15.50:0/2209825308 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.491+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/2209825308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3a0ad9e0 con 0x558e39fbc130 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.491+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/2209825308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0ad410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000b240 tx=0x7f9ff000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423fdada53741b91 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.491+0000 7f9eeb606640 1 -- 172.21.15.50:0/2209825308 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff0008070 con 0x558e39fbc130 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.491+0000 7f9eeb606640 1 -- 172.21.15.50:0/2209825308 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff000d500 con 0x558e39fbc130 2024-05-07T13:56:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.491+0000 7f9eeb606640 1 -- 172.21.15.50:0/2209825308 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff000d860 con 0x558e39fbc130 2024-05-07T13:56:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 -- 172.21.15.50:0/2209825308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 msgr2=0x558e3a0ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 --2- 172.21.15.50:0/2209825308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0ad410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000b240 tx=0x7f9ff000b700 comp rx=0 tx=0).stop 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 -- 172.21.15.50:0/2209825308 shutdown_connections 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 --2- 172.21.15.50:0/2209825308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0ad410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 -- 172.21.15.50:0/2209825308 >> 172.21.15.50:0/2209825308 conn(0x558e39fb7770 msgr2=0x558e3a0a8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 -- 172.21.15.50:0/2209825308 shutdown_connections 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 -- 172.21.15.50:0/2209825308 wait complete. 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 Processor -- start 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 -- start start 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.492+0000 7fa001933800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e39fc3400 con 0x558e39fbc130 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44490/0 (socket says 172.21.15.50:44490) 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3343291197 learned_addr learned my addr 172.21.15.50:0/3343291197 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3343291197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3a0b5560 con 0x558e39fbc130 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0b5020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x558e3a0ae1a0 tx=0x7f9ff0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7f9ee9e03640 1 -- 172.21.15.50:0/3343291197 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff0019870 con 0x558e39fbc130 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7f9ee9e03640 1 -- 172.21.15.50:0/3343291197 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff0019a10 con 0x558e39fbc130 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e3a0b57f0 con 0x558e39fbc130 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7f9ee9e03640 1 -- 172.21.15.50:0/3343291197 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff0019d30 con 0x558e39fbc130 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.493+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3a0b8450 con 0x558e39fbc130 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.494+0000 7f9ee9e03640 1 -- 172.21.15.50:0/3343291197 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9ff0017040 con 0x558e39fbc130 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.494+0000 7f9ee9e03640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ee4036950 0x7f9ee4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.494+0000 7f9ee9e03640 1 -- 172.21.15.50:0/3343291197 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9ff0015020 con 0x558e39fbc130 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.494+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ee4036950 0x7f9ee4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.494+0000 7fa001933800 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e39fc0570 0x558e3a0bc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.494+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0bc7a0 con 0x558e39fc0570 2024-05-07T13:56:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.495+0000 7f9ffddd9640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e39fc0570 0x558e3a0bc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.495+0000 7f9ffddd9640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e39fc0570 0x558e3a0bc210 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.495+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ee4036950 0x7f9ee4038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4054000 tx=0x7f9ff404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.495+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3343291197 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e39fc0570 2024-05-07T13:56:08.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.495+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0b97c0 con 0x558e39fc0570 2024-05-07T13:56:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.495+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3343291197 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e39fc0570 2024-05-07T13:56:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.496+0000 7fa001933800 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0bead0 0x558e3a0c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.496+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0c1560 con 0x558e3a0bead0 2024-05-07T13:56:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.496+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0bead0 0x558e3a0c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.496+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0bead0 0x558e3a0c0ec0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.496+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3343291197 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9ff002d070 con 0x558e3a0bead0 2024-05-07T13:56:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.496+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0bda80 con 0x558e39fc0570 2024-05-07T13:56:08.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.496+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3343291197 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e39fc0570 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.497+0000 7fa001933800 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e3a0c2a10 0x558e3a0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.497+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0c55c0 con 0x558e3a0c2a10 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.497+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e3a0c2a10 0x558e3a0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.497+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e3a0c2a10 0x558e3a0c4e60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.497+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3343291197 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9ff405a040 con 0x558e3a0c2a10 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.498+0000 7fa001933800 1 Processor -- start 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.498+0000 7fa001933800 1 -- start start 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.498+0000 7fa001933800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39f31a60 0x558e39f2fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.498+0000 7fa001933800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e39eadcf0 con 0x558e39f31a60 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.498+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39f31a60 0x558e39f2fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.498+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39f31a60 0x558e39f2fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44496/0 (socket says 172.21.15.50:44496) 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.498+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/1791403680 learned_addr learned my addr 172.21.15.50:0/1791403680 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.498+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/1791403680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e39f30410 con 0x558e39f31a60 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.498+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/1791403680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39f31a60 0x558e39f2fed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9ff004b480 tx=0x7f9ff000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.499+0000 7f9ee2ffd640 1 -- 172.21.15.50:0/1791403680 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff0044a50 con 0x558e39f31a60 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.499+0000 7f9ee2ffd640 1 -- 172.21.15.50:0/1791403680 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff0044bf0 con 0x558e39f31a60 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.499+0000 7fa001933800 1 -- 172.21.15.50:0/1791403680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e39f306a0 con 0x558e39f31a60 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.499+0000 7f9ee2ffd640 1 -- 172.21.15.50:0/1791403680 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff0044ed0 con 0x558e39f31a60 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.499+0000 7fa001933800 1 -- 172.21.15.50:0/1791403680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e39f30ba0 con 0x558e39f31a60 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.499+0000 7f9ee2ffd640 1 -- 172.21.15.50:0/1791403680 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9ff003f1b0 con 0x558e39f31a60 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.499+0000 7f9ee2ffd640 1 --2- 172.21.15.50:0/1791403680 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ed4036950 0x7f9ed4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7f9ee2ffd640 1 -- 172.21.15.50:0/1791403680 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9ff003cc70 con 0x558e39f31a60 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/1791403680 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ed4036950 0x7f9ed4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7fa001933800 1 Processor -- start 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7fa001933800 1 -- start start 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/1791403680 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ed4036950 0x7f9ed4038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x558e3a0b9700 tx=0x7f9ff4005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7fa001933800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0e3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7fa001933800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e3a0add60 con 0x558e3a0e2f70 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0e3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44512/0 (socket says 172.21.15.50:44512) 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.500+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3212871032 learned_addr learned my addr 172.21.15.50:0/3212871032 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3212871032 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3a0e3960 con 0x558e3a0e2f70 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/3212871032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0e3390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0042fd0 tx=0x7f9ff0026610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137874fac4ae972e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7f9ee0ff9640 1 -- 172.21.15.50:0/3212871032 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff0027df0 con 0x558e3a0e2f70 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7f9ee0ff9640 1 -- 172.21.15.50:0/3212871032 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff0030d50 con 0x558e3a0e2f70 2024-05-07T13:56:08.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7f9ee0ff9640 1 -- 172.21.15.50:0/3212871032 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff0040a00 con 0x558e3a0e2f70 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7fa001933800 1 -- 172.21.15.50:0/3212871032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 msgr2=0x558e3a0e3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7fa001933800 1 --2- 172.21.15.50:0/3212871032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0e3390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0042fd0 tx=0x7f9ff0026610 comp rx=0 tx=0).stop 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7fa001933800 1 -- 172.21.15.50:0/3212871032 shutdown_connections 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7fa001933800 1 --2- 172.21.15.50:0/3212871032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0e3390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7fa001933800 1 -- 172.21.15.50:0/3212871032 >> 172.21.15.50:0/3212871032 conn(0x558e3a0df1f0 msgr2=0x558e3a0dd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7fa001933800 1 -- 172.21.15.50:0/3212871032 shutdown_connections 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.501+0000 7fa001933800 1 -- 172.21.15.50:0/3212871032 wait complete. 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.502+0000 7fa001933800 1 Processor -- start 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.502+0000 7fa001933800 1 -- start start 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.502+0000 7fa001933800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.502+0000 7fa001933800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e3a0e3fd0 con 0x558e3a0e2f70 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.502+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.502+0000 7f9ffd5d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0ea2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44514/0 (socket says 172.21.15.50:44514) 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.502+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 learned_addr learned my addr 172.21.15.50:0/3756798647 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.502+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3a0ea7f0 con 0x558e3a0e2f70 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.503+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0ea2b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9ff003cee0 tx=0x7f9ff001d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.503+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3756798647 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff001d040 con 0x558e3a0e2f70 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.503+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3756798647 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff006b030 con 0x558e3a0e2f70 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.503+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e3a0ea7f0 con 0x558e3a0e2f70 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.503+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3756798647 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff0032a80 con 0x558e3a0e2f70 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.503+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3a0ea7f0 con 0x558e3a0e2f70 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.504+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3756798647 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9ff0032c20 con 0x558e3a0e2f70 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.504+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.504+0000 7f9ed2ffd640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ec8036950 0x7f9ec8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.504+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3756798647 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9ff0071c80 con 0x558e3a0e2f70 2024-05-07T13:56:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.504+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ec8036950 0x7f9ec8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.504+0000 7fa001933800 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e3a0f58b0 0x558e3a0f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.504+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f84a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7f9ffddd9640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e3a0f58b0 0x558e3a0f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7f9ffddd9640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e3a0f58b0 0x558e3a0f7d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ec8036950 0x7f9ec8038e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ff401ced0 tx=0x7f9ff404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7fa001933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7fa001933800 20 realm 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f88b0 con 0x558e3a0f58b0 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7fa001933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7fa001933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.505+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f9150 con 0x558e3a0f58b0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7fa001933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x558e3a0f58b0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7fa001933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7fa001933800 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0fa250 0x558e3a0fc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0fcb80 con 0x558e3a0fa250 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0fa250 0x558e3a0fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.506+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0fa250 0x558e3a0fc640 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.507+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.507+0000 7fa001933800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.507+0000 7fa001933800 20 searching for the correct realm 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.507+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0fe530 con 0x558e3a0fa250 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.507+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.507+0000 7f9ffd5d8640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9ff0056040 0x7f9ff001ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.507+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0fe530 con 0x7f9ff0056040 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.507+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9ff0056040 0x7f9ff001ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.508+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9ff0056040 0x7f9ff001ca70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.508+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.508+0000 7f9ffcdd7640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9ff4083040 0x7f9ff4075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.508+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0fe530 con 0x7f9ff4083040 2024-05-07T13:56:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.508+0000 7f9ffddd9640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9ff4083040 0x7f9ff4075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.508+0000 7f9ffddd9640 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9ff4083040 0x7f9ff4075430 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.509+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.509+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x558e3a0f58b0 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.509+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.509+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x558e3a0f58b0 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.509+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.509+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x7f9ff4083040 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.509+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.509+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x7f9ff4083040 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.510+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.510+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x7f9ff0056040 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.510+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.510+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x558e3a0fa250 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.510+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.510+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x558e3a0f58b0 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.510+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.510+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x7f9ff4083040 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.511+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.511+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x558e3a0f58b0 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.511+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.511+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x7f9ff0056040 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.511+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.511+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x558e3a0fa250 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.511+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.511+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0f94f0 con 0x558e3a0fa250 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.512+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.512+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x7f9ff4083040 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.512+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.512+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x558e3a0fa250 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.512+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.512+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x558e3a0fa250 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.512+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.513+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x558e3a0f58b0 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.513+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.513+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x558e3a0f58b0 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.513+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.513+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x7f9ff4083040 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.513+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.513+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x558e3a0fa250 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.514+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.514+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x7f9ff0056040 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.514+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.514+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x558e3a0f58b0 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.514+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.514+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x7f9ff4083040 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.515+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.515+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x558e3a0fa250 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.515+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.515+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x7f9ff4083040 2024-05-07T13:56:08.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.515+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.515+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x7f9ff0056040 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.515+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.515+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x558e3a0fa250 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x7f9ff4083040 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x558e3a0f58b0 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f9ff0088080 con 0x7f9ff0056040 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7fa001933800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:08.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7fa001933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7fa001933800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7fa001933800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7fa001933800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7fa001933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.516+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0fd500 con 0x558e3a0f58b0 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0fd8f0 con 0x558e3a0f58b0 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0fd8f0 con 0x7f9ff4083040 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 20 zone default found 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 4 Realm: () 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 20 zonegroup default 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0fdd10 con 0x7f9ff4083040 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.517+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0fe130 con 0x558e3a0fa250 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a1003e0 con 0x558e3a0fa250 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 20 started sync module instance, tier type = 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.518+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a0ff880 con 0x7f9ff0056040 2024-05-07T13:56:08.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.519+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.519+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069347843232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a100c30 con 0x7f9ff0056040 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.519+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a101480 con 0x558e3a0f58b0 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.520+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94069347843232] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.520+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.520+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94069347846016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a101480 con 0x558e3a0f58b0 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.520+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a101f50 con 0x558e3a0fa250 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.521+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94069347846016] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.522+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.522+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94069347848144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a1013f0 con 0x558e3a0fa250 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.522+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a102e10 con 0x7f9ff0056040 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.522+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94069347848144] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.523+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.523+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94069347853120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a1036b0 con 0x7f9ff0056040 2024-05-07T13:56:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.523+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a104070 con 0x558e3a0f58b0 2024-05-07T13:56:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.524+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.524+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069347859872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a1047f0 con 0x558e3a0f58b0 2024-05-07T13:56:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.524+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a105310 con 0x7f9ff4083040 2024-05-07T13:56:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.524+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94069347853120] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.525+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94069347859872] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.525+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.525+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069347864032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a1052d0 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.525+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a105bb0 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.526+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94069347864032] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.526+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.526+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94069347856896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a1052d0 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.526+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a1052d0 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94069347856896] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069347866288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a106180 con 0x7f9ff4083040 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7fa001933800 20 add_watcher() i=0 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7fa001933800 20 add_watcher() i=1 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7fa001933800 20 add_watcher() i=2 2024-05-07T13:56:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7fa001933800 20 add_watcher() i=3 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7fa001933800 20 add_watcher() i=4 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7fa001933800 20 add_watcher() i=5 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.527+0000 7fa001933800 20 add_watcher() i=6 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.528+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94069347866288] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.528+0000 7fa001933800 20 add_watcher() i=7 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.528+0000 7fa001933800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.528+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a1095b0 con 0x558e3a0f58b0 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.528+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.528+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94069347868320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a106ad0 con 0x558e3a0f58b0 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.529+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94069347868320] v27'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.529+0000 7f9eb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.529+0000 7fa001933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.529+0000 7fa001933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.529+0000 7fa001933800 5 note: GC not initialized 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.530+0000 7f9eb27e4640 20 reqs_thread_entry: start 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.530+0000 7fa001933800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.530+0000 7fa001933800 20 Filter name: none 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.530+0000 7f9e23fff640 20 reqs_thread_entry: start 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.530+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d090 con 0x558e3a0f58b0 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.530+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.530+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d050 con 0x7f9ff0056040 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.531+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.531+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.531+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.531+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.531+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.531+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.531+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.531+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.532+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.532+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.532+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.532+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.532+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.532+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.532+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.532+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.533+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.533+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.533+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.533+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.533+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.533+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff0056040 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.534+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.534+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.534+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.534+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.534+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.534+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.535+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.535+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.535+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.535+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.535+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.535+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.535+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.535+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.536+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.536+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.536+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.536+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff0056040 2024-05-07T13:56:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.536+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.536+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.536+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.537+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.537+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.537+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.537+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.537+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.537+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.537+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.537+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.537+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.538+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.538+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.538+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.538+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.538+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.538+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.538+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.538+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.539+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.540+0000 7f9eb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.540+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94069347868320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.540+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94069347868320] v27'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.540+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94069347843232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff0056040 2024-05-07T13:56:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.541+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94069347843232] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.541+0000 7fa001933800 20 remove_watcher() i=0 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.541+0000 7fa001933800 2 removed watcher, disabling cache 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.541+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94069347846016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.542+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94069347846016] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.543+0000 7fa001933800 20 remove_watcher() i=1 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.543+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94069347848144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0fa250 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.543+0000 7f9ffd5d8640 1 -- 172.21.15.50:0/3756798647 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94069347848144] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff0077070 con 0x558e3a0fa250 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.544+0000 7fa001933800 20 remove_watcher() i=2 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.544+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94069347853120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff0056040 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.544+0000 7f9ffcdd7640 1 -- 172.21.15.50:0/3756798647 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94069347853120] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff4070030 con 0x7f9ff0056040 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.544+0000 7fa001933800 20 remove_watcher() i=3 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.544+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94069347859872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x558e3a0f58b0 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.546+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94069347859872] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x558e3a0f58b0 2024-05-07T13:56:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.546+0000 7fa001933800 20 remove_watcher() i=4 2024-05-07T13:56:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.546+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94069347864032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.547+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94069347864032] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.547+0000 7fa001933800 20 remove_watcher() i=5 2024-05-07T13:56:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.547+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94069347856896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.548+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94069347856896] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.548+0000 7fa001933800 20 remove_watcher() i=6 2024-05-07T13:56:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.548+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94069347866288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558e3a13d510 con 0x7f9ff4083040 2024-05-07T13:56:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.548+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94069347866288] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ff800a4a0 con 0x7f9ff4083040 2024-05-07T13:56:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.548+0000 7fa001933800 20 remove_watcher() i=7 2024-05-07T13:56:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9ff4083040 msgr2=0x7f9ff4075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9ff4083040 0x7f9ff4075430 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e3a0f58b0 msgr2=0x558e3a0f7d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e3a0f58b0 0x558e3a0f7d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9ff0056040 msgr2=0x7f9ff001ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9ff0056040 0x7f9ff001ca70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0fa250 msgr2=0x558e3a0fc640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0fa250 0x558e3a0fc640 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ec8036950 msgr2=0x7f9ec8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ec8036950 0x7f9ec8038e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ff401ced0 tx=0x7f9ff404f000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 msgr2=0x558e3a0ea2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3756798647 reap_dead start 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0ea2b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9ff003cee0 tx=0x7f9ff001d470 comp rx=0 tx=0).stop 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 shutdown_connections 2024-05-07T13:56:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/3756798647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e3a0e2f70 0x558e3a0ea2b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 >> 172.21.15.50:0/3756798647 conn(0x558e3a0df1f0 msgr2=0x558e3a0dc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 shutdown_connections 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/3756798647 wait complete. 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/1791403680 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ed4036950 msgr2=0x7f9ed4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/1791403680 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ed4036950 0x7f9ed4038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x558e3a0b9700 tx=0x7f9ff4005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/1791403680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39f31a60 msgr2=0x558e39f2fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/1791403680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39f31a60 0x558e39f2fed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9ff004b480 tx=0x7f9ff000ed40 comp rx=0 tx=0).stop 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/1791403680 shutdown_connections 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/1791403680 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ed4036950 0x7f9ed4038e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 --2- 172.21.15.50:0/1791403680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39f31a60 0x558e39f2fed0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/1791403680 >> 172.21.15.50:0/1791403680 conn(0x558e3a0c7ac0 msgr2=0x558e3a0c7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/1791403680 shutdown_connections 2024-05-07T13:56:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.549+0000 7fa001933800 1 -- 172.21.15.50:0/1791403680 wait complete. 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e3a0c2a10 msgr2=0x558e3a0c4e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e3a0c2a10 0x558e3a0c4e60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e39fc0570 msgr2=0x558e3a0bc210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e39fc0570 0x558e3a0bc210 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0bead0 msgr2=0x558e3a0c0ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e3a0bead0 0x558e3a0c0ec0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ee4036950 msgr2=0x7f9ee4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9ee4036950 0x7f9ee4038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4054000 tx=0x7f9ff404e000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 msgr2=0x558e3a0b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 --2- 172.21.15.50:0/3343291197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e39fbc130 0x558e3a0b5020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x558e3a0ae1a0 tx=0x7f9ff0000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7f9ffddd9640 1 -- 172.21.15.50:0/3343291197 reap_dead start 2024-05-07T13:56:08.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 shutdown_connections 2024-05-07T13:56:08.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 >> 172.21.15.50:0/3343291197 conn(0x558e39fb7770 msgr2=0x558e3a0a7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 shutdown_connections 2024-05-07T13:56:08.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.550+0000 7fa001933800 1 -- 172.21.15.50:0/3343291197 wait complete. 2024-05-07T13:56:08.552 INFO:teuthology.orchestra.run.smithi050.stdout:{"entries":[],"summary":[]} 2024-05-07T13:56:08.553 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-07T13:56:08.553 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-07T13:56:08.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-07T13:56:08.553 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-07T13:56:08.639 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:08.639 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:08.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.651+0000 7f461d519800 1 Processor -- start 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.651+0000 7f461d519800 1 -- start start 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.651+0000 7f461d519800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5617b97cffd0 0x5617b97d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.651+0000 7f461d519800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617b97d0a70 con 0x5617b97d1230 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.651+0000 7f461d519800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5617b9662050 con 0x5617b97cffd0 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.652+0000 7f461b018640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5617b97cffd0 0x5617b97d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.652+0000 7f461a817640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5617b97d1230 0x5617b97d16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39490/0 (socket says 172.21.15.50:39490) 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.652+0000 7f461b018640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5617b97cffd0 0x5617b97d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44518/0 (socket says 172.21.15.50:44518) 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.652+0000 7f461a817640 1 -- 172.21.15.50:0/2724571870 learned_addr learned my addr 172.21.15.50:0/2724571870 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.652+0000 7f461b018640 1 -- 172.21.15.50:0/2724571870 >> v1:172.21.15.22:6789/0 conn(0x5617b97d1230 legacy=0x5617b97d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.652+0000 7f461b018640 1 -- 172.21.15.50:0/2724571870 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b97d1df0 con 0x5617b97cffd0 2024-05-07T13:56:08.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.652+0000 7f461a016640 1 -- 172.21.15.50:0/2724571870 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 857110141 0 0) 0x5617b97d0a70 con 0x5617b97d1230 2024-05-07T13:56:08.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.654+0000 7f461b018640 1 --2- 172.21.15.50:0/2724571870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b97d03f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f460c00a470 tx=0x7f460c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325a4c56432b0b74 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.654+0000 7f461a016640 1 -- 172.21.15.50:0/2724571870 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c057070 con 0x5617b97cffd0 2024-05-07T13:56:08.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.654+0000 7f461a016640 1 -- 172.21.15.50:0/2724571870 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c04adc0 con 0x5617b97cffd0 2024-05-07T13:56:08.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.654+0000 7f461a016640 1 -- 172.21.15.50:0/2724571870 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c052590 con 0x5617b97cffd0 2024-05-07T13:56:08.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.655+0000 7f461d519800 1 -- 172.21.15.50:0/2724571870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 msgr2=0x5617b97d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.655+0000 7f461d519800 1 --2- 172.21.15.50:0/2724571870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b97d03f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f460c00a470 tx=0x7f460c01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:08.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.655+0000 7f461d519800 1 -- 172.21.15.50:0/2724571870 shutdown_connections 2024-05-07T13:56:08.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.655+0000 7f461d519800 1 --2- 172.21.15.50:0/2724571870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b97d03f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.655+0000 7f461d519800 1 -- 172.21.15.50:0/2724571870 >> 172.21.15.50:0/2724571870 conn(0x5617b97cb5b0 msgr2=0x5617b97cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.655+0000 7f461d519800 1 -- 172.21.15.50:0/2724571870 shutdown_connections 2024-05-07T13:56:08.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.655+0000 7f461d519800 1 -- 172.21.15.50:0/2724571870 wait complete. 2024-05-07T13:56:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.670+0000 7f461d519800 1 Processor -- start 2024-05-07T13:56:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.670+0000 7f461d519800 1 -- start start 2024-05-07T13:56:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.670+0000 7f461d519800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b9743e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.670+0000 7f461d519800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5617b971c1d0 con 0x5617b97cffd0 2024-05-07T13:56:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.670+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b9743e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.670+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b9743e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44534/0 (socket says 172.21.15.50:44534) 2024-05-07T13:56:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.670+0000 7f461b018640 1 -- 172.21.15.50:0/2498948433 learned_addr learned my addr 172.21.15.50:0/2498948433 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.671+0000 7f461b018640 1 -- 172.21.15.50:0/2498948433 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b98c5370 con 0x5617b97cffd0 2024-05-07T13:56:08.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.671+0000 7f461b018640 1 --2- 172.21.15.50:0/2498948433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b9743e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f460c055040 tx=0x7f460c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a19a5834b352da server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.671+0000 7f450960a640 1 -- 172.21.15.50:0/2498948433 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c057040 con 0x5617b97cffd0 2024-05-07T13:56:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.671+0000 7f450960a640 1 -- 172.21.15.50:0/2498948433 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c063070 con 0x5617b97cffd0 2024-05-07T13:56:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.671+0000 7f450960a640 1 -- 172.21.15.50:0/2498948433 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c05d790 con 0x5617b97cffd0 2024-05-07T13:56:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 -- 172.21.15.50:0/2498948433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 msgr2=0x5617b9743e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 --2- 172.21.15.50:0/2498948433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b9743e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f460c055040 tx=0x7f460c04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 -- 172.21.15.50:0/2498948433 shutdown_connections 2024-05-07T13:56:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 --2- 172.21.15.50:0/2498948433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b9743e40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 -- 172.21.15.50:0/2498948433 >> 172.21.15.50:0/2498948433 conn(0x5617b97cb5b0 msgr2=0x5617b98bce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 -- 172.21.15.50:0/2498948433 shutdown_connections 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 -- 172.21.15.50:0/2498948433 wait complete. 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 Processor -- start 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 -- start start 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b98ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461d519800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5617b97d9700 con 0x5617b97cffd0 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b98ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b98ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44544/0 (socket says 172.21.15.50:44544) 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.672+0000 7f461b018640 1 -- 172.21.15.50:0/665043877 learned_addr learned my addr 172.21.15.50:0/665043877 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.673+0000 7f461b018640 1 -- 172.21.15.50:0/665043877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b98ca5b0 con 0x5617b97cffd0 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.673+0000 7f461b018640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b98ca070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f460c060040 tx=0x7f460c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.673+0000 7f4507e07640 1 -- 172.21.15.50:0/665043877 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c057050 con 0x5617b97cffd0 2024-05-07T13:56:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.673+0000 7f4507e07640 1 -- 172.21.15.50:0/665043877 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c05dcd0 con 0x5617b97cffd0 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.673+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617b98ca840 con 0x5617b97cffd0 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.673+0000 7f4507e07640 1 -- 172.21.15.50:0/665043877 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c052440 con 0x5617b97cffd0 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.673+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b98cd4f0 con 0x5617b97cffd0 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.674+0000 7f4507e07640 1 -- 172.21.15.50:0/665043877 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f460c052600 con 0x5617b97cffd0 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.674+0000 7f4507e07640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4500036950 0x7f4500038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.674+0000 7f4507e07640 1 -- 172.21.15.50:0/665043877 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f460c08dcc0 con 0x5617b97cffd0 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.674+0000 7f461a817640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4500036950 0x7f4500038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.675+0000 7f461d519800 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b97d1230 0x5617b98d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.675+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b98d17f0 con 0x5617b97d1230 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.675+0000 7f461b819640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b97d1230 0x5617b98d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.675+0000 7f461a817640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4500036950 0x7f4500038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4604000c00 tx=0x7f46040013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.675+0000 7f461b819640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b97d1230 0x5617b98d12b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.675+0000 7f461b819640 1 -- 172.21.15.50:0/665043877 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b97d1230 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.675+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b98ce860 con 0x5617b97d1230 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.675+0000 7f461b819640 1 -- 172.21.15.50:0/665043877 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b97d1230 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.675+0000 7f461d519800 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b98d3ae0 0x5617b98d5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.676+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b98d65a0 con 0x5617b98d3ae0 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.676+0000 7f461b018640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b98d3ae0 0x5617b98d5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.676+0000 7f461b018640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b98d3ae0 0x5617b98d5ed0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.676+0000 7f461b018640 1 -- 172.21.15.50:0/665043877 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f460c078070 con 0x5617b98d3ae0 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.676+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b98d2a90 con 0x5617b97d1230 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.676+0000 7f461b819640 1 -- 172.21.15.50:0/665043877 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b97d1230 2024-05-07T13:56:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.676+0000 7f461d519800 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5617b98d79e0 0x5617b98d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.676+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b98da630 con 0x5617b98d79e0 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.677+0000 7f461a817640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5617b98d79e0 0x5617b98d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.677+0000 7f461a817640 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5617b98d79e0 0x5617b98d9ea0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.677+0000 7f461a817640 1 -- 172.21.15.50:0/665043877 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f460400f670 con 0x5617b98d79e0 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.678+0000 7f461d519800 1 Processor -- start 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.678+0000 7f461d519800 1 -- start start 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.678+0000 7f461d519800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98c2f20 0x5617b98c1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.678+0000 7f461d519800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5617b96c2cf0 con 0x5617b98c2f20 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.678+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98c2f20 0x5617b98c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.678+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98c2f20 0x5617b98c1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44554/0 (socket says 172.21.15.50:44554) 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.678+0000 7f461b018640 1 -- 172.21.15.50:0/2954818404 learned_addr learned my addr 172.21.15.50:0/2954818404 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.678+0000 7f461b018640 1 -- 172.21.15.50:0/2954818404 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b98c18d0 con 0x5617b98c2f20 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.678+0000 7f461b018640 1 --2- 172.21.15.50:0/2954818404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98c2f20 0x5617b98c1390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f460c08c350 tx=0x7f460c052f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.679+0000 7f4505602640 1 -- 172.21.15.50:0/2954818404 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c076040 con 0x5617b98c2f20 2024-05-07T13:56:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.679+0000 7f4505602640 1 -- 172.21.15.50:0/2954818404 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c05ba80 con 0x5617b98c2f20 2024-05-07T13:56:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.679+0000 7f4505602640 1 -- 172.21.15.50:0/2954818404 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c05bda0 con 0x5617b98c2f20 2024-05-07T13:56:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.679+0000 7f461d519800 1 -- 172.21.15.50:0/2954818404 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617b98c1b60 con 0x5617b98c2f20 2024-05-07T13:56:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.679+0000 7f461d519800 1 -- 172.21.15.50:0/2954818404 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b98c1b60 con 0x5617b98c2f20 2024-05-07T13:56:08.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.679+0000 7f4505602640 1 -- 172.21.15.50:0/2954818404 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f460c05e900 con 0x5617b98c2f20 2024-05-07T13:56:08.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f4505602640 1 --2- 172.21.15.50:0/2954818404 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44f4036900 0x7f44f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f4505602640 1 -- 172.21.15.50:0/2954818404 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f460c086070 con 0x5617b98c2f20 2024-05-07T13:56:08.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f461a817640 1 --2- 172.21.15.50:0/2954818404 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44f4036900 0x7f44f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f461d519800 1 Processor -- start 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f461a817640 1 --2- 172.21.15.50:0/2954818404 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44f4036900 0x7f44f4038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x5617b98d1c80 tx=0x7f4604006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f461d519800 1 -- start start 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f461d519800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f461d519800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5617b98c5600 con 0x5617b98f7bd0 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98f7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44562/0 (socket says 172.21.15.50:44562) 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.680+0000 7f461b018640 1 -- 172.21.15.50:0/3780662356 learned_addr learned my addr 172.21.15.50:0/3780662356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f461b018640 1 -- 172.21.15.50:0/3780662356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b98f85c0 con 0x5617b98f7bd0 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f461b018640 1 --2- 172.21.15.50:0/3780662356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98f7ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f460c077000 tx=0x7f460c065410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4c9df9ad000bc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f44feffd640 1 -- 172.21.15.50:0/3780662356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c092040 con 0x5617b98f7bd0 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f44feffd640 1 -- 172.21.15.50:0/3780662356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c05b370 con 0x5617b98f7bd0 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f44feffd640 1 -- 172.21.15.50:0/3780662356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c0513a0 con 0x5617b98f7bd0 2024-05-07T13:56:08.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f461d519800 1 -- 172.21.15.50:0/3780662356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 msgr2=0x5617b98f7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f461d519800 1 --2- 172.21.15.50:0/3780662356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98f7ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f460c077000 tx=0x7f460c065410 comp rx=0 tx=0).stop 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f461d519800 1 -- 172.21.15.50:0/3780662356 shutdown_connections 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f461d519800 1 --2- 172.21.15.50:0/3780662356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98f7ff0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f461d519800 1 -- 172.21.15.50:0/3780662356 >> 172.21.15.50:0/3780662356 conn(0x5617b98f3f80 msgr2=0x5617b98f1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f461d519800 1 -- 172.21.15.50:0/3780662356 shutdown_connections 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.681+0000 7f461d519800 1 -- 172.21.15.50:0/3780662356 wait complete. 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.682+0000 7f461d519800 1 Processor -- start 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.682+0000 7f461d519800 1 -- start start 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.682+0000 7f461d519800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98fefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.682+0000 7f461d519800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5617b98f8cc0 con 0x5617b98f7bd0 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.682+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98fefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.682+0000 7f461b018640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98fefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44568/0 (socket says 172.21.15.50:44568) 2024-05-07T13:56:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.682+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 learned_addr learned my addr 172.21.15.50:0/2324396536 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.683+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b98ff500 con 0x5617b98f7bd0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.683+0000 7f461b018640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98fefc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f460c071740 tx=0x7f460c070ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.683+0000 7f44fd7fa640 1 -- 172.21.15.50:0/2324396536 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c0b0070 con 0x5617b98f7bd0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.683+0000 7f44fd7fa640 1 -- 172.21.15.50:0/2324396536 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c071c40 con 0x5617b98f7bd0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.683+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617b98ff500 con 0x5617b98f7bd0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.683+0000 7f44fd7fa640 1 -- 172.21.15.50:0/2324396536 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460c092040 con 0x5617b98f7bd0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.683+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b98ff500 con 0x5617b98f7bd0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.684+0000 7f44fd7fa640 1 -- 172.21.15.50:0/2324396536 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f460c0b3070 con 0x5617b98f7bd0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.684+0000 7f44fd7fa640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44e4036950 0x7f44e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.684+0000 7f44fd7fa640 1 -- 172.21.15.50:0/2324396536 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f460c09d050 con 0x5617b98f7bd0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.684+0000 7f461a817640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44e4036950 0x7f44e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461d519800 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b990a740 0x5617b990cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b990d350 con 0x5617b990a740 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461b819640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b990a740 0x5617b990cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461a817640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44e4036950 0x7f44e4038e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5617b98daa30 tx=0x7f4604023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461b819640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b990a740 0x5617b990cc00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461d519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461d519800 20 realm 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.685+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b990d760 con 0x5617b990a740 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e030 con 0x5617b990a740 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990a740 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b990eec0 0x5617b99112b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b99119f0 con 0x5617b990eec0 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461b018640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b990eec0 0x5617b99112b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.686+0000 7f461b018640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b990eec0 0x5617b99112b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.687+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.687+0000 7f461d519800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.687+0000 7f461d519800 20 searching for the correct realm 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.687+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b99133c0 con 0x5617b990eec0 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.687+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.687+0000 7f461b018640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f460c0b5070 0x7f460c070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.687+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b99133c0 con 0x7f460c0b5070 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.687+0000 7f461a817640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f460c0b5070 0x7f460c070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.688+0000 7f461a817640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f460c0b5070 0x7f460c070350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.688+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.688+0000 7f461a817640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f460403a3c0 0x7f460403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.688+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b99133c0 con 0x7f460403a3c0 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.688+0000 7f461b819640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f460403a3c0 0x7f460403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.689+0000 7f461b819640 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f460403a3c0 0x7f460403a810 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.689+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.689+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990a740 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.689+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.689+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990a740 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.689+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.689+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460403a3c0 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.690+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.690+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460403a3c0 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.690+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.690+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460c0b5070 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.690+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.690+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990eec0 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.690+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.690+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990a740 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.691+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.691+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460403a3c0 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.691+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.691+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990a740 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.691+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.691+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460c0b5070 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.691+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.691+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990eec0 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.692+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.692+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990eec0 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.692+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.692+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460403a3c0 2024-05-07T13:56:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.692+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.692+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990eec0 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.693+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.693+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990eec0 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.693+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.693+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990a740 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.693+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.693+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990a740 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.693+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.693+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460403a3c0 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.694+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.694+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990eec0 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.694+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.694+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460c0b5070 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.694+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.694+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990a740 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.694+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.695+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460403a3c0 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.695+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.695+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990eec0 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.695+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.695+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460403a3c0 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.695+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.695+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460c0b5070 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.696+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.696+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990eec0 2024-05-07T13:56:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.696+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.696+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460403a3c0 2024-05-07T13:56:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.696+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.696+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x5617b990a740 2024-05-07T13:56:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5617b990e3d0 con 0x7f460c0b5070 2024-05-07T13:56:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b9912390 con 0x5617b990a740 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b9912780 con 0x5617b990a740 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.697+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b9912780 con 0x7f460403a3c0 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 20 zone default found 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 4 Realm: () 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 20 zonegroup default 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b9912ba0 con 0x7f460403a3c0 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b9912ba0 con 0x5617b990eec0 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.698+0000 7f461d519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.699+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.699+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b9915270 con 0x5617b990eec0 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.699+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.699+0000 7f461d519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.699+0000 7f461d519800 20 started sync module instance, tier type = 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.699+0000 7f461d519800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.699+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9914710 con 0x7f460c0b5070 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.700+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.700+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94659897543344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9914ed0 con 0x7f460c0b5070 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.700+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99160e0 con 0x5617b990a740 2024-05-07T13:56:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.701+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94659897543344] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.701+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.701+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94659897547824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9916500 con 0x5617b990a740 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.701+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9916ec0 con 0x5617b990eec0 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.702+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94659897547824] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.702+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.702+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94659897551376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9917260 con 0x5617b990eec0 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.702+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9917d50 con 0x7f460c0b5070 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.703+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.703+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94659897557312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9918a10 con 0x7f460c0b5070 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.703+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94659897551376] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.703+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9916090 con 0x5617b990a740 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.704+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.704+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94659897560912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9919820 con 0x5617b990a740 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.704+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b991a310 con 0x7f460403a3c0 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.704+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94659897557312] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.705+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94659897560912] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.706+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.706+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94659897561968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b9918560 con 0x7f460403a3c0 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.706+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b991a7e0 con 0x7f460403a3c0 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.707+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94659897561968] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.707+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.707+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94659897565904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b991a7a0 con 0x7f460403a3c0 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.707+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b991b1c0 con 0x7f460403a3c0 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94659897565904] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94659897568432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b991b630 con 0x7f460403a3c0 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461d519800 20 add_watcher() i=0 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461d519800 20 add_watcher() i=1 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461d519800 20 add_watcher() i=2 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461d519800 20 add_watcher() i=3 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461d519800 20 add_watcher() i=4 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461d519800 20 add_watcher() i=5 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.708+0000 7f461d519800 20 add_watcher() i=6 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.709+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94659897568432] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.709+0000 7f461d519800 20 add_watcher() i=7 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.709+0000 7f461d519800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.709+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b991b630 con 0x5617b990a740 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.709+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.709+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94659897569664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b991b5a0 con 0x5617b990a740 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.710+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94659897569664] v27'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.710+0000 7f44d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.710+0000 7f461d519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.710+0000 7f461d519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.710+0000 7f461d519800 5 note: GC not initialized 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.711+0000 7f44d0fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.711+0000 7f461d519800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.711+0000 7f461d519800 20 Filter name: none 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.711+0000 7f444a7fc640 20 reqs_thread_entry: start 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.711+0000 7f461d519800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.711+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5617b9951610 con 0x5617b990a740 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.711+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.711+0000 7f461d519800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:could not fetch user info: no user info saved 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.712+0000 7f44d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.712+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94659897569664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99515d0 con 0x5617b990a740 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.713+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94659897569664] v27'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.713+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94659897543344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99515d0 con 0x7f460c0b5070 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.714+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94659897543344] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.714+0000 7f461d519800 20 remove_watcher() i=0 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.714+0000 7f461d519800 2 removed watcher, disabling cache 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.714+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94659897547824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99515d0 con 0x5617b990a740 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.715+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94659897547824] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.715+0000 7f461d519800 20 remove_watcher() i=1 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.715+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94659897551376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99515d0 con 0x5617b990eec0 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.716+0000 7f461b018640 1 -- 172.21.15.50:0/2324396536 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94659897551376] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c0b2030 con 0x5617b990eec0 2024-05-07T13:56:08.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.716+0000 7f461d519800 20 remove_watcher() i=2 2024-05-07T13:56:08.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.716+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94659897557312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99515d0 con 0x7f460c0b5070 2024-05-07T13:56:08.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.717+0000 7f461a817640 1 -- 172.21.15.50:0/2324396536 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94659897557312] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4604037040 con 0x7f460c0b5070 2024-05-07T13:56:08.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.717+0000 7f461d519800 20 remove_watcher() i=3 2024-05-07T13:56:08.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.717+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94659897560912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99515d0 con 0x5617b990a740 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.718+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94659897560912] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x5617b990a740 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.718+0000 7f461d519800 20 remove_watcher() i=4 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.718+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94659897561968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99515d0 con 0x7f460403a3c0 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.719+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94659897561968] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.719+0000 7f461d519800 20 remove_watcher() i=5 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.719+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94659897565904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99515d0 con 0x7f460403a3c0 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.720+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94659897565904] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.720+0000 7f461d519800 20 remove_watcher() i=6 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.720+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94659897568432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5617b99515d0 con 0x7f460403a3c0 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94659897568432] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461400a4a0 con 0x7f460403a3c0 2024-05-07T13:56:08.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 20 remove_watcher() i=7 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f460403a3c0 msgr2=0x7f460403a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f460403a3c0 0x7f460403a810 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b990a740 msgr2=0x5617b990cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b990a740 0x5617b990cc00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f460c0b5070 msgr2=0x7f460c070350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f460c0b5070 0x7f460c070350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b990eec0 msgr2=0x5617b99112b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b990eec0 0x5617b99112b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44e4036950 msgr2=0x7f44e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44e4036950 0x7f44e4038e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5617b98daa30 tx=0x7f4604023040 comp rx=0 tx=0).stop 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 msgr2=0x5617b98fefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461b819640 1 -- 172.21.15.50:0/2324396536 reap_dead start 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98fefc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f460c071740 tx=0x7f460c070ee0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 shutdown_connections 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 --2- 172.21.15.50:0/2324396536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98f7bd0 0x5617b98fefc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 >> 172.21.15.50:0/2324396536 conn(0x5617b98f3f80 msgr2=0x5617b98f15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 shutdown_connections 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.721+0000 7f461d519800 1 -- 172.21.15.50:0/2324396536 wait complete. 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/2954818404 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44f4036900 msgr2=0x7f44f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 --2- 172.21.15.50:0/2954818404 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44f4036900 0x7f44f4038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x5617b98d1c80 tx=0x7f4604006000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/2954818404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98c2f20 msgr2=0x5617b98c1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 --2- 172.21.15.50:0/2954818404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98c2f20 0x5617b98c1390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f460c08c350 tx=0x7f460c052f40 comp rx=0 tx=0).stop 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/2954818404 shutdown_connections 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 --2- 172.21.15.50:0/2954818404 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f44f4036900 0x7f44f4038dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 --2- 172.21.15.50:0/2954818404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b98c2f20 0x5617b98c1390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/2954818404 >> 172.21.15.50:0/2954818404 conn(0x5617b98dcb80 msgr2=0x5617b98dcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/2954818404 shutdown_connections 2024-05-07T13:56:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/2954818404 wait complete. 2024-05-07T13:56:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5617b98d79e0 msgr2=0x5617b98d9ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5617b98d79e0 0x5617b98d9ea0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b97d1230 msgr2=0x5617b98d12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617b97d1230 0x5617b98d12b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b98d3ae0 msgr2=0x5617b98d5ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617b98d3ae0 0x5617b98d5ed0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4500036950 msgr2=0x7f4500038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4500036950 0x7f4500038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4604000c00 tx=0x7f46040013b0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 msgr2=0x5617b98ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 --2- 172.21.15.50:0/665043877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617b97cffd0 0x5617b98ca070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f460c060040 tx=0x7f460c002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461b819640 1 -- 172.21.15.50:0/665043877 reap_dead start 2024-05-07T13:56:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 shutdown_connections 2024-05-07T13:56:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 >> 172.21.15.50:0/665043877 conn(0x5617b97cb5b0 msgr2=0x5617b98bb660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 shutdown_connections 2024-05-07T13:56:08.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.722+0000 7f461d519800 1 -- 172.21.15.50:0/665043877 wait complete. 2024-05-07T13:56:08.724 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-07T13:56:08.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-07T13:56:08.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-07T13:56:08.724 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-05-07T13:56:08.780 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:08.780 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:08.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.792+0000 7f6189c1f800 1 Processor -- start 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f6189c1f800 1 -- start start 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f6189c1f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5579e6c864c0 0x5579e6c8efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f6189c1f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579e6bf98c0 con 0x5579e6c84980 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f6189c1f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5579e6b17050 con 0x5579e6c864c0 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f6186f1d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5579e6c864c0 0x5579e6c8efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f618771e640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5579e6c84980 0x5579e6c84da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39504/0 (socket says 172.21.15.50:39504) 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f6186f1d640 1 --2- 172.21.15.50:0/4107150174 >> v2:172.21.15.22:3300/0 conn(0x5579e6c864c0 0x5579e6c8efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44570/0 (socket says 172.21.15.50:44570) 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f618771e640 1 -- 172.21.15.50:0/4107150174 learned_addr learned my addr 172.21.15.50:0/4107150174 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f6186f1d640 1 -- 172.21.15.50:0/4107150174 >> v1:172.21.15.22:6789/0 conn(0x5579e6c84980 legacy=0x5579e6c84da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f6186f1d640 1 -- 172.21.15.50:0/4107150174 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e6c90510 con 0x5579e6c864c0 2024-05-07T13:56:08.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.793+0000 7f618671c640 1 -- 172.21.15.50:0/4107150174 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 136672643 0 0) 0x5579e6bf98c0 con 0x5579e6c84980 2024-05-07T13:56:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.795+0000 7f6186f1d640 1 --2- 172.21.15.50:0/4107150174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c864c0 0x5579e6c8efc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f617c00a470 tx=0x7f617c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2e2db524be7f32 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.795+0000 7f618671c640 1 -- 172.21.15.50:0/4107150174 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c057070 con 0x5579e6c864c0 2024-05-07T13:56:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.795+0000 7f618671c640 1 -- 172.21.15.50:0/4107150174 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c04adc0 con 0x5579e6c864c0 2024-05-07T13:56:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.795+0000 7f618671c640 1 -- 172.21.15.50:0/4107150174 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c052590 con 0x5579e6c864c0 2024-05-07T13:56:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.796+0000 7f6189c1f800 1 -- 172.21.15.50:0/4107150174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c864c0 msgr2=0x5579e6c8efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.796+0000 7f6189c1f800 1 --2- 172.21.15.50:0/4107150174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c864c0 0x5579e6c8efc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f617c00a470 tx=0x7f617c01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.796+0000 7f6189c1f800 1 -- 172.21.15.50:0/4107150174 shutdown_connections 2024-05-07T13:56:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.796+0000 7f6189c1f800 1 --2- 172.21.15.50:0/4107150174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c864c0 0x5579e6c8efc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.796+0000 7f6189c1f800 1 -- 172.21.15.50:0/4107150174 >> 172.21.15.50:0/4107150174 conn(0x5579e6c80540 msgr2=0x5579e6c82960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.796+0000 7f6189c1f800 1 -- 172.21.15.50:0/4107150174 shutdown_connections 2024-05-07T13:56:08.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.796+0000 7f6189c1f800 1 -- 172.21.15.50:0/4107150174 wait complete. 2024-05-07T13:56:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.811+0000 7f6189c1f800 1 Processor -- start 2024-05-07T13:56:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.811+0000 7f6189c1f800 1 -- start start 2024-05-07T13:56:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.811+0000 7f6189c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d79870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.811+0000 7f6189c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5579e6bd1170 con 0x5579e6c84980 2024-05-07T13:56:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.812+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d79870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.812+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d79870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44580/0 (socket says 172.21.15.50:44580) 2024-05-07T13:56:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.812+0000 7f618771e640 1 -- 172.21.15.50:0/514149526 learned_addr learned my addr 172.21.15.50:0/514149526 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.812+0000 7f618771e640 1 -- 172.21.15.50:0/514149526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e6d79e40 con 0x5579e6c84980 2024-05-07T13:56:08.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.812+0000 7f618771e640 1 --2- 172.21.15.50:0/514149526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d79870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f617800b210 tx=0x7f617800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102ee791ae0eb6cf server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.812+0000 7f607560a640 1 -- 172.21.15.50:0/514149526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6178008070 con 0x5579e6c84980 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.812+0000 7f607560a640 1 -- 172.21.15.50:0/514149526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617800d500 con 0x5579e6c84980 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.812+0000 7f607560a640 1 -- 172.21.15.50:0/514149526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617800d840 con 0x5579e6c84980 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.813+0000 7f6189c1f800 1 -- 172.21.15.50:0/514149526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 msgr2=0x5579e6d79870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.813+0000 7f6189c1f800 1 --2- 172.21.15.50:0/514149526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d79870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f617800b210 tx=0x7f617800b6d0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.813+0000 7f6189c1f800 1 -- 172.21.15.50:0/514149526 shutdown_connections 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.813+0000 7f6189c1f800 1 --2- 172.21.15.50:0/514149526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d79870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.813+0000 7f6189c1f800 1 -- 172.21.15.50:0/514149526 >> 172.21.15.50:0/514149526 conn(0x5579e6c80540 msgr2=0x5579e6d75190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.813+0000 7f6189c1f800 1 -- 172.21.15.50:0/514149526 shutdown_connections 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.813+0000 7f6189c1f800 1 -- 172.21.15.50:0/514149526 wait complete. 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.813+0000 7f6189c1f800 1 Processor -- start 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.814+0000 7f6189c1f800 1 -- start start 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.814+0000 7f6189c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d81440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.814+0000 7f6189c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5579e6c8f7d0 con 0x5579e6c84980 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.814+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d81440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.814+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d81440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44590/0 (socket says 172.21.15.50:44590) 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.814+0000 7f618771e640 1 -- 172.21.15.50:0/3636979153 learned_addr learned my addr 172.21.15.50:0/3636979153 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.814+0000 7f618771e640 1 -- 172.21.15.50:0/3636979153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e6d81980 con 0x5579e6c84980 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.815+0000 7f618771e640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d81440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f617800b210 tx=0x7f6178000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.815+0000 7f6073e07640 1 -- 172.21.15.50:0/3636979153 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617800f950 con 0x5579e6c84980 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.815+0000 7f6073e07640 1 -- 172.21.15.50:0/3636979153 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617800faf0 con 0x5579e6c84980 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.815+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579e6d81c10 con 0x5579e6c84980 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.815+0000 7f6073e07640 1 -- 172.21.15.50:0/3636979153 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617800fdd0 con 0x5579e6c84980 2024-05-07T13:56:08.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.815+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e6d848c0 con 0x5579e6c84980 2024-05-07T13:56:08.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.816+0000 7f6073e07640 1 -- 172.21.15.50:0/3636979153 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6178017040 con 0x5579e6c84980 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.816+0000 7f6073e07640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f606c0368b0 0x7f606c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.816+0000 7f6073e07640 1 -- 172.21.15.50:0/3636979153 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6178015020 con 0x5579e6c84980 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.816+0000 7f6186f1d640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f606c0368b0 0x7f606c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.816+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6c864c0 0x5579e6d88680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.816+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6d88c00 con 0x5579e6c864c0 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.816+0000 7f6187f1f640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6c864c0 0x5579e6d88680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.816+0000 7f6186f1d640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f606c0368b0 0x7f606c038d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f617c054000 tx=0x7f617c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.816+0000 7f6187f1f640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6c864c0 0x5579e6d88680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.817+0000 7f6187f1f640 1 -- 172.21.15.50:0/3636979153 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6c864c0 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.817+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6d85c50 con 0x5579e6c864c0 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.817+0000 7f6187f1f640 1 -- 172.21.15.50:0/3636979153 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6c864c0 2024-05-07T13:56:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.817+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6d8af30 0x5579e6d8d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.817+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6d8da10 con 0x5579e6d8af30 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.817+0000 7f618771e640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6d8af30 0x5579e6d8d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.817+0000 7f618771e640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6d8af30 0x5579e6d8d320 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.818+0000 7f618771e640 1 -- 172.21.15.50:0/3636979153 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f617802d070 con 0x5579e6d8af30 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.818+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6d89ee0 con 0x5579e6c864c0 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.818+0000 7f6187f1f640 1 -- 172.21.15.50:0/3636979153 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6c864c0 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.818+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5579e6d8eec0 0x5579e6d91310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.818+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6d91a70 con 0x5579e6d8eec0 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.818+0000 7f6186f1d640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5579e6d8eec0 0x5579e6d91310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.819+0000 7f6186f1d640 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5579e6d8eec0 0x5579e6d91310 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.819+0000 7f6186f1d640 1 -- 172.21.15.50:0/3636979153 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f617c05a040 con 0x5579e6d8eec0 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.819+0000 7f6189c1f800 1 Processor -- start 2024-05-07T13:56:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.819+0000 7f6189c1f800 1 -- start start 2024-05-07T13:56:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.820+0000 7f6189c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6d9fe60 0x5579e6da0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.820+0000 7f6189c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5579e6b77cf0 con 0x5579e6d9fe60 2024-05-07T13:56:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.820+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6d9fe60 0x5579e6da0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.820+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6d9fe60 0x5579e6da0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44594/0 (socket says 172.21.15.50:44594) 2024-05-07T13:56:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.820+0000 7f618771e640 1 -- 172.21.15.50:0/3595620942 learned_addr learned my addr 172.21.15.50:0/3595620942 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.820+0000 7f618771e640 1 -- 172.21.15.50:0/3595620942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e6da07c0 con 0x5579e6d9fe60 2024-05-07T13:56:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.820+0000 7f618771e640 1 --2- 172.21.15.50:0/3595620942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6d9fe60 0x5579e6da0280 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f617800b710 tx=0x7f6178041d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.821+0000 7f6071602640 1 -- 172.21.15.50:0/3595620942 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6178019470 con 0x5579e6d9fe60 2024-05-07T13:56:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.821+0000 7f6071602640 1 -- 172.21.15.50:0/3595620942 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6178019610 con 0x5579e6d9fe60 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.821+0000 7f6189c1f800 1 -- 172.21.15.50:0/3595620942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579e6da1230 con 0x5579e6d9fe60 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.821+0000 7f6071602640 1 -- 172.21.15.50:0/3595620942 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61780198f0 con 0x5579e6d9fe60 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.821+0000 7f6189c1f800 1 -- 172.21.15.50:0/3595620942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e6da1730 con 0x5579e6d9fe60 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.821+0000 7f6071602640 1 -- 172.21.15.50:0/3595620942 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f617803f250 con 0x5579e6d9fe60 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f6071602640 1 --2- 172.21.15.50:0/3595620942 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f60600368b0 0x7f6060038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f6071602640 1 -- 172.21.15.50:0/3595620942 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f617803ace0 con 0x5579e6d9fe60 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f6186f1d640 1 --2- 172.21.15.50:0/3595620942 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f60600368b0 0x7f6060038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f6189c1f800 1 Processor -- start 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f6189c1f800 1 -- start start 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f6186f1d640 1 --2- 172.21.15.50:0/3595620942 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f60600368b0 0x7f6060038d70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5579e6d894e0 tx=0x7f617c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f6189c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6dad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f6189c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5579e6d7a1c0 con 0x5579e6dad2a0 2024-05-07T13:56:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6dad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6dad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44610/0 (socket says 172.21.15.50:44610) 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.822+0000 7f618771e640 1 -- 172.21.15.50:0/604374332 learned_addr learned my addr 172.21.15.50:0/604374332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f618771e640 1 -- 172.21.15.50:0/604374332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e6dadc90 con 0x5579e6dad2a0 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f618771e640 1 --2- 172.21.15.50:0/604374332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6dad6c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f617803b000 tx=0x7f617804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f8ffeebaf30851 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f606affd640 1 -- 172.21.15.50:0/604374332 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6178045010 con 0x5579e6dad2a0 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f606affd640 1 -- 172.21.15.50:0/604374332 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617801cc80 con 0x5579e6dad2a0 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f606affd640 1 -- 172.21.15.50:0/604374332 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6178044af0 con 0x5579e6dad2a0 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f6189c1f800 1 -- 172.21.15.50:0/604374332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 msgr2=0x5579e6dad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f6189c1f800 1 --2- 172.21.15.50:0/604374332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6dad6c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f617803b000 tx=0x7f617804f000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f6189c1f800 1 -- 172.21.15.50:0/604374332 shutdown_connections 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f6189c1f800 1 --2- 172.21.15.50:0/604374332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6dad6c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f6189c1f800 1 -- 172.21.15.50:0/604374332 >> 172.21.15.50:0/604374332 conn(0x5579e6da9520 msgr2=0x5579e6da7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f6189c1f800 1 -- 172.21.15.50:0/604374332 shutdown_connections 2024-05-07T13:56:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.823+0000 7f6189c1f800 1 -- 172.21.15.50:0/604374332 wait complete. 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.824+0000 7f6189c1f800 1 Processor -- start 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.824+0000 7f6189c1f800 1 -- start start 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.824+0000 7f6189c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6db46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.824+0000 7f6189c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5579e6dae300 con 0x5579e6dad2a0 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.824+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6db46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.824+0000 7f618771e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6db46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44624/0 (socket says 172.21.15.50:44624) 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.824+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 learned_addr learned my addr 172.21.15.50:0/2794337425 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.824+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e6db4be0 con 0x5579e6dad2a0 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.825+0000 7f618771e640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6db46a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6178041fd0 tx=0x7f617802af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.825+0000 7f60697fa640 1 -- 172.21.15.50:0/2794337425 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6178045010 con 0x5579e6dad2a0 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.825+0000 7f60697fa640 1 -- 172.21.15.50:0/2794337425 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6178067070 con 0x5579e6dad2a0 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.825+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579e6db4be0 con 0x5579e6dad2a0 2024-05-07T13:56:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.825+0000 7f60697fa640 1 -- 172.21.15.50:0/2794337425 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617801c5e0 con 0x5579e6dad2a0 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.825+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e6db4be0 con 0x5579e6dad2a0 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.825+0000 7f60697fa640 1 -- 172.21.15.50:0/2794337425 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f617801c780 con 0x5579e6dad2a0 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.826+0000 7f60697fa640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6050036950 0x7f6050038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.826+0000 7f60697fa640 1 -- 172.21.15.50:0/2794337425 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6178058030 con 0x5579e6dad2a0 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.826+0000 7f6186f1d640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6050036950 0x7f6050038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.826+0000 7f6186f1d640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6050036950 0x7f6050038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f617c055040 tx=0x7f617c060040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.826+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.826+0000 7f6189c1f800 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6dbfd00 0x5579e6dc21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.826+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc2910 con 0x5579e6dbfd00 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6187f1f640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6dbfd00 0x5579e6dc21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6187f1f640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6dbfd00 0x5579e6dc21c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6dbfd00 2024-05-07T13:56:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 20 realm 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc2d20 con 0x5579e6dbfd00 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6dbfd00 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc35f0 con 0x5579e6dbfd00 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6dbfd00 2024-05-07T13:56:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.827+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dbfd00 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6dbfd00 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f6189c1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f6189c1f800 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6dc46f0 0x5579e6dc6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc70f0 con 0x5579e6dc46f0 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f618771e640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6dc46f0 0x5579e6dc6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f618771e640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6dc46f0 0x5579e6dc6ae0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f6189c1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f6189c1f800 20 searching for the correct realm 2024-05-07T13:56:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.828+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc8a00 con 0x5579e6dc46f0 2024-05-07T13:56:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.829+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.829+0000 7f618771e640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f617803f540 0x7f617806c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.829+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc8a00 con 0x7f617803f540 2024-05-07T13:56:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.829+0000 7f6186f1d640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f617803f540 0x7f617806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.830+0000 7f6186f1d640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f617803f540 0x7f617806c690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.830+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.830+0000 7f6186f1d640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f617c080930 0x7f617c073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.830+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc8a00 con 0x7f617c080930 2024-05-07T13:56:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.830+0000 7f6187f1f640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f617c080930 0x7f617c073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.831+0000 7f6187f1f640 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f617c080930 0x7f617c073420 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.831+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618000a4a0 con 0x7f617c080930 2024-05-07T13:56:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.831+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dbfd00 2024-05-07T13:56:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.831+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6dbfd00 2024-05-07T13:56:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.831+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dbfd00 2024-05-07T13:56:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.832+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6dbfd00 2024-05-07T13:56:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.832+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617c080930 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.832+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618000a4a0 con 0x7f617c080930 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.832+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617c080930 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.832+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f618000a4a0 con 0x7f617c080930 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.832+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617803f540 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.832+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.832+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dc46f0 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.833+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.833+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dbfd00 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.833+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6dbfd00 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.833+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617c080930 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.833+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618000a4a0 con 0x7f617c080930 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.833+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dbfd00 2024-05-07T13:56:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.833+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6dbfd00 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.833+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617803f540 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.834+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.834+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dc46f0 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.834+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.834+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dc46f0 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.834+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.834+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617c080930 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.835+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618000a4a0 con 0x7f617c080930 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.835+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dc46f0 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.835+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.835+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dc46f0 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.835+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.835+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dbfd00 2024-05-07T13:56:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.835+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618000a4a0 con 0x5579e6dbfd00 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.835+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dbfd00 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.836+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.836+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617c080930 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.836+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.836+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dc46f0 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.836+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.836+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617803f540 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.836+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.836+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dbfd00 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.837+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.837+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617c080930 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.837+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.837+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dc46f0 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.837+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.837+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617c080930 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.838+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.838+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617803f540 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.838+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.838+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dc46f0 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.838+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.838+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617c080930 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x5579e6dbfd00 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc3990 con 0x7f617803f540 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc79b0 con 0x5579e6dbfd00 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.839+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc7da0 con 0x5579e6dbfd00 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc7da0 con 0x7f617c080930 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 20 zone default found 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 4 Realm: () 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 20 zonegroup default 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.840+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc8e80 con 0x7f617c080930 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dca860 con 0x5579e6dc46f0 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcac00 con 0x5579e6dc46f0 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 20 started sync module instance, tier type = 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.841+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dc9d00 con 0x7f617803f540 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.842+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.842+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93982052620368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcafa0 con 0x7f617803f540 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.842+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcb7f0 con 0x5579e6dbfd00 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.843+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93982052620368] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.843+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.843+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93982052627264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcb760 con 0x5579e6dbfd00 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.844+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcc6b0 con 0x5579e6dc46f0 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.844+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.844+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93982052631040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dccf50 con 0x5579e6dc46f0 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.845+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcda00 con 0x7f617803f540 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.845+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93982052627264] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.845+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93982052631040] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.846+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.846+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93982052629472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcddf0 con 0x7f617803f540 2024-05-07T13:56:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.846+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dce680 con 0x5579e6dbfd00 2024-05-07T13:56:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.847+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.847+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93982052639120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcef20 con 0x5579e6dbfd00 2024-05-07T13:56:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.847+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcf9f0 con 0x7f617c080930 2024-05-07T13:56:08.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.847+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93982052629472] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.848+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93982052639120] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.848+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.848+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93982052635872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dce9a0 con 0x7f617c080930 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.848+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd0290 con 0x7f617c080930 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.849+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93982052635872] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.849+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.849+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93982052644016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dce9a0 con 0x7f617c080930 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.849+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd08b0 con 0x7f617c080930 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93982052647936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd0cd0 con 0x7f617c080930 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6189c1f800 20 add_watcher() i=0 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6189c1f800 20 add_watcher() i=1 2024-05-07T13:56:08.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6189c1f800 20 add_watcher() i=2 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6189c1f800 20 add_watcher() i=3 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6189c1f800 20 add_watcher() i=4 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6189c1f800 20 add_watcher() i=5 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93982052644016] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.850+0000 7f6189c1f800 20 add_watcher() i=6 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.851+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93982052647936] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.851+0000 7f6189c1f800 20 add_watcher() i=7 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.851+0000 7f6189c1f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.851+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd0cd0 con 0x5579e6dbfd00 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.851+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.851+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93982052648992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd0c40 con 0x5579e6dbfd00 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.852+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93982052648992] v27'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.852+0000 7f603dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.852+0000 7f6189c1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.852+0000 7f6189c1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.852+0000 7f6189c1f800 5 note: GC not initialized 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.852+0000 7f603cfe1640 20 reqs_thread_entry: start 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 20 Filter name: none 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f5fb67fc640 20 reqs_thread_entry: start 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e07260 con 0x5579e6dbfd00 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-07T13:56:08.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e05a00 con 0x5579e6dbfd00 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.853+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e05a00 con 0x7f617c080930 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.854+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.854+0000 7f6189c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.854+0000 7f6189c1f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-05-07T13:56:08.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.854+0000 7f6189c1f800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.854+0000 7f6189c1f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.854+0000 7f6189c1f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.854+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e06340 con 0x5579e6dbfd00 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v27'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f6189c1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f6189c1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f6189c1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 93982052868144 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e0ab50 con 0x5579e6dbfd00 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== watch-notify(notify (1) cookie 93982052639120 notify 115964116992 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5579e6e066e0 con 0x5579e6dbfd00 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f606affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 93982052639120 notifier 4285 bl.length()=567 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f606affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f606affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(66 notify.4 [notify cookie 93982052868144 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f606affd640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f604c003ea0 con 0x5579e6dbfd00 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.855+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.856+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== watch-notify(notify_complete (2) cookie 93982052868144 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5579e6e06cb0 con 0x5579e6dbfd00 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.856+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e06000 con 0x5579e6dbfd00 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f6189c1f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f6189c1f800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f6189c1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 93982052868096 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e0ab50 con 0x7f617803f540 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== watch-notify(notify (1) cookie 93982052629472 notify 115964116992 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7f617c089060 con 0x7f617803f540 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f606a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 93982052629472 notifier 4285 bl.length()=169 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f606a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f606a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-07T13:56:08.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(69 notify.3 [notify cookie 93982052868096 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.857+0000 7f606a7fc640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f5fbc003400 con 0x7f617803f540 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.858+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.858+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== watch-notify(notify_complete (2) cookie 93982052868096 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5579e6c90510 con 0x7f617803f540 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.858+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e060b0 con 0x7f617c080930 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f6189c1f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f6189c1f800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f6189c1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 93982052877952 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e0b1b0 con 0x7f617803f540 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== watch-notify(notify (1) cookie 93982052629472 notify 115964116993 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5579e6c90510 con 0x7f617803f540 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f606affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 93982052629472 notifier 4285 bl.length()=177 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f606affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-07T13:56:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f606affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-07T13:56:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f606affd640 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f604c003ea0 con 0x7f617803f540 2024-05-07T13:56:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(72 notify.3 [notify cookie 93982052877952 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.859+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== watch-notify(notify_complete (2) cookie 93982052877952 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f617c066ac0 con 0x7f617803f540 2024-05-07T13:56:08.857 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:08.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.860+0000 7f603dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.860+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93982052648992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6e08500 con 0x5579e6dbfd00 2024-05-07T13:56:08.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.861+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 93982052648992] v27'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.861+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93982052620368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd0820 con 0x7f617803f540 2024-05-07T13:56:08.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.862+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 93982052620368] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.862+0000 7f6189c1f800 20 remove_watcher() i=0 2024-05-07T13:56:08.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.862+0000 7f6189c1f800 2 removed watcher, disabling cache 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.862+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93982052627264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd0820 con 0x5579e6dbfd00 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.864+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 93982052627264] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.864+0000 7f6189c1f800 20 remove_watcher() i=1 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.864+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93982052631040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcb340 con 0x5579e6dc46f0 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.864+0000 7f618771e640 1 -- 172.21.15.50:0/2794337425 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 93982052631040] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617802d070 con 0x5579e6dc46f0 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.865+0000 7f6189c1f800 20 remove_watcher() i=2 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.865+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93982052629472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd0820 con 0x7f617803f540 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.865+0000 7f6186f1d640 1 -- 172.21.15.50:0/2794337425 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 93982052629472] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f617c070070 con 0x7f617803f540 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.865+0000 7f6189c1f800 20 remove_watcher() i=3 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.866+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93982052639120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcb340 con 0x5579e6dbfd00 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.866+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 93982052639120] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x5579e6dbfd00 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.866+0000 7f6189c1f800 20 remove_watcher() i=4 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.866+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93982052635872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dcbbe0 con 0x7f617c080930 2024-05-07T13:56:08.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.867+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 93982052635872] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.867+0000 7f6189c1f800 20 remove_watcher() i=5 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.867+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93982052644016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd0820 con 0x7f617c080930 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.868+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 93982052644016] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.869+0000 7f6189c1f800 20 remove_watcher() i=6 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.869+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93982052647936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5579e6dd0820 con 0x7f617c080930 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.869+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 93982052647936] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f618002f060 con 0x7f617c080930 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.869+0000 7f6189c1f800 20 remove_watcher() i=7 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f617c080930 msgr2=0x7f617c073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f617c080930 0x7f617c073420 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6dbfd00 msgr2=0x5579e6dc21c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6dbfd00 0x5579e6dc21c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f617803f540 msgr2=0x7f617806c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f617803f540 0x7f617806c690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6dc46f0 msgr2=0x5579e6dc6ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6dc46f0 0x5579e6dc6ae0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6050036950 msgr2=0x7f6050038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6050036950 0x7f6050038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f617c055040 tx=0x7f617c060040 comp rx=0 tx=0).stop 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6187f1f640 1 -- 172.21.15.50:0/2794337425 reap_dead start 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 msgr2=0x5579e6db46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6db46a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6178041fd0 tx=0x7f617802af70 comp rx=0 tx=0).stop 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 shutdown_connections 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/2794337425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6dad2a0 0x5579e6db46a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 >> 172.21.15.50:0/2794337425 conn(0x5579e6da9520 msgr2=0x5579e6da6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 shutdown_connections 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/2794337425 wait complete. 2024-05-07T13:56:08.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/3595620942 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f60600368b0 msgr2=0x7f6060038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3595620942 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f60600368b0 0x7f6060038d70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x5579e6d894e0 tx=0x7f617c005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/3595620942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6d9fe60 msgr2=0x5579e6da0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3595620942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6d9fe60 0x5579e6da0280 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f617800b710 tx=0x7f6178041d50 comp rx=0 tx=0).stop 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/3595620942 shutdown_connections 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3595620942 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f60600368b0 0x7f6060038d70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3595620942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6d9fe60 0x5579e6da0280 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/3595620942 >> 172.21.15.50:0/3595620942 conn(0x5579e6d93f00 msgr2=0x5579e6d94300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/3595620942 shutdown_connections 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.870+0000 7f6189c1f800 1 -- 172.21.15.50:0/3595620942 wait complete. 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5579e6d8eec0 msgr2=0x5579e6d91310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5579e6d8eec0 0x5579e6d91310 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6c864c0 msgr2=0x5579e6d88680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5579e6c864c0 0x5579e6d88680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6d8af30 msgr2=0x5579e6d8d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5579e6d8af30 0x5579e6d8d320 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f606c0368b0 msgr2=0x7f606c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f606c0368b0 0x7f606c038d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f617c054000 tx=0x7f617c04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 msgr2=0x5579e6d81440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 --2- 172.21.15.50:0/3636979153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579e6c84980 0x5579e6d81440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f617800b210 tx=0x7f6178000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6187f1f640 1 -- 172.21.15.50:0/3636979153 reap_dead start 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 shutdown_connections 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 >> 172.21.15.50:0/3636979153 conn(0x5579e6c80540 msgr2=0x5579e6d73990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 shutdown_connections 2024-05-07T13:56:08.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.871+0000 7f6189c1f800 1 -- 172.21.15.50:0/3636979153 wait complete. 2024-05-07T13:56:08.868 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:08.869 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-07T13:56:08.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-07T13:56:08.869 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-05-07T13:56:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:08.918 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.931+0000 7f5f4263f800 1 Processor -- start 2024-05-07T13:56:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.931+0000 7f5f4263f800 1 -- start start 2024-05-07T13:56:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.931+0000 7f5f4263f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f829fa9560 0x55f829fb2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.931+0000 7f5f4263f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f829f1c920 con 0x55f829fa7a20 2024-05-07T13:56:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.931+0000 7f5f4263f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55f829e3a050 con 0x55f829fa9560 2024-05-07T13:56:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.931+0000 7f5f3f944640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f829fa9560 0x55f829fb2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.931+0000 7f5f40145640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55f829fa7a20 0x55f829fa7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39514/0 (socket says 172.21.15.50:39514) 2024-05-07T13:56:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.931+0000 7f5f40145640 1 -- 172.21.15.50:0/515927184 learned_addr learned my addr 172.21.15.50:0/515927184 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.932+0000 7f5f3f944640 1 -- 172.21.15.50:0/515927184 >> v1:172.21.15.22:6789/0 conn(0x55f829fa7a20 legacy=0x55f829fa7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.932+0000 7f5f3f143640 1 -- 172.21.15.50:0/515927184 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860031936 0 0) 0x55f829f1c920 con 0x55f829fa7a20 2024-05-07T13:56:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.932+0000 7f5f3f944640 1 -- 172.21.15.50:0/515927184 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f829f1caf0 con 0x55f829fa9560 2024-05-07T13:56:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f3f944640 1 --2- 172.21.15.50:0/515927184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa9560 0x55f829fb2060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400a470 tx=0x7f5f3401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c291375a8d560a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f3f143640 1 -- 172.21.15.50:0/515927184 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f34057070 con 0x55f829fa9560 2024-05-07T13:56:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f3f143640 1 -- 172.21.15.50:0/515927184 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f34052570 con 0x55f829fa9560 2024-05-07T13:56:08.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f3f143640 1 -- 172.21.15.50:0/515927184 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f34052870 con 0x55f829fa9560 2024-05-07T13:56:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f4263f800 1 -- 172.21.15.50:0/515927184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa9560 msgr2=0x55f829fb2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f4263f800 1 --2- 172.21.15.50:0/515927184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa9560 0x55f829fb2060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400a470 tx=0x7f5f3401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:08.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f4263f800 1 -- 172.21.15.50:0/515927184 shutdown_connections 2024-05-07T13:56:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f4263f800 1 --2- 172.21.15.50:0/515927184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa9560 0x55f829fb2060 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f4263f800 1 -- 172.21.15.50:0/515927184 >> 172.21.15.50:0/515927184 conn(0x55f829fa35c0 msgr2=0x55f829fa59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f4263f800 1 -- 172.21.15.50:0/515927184 shutdown_connections 2024-05-07T13:56:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.934+0000 7f5f4263f800 1 -- 172.21.15.50:0/515927184 wait complete. 2024-05-07T13:56:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.949+0000 7f5f4263f800 1 Processor -- start 2024-05-07T13:56:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.949+0000 7f5f4263f800 1 -- start start 2024-05-07T13:56:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.949+0000 7f5f4263f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a09c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.949+0000 7f5f4263f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f829ef41f0 con 0x55f829fa7a20 2024-05-07T13:56:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.950+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a09c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.950+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a09c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44644/0 (socket says 172.21.15.50:44644) 2024-05-07T13:56:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.950+0000 7f5f40145640 1 -- 172.21.15.50:0/3354077969 learned_addr learned my addr 172.21.15.50:0/3354077969 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.950+0000 7f5f40145640 1 -- 172.21.15.50:0/3354077969 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f82a09cc40 con 0x55f829fa7a20 2024-05-07T13:56:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.950+0000 7f5f40145640 1 --2- 172.21.15.50:0/3354077969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a09c670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b210 tx=0x7f5f3000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1636c57c7316ea6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.950+0000 7f5e2e60c640 1 -- 172.21.15.50:0/3354077969 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30008070 con 0x55f829fa7a20 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.950+0000 7f5e2e60c640 1 -- 172.21.15.50:0/3354077969 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3000d500 con 0x55f829fa7a20 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.951+0000 7f5e2e60c640 1 -- 172.21.15.50:0/3354077969 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3000d840 con 0x55f829fa7a20 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.951+0000 7f5f4263f800 1 -- 172.21.15.50:0/3354077969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 msgr2=0x55f82a09c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.951+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3354077969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a09c670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b210 tx=0x7f5f3000b6d0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.951+0000 7f5f4263f800 1 -- 172.21.15.50:0/3354077969 shutdown_connections 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.951+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3354077969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a09c670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.951+0000 7f5f4263f800 1 -- 172.21.15.50:0/3354077969 >> 172.21.15.50:0/3354077969 conn(0x55f829fa35c0 msgr2=0x55f82a097f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.951+0000 7f5f4263f800 1 -- 172.21.15.50:0/3354077969 shutdown_connections 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.951+0000 7f5f4263f800 1 -- 172.21.15.50:0/3354077969 wait complete. 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.952+0000 7f5f4263f800 1 Processor -- start 2024-05-07T13:56:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.952+0000 7f5f4263f800 1 -- start start 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.952+0000 7f5f4263f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a0a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.952+0000 7f5f4263f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f829fb2870 con 0x55f829fa7a20 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.952+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a0a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.952+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a0a4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44660/0 (socket says 172.21.15.50:44660) 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.952+0000 7f5f40145640 1 -- 172.21.15.50:0/3473857163 learned_addr learned my addr 172.21.15.50:0/3473857163 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.952+0000 7f5f40145640 1 -- 172.21.15.50:0/3473857163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f82a0a47b0 con 0x55f829fa7a20 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.953+0000 7f5f40145640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a0a4270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b210 tx=0x7f5f30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.953+0000 7f5e2ce09640 1 -- 172.21.15.50:0/3473857163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3000f950 con 0x55f829fa7a20 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.953+0000 7f5e2ce09640 1 -- 172.21.15.50:0/3473857163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3000faf0 con 0x55f829fa7a20 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.953+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f82a0a4a40 con 0x55f829fa7a20 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.953+0000 7f5e2ce09640 1 -- 172.21.15.50:0/3473857163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3000fdd0 con 0x55f829fa7a20 2024-05-07T13:56:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.953+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f82a0a76f0 con 0x55f829fa7a20 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.954+0000 7f5e2ce09640 1 -- 172.21.15.50:0/3473857163 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f30017040 con 0x55f829fa7a20 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.954+0000 7f5e2ce09640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e28036900 0x7f5e28038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.954+0000 7f5e2ce09640 1 -- 172.21.15.50:0/3473857163 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5f30015020 con 0x55f829fa7a20 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.954+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e28036900 0x7f5e28038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.954+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f829fa9560 0x55f82a0ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.954+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ab9f0 con 0x55f829fa9560 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.954+0000 7f5f40946640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f829fa9560 0x55f82a0ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.954+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e28036900 0x7f5e28038dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5f34054000 tx=0x7f5f3404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.955+0000 7f5f40946640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f829fa9560 0x55f82a0ab4b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.955+0000 7f5f40946640 1 -- 172.21.15.50:0/3473857163 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f829fa9560 2024-05-07T13:56:08.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.955+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0a8a80 con 0x55f829fa9560 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.955+0000 7f5f40946640 1 -- 172.21.15.50:0/3473857163 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f829fa9560 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.955+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0add70 0x55f82a0b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.955+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0b0800 con 0x55f82a0add70 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.955+0000 7f5f40145640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0add70 0x55f82a0b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.955+0000 7f5f40145640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0add70 0x55f82a0b0160 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.956+0000 7f5f40145640 1 -- 172.21.15.50:0/3473857163 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f3002d070 con 0x55f82a0add70 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.956+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0acd20 con 0x55f829fa9560 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.956+0000 7f5f40946640 1 -- 172.21.15.50:0/3473857163 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f829fa9560 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.956+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f82a0b1cb0 0x55f82a0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.956+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0b4860 con 0x55f82a0b1cb0 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.956+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f82a0b1cb0 0x55f82a0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.957+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f82a0b1cb0 0x55f82a0b4100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.957+0000 7f5f3f944640 1 -- 172.21.15.50:0/3473857163 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f3405a040 con 0x55f82a0b1cb0 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.957+0000 7f5f4263f800 1 Processor -- start 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.957+0000 7f5f4263f800 1 -- start start 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.958+0000 7f5f4263f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0c2c70 0x55f82a0c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.958+0000 7f5f4263f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f829e9acf0 con 0x55f82a0c2c70 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.958+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0c2c70 0x55f82a0c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.958+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0c2c70 0x55f82a0c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44662/0 (socket says 172.21.15.50:44662) 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.958+0000 7f5f40145640 1 -- 172.21.15.50:0/3428415801 learned_addr learned my addr 172.21.15.50:0/3428415801 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.958+0000 7f5f40145640 1 -- 172.21.15.50:0/3428415801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f82a0c35d0 con 0x55f82a0c2c70 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.958+0000 7f5f40145640 1 --2- 172.21.15.50:0/3428415801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0c2c70 0x55f82a0c3090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5f3004b4b0 tx=0x7f5f3001aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.958+0000 7f5e25ffb640 1 -- 172.21.15.50:0/3428415801 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3001ade0 con 0x55f82a0c2c70 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.959+0000 7f5e25ffb640 1 -- 172.21.15.50:0/3428415801 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f30019470 con 0x55f82a0c2c70 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.959+0000 7f5f4263f800 1 -- 172.21.15.50:0/3428415801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f82a0c4040 con 0x55f82a0c2c70 2024-05-07T13:56:08.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.959+0000 7f5e25ffb640 1 -- 172.21.15.50:0/3428415801 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30019750 con 0x55f82a0c2c70 2024-05-07T13:56:08.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.959+0000 7f5f4263f800 1 -- 172.21.15.50:0/3428415801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f82a0c4540 con 0x55f82a0c2c70 2024-05-07T13:56:08.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.959+0000 7f5e25ffb640 1 -- 172.21.15.50:0/3428415801 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f3003f1b0 con 0x55f82a0c2c70 2024-05-07T13:56:08.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.959+0000 7f5e25ffb640 1 --2- 172.21.15.50:0/3428415801 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e180369c0 0x7f5e18038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.959+0000 7f5e25ffb640 1 -- 172.21.15.50:0/3428415801 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5f3003cc50 con 0x55f82a0c2c70 2024-05-07T13:56:08.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3428415801 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e180369c0 0x7f5e18038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f4263f800 1 Processor -- start 2024-05-07T13:56:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f4263f800 1 -- start start 2024-05-07T13:56:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3428415801 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e180369c0 0x7f5e18038e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55f82a0a89a0 tx=0x7f5f34005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f4263f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f4263f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f82a09cfc0 con 0x55f82a0d0080 2024-05-07T13:56:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44666/0 (socket says 172.21.15.50:44666) 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f40145640 1 -- 172.21.15.50:0/3053587048 learned_addr learned my addr 172.21.15.50:0/3053587048 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.960+0000 7f5f40145640 1 -- 172.21.15.50:0/3053587048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f82a0d0a70 con 0x55f82a0d0080 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5f40145640 1 --2- 172.21.15.50:0/3053587048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d04a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5f3001ac40 tx=0x7f5f30026920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372e5ea32dd5c1aa server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5e1f7fe640 1 -- 172.21.15.50:0/3053587048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30040e20 con 0x55f82a0d0080 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5e1f7fe640 1 -- 172.21.15.50:0/3053587048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f30027df0 con 0x55f82a0d0080 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5e1f7fe640 1 -- 172.21.15.50:0/3053587048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3001d040 con 0x55f82a0d0080 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5f4263f800 1 -- 172.21.15.50:0/3053587048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 msgr2=0x55f82a0d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3053587048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d04a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5f3001ac40 tx=0x7f5f30026920 comp rx=0 tx=0).stop 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5f4263f800 1 -- 172.21.15.50:0/3053587048 shutdown_connections 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3053587048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d04a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5f4263f800 1 -- 172.21.15.50:0/3053587048 >> 172.21.15.50:0/3053587048 conn(0x55f82a0cc350 msgr2=0x55f82a0ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5f4263f800 1 -- 172.21.15.50:0/3053587048 shutdown_connections 2024-05-07T13:56:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.961+0000 7f5f4263f800 1 -- 172.21.15.50:0/3053587048 wait complete. 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.962+0000 7f5f4263f800 1 Processor -- start 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.962+0000 7f5f4263f800 1 -- start start 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.962+0000 7f5f4263f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.962+0000 7f5f4263f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f82a0d1140 con 0x55f82a0d0080 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.962+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.962+0000 7f5f40145640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44670/0 (socket says 172.21.15.50:44670) 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.962+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 learned_addr learned my addr 172.21.15.50:0/3743943936 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.962+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f82a0d7910 con 0x55f82a0d0080 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.963+0000 7f5f40145640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d73d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5f3001ac40 tx=0x7f5f3001d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.963+0000 7f5e1dffb640 1 -- 172.21.15.50:0/3743943936 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f30040e20 con 0x55f82a0d0080 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.963+0000 7f5e1dffb640 1 -- 172.21.15.50:0/3743943936 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f30069070 con 0x55f82a0d0080 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.963+0000 7f5e1dffb640 1 -- 172.21.15.50:0/3743943936 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3001c710 con 0x55f82a0d0080 2024-05-07T13:56:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.963+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f82a0d7910 con 0x55f82a0d0080 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.963+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f82a0d7910 con 0x55f82a0d0080 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.964+0000 7f5e1dffb640 1 -- 172.21.15.50:0/3743943936 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f3003f4a0 con 0x55f82a0d0080 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.964+0000 7f5e1dffb640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e10036950 0x7f5e10038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.964+0000 7f5e1dffb640 1 -- 172.21.15.50:0/3743943936 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5f3006fcd0 con 0x55f82a0d0080 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.964+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e10036950 0x7f5e10038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.964+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e10036950 0x7f5e10038e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f3401ced0 tx=0x7f5f3404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f82a0e2a70 0x55f82a0e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e5680 con 0x55f82a0e2a70 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f40946640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f82a0e2a70 0x55f82a0e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f40946640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f82a0e2a70 0x55f82a0e4f30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f82a0e2a70 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f4263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f4263f800 20 realm 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.965+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e5a90 con 0x55f82a0e2a70 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f82a0e2a70 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6360 con 0x55f82a0e2a70 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f82a0e2a70 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e2a70 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f82a0e2a70 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0e7460 0x55f82a0e9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e9e60 con 0x55f82a0e7460 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f40145640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0e7460 0x55f82a0e9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.966+0000 7f5f40145640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0e7460 0x55f82a0e9850 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.967+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.967+0000 7f5f4263f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.967+0000 7f5f4263f800 20 searching for the correct realm 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.967+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0eb770 con 0x55f82a0e7460 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.967+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.967+0000 7f5f40145640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f30053070 0x7f5f3001ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.967+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0eb770 con 0x7f5f30053070 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.967+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f30053070 0x7f5f3001ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.968+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f30053070 0x7f5f3001ca10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.968+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.968+0000 7f5f3f944640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f34083040 0x7f5f34075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.968+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0eb770 con 0x7f5f34083040 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.968+0000 7f5f40946640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f34083040 0x7f5f34075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.969+0000 7f5f40946640 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f34083040 0x7f5f34075430 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.969+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4a0 con 0x7f5f34083040 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.969+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e2a70 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.969+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f82a0e2a70 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.969+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e2a70 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.969+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f82a0e2a70 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.969+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f34083040 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.970+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4a0 con 0x7f5f34083040 2024-05-07T13:56:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.970+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f34083040 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.970+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f3800a4a0 con 0x7f5f34083040 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.970+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f30053070 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.970+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.970+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e7460 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.970+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.970+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e2a70 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.971+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f82a0e2a70 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.971+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f34083040 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.971+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4a0 con 0x7f5f34083040 2024-05-07T13:56:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.971+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e2a70 2024-05-07T13:56:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.971+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f82a0e2a70 2024-05-07T13:56:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.971+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f30053070 2024-05-07T13:56:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.971+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.971+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e7460 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.972+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.972+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e7460 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.972+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.972+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f34083040 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.972+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4a0 con 0x7f5f34083040 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.972+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e7460 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.972+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.972+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e7460 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.973+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.973+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e2a70 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.973+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3800a4a0 con 0x55f82a0e2a70 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.973+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e2a70 2024-05-07T13:56:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.973+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.973+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f34083040 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.974+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.974+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e7460 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.974+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.974+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f30053070 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.974+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.974+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e2a70 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.974+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.974+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f34083040 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.975+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.975+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e7460 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.975+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.975+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f34083040 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.975+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.975+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f30053070 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.976+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.976+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e7460 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.976+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.976+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f34083040 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.976+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x55f82a0e2a70 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0e6700 con 0x7f5f30053070 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ea720 con 0x55f82a0e2a70 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.977+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0eab10 con 0x55f82a0e2a70 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0eab10 con 0x7f5f34083040 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 zone default found 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 4 Realm: () 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 zonegroup default 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ebbf0 con 0x7f5f34083040 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ed5d0 con 0x55f82a0e7460 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.978+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ed970 con 0x55f82a0e7460 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.979+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.979+0000 7f5f4263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.979+0000 7f5f4263f800 20 started sync module instance, tier type = 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.979+0000 7f5f4263f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.979+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0eca70 con 0x7f5f30053070 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.980+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.980+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94524345861568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0edd10 con 0x7f5f30053070 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.980+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ee560 con 0x55f82a0e2a70 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.981+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94524345861568] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.981+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.981+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94524345868464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ee4d0 con 0x55f82a0e2a70 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.981+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ef420 con 0x55f82a0e7460 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.982+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94524345868464] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.982+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.982+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94524345872240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ef7c0 con 0x55f82a0e7460 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.982+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f01c0 con 0x7f5f30053070 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.983+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94524345872240] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.983+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.983+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94524345870672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f0a90 con 0x7f5f30053070 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.983+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f1450 con 0x55f82a0e2a70 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.984+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94524345870672] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.984+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.984+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94524345880480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f1870 con 0x55f82a0e2a70 2024-05-07T13:56:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.984+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f2230 con 0x7f5f34083040 2024-05-07T13:56:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.985+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94524345880480] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.985+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.985+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94524345882016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f2230 con 0x7f5f34083040 2024-05-07T13:56:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.985+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f2bf0 con 0x7f5f34083040 2024-05-07T13:56:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.986+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.986+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94524345886528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f3010 con 0x7f5f34083040 2024-05-07T13:56:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.986+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f3b10 con 0x7f5f34083040 2024-05-07T13:56:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.986+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94524345882016] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94524345886528] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94524345890304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f3ad0 con 0x7f5f34083040 2024-05-07T13:56:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f4263f800 20 add_watcher() i=0 2024-05-07T13:56:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f4263f800 20 add_watcher() i=1 2024-05-07T13:56:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f4263f800 20 add_watcher() i=2 2024-05-07T13:56:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f4263f800 20 add_watcher() i=3 2024-05-07T13:56:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f4263f800 20 add_watcher() i=4 2024-05-07T13:56:08.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f4263f800 20 add_watcher() i=5 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.987+0000 7f5f4263f800 20 add_watcher() i=6 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.988+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94524345890304] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.988+0000 7f5f4263f800 20 add_watcher() i=7 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.988+0000 7f5f4263f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.988+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f1d80 con 0x55f82a0e2a70 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.989+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.989+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94524345887584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f4220 con 0x55f82a0e2a70 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.990+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94524345887584] v27'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.990+0000 7f5df67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.990+0000 7f5f4263f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.990+0000 7f5f4263f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.990+0000 7f5f4263f800 5 note: GC not initialized 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.990+0000 7f5df57e2640 20 reqs_thread_entry: start 2024-05-07T13:56:08.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.990+0000 7f5f4263f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 20 Filter name: none 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5d66ffd640 20 reqs_thread_entry: start 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a129ed0 con 0x7f5f34083040 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.991+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a128670 con 0x55f82a0e2a70 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 20 rados_obj.operate() r=0 bl.length=7 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f82a128a60 con 0x55f82a0e2a70 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.992+0000 7f5f4263f800 20 get_user_info_from_index found 0 xattrs 2024-05-07T13:56:08.992 INFO:teuthology.orchestra.run.smithi050.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.993+0000 7f5df67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.993+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94524345887584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0dea80 con 0x55f82a0e2a70 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.994+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94524345887584] v27'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.994+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94524345861568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f2b60 con 0x7f5f30053070 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.995+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94524345861568] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.995+0000 7f5f4263f800 20 remove_watcher() i=0 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.995+0000 7f5f4263f800 2 removed watcher, disabling cache 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.995+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94524345868464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ec5c0 con 0x55f82a0e2a70 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.996+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94524345868464] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.996+0000 7f5f4263f800 20 remove_watcher() i=1 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.996+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94524345872240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ee0b0 con 0x55f82a0e7460 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.997+0000 7f5f40145640 1 -- 172.21.15.50:0/3743943936 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94524345872240] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f30050020 con 0x55f82a0e7460 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.997+0000 7f5f4263f800 20 remove_watcher() i=2 2024-05-07T13:56:08.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.997+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94524345870672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ee0b0 con 0x7f5f30053070 2024-05-07T13:56:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.998+0000 7f5f3f944640 1 -- 172.21.15.50:0/3743943936 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94524345870672] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34070030 con 0x7f5f30053070 2024-05-07T13:56:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.998+0000 7f5f4263f800 20 remove_watcher() i=3 2024-05-07T13:56:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.998+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94524345880480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ee950 con 0x55f82a0e2a70 2024-05-07T13:56:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.999+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94524345880480] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x55f82a0e2a70 2024-05-07T13:56:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.999+0000 7f5f4263f800 20 remove_watcher() i=4 2024-05-07T13:56:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:08.999+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94524345882016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ee0b0 con 0x7f5f34083040 2024-05-07T13:56:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.000+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94524345882016] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.000+0000 7f5f4263f800 20 remove_watcher() i=5 2024-05-07T13:56:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.000+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94524345886528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0f0fa0 con 0x7f5f34083040 2024-05-07T13:56:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.001+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94524345886528] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.001+0000 7f5f4263f800 20 remove_watcher() i=6 2024-05-07T13:56:08.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.001+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94524345890304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f82a0ee950 con 0x7f5f34083040 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94524345890304] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3802f060 con 0x7f5f34083040 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 20 remove_watcher() i=7 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f34083040 msgr2=0x7f5f34075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f34083040 0x7f5f34075430 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f82a0e2a70 msgr2=0x55f82a0e4f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f82a0e2a70 0x55f82a0e4f30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f30053070 msgr2=0x7f5f3001ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f30053070 0x7f5f3001ca10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0e7460 msgr2=0x55f82a0e9850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0e7460 0x55f82a0e9850 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e10036950 msgr2=0x7f5e10038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e10036950 0x7f5e10038e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f3401ced0 tx=0x7f5f3404f000 comp rx=0 tx=0).stop 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 msgr2=0x55f82a0d73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f40946640 1 -- 172.21.15.50:0/3743943936 reap_dead start 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d73d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5f3001ac40 tx=0x7f5f3001d370 comp rx=0 tx=0).stop 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 shutdown_connections 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3743943936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0d0080 0x55f82a0d73d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 >> 172.21.15.50:0/3743943936 conn(0x55f82a0cc350 msgr2=0x55f82a0c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 shutdown_connections 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.002+0000 7f5f4263f800 1 -- 172.21.15.50:0/3743943936 wait complete. 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3428415801 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e180369c0 msgr2=0x7f5e18038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3428415801 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e180369c0 0x7f5e18038e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55f82a0a89a0 tx=0x7f5f34005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3428415801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0c2c70 msgr2=0x55f82a0c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:08.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3428415801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0c2c70 0x55f82a0c3090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5f3004b4b0 tx=0x7f5f3001aaf0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3428415801 shutdown_connections 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3428415801 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e180369c0 0x7f5e18038e80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3428415801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f82a0c2c70 0x55f82a0c3090 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3428415801 >> 172.21.15.50:0/3428415801 conn(0x55f82a0b6d10 msgr2=0x55f82a0b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3428415801 shutdown_connections 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3428415801 wait complete. 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f82a0b1cb0 msgr2=0x55f82a0b4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f82a0b1cb0 0x55f82a0b4100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f829fa9560 msgr2=0x55f82a0ab4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f829fa9560 0x55f82a0ab4b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0add70 msgr2=0x55f82a0b0160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f82a0add70 0x55f82a0b0160 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e28036900 msgr2=0x7f5e28038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e28036900 0x7f5e28038dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5f34054000 tx=0x7f5f3404e000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 msgr2=0x55f82a0a4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 --2- 172.21.15.50:0/3473857163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f829fa7a20 0x55f82a0a4270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b210 tx=0x7f5f30000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f40946640 1 -- 172.21.15.50:0/3473857163 reap_dead start 2024-05-07T13:56:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 shutdown_connections 2024-05-07T13:56:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 >> 172.21.15.50:0/3473857163 conn(0x55f829fa35c0 msgr2=0x55f82a096790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 shutdown_connections 2024-05-07T13:56:09.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.003+0000 7f5f4263f800 1 -- 172.21.15.50:0/3473857163 wait complete. 2024-05-07T13:56:09.002 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-05-07T13:56:09.002 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-07T13:56:09.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-07T13:56:09.002 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-07T13:56:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:09.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.060+0000 7f876b12e800 1 Processor -- start 2024-05-07T13:56:09.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.060+0000 7f876b12e800 1 -- start start 2024-05-07T13:56:09.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.060+0000 7f876b12e800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f7c89ac6f0 0x55f7c89aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.060+0000 7f876b12e800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7c89af020 con 0x55f7c89a8be0 2024-05-07T13:56:09.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.060+0000 7f876b12e800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55f7c8839050 con 0x55f7c89ac6f0 2024-05-07T13:56:09.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.061+0000 7f8766666640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f7c89ac6f0 0x55f7c89aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.061+0000 7f8766e67640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55f7c89a8be0 0x55f7c89aafd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39528/0 (socket says 172.21.15.50:39528) 2024-05-07T13:56:09.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.061+0000 7f8766e67640 1 -- 172.21.15.50:0/978047235 learned_addr learned my addr 172.21.15.50:0/978047235 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:09.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.061+0000 7f8766666640 1 --2- 172.21.15.50:0/978047235 >> v2:172.21.15.22:3300/0 conn(0x55f7c89ac6f0 0x55f7c89aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44682/0 (socket says 172.21.15.50:44682) 2024-05-07T13:56:09.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.061+0000 7f8766666640 1 -- 172.21.15.50:0/978047235 >> v1:172.21.15.22:6789/0 conn(0x55f7c89a8be0 legacy=0x55f7c89aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.061+0000 7f8766666640 1 -- 172.21.15.50:0/978047235 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c89b0200 con 0x55f7c89ac6f0 2024-05-07T13:56:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f8766666640 1 --2- 172.21.15.50:0/978047235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89ac6f0 0x55f7c89aeae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f875c00a470 tx=0x7f875c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b41c281e7c5430 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f8765e65640 1 -- 172.21.15.50:0/978047235 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875c057070 con 0x55f7c89ac6f0 2024-05-07T13:56:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f8765e65640 1 -- 172.21.15.50:0/978047235 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875c052570 con 0x55f7c89ac6f0 2024-05-07T13:56:09.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f8765e65640 1 -- 172.21.15.50:0/978047235 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875c052870 con 0x55f7c89ac6f0 2024-05-07T13:56:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f876b12e800 1 -- 172.21.15.50:0/978047235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89ac6f0 msgr2=0x55f7c89aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f876b12e800 1 --2- 172.21.15.50:0/978047235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89ac6f0 0x55f7c89aeae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f875c00a470 tx=0x7f875c01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f876b12e800 1 -- 172.21.15.50:0/978047235 shutdown_connections 2024-05-07T13:56:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f876b12e800 1 --2- 172.21.15.50:0/978047235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89ac6f0 0x55f7c89aeae0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f876b12e800 1 -- 172.21.15.50:0/978047235 >> 172.21.15.50:0/978047235 conn(0x55f7c89a25b0 msgr2=0x55f7c89a49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f876b12e800 1 -- 172.21.15.50:0/978047235 shutdown_connections 2024-05-07T13:56:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.063+0000 7f876b12e800 1 -- 172.21.15.50:0/978047235 wait complete. 2024-05-07T13:56:09.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.078+0000 7f876b12e800 1 Processor -- start 2024-05-07T13:56:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.079+0000 7f876b12e800 1 -- start start 2024-05-07T13:56:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.079+0000 7f876b12e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8a99710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.079+0000 7f876b12e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7c88f31d0 con 0x55f7c89a8be0 2024-05-07T13:56:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.079+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8a99710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.079+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8a99710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44698/0 (socket says 172.21.15.50:44698) 2024-05-07T13:56:09.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.079+0000 7f8766e67640 1 -- 172.21.15.50:0/2890748716 learned_addr learned my addr 172.21.15.50:0/2890748716 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.079+0000 7f8766e67640 1 -- 172.21.15.50:0/2890748716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c8a99ce0 con 0x55f7c89a8be0 2024-05-07T13:56:09.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.079+0000 7f8766e67640 1 --2- 172.21.15.50:0/2890748716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8a99710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8758001de0 tx=0x7f875800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87c3e7507e34af5 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f8654e09640 1 -- 172.21.15.50:0/2890748716 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8758012020 con 0x55f7c89a8be0 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f8654e09640 1 -- 172.21.15.50:0/2890748716 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875800e5a0 con 0x55f7c89a8be0 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f8654e09640 1 -- 172.21.15.50:0/2890748716 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875800e8c0 con 0x55f7c89a8be0 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f876b12e800 1 -- 172.21.15.50:0/2890748716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 msgr2=0x55f7c8a99710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f876b12e800 1 --2- 172.21.15.50:0/2890748716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8a99710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8758001de0 tx=0x7f875800b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f876b12e800 1 -- 172.21.15.50:0/2890748716 shutdown_connections 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f876b12e800 1 --2- 172.21.15.50:0/2890748716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8a99710 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f876b12e800 1 -- 172.21.15.50:0/2890748716 >> 172.21.15.50:0/2890748716 conn(0x55f7c89a25b0 msgr2=0x55f7c8a95030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f876b12e800 1 -- 172.21.15.50:0/2890748716 shutdown_connections 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.080+0000 7f876b12e800 1 -- 172.21.15.50:0/2890748716 wait complete. 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.081+0000 7f876b12e800 1 Processor -- start 2024-05-07T13:56:09.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.081+0000 7f876b12e800 1 -- start start 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.081+0000 7f876b12e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8aa1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.081+0000 7f876b12e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7c89af4f0 con 0x55f7c89a8be0 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.081+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8aa1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.081+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8aa1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44714/0 (socket says 172.21.15.50:44714) 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.081+0000 7f8766e67640 1 -- 172.21.15.50:0/1441482586 learned_addr learned my addr 172.21.15.50:0/1441482586 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.081+0000 7f8766e67640 1 -- 172.21.15.50:0/1441482586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c8aa1770 con 0x55f7c89a8be0 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.082+0000 7f8766e67640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8aa1230 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f875800c010 tx=0x7f8758000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.082+0000 7f8653606640 1 -- 172.21.15.50:0/1441482586 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8758012070 con 0x55f7c89a8be0 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.082+0000 7f8653606640 1 -- 172.21.15.50:0/1441482586 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875801a7a0 con 0x55f7c89a8be0 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.082+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7c8aa1a00 con 0x55f7c89a8be0 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.082+0000 7f8653606640 1 -- 172.21.15.50:0/1441482586 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875801aa80 con 0x55f7c89a8be0 2024-05-07T13:56:09.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.082+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7c8aa46b0 con 0x55f7c89a8be0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.083+0000 7f8653606640 1 -- 172.21.15.50:0/1441482586 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8758015020 con 0x55f7c89a8be0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.083+0000 7f8653606640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f864c036950 0x7f864c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.083+0000 7f8653606640 1 -- 172.21.15.50:0/1441482586 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8758020070 con 0x55f7c89a8be0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.083+0000 7f8766666640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f864c036950 0x7f864c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.083+0000 7f876b12e800 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c89ac6f0 0x55f7c8aa8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.083+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aa89b0 con 0x55f7c89ac6f0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.083+0000 7f8767668640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c89ac6f0 0x55f7c8aa8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.083+0000 7f8766666640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f864c036950 0x7f864c038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f875c054000 tx=0x7f875c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.083+0000 7f8767668640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c89ac6f0 0x55f7c8aa8470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.084+0000 7f8767668640 1 -- 172.21.15.50:0/1441482586 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c89ac6f0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.084+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aa5a40 con 0x55f7c89ac6f0 2024-05-07T13:56:09.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.084+0000 7f8767668640 1 -- 172.21.15.50:0/1441482586 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c89ac6f0 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.084+0000 7f876b12e800 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8aaad50 0x55f7c8aad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.084+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aad7e0 con 0x55f7c8aaad50 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.084+0000 7f8766e67640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8aaad50 0x55f7c8aad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.084+0000 7f8766e67640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8aaad50 0x55f7c8aad140 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.085+0000 7f8766e67640 1 -- 172.21.15.50:0/1441482586 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8aaad50 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.085+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aa9d00 con 0x55f7c89ac6f0 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.085+0000 7f8767668640 1 -- 172.21.15.50:0/1441482586 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c89ac6f0 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.085+0000 7f876b12e800 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7c8aaec90 0x55f7c8ab10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.085+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ab1840 con 0x55f7c8aaec90 2024-05-07T13:56:09.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.085+0000 7f8766666640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7c8aaec90 0x55f7c8ab10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.086+0000 7f8766666640 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7c8aaec90 0x55f7c8ab10e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.086+0000 7f8766666640 1 -- 172.21.15.50:0/1441482586 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f875c05a040 con 0x55f7c8aaec90 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.086+0000 7f876b12e800 1 Processor -- start 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.086+0000 7f876b12e800 1 -- start start 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.086+0000 7f876b12e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c8abfc50 0x55f7c8ac0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.086+0000 7f876b12e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7c8899cf0 con 0x55f7c8abfc50 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c8abfc50 0x55f7c8ac0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c8abfc50 0x55f7c8ac0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44728/0 (socket says 172.21.15.50:44728) 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f8766e67640 1 -- 172.21.15.50:0/166332000 learned_addr learned my addr 172.21.15.50:0/166332000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f8766e67640 1 -- 172.21.15.50:0/166332000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c8ac05b0 con 0x55f7c8abfc50 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f8766e67640 1 --2- 172.21.15.50:0/166332000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c8abfc50 0x55f7c8ac0070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f875804aa30 tx=0x7f875804c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f8650e01640 1 -- 172.21.15.50:0/166332000 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87580490e0 con 0x55f7c8abfc50 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f8650e01640 1 -- 172.21.15.50:0/166332000 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8758049280 con 0x55f7c8abfc50 2024-05-07T13:56:09.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f876b12e800 1 -- 172.21.15.50:0/166332000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7c8ac1020 con 0x55f7c8abfc50 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f8650e01640 1 -- 172.21.15.50:0/166332000 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8758049560 con 0x55f7c8abfc50 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.087+0000 7f876b12e800 1 -- 172.21.15.50:0/166332000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7c8ac1520 con 0x55f7c8abfc50 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.088+0000 7f8650e01640 1 -- 172.21.15.50:0/166332000 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8758044000 con 0x55f7c8abfc50 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.088+0000 7f8650e01640 1 --2- 172.21.15.50:0/166332000 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f86400369c0 0x7f8640038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.088+0000 7f8650e01640 1 -- 172.21.15.50:0/166332000 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8758039c90 con 0x55f7c8abfc50 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.088+0000 7f8766666640 1 --2- 172.21.15.50:0/166332000 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f86400369c0 0x7f8640038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.088+0000 7f876b12e800 1 Processor -- start 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.089+0000 7f876b12e800 1 -- start start 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.089+0000 7f8766666640 1 --2- 172.21.15.50:0/166332000 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f86400369c0 0x7f8640038e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55f7c8aa5960 tx=0x7f875c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.089+0000 7f876b12e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c89a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.089+0000 7f876b12e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7c8a9a060 con 0x55f7c89a81d0 2024-05-07T13:56:09.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.089+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c89a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.089+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c89a85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44736/0 (socket says 172.21.15.50:44736) 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.089+0000 7f8766e67640 1 -- 172.21.15.50:0/2011413738 learned_addr learned my addr 172.21.15.50:0/2011413738 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.089+0000 7f8766e67640 1 -- 172.21.15.50:0/2011413738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c89a69d0 con 0x55f7c89a81d0 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f8766e67640 1 --2- 172.21.15.50:0/2011413738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c89a85f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f875801ffd0 tx=0x7f8758003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1ffd933e02dd40 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f864a7fc640 1 -- 172.21.15.50:0/2011413738 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875802e450 con 0x55f7c89a81d0 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f864a7fc640 1 -- 172.21.15.50:0/2011413738 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875805b070 con 0x55f7c89a81d0 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f864a7fc640 1 -- 172.21.15.50:0/2011413738 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875800d500 con 0x55f7c89a81d0 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f876b12e800 1 -- 172.21.15.50:0/2011413738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 msgr2=0x55f7c89a85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f876b12e800 1 --2- 172.21.15.50:0/2011413738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c89a85f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f875801ffd0 tx=0x7f8758003ec0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f876b12e800 1 -- 172.21.15.50:0/2011413738 shutdown_connections 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f876b12e800 1 --2- 172.21.15.50:0/2011413738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c89a85f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f876b12e800 1 -- 172.21.15.50:0/2011413738 >> 172.21.15.50:0/2011413738 conn(0x55f7c8ac90d0 msgr2=0x55f7c8ac7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f876b12e800 1 -- 172.21.15.50:0/2011413738 shutdown_connections 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f876b12e800 1 -- 172.21.15.50:0/2011413738 wait complete. 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.090+0000 7f876b12e800 1 Processor -- start 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.091+0000 7f876b12e800 1 -- start start 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.091+0000 7f876b12e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c8ad6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.091+0000 7f876b12e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7c89a6de0 con 0x55f7c89a81d0 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.091+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c8ad6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.091+0000 7f8766e67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c8ad6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44744/0 (socket says 172.21.15.50:44744) 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.091+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 learned_addr learned my addr 172.21.15.50:0/2175299856 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.091+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c8ad6880 con 0x55f7c89a81d0 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.091+0000 7f8766e67640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c8ad6340 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f875801ffd0 tx=0x7f875802ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.092+0000 7f8648ff9640 1 -- 172.21.15.50:0/2175299856 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875803eb40 con 0x55f7c89a81d0 2024-05-07T13:56:09.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.092+0000 7f8648ff9640 1 -- 172.21.15.50:0/2175299856 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8758066070 con 0x55f7c89a81d0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.092+0000 7f8648ff9640 1 -- 172.21.15.50:0/2175299856 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875804c6e0 con 0x55f7c89a81d0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.092+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7c8ad6880 con 0x55f7c89a81d0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.092+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7c8ad6880 con 0x55f7c89a81d0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.092+0000 7f8648ff9640 1 -- 172.21.15.50:0/2175299856 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8758055070 con 0x55f7c89a81d0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.093+0000 7f8648ff9640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8630036950 0x7f8630038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.093+0000 7f8648ff9640 1 -- 172.21.15.50:0/2175299856 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f875806e120 con 0x55f7c89a81d0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.093+0000 7f8766666640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8630036950 0x7f8630038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.093+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.093+0000 7f876b12e800 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c8ae19d0 0x55f7c8ae3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.093+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae45e0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.093+0000 7f8767668640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c8ae19d0 0x55f7c8ae3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.093+0000 7f8766666640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8630036950 0x7f8630038e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55f7c8ab1c40 tx=0x7f875c04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f8767668640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c8ae19d0 0x55f7c8ae3e90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 20 realm 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae49f0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae52c0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x55f7c8ae19d0 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.094+0000 7f876b12e800 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8ae6150 0x55f7c8ae8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.095+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae8ca0 con 0x55f7c8ae6150 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.095+0000 7f8766e67640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8ae6150 0x55f7c8ae8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.095+0000 7f8766e67640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8ae6150 0x55f7c8ae8540 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.095+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.095+0000 7f876b12e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.095+0000 7f876b12e800 20 searching for the correct realm 2024-05-07T13:56:09.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.095+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aea680 con 0x55f7c8ae6150 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.096+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.096+0000 7f8766e67640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8758062040 0x7f875805f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.096+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aea680 con 0x7f8758062040 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.096+0000 7f8766666640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8758062040 0x7f875805f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.096+0000 7f8766666640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8758062040 0x7f875805f870 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.096+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.096+0000 7f8766666640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f875c074040 0x7f875c081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.096+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aea680 con 0x7f875c074040 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.097+0000 7f8767668640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f875c074040 0x7f875c081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.097+0000 7f8767668640 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f875c074040 0x7f875c081410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.097+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.097+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x55f7c8ae19d0 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.097+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.097+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x55f7c8ae19d0 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.098+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.098+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x7f875c074040 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.098+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.098+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x7f875c074040 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.098+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.098+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x7f8758062040 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.098+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.098+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x55f7c8ae6150 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.099+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.099+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x55f7c8ae19d0 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.099+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.099+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x7f875c074040 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.099+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.099+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x55f7c8ae19d0 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.100+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.100+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae5660 con 0x7f8758062040 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.100+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.100+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae6150 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.100+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.100+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae6150 2024-05-07T13:56:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.100+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.100+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x7f875c074040 2024-05-07T13:56:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.101+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.101+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae6150 2024-05-07T13:56:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.101+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.101+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae6150 2024-05-07T13:56:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.101+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.101+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae19d0 2024-05-07T13:56:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.101+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.101+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae19d0 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.102+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.102+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x7f875c074040 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.102+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.102+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae6150 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.102+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.102+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x7f8758062040 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.102+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.102+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae19d0 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.103+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.103+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x7f875c074040 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.103+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.103+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae6150 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.103+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.103+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x7f875c074040 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.104+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.104+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x7f8758062040 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.104+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.104+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae6150 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.104+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.104+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x7f875c074040 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.104+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.104+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x55f7c8ae19d0 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.104+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f875c08e060 con 0x7f8758062040 2024-05-07T13:56:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae9650 con 0x55f7c8ae19d0 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae9a40 con 0x55f7c8ae19d0 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.105+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae9a40 con 0x7f875c074040 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 zone default found 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 4 Realm: () 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 zonegroup default 2024-05-07T13:56:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae9e60 con 0x7f875c074040 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8ae9e60 con 0x55f7c8ae6150 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aec530 con 0x55f7c8ae6150 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 started sync module instance, tier type = 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.106+0000 7f876b12e800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.107+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aeb9d0 con 0x7f8758062040 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.108+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.108+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522712178112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aeb630 con 0x7f8758062040 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.108+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aed3a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.109+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522712178112] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.109+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.109+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522712182512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aed7c0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.109+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aee180 con 0x55f7c8ae6150 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.110+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.110+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522712186064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aee5e0 con 0x55f7c8ae6150 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.110+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aef100 con 0x7f8758062040 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.110+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522712182512] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.111+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522712186064] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.111+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.111+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522712189904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aee0f0 con 0x7f8758062040 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.111+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aefb10 con 0x55f7c8ae19d0 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.112+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.112+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522712189904] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.112+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522712192880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8af01a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.112+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aed350 con 0x7f875c074040 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.113+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522712192880] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.113+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.113+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522712194032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aed350 con 0x7f875c074040 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.113+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8af1230 con 0x7f875c074040 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.114+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.114+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522712198528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8af1650 con 0x7f875c074040 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.114+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8af2110 con 0x7f875c074040 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.114+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522712194032] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522712198528] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522712196960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8af1650 con 0x7f875c074040 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f876b12e800 20 add_watcher() i=0 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f876b12e800 20 add_watcher() i=1 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f876b12e800 20 add_watcher() i=2 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f876b12e800 20 add_watcher() i=3 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f876b12e800 20 add_watcher() i=4 2024-05-07T13:56:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f876b12e800 20 add_watcher() i=5 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.115+0000 7f876b12e800 20 add_watcher() i=6 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.116+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522712196960] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.116+0000 7f876b12e800 20 add_watcher() i=7 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.116+0000 7f876b12e800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.116+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8af5100 con 0x55f7c8ae19d0 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.117+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.117+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522712200048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8af2580 con 0x55f7c8ae19d0 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522712200048] v27'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f861d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f876b12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f876b12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f876b12e800 5 note: GC not initialized 2024-05-07T13:56:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f8597fff640 20 reqs_thread_entry: start 2024-05-07T13:56:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f876b12e800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f876b12e800 20 Filter name: none 2024-05-07T13:56:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f8595ffb640 20 reqs_thread_entry: start 2024-05-07T13:56:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f876b12e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.118+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8b28000 con 0x55f7c8ae19d0 2024-05-07T13:56:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.119+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.119+0000 7f876b12e800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:09.120 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.120+0000 7f861d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.120+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522712200048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8b26f50 con 0x55f7c8ae19d0 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.121+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94522712200048] v27'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.121+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522712178112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8af1340 con 0x7f8758062040 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.121+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94522712178112] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.122+0000 7f876b12e800 20 remove_watcher() i=0 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.122+0000 7f876b12e800 2 removed watcher, disabling cache 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.122+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522712182512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aebdc0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.123+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94522712182512] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.123+0000 7f876b12e800 20 remove_watcher() i=1 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.123+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522712186064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aebdc0 con 0x55f7c8ae6150 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.124+0000 7f8766e67640 1 -- 172.21.15.50:0/2175299856 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94522712186064] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875802b070 con 0x55f7c8ae6150 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.124+0000 7f876b12e800 20 remove_watcher() i=2 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.124+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522712189904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aedcd0 con 0x7f8758062040 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.125+0000 7f8766666640 1 -- 172.21.15.50:0/2175299856 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94522712189904] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875c07f070 con 0x7f8758062040 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.125+0000 7f876b12e800 20 remove_watcher() i=3 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.125+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522712192880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aebdc0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.126+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94522712192880] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x55f7c8ae19d0 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.126+0000 7f876b12e800 20 remove_watcher() i=4 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.126+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522712194032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aedcd0 con 0x7f875c074040 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.127+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94522712194032] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.127+0000 7f876b12e800 20 remove_watcher() i=5 2024-05-07T13:56:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.127+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522712198528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aef770 con 0x7f875c074040 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.128+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94522712198528] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.128+0000 7f876b12e800 20 remove_watcher() i=6 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.128+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522712196960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f7c8aebdc0 con 0x7f875c074040 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94522712196960] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876000a4a0 con 0x7f875c074040 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 20 remove_watcher() i=7 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f875c074040 msgr2=0x7f875c081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f875c074040 0x7f875c081410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c8ae19d0 msgr2=0x55f7c8ae3e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c8ae19d0 0x55f7c8ae3e90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8758062040 msgr2=0x7f875805f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8758062040 0x7f875805f870 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8ae6150 msgr2=0x55f7c8ae8540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8ae6150 0x55f7c8ae8540 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8630036950 msgr2=0x7f8630038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8630036950 0x7f8630038e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55f7c8ab1c40 tx=0x7f875c04f000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 msgr2=0x55f7c8ad6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c8ad6340 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f875801ffd0 tx=0x7f875802ef30 comp rx=0 tx=0).stop 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f8767668640 1 -- 172.21.15.50:0/2175299856 reap_dead start 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 shutdown_connections 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 --2- 172.21.15.50:0/2175299856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a81d0 0x55f7c8ad6340 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 >> 172.21.15.50:0/2175299856 conn(0x55f7c8ac90d0 msgr2=0x55f7c8ac6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 shutdown_connections 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.129+0000 7f876b12e800 1 -- 172.21.15.50:0/2175299856 wait complete. 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/166332000 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f86400369c0 msgr2=0x7f8640038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 --2- 172.21.15.50:0/166332000 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f86400369c0 0x7f8640038e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55f7c8aa5960 tx=0x7f875c005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/166332000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c8abfc50 msgr2=0x55f7c8ac0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 --2- 172.21.15.50:0/166332000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c8abfc50 0x55f7c8ac0070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f875804aa30 tx=0x7f875804c480 comp rx=0 tx=0).stop 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/166332000 shutdown_connections 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 --2- 172.21.15.50:0/166332000 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f86400369c0 0x7f8640038e80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 --2- 172.21.15.50:0/166332000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c8abfc50 0x55f7c8ac0070 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/166332000 >> 172.21.15.50:0/166332000 conn(0x55f7c8ab3cf0 msgr2=0x55f7c8ab40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/166332000 shutdown_connections 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/166332000 wait complete. 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7c8aaec90 msgr2=0x55f7c8ab10e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7c8aaec90 0x55f7c8ab10e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c89ac6f0 msgr2=0x55f7c8aa8470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7c89ac6f0 0x55f7c8aa8470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8aaad50 msgr2=0x55f7c8aad140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7c8aaad50 0x55f7c8aad140 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f864c036950 msgr2=0x7f864c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f864c036950 0x7f864c038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f875c054000 tx=0x7f875c04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 msgr2=0x55f7c8aa1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 --2- 172.21.15.50:0/1441482586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7c89a8be0 0x55f7c8aa1230 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f875800c010 tx=0x7f8758000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f8767668640 1 -- 172.21.15.50:0/1441482586 reap_dead start 2024-05-07T13:56:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 shutdown_connections 2024-05-07T13:56:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 >> 172.21.15.50:0/1441482586 conn(0x55f7c89a25b0 msgr2=0x55f7c8a93830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 shutdown_connections 2024-05-07T13:56:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.130+0000 7f876b12e800 1 -- 172.21.15.50:0/1441482586 wait complete. 2024-05-07T13:56:09.132 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:09.132 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-07T13:56:09.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-07T13:56:09.133 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-07T13:56:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.190+0000 7f1cd9a16800 1 Processor -- start 2024-05-07T13:56:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.190+0000 7f1cd9a16800 1 -- start start 2024-05-07T13:56:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.190+0000 7f1cd9a16800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x563c58e56550 0x563c58e5f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.190+0000 7f1cd9a16800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563c58dc9070 con 0x563c58e54a10 2024-05-07T13:56:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.190+0000 7f1cd9a16800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x563c58ce7050 con 0x563c58e56550 2024-05-07T13:56:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.191+0000 7f1cd4883640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x563c58e56550 0x563c58e5f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.191+0000 7f1cd4883640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x563c58e56550 0x563c58e5f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44748/0 (socket says 172.21.15.50:44748) 2024-05-07T13:56:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.191+0000 7f1cd5084640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x563c58e54a10 0x563c58e54e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39532/0 (socket says 172.21.15.50:39532) 2024-05-07T13:56:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.191+0000 7f1cd4883640 1 -- 172.21.15.50:0/1579991336 learned_addr learned my addr 172.21.15.50:0/1579991336 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.191+0000 7f1cd4883640 1 -- 172.21.15.50:0/1579991336 >> v1:172.21.15.22:6789/0 conn(0x563c58e54a10 legacy=0x563c58e54e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.191+0000 7f1cc7fff640 1 -- 172.21.15.50:0/1579991336 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728612756 0 0) 0x563c58dc9070 con 0x563c58e54a10 2024-05-07T13:56:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.191+0000 7f1cd4883640 1 -- 172.21.15.50:0/1579991336 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c58dc9240 con 0x563c58e56550 2024-05-07T13:56:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.193+0000 7f1cd4883640 1 --2- 172.21.15.50:0/1579991336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e56550 0x563c58e5f050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00a520 tx=0x7f1ccc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18518882c06cd977 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.193+0000 7f1cc7fff640 1 -- 172.21.15.50:0/1579991336 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc057070 con 0x563c58e56550 2024-05-07T13:56:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.193+0000 7f1cc7fff640 1 -- 172.21.15.50:0/1579991336 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc052570 con 0x563c58e56550 2024-05-07T13:56:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.193+0000 7f1cc7fff640 1 -- 172.21.15.50:0/1579991336 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc04ae60 con 0x563c58e56550 2024-05-07T13:56:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.194+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1579991336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e56550 msgr2=0x563c58e5f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.194+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/1579991336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e56550 0x563c58e5f050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00a520 tx=0x7f1ccc01d010 comp rx=0 tx=0).stop 2024-05-07T13:56:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.194+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1579991336 shutdown_connections 2024-05-07T13:56:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.194+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/1579991336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e56550 0x563c58e5f050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.194+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1579991336 >> 172.21.15.50:0/1579991336 conn(0x563c58e505b0 msgr2=0x563c58e529d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.194+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1579991336 shutdown_connections 2024-05-07T13:56:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.194+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1579991336 wait complete. 2024-05-07T13:56:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.208+0000 7f1cd9a16800 1 Processor -- start 2024-05-07T13:56:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.208+0000 7f1cd9a16800 1 -- start start 2024-05-07T13:56:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.208+0000 7f1cd9a16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f49720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.208+0000 7f1cd9a16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563c58da11d0 con 0x563c58e54a10 2024-05-07T13:56:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.209+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f49720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.209+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f49720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44754/0 (socket says 172.21.15.50:44754) 2024-05-07T13:56:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.209+0000 7f1cd5084640 1 -- 172.21.15.50:0/1558245046 learned_addr learned my addr 172.21.15.50:0/1558245046 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.209+0000 7f1cd5084640 1 -- 172.21.15.50:0/1558245046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c58f49cf0 con 0x563c58e54a10 2024-05-07T13:56:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.209+0000 7f1cd5084640 1 --2- 172.21.15.50:0/1558245046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f49720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800b210 tx=0x7f1cc800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6eca9f7db9a541 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.209+0000 7f1bc3606640 1 -- 172.21.15.50:0/1558245046 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc8008070 con 0x563c58e54a10 2024-05-07T13:56:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.209+0000 7f1bc3606640 1 -- 172.21.15.50:0/1558245046 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc800d500 con 0x563c58e54a10 2024-05-07T13:56:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.209+0000 7f1bc3606640 1 -- 172.21.15.50:0/1558245046 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc800d840 con 0x563c58e54a10 2024-05-07T13:56:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1558245046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 msgr2=0x563c58f49720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/1558245046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f49720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800b210 tx=0x7f1cc800b6d0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1558245046 shutdown_connections 2024-05-07T13:56:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/1558245046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f49720 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1558245046 >> 172.21.15.50:0/1558245046 conn(0x563c58e505b0 msgr2=0x563c58f45040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1558245046 shutdown_connections 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 -- 172.21.15.50:0/1558245046 wait complete. 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 Processor -- start 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 -- start start 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f51290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.210+0000 7f1cd9a16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563c58e5f860 con 0x563c58e54a10 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f51290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f51290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44760/0 (socket says 172.21.15.50:44760) 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1cd5084640 1 -- 172.21.15.50:0/2665449131 learned_addr learned my addr 172.21.15.50:0/2665449131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1cd5084640 1 -- 172.21.15.50:0/2665449131 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c58f517d0 con 0x563c58e54a10 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1cd5084640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f51290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800b210 tx=0x7f1cc8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1bc1e03640 1 -- 172.21.15.50:0/2665449131 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc800f950 con 0x563c58e54a10 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1bc1e03640 1 -- 172.21.15.50:0/2665449131 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc800faf0 con 0x563c58e54a10 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c58f51a60 con 0x563c58e54a10 2024-05-07T13:56:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1bc1e03640 1 -- 172.21.15.50:0/2665449131 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc800fdd0 con 0x563c58e54a10 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.211+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c58f54710 con 0x563c58e54a10 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.212+0000 7f1bc1e03640 1 -- 172.21.15.50:0/2665449131 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1cc8017040 con 0x563c58e54a10 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.212+0000 7f1bc1e03640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bbc036950 0x7f1bbc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.212+0000 7f1bc1e03640 1 -- 172.21.15.50:0/2665449131 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1cc8015020 con 0x563c58e54a10 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.212+0000 7f1cd4883640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bbc036950 0x7f1bbc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.212+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58e56550 0x563c58f584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.213+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f58a10 con 0x563c58e56550 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.213+0000 7f1cd5885640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58e56550 0x563c58f584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.213+0000 7f1cd4883640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bbc036950 0x7f1bbc038e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc054000 tx=0x7f1ccc04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.213+0000 7f1cd5885640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58e56550 0x563c58f584d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.213+0000 7f1cd5885640 1 -- 172.21.15.50:0/2665449131 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58e56550 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.213+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f55aa0 con 0x563c58e56550 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.213+0000 7f1cd5885640 1 -- 172.21.15.50:0/2665449131 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58e56550 2024-05-07T13:56:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.214+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f5ad20 0x563c58f5d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.214+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f5d800 con 0x563c58f5ad20 2024-05-07T13:56:09.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.214+0000 7f1cd5084640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f5ad20 0x563c58f5d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.214+0000 7f1cd5084640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f5ad20 0x563c58f5d110 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.214+0000 7f1cd5084640 1 -- 172.21.15.50:0/2665449131 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1cc802d070 con 0x563c58f5ad20 2024-05-07T13:56:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.214+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f59cd0 con 0x563c58e56550 2024-05-07T13:56:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.214+0000 7f1cd5885640 1 -- 172.21.15.50:0/2665449131 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58e56550 2024-05-07T13:56:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.214+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563c58f5ecb0 0x563c58f61100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.215+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f61860 con 0x563c58f5ecb0 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.215+0000 7f1cd4883640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563c58f5ecb0 0x563c58f61100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.215+0000 7f1cd4883640 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563c58f5ecb0 0x563c58f61100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.216+0000 7f1cd4883640 1 -- 172.21.15.50:0/2665449131 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ccc05a040 con 0x563c58f5ecb0 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.216+0000 7f1cd9a16800 1 Processor -- start 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.216+0000 7f1cd9a16800 1 -- start start 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.216+0000 7f1cd9a16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f6fcc0 0x563c58f700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.216+0000 7f1cd9a16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563c58d47cf0 con 0x563c58f6fcc0 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.216+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f6fcc0 0x563c58f700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.216+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f6fcc0 0x563c58f700e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44768/0 (socket says 172.21.15.50:44768) 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.216+0000 7f1cd5084640 1 -- 172.21.15.50:0/3982440110 learned_addr learned my addr 172.21.15.50:0/3982440110 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.217+0000 7f1cd5084640 1 -- 172.21.15.50:0/3982440110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c58f70620 con 0x563c58f6fcc0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.217+0000 7f1cd5084640 1 --2- 172.21.15.50:0/3982440110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f6fcc0 0x563c58f700e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1cc804b450 tx=0x7f1cc801aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.217+0000 7f1bbaffd640 1 -- 172.21.15.50:0/3982440110 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc801ade0 con 0x563c58f6fcc0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.217+0000 7f1bbaffd640 1 -- 172.21.15.50:0/3982440110 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc8019470 con 0x563c58f6fcc0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.217+0000 7f1bbaffd640 1 -- 172.21.15.50:0/3982440110 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc8019790 con 0x563c58f6fcc0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.217+0000 7f1cd9a16800 1 -- 172.21.15.50:0/3982440110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c58f71090 con 0x563c58f6fcc0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.217+0000 7f1cd9a16800 1 -- 172.21.15.50:0/3982440110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c58f71590 con 0x563c58f6fcc0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.217+0000 7f1bbaffd640 1 -- 172.21.15.50:0/3982440110 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1cc8050060 con 0x563c58f6fcc0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.218+0000 7f1bbaffd640 1 --2- 172.21.15.50:0/3982440110 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bac036950 0x7f1bac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.218+0000 7f1bbaffd640 1 -- 172.21.15.50:0/3982440110 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1cc804e070 con 0x563c58f6fcc0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.218+0000 7f1cd4883640 1 --2- 172.21.15.50:0/3982440110 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bac036950 0x7f1bac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.218+0000 7f1cd9a16800 1 Processor -- start 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.218+0000 7f1cd9a16800 1 -- start start 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.218+0000 7f1cd4883640 1 --2- 172.21.15.50:0/3982440110 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bac036950 0x7f1bac038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x563c58f592d0 tx=0x7f1ccc005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.218+0000 7f1cd9a16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f7d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.218+0000 7f1cd9a16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563c58f4a070 con 0x563c58f7cf60 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.219+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f7d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.219+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f7d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44772/0 (socket says 172.21.15.50:44772) 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.219+0000 7f1cd5084640 1 -- 172.21.15.50:0/4139839367 learned_addr learned my addr 172.21.15.50:0/4139839367 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.219+0000 7f1cd5084640 1 -- 172.21.15.50:0/4139839367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c58f7d950 con 0x563c58f7cf60 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.219+0000 7f1cd5084640 1 --2- 172.21.15.50:0/4139839367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f7d380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80017b0 tx=0x7f1cc8030bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8750a6ade29d4cfe server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.219+0000 7f1bb8ff9640 1 -- 172.21.15.50:0/4139839367 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc803e040 con 0x563c58f7cf60 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.219+0000 7f1bb8ff9640 1 -- 172.21.15.50:0/4139839367 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc803f250 con 0x563c58f7cf60 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.219+0000 7f1bb8ff9640 1 -- 172.21.15.50:0/4139839367 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc8040b10 con 0x563c58f7cf60 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 -- 172.21.15.50:0/4139839367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 msgr2=0x563c58f7d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/4139839367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f7d380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80017b0 tx=0x7f1cc8030bd0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 -- 172.21.15.50:0/4139839367 shutdown_connections 2024-05-07T13:56:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/4139839367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f7d380 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 -- 172.21.15.50:0/4139839367 >> 172.21.15.50:0/4139839367 conn(0x563c58f792c0 msgr2=0x563c58f77320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 -- 172.21.15.50:0/4139839367 shutdown_connections 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 -- 172.21.15.50:0/4139839367 wait complete. 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 Processor -- start 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 -- start start 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f84360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd9a16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563c58f7e000 con 0x563c58f7cf60 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f84360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd5084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f84360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44786/0 (socket says 172.21.15.50:44786) 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.220+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 learned_addr learned my addr 172.21.15.50:0/982306959 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.221+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c58f848a0 con 0x563c58f7cf60 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.221+0000 7f1cd5084640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f84360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8026820 tx=0x7f1cc8013f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.221+0000 7f1baaffd640 1 -- 172.21.15.50:0/982306959 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc806d070 con 0x563c58f7cf60 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.221+0000 7f1baaffd640 1 -- 172.21.15.50:0/982306959 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cc8026890 con 0x563c58f7cf60 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.221+0000 7f1baaffd640 1 -- 172.21.15.50:0/982306959 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cc803e040 con 0x563c58f7cf60 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.221+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c58f848a0 con 0x563c58f7cf60 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.221+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c58f84d40 con 0x563c58f7cf60 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.222+0000 7f1baaffd640 1 -- 172.21.15.50:0/982306959 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1cc8070070 con 0x563c58f7cf60 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.222+0000 7f1baaffd640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1ba0036950 0x7f1ba0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.222+0000 7f1baaffd640 1 -- 172.21.15.50:0/982306959 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1cc8065070 con 0x563c58f7cf60 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.222+0000 7f1cd4883640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1ba0036950 0x7f1ba0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.223+0000 7f1cd4883640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1ba0036950 0x7f1ba0038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x563c58f61c60 tx=0x7f1ccc04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.223+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.223+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58f8f940 0x563c58f91e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.223+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f92550 con 0x563c58f8f940 2024-05-07T13:56:09.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.223+0000 7f1cd5885640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58f8f940 0x563c58f91e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.223+0000 7f1cd5885640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58f8f940 0x563c58f91e00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.223+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58f8f940 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.223+0000 7f1cd9a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.223+0000 7f1cd9a16800 20 realm 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f92960 con 0x563c58f8f940 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58f8f940 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f93230 con 0x563c58f8f940 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58f8f940 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x563c58f8f940 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58f8f940 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f94330 0x563c58f96720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f96d30 con 0x563c58f94330 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.224+0000 7f1cd5084640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f94330 0x563c58f96720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.225+0000 7f1cd5084640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f94330 0x563c58f96720 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.225+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.225+0000 7f1cd9a16800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.225+0000 7f1cd9a16800 20 searching for the correct realm 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.225+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f98660 con 0x563c58f94330 2024-05-07T13:56:09.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.225+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.225+0000 7f1cd5084640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1cc8072060 0x7f1cc8029650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.226+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f98660 con 0x7f1cc8072060 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.226+0000 7f1cd4883640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1cc8072060 0x7f1cc8029650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.226+0000 7f1cd4883640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1cc8072060 0x7f1cc8029650 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.226+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.226+0000 7f1cd4883640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1ccc074040 0x7f1ccc081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.226+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f98660 con 0x7f1ccc074040 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.226+0000 7f1cd5885640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1ccc074040 0x7f1ccc081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.227+0000 7f1cd5885640 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1ccc074040 0x7f1ccc081410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.227+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd000a4a0 con 0x7f1ccc074040 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.227+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x563c58f8f940 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.227+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58f8f940 2024-05-07T13:56:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.227+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x563c58f8f940 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.228+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58f8f940 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.228+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x7f1ccc074040 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.228+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd000a4a0 con 0x7f1ccc074040 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.228+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x7f1ccc074040 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.228+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1cd000a4a0 con 0x7f1ccc074040 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.228+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x7f1cc8072060 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.228+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.228+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x563c58f94330 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.228+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.229+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x563c58f8f940 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.229+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58f8f940 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.229+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x7f1ccc074040 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.229+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd000a4a0 con 0x7f1ccc074040 2024-05-07T13:56:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.229+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x563c58f8f940 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.229+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58f8f940 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.229+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563c58f935d0 con 0x7f1cc8072060 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.229+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.229+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f94330 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.230+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.230+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f94330 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.230+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.230+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x7f1ccc074040 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.230+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd000a4a0 con 0x7f1ccc074040 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.230+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f94330 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.231+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.231+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f94330 2024-05-07T13:56:09.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.231+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.231+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f8f940 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.231+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd000a4a0 con 0x563c58f8f940 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.231+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f8f940 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.231+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.231+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x7f1ccc074040 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.232+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.232+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f94330 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.232+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.232+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x7f1cc8072060 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.232+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.232+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f8f940 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.232+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.232+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x7f1ccc074040 2024-05-07T13:56:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.233+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.233+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f94330 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.233+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.233+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x7f1ccc074040 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.233+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.233+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x7f1cc8072060 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.233+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.233+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f94330 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.234+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.234+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x7f1ccc074040 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.234+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.234+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x563c58f8f940 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.234+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.234+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1ccc08e060 con 0x7f1cc8072060 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f975f0 con 0x563c58f8f940 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f979e0 con 0x563c58f8f940 2024-05-07T13:56:09.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.235+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f979e0 con 0x7f1ccc074040 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 zone default found 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 4 Realm: () 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 zonegroup default 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f97170 con 0x7f1ccc074040 2024-05-07T13:56:09.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f97170 con 0x563c58f94330 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9a5b0 con 0x563c58f94330 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 started sync module instance, tier type = 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.236+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f99960 con 0x7f1cc8072060 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.237+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.237+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94817190780288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f995c0 con 0x7f1cc8072060 2024-05-07T13:56:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.237+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9b4e0 con 0x563c58f8f940 2024-05-07T13:56:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.238+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94817190780288] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.239+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.239+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94817190785072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9b900 con 0x563c58f8f940 2024-05-07T13:56:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.239+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9c2c0 con 0x563c58f94330 2024-05-07T13:56:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.240+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.240+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94817190788624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9cb10 con 0x563c58f94330 2024-05-07T13:56:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.240+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9d590 con 0x7f1cc8072060 2024-05-07T13:56:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.240+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94817190785072] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.241+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94817190788624] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.241+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.241+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94817190786128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9cb10 con 0x7f1cc8072060 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.241+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9dec0 con 0x563c58f8f940 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.242+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94817190786128] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.242+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.242+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94817190795696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9e2b0 con 0x563c58f8f940 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.242+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9ecf0 con 0x7f1ccc074040 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.243+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94817190795696] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.243+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.243+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94817190799296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9ecb0 con 0x7f1ccc074040 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.243+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9f6f0 con 0x7f1ccc074040 2024-05-07T13:56:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.244+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.244+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94817190801856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9fb60 con 0x7f1ccc074040 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.244+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58fa0620 con 0x7f1ccc074040 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94817190799296] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94817190801856] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94817190805840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9f6b0 con 0x7f1ccc074040 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd9a16800 20 add_watcher() i=0 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd9a16800 20 add_watcher() i=1 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd9a16800 20 add_watcher() i=2 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd9a16800 20 add_watcher() i=3 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd9a16800 20 add_watcher() i=4 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd9a16800 20 add_watcher() i=5 2024-05-07T13:56:09.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.245+0000 7f1cd9a16800 20 add_watcher() i=6 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.246+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94817190805840] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.246+0000 7f1cd9a16800 20 add_watcher() i=7 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.246+0000 7f1cd9a16800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.246+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58fa3650 con 0x563c58f8f940 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.247+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.247+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94817190790752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58fa0ad0 con 0x563c58f8f940 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94817190790752] v27'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1b8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1cd9a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1cd9a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1cd9a16800 5 note: GC not initialized 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1b8a7e4640 20 reqs_thread_entry: start 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1cd9a16800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:09.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1cd9a16800 20 Filter name: none 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1afbfff640 20 reqs_thread_entry: start 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1cd9a16800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1cd9a16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.248+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58fd69f0 con 0x563c58f8f940 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.249+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.249+0000 7f1cd9a16800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.249+0000 7f1cd9a16800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.249+0000 7f1cd9a16800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.249+0000 7f1cd9a16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.249+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58fd9320 con 0x7f1cc8072060 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.249+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.249+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58fdc9d0 con 0x563c58f8f940 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.250+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v27'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.250+0000 7f1cd9a16800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.250+0000 7f1cd9a16800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.250+0000 7f1cd9a16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.250+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94817191052384 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563c58fd8310 con 0x563c58f8f940 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.251+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94817190795696 notify 115964116993 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f1cd001e040 con 0x563c58f8f940 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.251+0000 7f1bb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94817190795696 notifier 4306 bl.length()=567 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.251+0000 7f1bb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.251+0000 7f1bb8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.251+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify cookie 94817191052384 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.251+0000 7f1bb8ff9640 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f1b98003ea0 con 0x563c58f8f940 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.251+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94817191052384 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1cd0027c90 con 0x563c58f8f940 2024-05-07T13:56:09.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.251+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.250 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.252+0000 7f1b8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.252+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94817190790752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58fdb390 con 0x563c58f8f940 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.253+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94817190790752] v27'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.253+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94817190780288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9c660 con 0x7f1cc8072060 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.254+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94817190780288] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.254+0000 7f1cd9a16800 20 remove_watcher() i=0 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.254+0000 7f1cd9a16800 2 removed watcher, disabling cache 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.254+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94817190785072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f99d80 con 0x563c58f8f940 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.255+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94817190785072] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.255+0000 7f1cd9a16800 20 remove_watcher() i=1 2024-05-07T13:56:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.255+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94817190788624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f99d80 con 0x563c58f94330 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.256+0000 7f1cd5084640 1 -- 172.21.15.50:0/982306959 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94817190788624] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc806f030 con 0x563c58f94330 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.256+0000 7f1cd9a16800 20 remove_watcher() i=2 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.256+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94817190786128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f99d80 con 0x7f1cc8072060 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.257+0000 7f1cd4883640 1 -- 172.21.15.50:0/982306959 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94817190786128] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc07f070 con 0x7f1cc8072060 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.257+0000 7f1cd9a16800 20 remove_watcher() i=3 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.257+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94817190795696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f99d80 con 0x563c58f8f940 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.258+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94817190795696] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x563c58f8f940 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.258+0000 7f1cd9a16800 20 remove_watcher() i=4 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.258+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94817190799296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f99d80 con 0x7f1ccc074040 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.259+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94817190799296] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.259+0000 7f1cd9a16800 20 remove_watcher() i=5 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.259+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94817190801856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f9e7c0 con 0x7f1ccc074040 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.260+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94817190801856] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.260+0000 7f1cd9a16800 20 remove_watcher() i=6 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.260+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94817190805840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563c58f99d80 con 0x7f1ccc074040 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94817190805840] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd002f060 con 0x7f1ccc074040 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd9a16800 20 remove_watcher() i=7 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1ccc074040 msgr2=0x7f1ccc081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1ccc074040 0x7f1ccc081410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58f8f940 msgr2=0x563c58f91e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58f8f940 0x563c58f91e00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1cc8072060 msgr2=0x7f1cc8029650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1cc8072060 0x7f1cc8029650 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f94330 msgr2=0x563c58f96720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.261+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f94330 0x563c58f96720 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1ba0036950 msgr2=0x7f1ba0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1ba0036950 0x7f1ba0038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x563c58f61c60 tx=0x7f1ccc04f000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 msgr2=0x563c58f84360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/982306959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f7cf60 0x563c58f84360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8026820 tx=0x7f1cc8013f70 comp rx=0 tx=0).stop 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 reap_dead start 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd5885640 1 -- 172.21.15.50:0/982306959 reap_dead start 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 shutdown_connections 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 >> 172.21.15.50:0/982306959 conn(0x563c58f792c0 msgr2=0x563c58f76920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 shutdown_connections 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/982306959 wait complete. 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/3982440110 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bac036950 msgr2=0x7f1bac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/3982440110 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bac036950 0x7f1bac038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x563c58f592d0 tx=0x7f1ccc005ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/3982440110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f6fcc0 msgr2=0x563c58f700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/3982440110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f6fcc0 0x563c58f700e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1cc804b450 tx=0x7f1cc801aaf0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/3982440110 shutdown_connections 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/3982440110 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bac036950 0x7f1bac038e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/3982440110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58f6fcc0 0x563c58f700e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/3982440110 >> 172.21.15.50:0/3982440110 conn(0x563c58f63d60 msgr2=0x563c58f64160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/3982440110 shutdown_connections 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/3982440110 wait complete. 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563c58f5ecb0 msgr2=0x563c58f61100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563c58f5ecb0 0x563c58f61100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58e56550 msgr2=0x563c58f584d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563c58e56550 0x563c58f584d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f5ad20 msgr2=0x563c58f5d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563c58f5ad20 0x563c58f5d110 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bbc036950 msgr2=0x7f1bbc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1bbc036950 0x7f1bbc038e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc054000 tx=0x7f1ccc04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.262+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 msgr2=0x563c58f51290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.263+0000 7f1cd9a16800 1 --2- 172.21.15.50:0/2665449131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c58e54a10 0x563c58f51290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800b210 tx=0x7f1cc8000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.263+0000 7f1cd5885640 1 -- 172.21.15.50:0/2665449131 reap_dead start 2024-05-07T13:56:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.263+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 shutdown_connections 2024-05-07T13:56:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.263+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 >> 172.21.15.50:0/2665449131 conn(0x563c58e505b0 msgr2=0x563c58f43840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.263+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 shutdown_connections 2024-05-07T13:56:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.263+0000 7f1cd9a16800 1 -- 172.21.15.50:0/2665449131 wait complete. 2024-05-07T13:56:09.261 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:09.261 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-07T13:56:09.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-07T13:56:09.261 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-07T13:56:09.307 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:09.307 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.319+0000 7f8e379a2800 1 Processor -- start 2024-05-07T13:56:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.319+0000 7f8e379a2800 1 -- start start 2024-05-07T13:56:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.319+0000 7f8e379a2800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b0c1e5ba10 0x55b0c1e5be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.319+0000 7f8e379a2800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b0c1dd01b0 con 0x55b0c1e5c370 2024-05-07T13:56:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.319+0000 7f8e379a2800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55b0c1cee050 con 0x55b0c1e5ba10 2024-05-07T13:56:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.320+0000 7f8e354a1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b0c1e5ba10 0x55b0c1e5be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.320+0000 7f8e34ca0640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55b0c1e5c370 0x55b0c1e5c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39540/0 (socket says 172.21.15.50:39540) 2024-05-07T13:56:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.320+0000 7f8e34ca0640 1 -- 172.21.15.50:0/2173842621 learned_addr learned my addr 172.21.15.50:0/2173842621 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.320+0000 7f8e354a1640 1 -- 172.21.15.50:0/2173842621 >> v1:172.21.15.22:6789/0 conn(0x55b0c1e5c370 legacy=0x55b0c1e5c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.320+0000 7f8e354a1640 1 -- 172.21.15.50:0/2173842621 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0c1e5cf30 con 0x55b0c1e5ba10 2024-05-07T13:56:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.320+0000 7f8e27fff640 1 -- 172.21.15.50:0/2173842621 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814775090 0 0) 0x55b0c1dd01b0 con 0x55b0c1e5c370 2024-05-07T13:56:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.322+0000 7f8e354a1640 1 --2- 172.21.15.50:0/2173842621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1e5be30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e28005fd0 tx=0x7f8e2801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81d5f4620421c76 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.322+0000 7f8e27fff640 1 -- 172.21.15.50:0/2173842621 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e28052560 con 0x55b0c1e5ba10 2024-05-07T13:56:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.322+0000 7f8e27fff640 1 -- 172.21.15.50:0/2173842621 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e28052700 con 0x55b0c1e5ba10 2024-05-07T13:56:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.322+0000 7f8e27fff640 1 -- 172.21.15.50:0/2173842621 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e28052a20 con 0x55b0c1e5ba10 2024-05-07T13:56:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.322+0000 7f8e379a2800 1 -- 172.21.15.50:0/2173842621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 msgr2=0x55b0c1e5be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.322+0000 7f8e379a2800 1 --2- 172.21.15.50:0/2173842621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1e5be30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e28005fd0 tx=0x7f8e2801ccc0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.322+0000 7f8e379a2800 1 -- 172.21.15.50:0/2173842621 shutdown_connections 2024-05-07T13:56:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.322+0000 7f8e379a2800 1 --2- 172.21.15.50:0/2173842621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1e5be30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.322+0000 7f8e379a2800 1 -- 172.21.15.50:0/2173842621 >> 172.21.15.50:0/2173842621 conn(0x55b0c1e575b0 msgr2=0x55b0c1e599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.323+0000 7f8e379a2800 1 -- 172.21.15.50:0/2173842621 shutdown_connections 2024-05-07T13:56:09.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.323+0000 7f8e379a2800 1 -- 172.21.15.50:0/2173842621 wait complete. 2024-05-07T13:56:09.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.338+0000 7f8e379a2800 1 Processor -- start 2024-05-07T13:56:09.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.338+0000 7f8e379a2800 1 -- start start 2024-05-07T13:56:09.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.338+0000 7f8e379a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f50950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.338+0000 7f8e379a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b0c1da81d0 con 0x55b0c1e5ba10 2024-05-07T13:56:09.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.338+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f50950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.338+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f50950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44794/0 (socket says 172.21.15.50:44794) 2024-05-07T13:56:09.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.338+0000 7f8e354a1640 1 -- 172.21.15.50:0/3764030423 learned_addr learned my addr 172.21.15.50:0/3764030423 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.338+0000 7f8e354a1640 1 -- 172.21.15.50:0/3764030423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0c1f50f20 con 0x55b0c1e5ba10 2024-05-07T13:56:09.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.339+0000 7f8e354a1640 1 --2- 172.21.15.50:0/3764030423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f50950 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e28054040 tx=0x7f8e2804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab098ed755016f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.339+0000 7f8d23606640 1 -- 172.21.15.50:0/3764030423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e280529e0 con 0x55b0c1e5ba10 2024-05-07T13:56:09.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.339+0000 7f8d23606640 1 -- 172.21.15.50:0/3764030423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e28052b80 con 0x55b0c1e5ba10 2024-05-07T13:56:09.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.339+0000 7f8d23606640 1 -- 172.21.15.50:0/3764030423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e2805c430 con 0x55b0c1e5ba10 2024-05-07T13:56:09.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.339+0000 7f8e379a2800 1 -- 172.21.15.50:0/3764030423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 msgr2=0x55b0c1f50950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.339+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3764030423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f50950 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e28054040 tx=0x7f8e2804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e379a2800 1 -- 172.21.15.50:0/3764030423 shutdown_connections 2024-05-07T13:56:09.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3764030423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f50950 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e379a2800 1 -- 172.21.15.50:0/3764030423 >> 172.21.15.50:0/3764030423 conn(0x55b0c1e575b0 msgr2=0x55b0c1f4c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e379a2800 1 -- 172.21.15.50:0/3764030423 shutdown_connections 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e379a2800 1 -- 172.21.15.50:0/3764030423 wait complete. 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e379a2800 1 Processor -- start 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e379a2800 1 -- start start 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e379a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f58400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e379a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b0c1e5d4c0 con 0x55b0c1e5ba10 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f58400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f58400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44806/0 (socket says 172.21.15.50:44806) 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.340+0000 7f8e354a1640 1 -- 172.21.15.50:0/4223604247 learned_addr learned my addr 172.21.15.50:0/4223604247 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.341+0000 7f8e354a1640 1 -- 172.21.15.50:0/4223604247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0c1f58940 con 0x55b0c1e5ba10 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.341+0000 7f8e354a1640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f58400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8e28044920 tx=0x7f8e28003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.341+0000 7f8d21e03640 1 -- 172.21.15.50:0/4223604247 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e28066410 con 0x55b0c1e5ba10 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.341+0000 7f8d21e03640 1 -- 172.21.15.50:0/4223604247 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e280665b0 con 0x55b0c1e5ba10 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.341+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0c1f58bd0 con 0x55b0c1e5ba10 2024-05-07T13:56:09.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.341+0000 7f8d21e03640 1 -- 172.21.15.50:0/4223604247 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e280668d0 con 0x55b0c1e5ba10 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.341+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0c1f5b880 con 0x55b0c1e5ba10 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.342+0000 7f8d21e03640 1 -- 172.21.15.50:0/4223604247 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8e28078020 con 0x55b0c1e5ba10 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.342+0000 7f8d21e03640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d1c036950 0x7f8d1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.342+0000 7f8d21e03640 1 -- 172.21.15.50:0/4223604247 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8e2808ea20 con 0x55b0c1e5ba10 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.342+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d1c036950 0x7f8d1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.342+0000 7f8e379a2800 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1e5c370 0x55b0c1f5f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.342+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f5fbc0 con 0x55b0c1e5c370 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.342+0000 7f8e35ca2640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1e5c370 0x55b0c1f5f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.342+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d1c036950 0x7f8d1c038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c000c00 tx=0x7f8e2c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.343+0000 7f8e35ca2640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1e5c370 0x55b0c1f5f640 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.343+0000 7f8e35ca2640 1 -- 172.21.15.50:0/4223604247 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1e5c370 2024-05-07T13:56:09.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.343+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f5cbd0 con 0x55b0c1e5c370 2024-05-07T13:56:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.343+0000 7f8e35ca2640 1 -- 172.21.15.50:0/4223604247 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1e5c370 2024-05-07T13:56:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.343+0000 7f8e379a2800 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f61ed0 0x55b0c1f642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.343+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f64990 con 0x55b0c1f61ed0 2024-05-07T13:56:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.343+0000 7f8e354a1640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f61ed0 0x55b0c1f642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.344+0000 7f8e354a1640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f61ed0 0x55b0c1f642c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.344+0000 7f8e354a1640 1 -- 172.21.15.50:0/4223604247 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f61ed0 2024-05-07T13:56:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.344+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f60e80 con 0x55b0c1e5c370 2024-05-07T13:56:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.344+0000 7f8e35ca2640 1 -- 172.21.15.50:0/4223604247 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1e5c370 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.344+0000 7f8e379a2800 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b0c1f65e20 0x55b0c1f682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.344+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f68a50 con 0x55b0c1f65e20 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.344+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b0c1f65e20 0x55b0c1f682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.345+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b0c1f65e20 0x55b0c1f682c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.345+0000 7f8e34ca0640 1 -- 172.21.15.50:0/4223604247 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8e2c00f670 con 0x55b0c1f65e20 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.345+0000 7f8e379a2800 1 Processor -- start 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.345+0000 7f8e379a2800 1 -- start start 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.345+0000 7f8e379a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f76e00 0x55b0c1f77220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.345+0000 7f8e379a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b0c1d4ecf0 con 0x55b0c1f76e00 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f76e00 0x55b0c1f77220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f76e00 0x55b0c1f77220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44814/0 (socket says 172.21.15.50:44814) 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8e354a1640 1 -- 172.21.15.50:0/3446682592 learned_addr learned my addr 172.21.15.50:0/3446682592 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8e354a1640 1 -- 172.21.15.50:0/3446682592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0c1f77760 con 0x55b0c1f76e00 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8e354a1640 1 --2- 172.21.15.50:0/3446682592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f76e00 0x55b0c1f77220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8e280833f0 tx=0x7f8e28065eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8d1affd640 1 -- 172.21.15.50:0/3446682592 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e28070720 con 0x55b0c1f76e00 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8d1affd640 1 -- 172.21.15.50:0/3446682592 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e28093070 con 0x55b0c1f76e00 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8e379a2800 1 -- 172.21.15.50:0/3446682592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0c1f781d0 con 0x55b0c1f76e00 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8d1affd640 1 -- 172.21.15.50:0/3446682592 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e280709f0 con 0x55b0c1f76e00 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.346+0000 7f8e379a2800 1 -- 172.21.15.50:0/3446682592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0c1f786d0 con 0x55b0c1f76e00 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.347+0000 7f8d1affd640 1 -- 172.21.15.50:0/3446682592 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8e28066a70 con 0x55b0c1f76e00 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.347+0000 7f8d1affd640 1 --2- 172.21.15.50:0/3446682592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d0c036900 0x7f8d0c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.347+0000 7f8d1affd640 1 -- 172.21.15.50:0/3446682592 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8e28089050 con 0x55b0c1f76e00 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.347+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/3446682592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d0c036900 0x7f8d0c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.347+0000 7f8e379a2800 1 Processor -- start 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8e379a2800 1 -- start start 2024-05-07T13:56:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/3446682592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d0c036900 0x7f8d0c038dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55b0c1f68e50 tx=0x7f8e2c006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8e379a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8e379a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b0c1f511e0 con 0x55b0c1f83f90 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f843b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44824/0 (socket says 172.21.15.50:44824) 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8e354a1640 1 -- 172.21.15.50:0/258801225 learned_addr learned my addr 172.21.15.50:0/258801225 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8e354a1640 1 -- 172.21.15.50:0/258801225 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0c1f84980 con 0x55b0c1f83f90 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8e354a1640 1 --2- 172.21.15.50:0/258801225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f843b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8e28097fd0 tx=0x7f8e28098460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d49fc9b93a8a1db server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8d18ff9640 1 -- 172.21.15.50:0/258801225 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e28098640 con 0x55b0c1f83f90 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8d18ff9640 1 -- 172.21.15.50:0/258801225 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2807b3e0 con 0x55b0c1f83f90 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.348+0000 7f8d18ff9640 1 -- 172.21.15.50:0/258801225 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e2804be80 con 0x55b0c1f83f90 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 -- 172.21.15.50:0/258801225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 msgr2=0x55b0c1f843b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 --2- 172.21.15.50:0/258801225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f843b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8e28097fd0 tx=0x7f8e28098460 comp rx=0 tx=0).stop 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 -- 172.21.15.50:0/258801225 shutdown_connections 2024-05-07T13:56:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 --2- 172.21.15.50:0/258801225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f843b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 -- 172.21.15.50:0/258801225 >> 172.21.15.50:0/258801225 conn(0x55b0c1f80260 msgr2=0x55b0c1f7e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 -- 172.21.15.50:0/258801225 shutdown_connections 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 -- 172.21.15.50:0/258801225 wait complete. 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 Processor -- start 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 -- start start 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f8b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.349+0000 7f8e379a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b0c1f84fe0 con 0x55b0c1f83f90 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f8b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8e354a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f8b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44832/0 (socket says 172.21.15.50:44832) 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 learned_addr learned my addr 172.21.15.50:0/3150277678 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0c1f8b7c0 con 0x55b0c1f83f90 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8e354a1640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f8b280 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e280989c0 tx=0x7f8e28055fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8d0affd640 1 -- 172.21.15.50:0/3150277678 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e2804be80 con 0x55b0c1f83f90 2024-05-07T13:56:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8d0affd640 1 -- 172.21.15.50:0/3150277678 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2807b670 con 0x55b0c1f83f90 2024-05-07T13:56:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8d0affd640 1 -- 172.21.15.50:0/3150277678 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e2808e0b0 con 0x55b0c1f83f90 2024-05-07T13:56:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0c1f8b7c0 con 0x55b0c1f83f90 2024-05-07T13:56:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.350+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0c1f8b7c0 con 0x55b0c1f83f90 2024-05-07T13:56:09.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.351+0000 7f8d0affd640 1 -- 172.21.15.50:0/3150277678 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8e280ba020 con 0x55b0c1f83f90 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.351+0000 7f8d0affd640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d00036950 0x7f8d00038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.351+0000 7f8d0affd640 1 -- 172.21.15.50:0/3150277678 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8e280b8020 con 0x55b0c1f83f90 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.351+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d00036950 0x7f8d00038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1f967a0 0x55b0c1f98c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f993b0 con 0x55b0c1f967a0 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e35ca2640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1f967a0 0x55b0c1f98c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d00036950 0x7f8d00038e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00feb0 tx=0x7f8e2c023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e35ca2640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1f967a0 0x55b0c1f98c60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e379a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e379a2800 20 realm 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.352+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f997c0 con 0x55b0c1f967a0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f967a0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a430 con 0x55b0c1f967a0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f9ab40 0x55b0c1f9cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9d6c0 con 0x55b0c1f9ab40 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.353+0000 7f8e354a1640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f9ab40 0x55b0c1f9cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.354+0000 7f8e354a1640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f9ab40 0x55b0c1f9cf30 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.354+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.354+0000 7f8e379a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.354+0000 7f8e379a2800 20 searching for the correct realm 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.354+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9f0e0 con 0x55b0c1f9ab40 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.355+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.355+0000 7f8e354a1640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e280b2c20 0x7f8e2807fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.355+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9f0e0 con 0x7f8e280b2c20 2024-05-07T13:56:09.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.355+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e280b2c20 0x7f8e2807fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.355+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e280b2c20 0x7f8e2807fa00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.355+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.355+0000 7f8e34ca0640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e2c02e910 0x7f8e2c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.355+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9f0e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.355+0000 7f8e35ca2640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e2c02e910 0x7f8e2c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.356+0000 7f8e35ca2640 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e2c02e910 0x7f8e2c03a3c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.356+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.356+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f967a0 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.356+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.356+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f967a0 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.357+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.357+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e2c02e910 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.357+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.357+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e2c02e910 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.357+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.357+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e280b2c20 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.357+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.357+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f9ab40 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.357+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.358+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f967a0 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.358+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.358+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e2c02e910 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.358+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.358+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f967a0 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.358+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.358+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e280b2c20 2024-05-07T13:56:09.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.359+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.359+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f9ab40 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.359+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.359+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f9ab40 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.359+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.359+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e2c02e910 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.359+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.359+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f9ab40 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.360+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.360+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f9ab40 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.360+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.360+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f967a0 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.360+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.360+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f967a0 2024-05-07T13:56:09.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.360+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.360+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e2c02e910 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.361+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.361+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f9ab40 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.361+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.361+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e280b2c20 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.361+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.361+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f967a0 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.361+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.361+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e2c02e910 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.362+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.362+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f9ab40 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.362+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.362+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e2c02e910 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.362+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.362+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e280b2c20 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.363+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.363+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f9ab40 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.363+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.363+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e2c02e910 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.363+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.363+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x55b0c1f967a0 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9a090 con 0x7f8e280b2c20 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:09.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9e070 con 0x55b0c1f967a0 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9e460 con 0x55b0c1f967a0 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.364+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9e460 con 0x7f8e2c02e910 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 20 zone default found 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 4 Realm: () 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 20 zonegroup default 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9e880 con 0x7f8e2c02e910 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.365+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1f9eca0 con 0x55b0c1f9ab40 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.366+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.366+0000 7f8e379a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.366+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.366+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa0f90 con 0x55b0c1f9ab40 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.366+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.366+0000 7f8e379a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.366+0000 7f8e379a2800 20 started sync module instance, tier type = 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.366+0000 7f8e379a2800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.366+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa0430 con 0x7f8e280b2c20 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.367+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.367+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94217656993872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa0090 con 0x7f8e280b2c20 2024-05-07T13:56:09.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.367+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa1e00 con 0x55b0c1f967a0 2024-05-07T13:56:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.368+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94217656993872] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.368+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.368+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94217656998224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa2220 con 0x55b0c1f967a0 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.368+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa2ad0 con 0x55b0c1f9ab40 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.369+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94217656998224] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.369+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.369+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94217656999760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa2ec0 con 0x55b0c1f9ab40 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.369+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa38e0 con 0x7f8e280b2c20 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.370+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94217656999760] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.370+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.370+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94217657000944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa4180 con 0x7f8e280b2c20 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.370+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa4b40 con 0x55b0c1f967a0 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.371+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.371+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94217657010288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa5300 con 0x55b0c1f967a0 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.371+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa5e20 con 0x7f8e2c02e910 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.371+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94217657000944] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.372+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94217657010288] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.372+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.372+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94217657014512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa5de0 con 0x7f8e2c02e910 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.372+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa66c0 con 0x7f8e2c02e910 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.373+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94217657014512] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.374+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.374+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94217657007312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa5de0 con 0x7f8e2c02e910 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.374+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa6ce0 con 0x7f8e2c02e910 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.374+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94217657018416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa7100 con 0x7f8e2c02e910 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 20 add_watcher() i=0 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 20 add_watcher() i=1 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 20 add_watcher() i=2 2024-05-07T13:56:09.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 20 add_watcher() i=3 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 20 add_watcher() i=4 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 20 add_watcher() i=5 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94217657007312] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 20 add_watcher() i=6 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94217657018416] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 20 add_watcher() i=7 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.375+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa7100 con 0x55b0c1f967a0 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.376+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.376+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94217657019472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa7070 con 0x55b0c1f967a0 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94217657019472] v27'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8ceb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8e379a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8e379a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8e379a2800 5 note: GC not initialized 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8cea7e4640 20 reqs_thread_entry: start 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8e379a2800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8e379a2800 20 Filter name: none 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8c5bfff640 20 reqs_thread_entry: start 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.377+0000 7f8e379a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.378+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fdd360 con 0x55b0c1f967a0 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.378+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.378+0000 7f8e379a2800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:09.376 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.379+0000 7f8ceb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.379+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94217657019472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fdbe00 con 0x55b0c1f967a0 2024-05-07T13:56:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.380+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94217657019472] v27'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.380+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94217656993872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa6c50 con 0x7f8e280b2c20 2024-05-07T13:56:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.381+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94217656993872] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.381+0000 7f8e379a2800 20 remove_watcher() i=0 2024-05-07T13:56:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.381+0000 7f8e379a2800 2 removed watcher, disabling cache 2024-05-07T13:56:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.381+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94217656998224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa6c50 con 0x55b0c1f967a0 2024-05-07T13:56:09.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.382+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94217656998224] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.382+0000 7f8e379a2800 20 remove_watcher() i=1 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.382+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94217656999760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa6c50 con 0x55b0c1f9ab40 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.383+0000 7f8e354a1640 1 -- 172.21.15.50:0/3150277678 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94217656999760] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e28071910 con 0x55b0c1f9ab40 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.383+0000 7f8e379a2800 20 remove_watcher() i=2 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.383+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94217657000944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa6c50 con 0x7f8e280b2c20 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.384+0000 7f8e34ca0640 1 -- 172.21.15.50:0/3150277678 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94217657000944] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c037040 con 0x7f8e280b2c20 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.384+0000 7f8e379a2800 20 remove_watcher() i=3 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.384+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94217657010288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa6c50 con 0x55b0c1f967a0 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.385+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94217657010288] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x55b0c1f967a0 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.385+0000 7f8e379a2800 20 remove_watcher() i=4 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.385+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94217657014512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa4870 con 0x7f8e2c02e910 2024-05-07T13:56:09.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.386+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94217657014512] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.386+0000 7f8e379a2800 20 remove_watcher() i=5 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.386+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94217657007312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa6c50 con 0x7f8e2c02e910 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.387+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94217657007312] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.387+0000 7f8e379a2800 20 remove_watcher() i=6 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.387+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94217657018416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b0c1fa4870 con 0x7f8e2c02e910 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94217657018416] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e300083e0 con 0x7f8e2c02e910 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 20 remove_watcher() i=7 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e2c02e910 msgr2=0x7f8e2c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e2c02e910 0x7f8e2c03a3c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1f967a0 msgr2=0x55b0c1f98c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1f967a0 0x55b0c1f98c60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e280b2c20 msgr2=0x7f8e2807fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e280b2c20 0x7f8e2807fa00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f9ab40 msgr2=0x55b0c1f9cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f9ab40 0x55b0c1f9cf30 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d00036950 msgr2=0x7f8d00038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d00036950 0x7f8d00038e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00feb0 tx=0x7f8e2c023040 comp rx=0 tx=0).stop 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 msgr2=0x55b0c1f8b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3150277678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f83f90 0x55b0c1f8b280 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e280989c0 tx=0x7f8e28055fe0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.388+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 reap_dead start 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e35ca2640 1 -- 172.21.15.50:0/3150277678 reap_dead start 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 shutdown_connections 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 >> 172.21.15.50:0/3150277678 conn(0x55b0c1f80260 msgr2=0x55b0c1f7d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 shutdown_connections 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3150277678 wait complete. 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3446682592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d0c036900 msgr2=0x7f8d0c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3446682592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d0c036900 0x7f8d0c038dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55b0c1f68e50 tx=0x7f8e2c006000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3446682592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f76e00 msgr2=0x55b0c1f77220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3446682592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f76e00 0x55b0c1f77220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8e280833f0 tx=0x7f8e28065eb0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3446682592 shutdown_connections 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3446682592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d0c036900 0x7f8d0c038dc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 --2- 172.21.15.50:0/3446682592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1f76e00 0x55b0c1f77220 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3446682592 >> 172.21.15.50:0/3446682592 conn(0x55b0c1f6aea0 msgr2=0x55b0c1f6b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3446682592 shutdown_connections 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/3446682592 wait complete. 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b0c1f65e20 msgr2=0x55b0c1f682c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b0c1f65e20 0x55b0c1f682c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1e5c370 msgr2=0x55b0c1f5f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b0c1e5c370 0x55b0c1f5f640 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f61ed0 msgr2=0x55b0c1f642c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b0c1f61ed0 0x55b0c1f642c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.389+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d1c036950 msgr2=0x7f8d1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.390+0000 7f8e379a2800 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d1c036950 0x7f8d1c038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c000c00 tx=0x7f8e2c0013b0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.390+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 msgr2=0x55b0c1f58400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.390+0000 7f8e379a2800 1 --2- 172.21.15.50:0/4223604247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0c1e5ba10 0x55b0c1f58400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8e28044920 tx=0x7f8e28003330 comp rx=0 tx=0).stop 2024-05-07T13:56:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.390+0000 7f8e35ca2640 1 -- 172.21.15.50:0/4223604247 reap_dead start 2024-05-07T13:56:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.390+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 shutdown_connections 2024-05-07T13:56:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.390+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 >> 172.21.15.50:0/4223604247 conn(0x55b0c1e575b0 msgr2=0x55b0c1f4aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.390+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 shutdown_connections 2024-05-07T13:56:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.390+0000 7f8e379a2800 1 -- 172.21.15.50:0/4223604247 wait complete. 2024-05-07T13:56:09.387 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:09.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-07T13:56:09.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-07T13:56:09.388 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-07T13:56:09.433 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:09.433 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.445+0000 7ff4b391f800 1 Processor -- start 2024-05-07T13:56:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.445+0000 7ff4b391f800 1 -- start start 2024-05-07T13:56:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.445+0000 7ff4b391f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562986021600 0x5629860239f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.445+0000 7ff4b391f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562986023f30 con 0x56298601b390 2024-05-07T13:56:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.445+0000 7ff4b391f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x562985eae050 con 0x562986021600 2024-05-07T13:56:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.445+0000 7ff4a7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562986021600 0x5629860239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.445+0000 7ff4a7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562986021600 0x5629860239f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44846/0 (socket says 172.21.15.50:44846) 2024-05-07T13:56:09.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.445+0000 7ff4a7fff640 1 -- 172.21.15.50:0/1792239459 learned_addr learned my addr 172.21.15.50:0/1792239459 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.445+0000 7ff4af5e7640 1 --1- 172.21.15.50:0/1792239459 >> v1:172.21.15.22:6789/0 conn(0x56298601b390 0x56298601b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39552/0 (socket says 172.21.15.50:39552) 2024-05-07T13:56:09.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.446+0000 7ff4a7fff640 1 -- 172.21.15.50:0/1792239459 >> v1:172.21.15.22:6789/0 conn(0x56298601b390 legacy=0x56298601b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.446+0000 7ff4a7fff640 1 -- 172.21.15.50:0/1792239459 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562986025140 con 0x562986021600 2024-05-07T13:56:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.447+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/1792239459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986021600 0x5629860239f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff49800a520 tx=0x7ff49801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3120a0cbe5b794a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4aede6640 1 -- 172.21.15.50:0/1792239459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff498057070 con 0x562986021600 2024-05-07T13:56:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4aede6640 1 -- 172.21.15.50:0/1792239459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff498052570 con 0x562986021600 2024-05-07T13:56:09.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4aede6640 1 -- 172.21.15.50:0/1792239459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49804ae60 con 0x562986021600 2024-05-07T13:56:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4b391f800 1 -- 172.21.15.50:0/1792239459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986021600 msgr2=0x5629860239f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4b391f800 1 --2- 172.21.15.50:0/1792239459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986021600 0x5629860239f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff49800a520 tx=0x7ff49801d010 comp rx=0 tx=0).stop 2024-05-07T13:56:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4b391f800 1 -- 172.21.15.50:0/1792239459 shutdown_connections 2024-05-07T13:56:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4b391f800 1 --2- 172.21.15.50:0/1792239459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986021600 0x5629860239f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4b391f800 1 -- 172.21.15.50:0/1792239459 >> 172.21.15.50:0/1792239459 conn(0x562986016d30 msgr2=0x562986019150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4b391f800 1 -- 172.21.15.50:0/1792239459 shutdown_connections 2024-05-07T13:56:09.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.448+0000 7ff4b391f800 1 -- 172.21.15.50:0/1792239459 wait complete. 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.463+0000 7ff4b391f800 1 Processor -- start 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.463+0000 7ff4b391f800 1 -- start start 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.463+0000 7ff4b391f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298610e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.463+0000 7ff4b391f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562985f681d0 con 0x56298601b390 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.464+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298610e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.464+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298610e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44854/0 (socket says 172.21.15.50:44854) 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.464+0000 7ff4af5e7640 1 -- 172.21.15.50:0/1243628814 learned_addr learned my addr 172.21.15.50:0/1243628814 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.464+0000 7ff4af5e7640 1 -- 172.21.15.50:0/1243628814 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298610ecb0 con 0x56298601b390 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.464+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/1243628814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298610e6e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000b230 tx=0x7ff4a000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9688e77b923b420 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.464+0000 7ff39d60a640 1 -- 172.21.15.50:0/1243628814 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a000e5c0 con 0x56298601b390 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.464+0000 7ff39d60a640 1 -- 172.21.15.50:0/1243628814 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a0006070 con 0x56298601b390 2024-05-07T13:56:09.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.464+0000 7ff39d60a640 1 -- 172.21.15.50:0/1243628814 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a000e890 con 0x56298601b390 2024-05-07T13:56:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.465+0000 7ff4b391f800 1 -- 172.21.15.50:0/1243628814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 msgr2=0x56298610e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.465+0000 7ff4b391f800 1 --2- 172.21.15.50:0/1243628814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298610e6e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000b230 tx=0x7ff4a000b6f0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.465+0000 7ff4b391f800 1 -- 172.21.15.50:0/1243628814 shutdown_connections 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.465+0000 7ff4b391f800 1 --2- 172.21.15.50:0/1243628814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298610e6e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.465+0000 7ff4b391f800 1 -- 172.21.15.50:0/1243628814 >> 172.21.15.50:0/1243628814 conn(0x562986016d30 msgr2=0x56298610a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.465+0000 7ff4b391f800 1 -- 172.21.15.50:0/1243628814 shutdown_connections 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.465+0000 7ff4b391f800 1 -- 172.21.15.50:0/1243628814 wait complete. 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.465+0000 7ff4b391f800 1 Processor -- start 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.465+0000 7ff4b391f800 1 -- start start 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff4b391f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298601dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff4b391f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562986024400 con 0x56298601b390 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298601dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298601dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44870/0 (socket says 172.21.15.50:44870) 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff4af5e7640 1 -- 172.21.15.50:0/2452879694 learned_addr learned my addr 172.21.15.50:0/2452879694 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff4af5e7640 1 -- 172.21.15.50:0/2452879694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298601c400 con 0x56298601b390 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298601dd10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0000fd0 tx=0x7ff4a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff39be07640 1 -- 172.21.15.50:0/2452879694 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a000f8d0 con 0x56298601b390 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff39be07640 1 -- 172.21.15.50:0/2452879694 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a000fa90 con 0x56298601b390 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.466+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56298601c690 con 0x56298601b390 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.467+0000 7ff39be07640 1 -- 172.21.15.50:0/2452879694 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a000fdb0 con 0x56298601b390 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.467+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298601cbb0 con 0x56298601b390 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.467+0000 7ff39be07640 1 -- 172.21.15.50:0/2452879694 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff4a0017070 con 0x56298601b390 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.467+0000 7ff39be07640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff394036950 0x7ff394038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.468+0000 7ff39be07640 1 -- 172.21.15.50:0/2452879694 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff4a0015020 con 0x56298601b390 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.468+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff394036950 0x7ff394038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.468+0000 7ff4b391f800 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986021600 0x56298611f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.468+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298611fc50 con 0x562986021600 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.468+0000 7ff4afde8640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986021600 0x56298611f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.468+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff394036950 0x7ff394038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff498054000 tx=0x7ff49804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.468+0000 7ff4afde8640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986021600 0x56298611f6d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.468+0000 7ff4afde8640 1 -- 172.21.15.50:0/2452879694 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986021600 2024-05-07T13:56:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.469+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562986120510 con 0x562986021600 2024-05-07T13:56:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.469+0000 7ff4afde8640 1 -- 172.21.15.50:0/2452879694 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986021600 2024-05-07T13:56:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.469+0000 7ff4b391f800 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562986121f90 0x562986124450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.469+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562986124be0 con 0x562986121f90 2024-05-07T13:56:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.469+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562986121f90 0x562986124450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.469+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562986121f90 0x562986124450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.470+0000 7ff4af5e7640 1 -- 172.21.15.50:0/2452879694 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff4a002e070 con 0x562986121f90 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.470+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562986120d90 con 0x562986021600 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.470+0000 7ff4afde8640 1 -- 172.21.15.50:0/2452879694 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986021600 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.470+0000 7ff4b391f800 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562986126090 0x562986128500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.470+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562986128c60 con 0x562986126090 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.470+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562986126090 0x562986128500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.471+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562986126090 0x562986128500 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.471+0000 7ff4a7fff640 1 -- 172.21.15.50:0/2452879694 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff49805a040 con 0x562986126090 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.471+0000 7ff4b391f800 1 Processor -- start 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.471+0000 7ff4b391f800 1 -- start start 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.471+0000 7ff4b391f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986137050 0x562986137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.471+0000 7ff4b391f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56298601e250 con 0x562986137050 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986137050 0x562986137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986137050 0x562986137470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44872/0 (socket says 172.21.15.50:44872) 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff4af5e7640 1 -- 172.21.15.50:0/432261102 learned_addr learned my addr 172.21.15.50:0/432261102 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff4af5e7640 1 -- 172.21.15.50:0/432261102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629861379b0 con 0x562986137050 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/432261102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986137050 0x562986137470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff4a004b470 tx=0x7ff4a0017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff399602640 1 -- 172.21.15.50:0/432261102 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0044a40 con 0x562986137050 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff399602640 1 -- 172.21.15.50:0/432261102 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a0044be0 con 0x562986137050 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff399602640 1 -- 172.21.15.50:0/432261102 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0044ec0 con 0x562986137050 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff4b391f800 1 -- 172.21.15.50:0/432261102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562986138420 con 0x562986137050 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.472+0000 7ff4b391f800 1 -- 172.21.15.50:0/432261102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562986138420 con 0x562986137050 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.473+0000 7ff399602640 1 -- 172.21.15.50:0/432261102 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff4a0019860 con 0x562986137050 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.473+0000 7ff399602640 1 --2- 172.21.15.50:0/432261102 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff388036950 0x7ff388038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.473+0000 7ff399602640 1 -- 172.21.15.50:0/432261102 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff4a0038020 con 0x562986137050 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.473+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/432261102 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff388036950 0x7ff388038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4b391f800 1 Processor -- start 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4b391f800 1 -- start start 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/432261102 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff388036950 0x7ff388038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x56298601d0d0 tx=0x7ff498005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4b391f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x562986144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4b391f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562985f0ecf0 con 0x562986143f40 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x562986144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x562986144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44884/0 (socket says 172.21.15.50:44884) 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4af5e7640 1 -- 172.21.15.50:0/3062786142 learned_addr learned my addr 172.21.15.50:0/3062786142 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4af5e7640 1 -- 172.21.15.50:0/3062786142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562986144930 con 0x562986143f40 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.474+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/3062786142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x562986144360 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0010980 tx=0x7ff4a003feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2707e3075174e05b server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff392ffd640 1 -- 172.21.15.50:0/3062786142 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0065070 con 0x562986143f40 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff392ffd640 1 -- 172.21.15.50:0/3062786142 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a0058070 con 0x562986143f40 2024-05-07T13:56:09.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff392ffd640 1 -- 172.21.15.50:0/3062786142 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0010da0 con 0x562986143f40 2024-05-07T13:56:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff4b391f800 1 -- 172.21.15.50:0/3062786142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 msgr2=0x562986144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff4b391f800 1 --2- 172.21.15.50:0/3062786142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x562986144360 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0010980 tx=0x7ff4a003feb0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff4b391f800 1 -- 172.21.15.50:0/3062786142 shutdown_connections 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff4b391f800 1 --2- 172.21.15.50:0/3062786142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x562986144360 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff4b391f800 1 -- 172.21.15.50:0/3062786142 >> 172.21.15.50:0/3062786142 conn(0x5629861402a0 msgr2=0x56298613e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff4b391f800 1 -- 172.21.15.50:0/3062786142 shutdown_connections 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff4b391f800 1 -- 172.21.15.50:0/3062786142 wait complete. 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff4b391f800 1 Processor -- start 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.475+0000 7ff4b391f800 1 -- start start 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.476+0000 7ff4b391f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x56298614b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.476+0000 7ff4b391f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562986144e60 con 0x562986143f40 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.476+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x56298614b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.476+0000 7ff4af5e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x56298614b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44890/0 (socket says 172.21.15.50:44890) 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.476+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 learned_addr learned my addr 172.21.15.50:0/705951425 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.476+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298614b770 con 0x562986143f40 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.476+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x56298614b230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000bc40 tx=0x7ff4a0010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.477+0000 7ff3917fa640 1 -- 172.21.15.50:0/705951425 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0065030 con 0x562986143f40 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.477+0000 7ff3917fa640 1 -- 172.21.15.50:0/705951425 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a0070070 con 0x562986143f40 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.477+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56298614b770 con 0x562986143f40 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.477+0000 7ff3917fa640 1 -- 172.21.15.50:0/705951425 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4a0031440 con 0x562986143f40 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.477+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298614bc10 con 0x562986143f40 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.477+0000 7ff3917fa640 1 -- 172.21.15.50:0/705951425 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff4a0026b70 con 0x562986143f40 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.478+0000 7ff3917fa640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff378036950 0x7ff378038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.478+0000 7ff3917fa640 1 -- 172.21.15.50:0/705951425 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff4a006cc80 con 0x562986143f40 2024-05-07T13:56:09.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.478+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff378036950 0x7ff378038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.478+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff378036950 0x7ff378038e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff498052fd0 tx=0x7ff49804f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.478+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.478+0000 7ff4b391f800 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986156980 0x562986158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.478+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562986159590 con 0x562986156980 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4afde8640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986156980 0x562986158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4afde8640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986156980 0x562986158e40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986156980 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4b391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4b391f800 20 realm 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5629861599a0 con 0x562986156980 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986156980 2024-05-07T13:56:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4b391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4b391f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.479+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298615a270 con 0x562986156980 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986156980 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4b391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x562986156980 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986156980 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4b391f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4b391f800 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56298615b370 0x56298615d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298615dd70 con 0x56298615b370 2024-05-07T13:56:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56298615b370 0x56298615d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.480+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56298615b370 0x56298615d760 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.481+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.481+0000 7ff4b391f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.481+0000 7ff4b391f800 20 searching for the correct realm 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.481+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615f6a0 con 0x56298615b370 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.481+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.481+0000 7ff4af5e7640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4a000f070 0x7ff4a004b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.481+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615f6a0 con 0x7ff4a000f070 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.481+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4a000f070 0x7ff4a004b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.482+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4a000f070 0x7ff4a004b7c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.482+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.482+0000 7ff4a7fff640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff498074040 0x7ff498081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.482+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615f6a0 con 0x7ff498074040 2024-05-07T13:56:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.482+0000 7ff4afde8640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff498074040 0x7ff498081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.482+0000 7ff4afde8640 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff498074040 0x7ff498081410 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.483+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a800a4a0 con 0x7ff498074040 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.483+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x562986156980 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.483+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986156980 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.483+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x562986156980 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.483+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986156980 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.483+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x7ff498074040 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.483+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a800a4a0 con 0x7ff498074040 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.483+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x7ff498074040 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.484+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff4a800a4a0 con 0x7ff498074040 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.484+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x7ff4a000f070 2024-05-07T13:56:09.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.484+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.484+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x56298615b370 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.484+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.484+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x562986156980 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.484+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986156980 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.484+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x7ff498074040 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.485+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a800a4a0 con 0x7ff498074040 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.485+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x562986156980 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.485+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986156980 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.485+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56298615a610 con 0x7ff4a000f070 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.485+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.485+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x56298615b370 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.486+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.486+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x56298615b370 2024-05-07T13:56:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.486+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.486+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x7ff498074040 2024-05-07T13:56:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.486+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a800a4a0 con 0x7ff498074040 2024-05-07T13:56:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.486+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x56298615b370 2024-05-07T13:56:09.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.487+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.487+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x56298615b370 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.487+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.487+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x562986156980 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.487+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a800a4a0 con 0x562986156980 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.487+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x562986156980 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.487+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.487+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x7ff498074040 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.487+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.488+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x56298615b370 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.488+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.488+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x7ff4a000f070 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.488+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.488+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x562986156980 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.488+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.488+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x7ff498074040 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.489+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.489+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x56298615b370 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.489+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.489+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x7ff498074040 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.489+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.489+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x7ff4a000f070 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.489+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.489+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x56298615b370 2024-05-07T13:56:09.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.489+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.490+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x7ff498074040 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.490+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.490+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x562986156980 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.490+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.490+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff49808e060 con 0x7ff4a000f070 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.490+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.490+0000 7ff4b391f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:09.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298615e630 con 0x562986156980 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298615ea20 con 0x562986156980 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298615ea20 con 0x7ff498074040 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:09.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 zone default found 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 4 Realm: () 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 zonegroup default 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.491+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298615e1b0 con 0x7ff498074040 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298615e1b0 con 0x56298615b370 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5629861615e0 con 0x56298615b370 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 20 started sync module instance, tier type = 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.492+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5629861609a0 con 0x7ff4a000f070 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.493+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.493+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94736343240128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986160600 con 0x7ff4a000f070 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.493+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986162510 con 0x562986156980 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.494+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94736343240128] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.494+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.494+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94736343244896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986162930 con 0x562986156980 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.494+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5629861632f0 con 0x56298615b370 2024-05-07T13:56:09.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.495+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.495+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94736343248448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986163b90 con 0x56298615b370 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.495+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986164670 con 0x7ff4a000f070 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.495+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94736343244896] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.496+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.496+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94736343253376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986164a60 con 0x7ff4a000f070 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.496+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94736343248448] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.496+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5629861654e0 con 0x562986156980 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.498+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94736343253376] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.498+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.498+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94736343245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5629861636e0 con 0x562986156980 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.498+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986165d80 con 0x7ff498074040 2024-05-07T13:56:09.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.499+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94736343245952] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.499+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.499+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94736343257040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986165d30 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.499+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986166790 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.500+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94736343257040] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.500+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.500+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94736343259264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986166970 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.500+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5629861671c0 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94736343259264] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94736343264080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986167540 con 0x7ff498074040 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4b391f800 20 add_watcher() i=0 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4b391f800 20 add_watcher() i=1 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4b391f800 20 add_watcher() i=2 2024-05-07T13:56:09.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4b391f800 20 add_watcher() i=3 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4b391f800 20 add_watcher() i=4 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4b391f800 20 add_watcher() i=5 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.501+0000 7ff4b391f800 20 add_watcher() i=6 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.502+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94736343264080] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.502+0000 7ff4b391f800 20 add_watcher() i=7 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.502+0000 7ff4b391f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.502+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562986166550 con 0x562986156980 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.502+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.502+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94736343265264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986166550 con 0x562986156980 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.503+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94736343265264] v27'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.503+0000 7ff365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.503+0000 7ff4b391f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.503+0000 7ff4b391f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:09.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.503+0000 7ff4b391f800 5 note: GC not initialized 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff364fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 20 Filter name: none 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff2de7fc640 20 reqs_thread_entry: start 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298619d980 con 0x562986156980 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.504+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5629861a02b0 con 0x7ff4a000f070 2024-05-07T13:56:09.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.505+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.505+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5629861a3980 con 0x562986156980 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v27'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff4b391f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff4b391f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff4b391f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94736343512048 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56298619f2a0 con 0x562986156980 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94736343245952 notify 115964116994 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7ff4a801e040 con 0x562986156980 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff392ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94736343245952 notifier 4320 bl.length()=567 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify cookie 94736343512048 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff392ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff392ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff392ffd640 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff374003ea0 con 0x562986156980 2024-05-07T13:56:09.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.506+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.507+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 94736343512048 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff4a8027c90 con 0x562986156980 2024-05-07T13:56:09.507 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:09.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.508+0000 7ff365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.508+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94736343265264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5629861517a0 con 0x562986156980 2024-05-07T13:56:09.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.508+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94736343265264] v27'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.508+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94736343240128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986166fb0 con 0x7ff4a000f070 2024-05-07T13:56:09.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.509+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94736343240128] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.509+0000 7ff4b391f800 20 remove_watcher() i=0 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.509+0000 7ff4b391f800 2 removed watcher, disabling cache 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.509+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94736343244896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986160dc0 con 0x562986156980 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.510+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94736343244896] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.510+0000 7ff4b391f800 20 remove_watcher() i=1 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.510+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94736343248448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986162060 con 0x56298615b370 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.511+0000 7ff4af5e7640 1 -- 172.21.15.50:0/705951425 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94736343248448] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a005d070 con 0x56298615b370 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.511+0000 7ff4b391f800 20 remove_watcher() i=2 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.511+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94736343253376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986162060 con 0x7ff4a000f070 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.512+0000 7ff4a7fff640 1 -- 172.21.15.50:0/705951425 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94736343253376] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49807f070 con 0x7ff4a000f070 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.512+0000 7ff4b391f800 20 remove_watcher() i=3 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.512+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94736343245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986162060 con 0x562986156980 2024-05-07T13:56:09.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.513+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94736343245952] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x562986156980 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.514+0000 7ff4b391f800 20 remove_watcher() i=4 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.514+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94736343257040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986164180 con 0x7ff498074040 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.514+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94736343257040] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.514+0000 7ff4b391f800 20 remove_watcher() i=5 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.515+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94736343259264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986164180 con 0x7ff498074040 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.516+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94736343259264] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.516+0000 7ff4b391f800 20 remove_watcher() i=6 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.516+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94736343264080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562986164180 con 0x7ff498074040 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.516+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94736343264080] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4a802f060 con 0x7ff498074040 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.516+0000 7ff4b391f800 20 remove_watcher() i=7 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff498074040 msgr2=0x7ff498081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff498074040 0x7ff498081410 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986156980 msgr2=0x562986158e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986156980 0x562986158e40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4a000f070 msgr2=0x7ff4a004b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4a000f070 0x7ff4a004b7c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56298615b370 msgr2=0x56298615d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56298615b370 0x56298615d760 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff378036950 msgr2=0x7ff378038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff378036950 0x7ff378038e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff498052fd0 tx=0x7ff49804f000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 msgr2=0x56298614b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x56298614b230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000bc40 tx=0x7ff4a0010910 comp rx=0 tx=0).stop 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4afde8640 1 -- 172.21.15.50:0/705951425 reap_dead start 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 shutdown_connections 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/705951425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986143f40 0x56298614b230 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 >> 172.21.15.50:0/705951425 conn(0x5629861402a0 msgr2=0x56298613d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 shutdown_connections 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/705951425 wait complete. 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/432261102 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff388036950 msgr2=0x7ff388038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/432261102 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff388036950 0x7ff388038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x56298601d0d0 tx=0x7ff498005ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/432261102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986137050 msgr2=0x562986137470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/432261102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986137050 0x562986137470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff4a004b470 tx=0x7ff4a0017d50 comp rx=0 tx=0).stop 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/432261102 shutdown_connections 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/432261102 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff388036950 0x7ff388038e10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 --2- 172.21.15.50:0/432261102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562986137050 0x562986137470 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/432261102 >> 172.21.15.50:0/432261102 conn(0x56298612b0f0 msgr2=0x56298612b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/432261102 shutdown_connections 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.517+0000 7ff4b391f800 1 -- 172.21.15.50:0/432261102 wait complete. 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562986126090 msgr2=0x562986128500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562986126090 0x562986128500 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986021600 msgr2=0x56298611f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562986021600 0x56298611f6d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562986121f90 msgr2=0x562986124450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562986121f90 0x562986124450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff394036950 msgr2=0x7ff394038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff394036950 0x7ff394038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff498054000 tx=0x7ff49804e000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 msgr2=0x56298601dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 --2- 172.21.15.50:0/2452879694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56298601b390 0x56298601dd10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0000fd0 tx=0x7ff4a0000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4afde8640 1 -- 172.21.15.50:0/2452879694 reap_dead start 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 shutdown_connections 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 >> 172.21.15.50:0/2452879694 conn(0x562986016d30 msgr2=0x562986108820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 shutdown_connections 2024-05-07T13:56:09.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.518+0000 7ff4b391f800 1 -- 172.21.15.50:0/2452879694 wait complete. 2024-05-07T13:56:09.518 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:09.518 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-07T13:56:09.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-07T13:56:09.519 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-07T13:56:09.564 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:09.564 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.576+0000 7f59abb46800 1 Processor -- start 2024-05-07T13:56:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.576+0000 7f59abb46800 1 -- start start 2024-05-07T13:56:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.577+0000 7f59abb46800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f2a1024700 0x55f2a1026af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.577+0000 7f59abb46800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f2a1027030 con 0x55f2a1020bf0 2024-05-07T13:56:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.577+0000 7f59abb46800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55f2a0eb1050 con 0x55f2a1024700 2024-05-07T13:56:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.577+0000 7f59a8e4b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f2a1024700 0x55f2a1026af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.577+0000 7f59a964c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55f2a1020bf0 0x55f2a1022fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39564/0 (socket says 172.21.15.50:39564) 2024-05-07T13:56:09.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.577+0000 7f59a964c640 1 -- 172.21.15.50:0/293347011 learned_addr learned my addr 172.21.15.50:0/293347011 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:09.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.577+0000 7f59a8e4b640 1 -- 172.21.15.50:0/293347011 >> v1:172.21.15.22:6789/0 conn(0x55f2a1020bf0 legacy=0x55f2a1022fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.577+0000 7f59a8e4b640 1 -- 172.21.15.50:0/293347011 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a1028210 con 0x55f2a1024700 2024-05-07T13:56:09.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.577+0000 7f599bfff640 1 -- 172.21.15.50:0/293347011 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2129335767 0 0) 0x55f2a1027030 con 0x55f2a1020bf0 2024-05-07T13:56:09.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.579+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/293347011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1024700 0x55f2a1026af0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59a000a470 tx=0x7f59a001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538dedfcc7d09e70 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.579+0000 7f599bfff640 1 -- 172.21.15.50:0/293347011 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a0057070 con 0x55f2a1024700 2024-05-07T13:56:09.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.579+0000 7f599bfff640 1 -- 172.21.15.50:0/293347011 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a0052570 con 0x55f2a1024700 2024-05-07T13:56:09.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.579+0000 7f599bfff640 1 -- 172.21.15.50:0/293347011 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a0052870 con 0x55f2a1024700 2024-05-07T13:56:09.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.580+0000 7f59abb46800 1 -- 172.21.15.50:0/293347011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1024700 msgr2=0x55f2a1026af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.580+0000 7f59abb46800 1 --2- 172.21.15.50:0/293347011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1024700 0x55f2a1026af0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59a000a470 tx=0x7f59a001ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:09.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.580+0000 7f59abb46800 1 -- 172.21.15.50:0/293347011 shutdown_connections 2024-05-07T13:56:09.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.580+0000 7f59abb46800 1 --2- 172.21.15.50:0/293347011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1024700 0x55f2a1026af0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.580+0000 7f59abb46800 1 -- 172.21.15.50:0/293347011 >> 172.21.15.50:0/293347011 conn(0x55f2a101a5a0 msgr2=0x55f2a101c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.580+0000 7f59abb46800 1 -- 172.21.15.50:0/293347011 shutdown_connections 2024-05-07T13:56:09.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.580+0000 7f59abb46800 1 -- 172.21.15.50:0/293347011 wait complete. 2024-05-07T13:56:09.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.595+0000 7f59abb46800 1 Processor -- start 2024-05-07T13:56:09.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.595+0000 7f59abb46800 1 -- start start 2024-05-07T13:56:09.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.595+0000 7f59abb46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1111450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.595+0000 7f59abb46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f2a0f6b1d0 con 0x55f2a1020bf0 2024-05-07T13:56:09.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.595+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1111450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.595+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1111450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44908/0 (socket says 172.21.15.50:44908) 2024-05-07T13:56:09.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.595+0000 7f59a964c640 1 -- 172.21.15.50:0/2540753286 learned_addr learned my addr 172.21.15.50:0/2540753286 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.596+0000 7f59a964c640 1 -- 172.21.15.50:0/2540753286 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a1111a20 con 0x55f2a1020bf0 2024-05-07T13:56:09.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.596+0000 7f59a964c640 1 --2- 172.21.15.50:0/2540753286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1111450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f599c00b210 tx=0x7f599c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd90f12e978879 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.596+0000 7f5897606640 1 -- 172.21.15.50:0/2540753286 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c008070 con 0x55f2a1020bf0 2024-05-07T13:56:09.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.596+0000 7f5897606640 1 -- 172.21.15.50:0/2540753286 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c00d500 con 0x55f2a1020bf0 2024-05-07T13:56:09.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.596+0000 7f5897606640 1 -- 172.21.15.50:0/2540753286 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c00d840 con 0x55f2a1020bf0 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 -- 172.21.15.50:0/2540753286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 msgr2=0x55f2a1111450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 --2- 172.21.15.50:0/2540753286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1111450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f599c00b210 tx=0x7f599c00b6d0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 -- 172.21.15.50:0/2540753286 shutdown_connections 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 --2- 172.21.15.50:0/2540753286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1111450 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 -- 172.21.15.50:0/2540753286 >> 172.21.15.50:0/2540753286 conn(0x55f2a101a5a0 msgr2=0x55f2a110cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 -- 172.21.15.50:0/2540753286 shutdown_connections 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 -- 172.21.15.50:0/2540753286 wait complete. 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 Processor -- start 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 -- start start 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1119080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.597+0000 7f59abb46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f2a1027500 con 0x55f2a1020bf0 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1119080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1119080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44916/0 (socket says 172.21.15.50:44916) 2024-05-07T13:56:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f59a964c640 1 -- 172.21.15.50:0/134382246 learned_addr learned my addr 172.21.15.50:0/134382246 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f59a964c640 1 -- 172.21.15.50:0/134382246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a11195c0 con 0x55f2a1020bf0 2024-05-07T13:56:09.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f59a964c640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1119080 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f599c00b210 tx=0x7f599c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f5895e03640 1 -- 172.21.15.50:0/134382246 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c00f950 con 0x55f2a1020bf0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2a1119850 con 0x55f2a1020bf0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f5895e03640 1 -- 172.21.15.50:0/134382246 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c00faf0 con 0x55f2a1020bf0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a111c500 con 0x55f2a1020bf0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.598+0000 7f5895e03640 1 -- 172.21.15.50:0/134382246 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c02b060 con 0x55f2a1020bf0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.599+0000 7f5895e03640 1 -- 172.21.15.50:0/134382246 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f599c017040 con 0x55f2a1020bf0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.599+0000 7f5895e03640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5890036900 0x7f5890038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.599+0000 7f5895e03640 1 -- 172.21.15.50:0/134382246 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f599c015020 con 0x55f2a1020bf0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.600+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5890036900 0x7f5890038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.600+0000 7f59abb46800 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1024700 0x55f2a11202c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.600+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1120840 con 0x55f2a1024700 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.600+0000 7f59a9e4d640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1024700 0x55f2a11202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.600+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5890036900 0x7f5890038dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59a0054000 tx=0x7f59a004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.600+0000 7f59a9e4d640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1024700 0x55f2a11202c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.600+0000 7f59a9e4d640 1 -- 172.21.15.50:0/134382246 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1024700 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.600+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a111d890 con 0x55f2a1024700 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.601+0000 7f59a9e4d640 1 -- 172.21.15.50:0/134382246 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1024700 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.601+0000 7f59abb46800 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a1122b70 0x55f2a1124f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.601+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1125650 con 0x55f2a1122b70 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.601+0000 7f59a964c640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a1122b70 0x55f2a1124f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.601+0000 7f59a964c640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a1122b70 0x55f2a1124f60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.601+0000 7f59a964c640 1 -- 172.21.15.50:0/134382246 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a1122b70 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.601+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1121af0 con 0x55f2a1024700 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.602+0000 7f59a9e4d640 1 -- 172.21.15.50:0/134382246 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1024700 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.602+0000 7f59abb46800 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f2a1126ab0 0x55f2a1128f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.602+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1129690 con 0x55f2a1126ab0 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.602+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f2a1126ab0 0x55f2a1128f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.602+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f2a1126ab0 0x55f2a1128f00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.603+0000 7f59a8e4b640 1 -- 172.21.15.50:0/134382246 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f59a005a040 con 0x55f2a1126ab0 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.603+0000 7f59abb46800 1 Processor -- start 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.603+0000 7f59abb46800 1 -- start start 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.603+0000 7f59abb46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1137a80 0x55f2a1137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.603+0000 7f59abb46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f2a0f11cf0 con 0x55f2a1137a80 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.603+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1137a80 0x55f2a1137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.603+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1137a80 0x55f2a1137ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44926/0 (socket says 172.21.15.50:44926) 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.603+0000 7f59a964c640 1 -- 172.21.15.50:0/1664109940 learned_addr learned my addr 172.21.15.50:0/1664109940 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.604+0000 7f59a964c640 1 -- 172.21.15.50:0/1664109940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a11383e0 con 0x55f2a1137a80 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.604+0000 7f59a964c640 1 --2- 172.21.15.50:0/1664109940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1137a80 0x55f2a1137ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f599c00ffd0 tx=0x7f599c01a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.604+0000 7f588effd640 1 -- 172.21.15.50:0/1664109940 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c034030 con 0x55f2a1137a80 2024-05-07T13:56:09.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.604+0000 7f588effd640 1 -- 172.21.15.50:0/1664109940 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c046040 con 0x55f2a1137a80 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.604+0000 7f59abb46800 1 -- 172.21.15.50:0/1664109940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2a1138e50 con 0x55f2a1137a80 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.604+0000 7f588effd640 1 -- 172.21.15.50:0/1664109940 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c044a20 con 0x55f2a1137a80 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.604+0000 7f59abb46800 1 -- 172.21.15.50:0/1664109940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a1139350 con 0x55f2a1137a80 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.605+0000 7f588effd640 1 -- 172.21.15.50:0/1664109940 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f599c044bc0 con 0x55f2a1137a80 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.605+0000 7f588effd640 1 --2- 172.21.15.50:0/1664109940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5880036950 0x7f5880038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.605+0000 7f588effd640 1 -- 172.21.15.50:0/1664109940 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f599c038070 con 0x55f2a1137a80 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.605+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/1664109940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5880036950 0x7f5880038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.605+0000 7f59abb46800 1 Processor -- start 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.605+0000 7f59abb46800 1 -- start start 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/1664109940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5880036950 0x7f5880038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55f2a1121120 tx=0x7f59a0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f59abb46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a101e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f59abb46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f2a1111da0 con 0x55f2a10202b0 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a101e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a101e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44928/0 (socket says 172.21.15.50:44928) 2024-05-07T13:56:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f59a964c640 1 -- 172.21.15.50:0/1724822160 learned_addr learned my addr 172.21.15.50:0/1724822160 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f59a964c640 1 -- 172.21.15.50:0/1724822160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a1020760 con 0x55f2a10202b0 2024-05-07T13:56:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f59a964c640 1 --2- 172.21.15.50:0/1724822160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a101e9e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f599c03f760 tx=0x7f599c030560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d4b75b3354a246 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f588cff9640 1 -- 172.21.15.50:0/1724822160 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c064070 con 0x55f2a10202b0 2024-05-07T13:56:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f588cff9640 1 -- 172.21.15.50:0/1724822160 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c04e070 con 0x55f2a10202b0 2024-05-07T13:56:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.606+0000 7f588cff9640 1 -- 172.21.15.50:0/1724822160 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c044eb0 con 0x55f2a10202b0 2024-05-07T13:56:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 -- 172.21.15.50:0/1724822160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 msgr2=0x55f2a101e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 --2- 172.21.15.50:0/1724822160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a101e9e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f599c03f760 tx=0x7f599c030560 comp rx=0 tx=0).stop 2024-05-07T13:56:09.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 -- 172.21.15.50:0/1724822160 shutdown_connections 2024-05-07T13:56:09.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 --2- 172.21.15.50:0/1724822160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a101e9e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 -- 172.21.15.50:0/1724822160 >> 172.21.15.50:0/1724822160 conn(0x55f2a1141080 msgr2=0x55f2a113f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 -- 172.21.15.50:0/1724822160 shutdown_connections 2024-05-07T13:56:09.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 -- 172.21.15.50:0/1724822160 wait complete. 2024-05-07T13:56:09.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 Processor -- start 2024-05-07T13:56:09.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 -- start start 2024-05-07T13:56:09.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a114e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.607+0000 7f59abb46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f2a101ef20 con 0x55f2a10202b0 2024-05-07T13:56:09.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a114e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f59a964c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a114e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44932/0 (socket says 172.21.15.50:44932) 2024-05-07T13:56:09.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 learned_addr learned my addr 172.21.15.50:0/2915120249 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a114e8f0 con 0x55f2a10202b0 2024-05-07T13:56:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f59a964c640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a114e3b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f599c03f760 tx=0x7f599c019f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f587effd640 1 -- 172.21.15.50:0/2915120249 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c064040 con 0x55f2a10202b0 2024-05-07T13:56:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f587effd640 1 -- 172.21.15.50:0/2915120249 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c070070 con 0x55f2a10202b0 2024-05-07T13:56:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2a114e8f0 con 0x55f2a10202b0 2024-05-07T13:56:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f587effd640 1 -- 172.21.15.50:0/2915120249 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599c03f080 con 0x55f2a10202b0 2024-05-07T13:56:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.608+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a114e8f0 con 0x55f2a10202b0 2024-05-07T13:56:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.609+0000 7f587effd640 1 -- 172.21.15.50:0/2915120249 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f599c03fb70 con 0x55f2a10202b0 2024-05-07T13:56:09.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.609+0000 7f587effd640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5874036950 0x7f5874038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.609+0000 7f587effd640 1 -- 172.21.15.50:0/2915120249 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f599c058070 con 0x55f2a10202b0 2024-05-07T13:56:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.609+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5874036950 0x7f5874038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.609+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.609+0000 7f59abb46800 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1159a20 0x55f2a115bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.609+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115c630 con 0x55f2a1159a20 2024-05-07T13:56:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59a9e4d640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1159a20 0x55f2a115bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5874036950 0x7f5874038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59a001ced0 tx=0x7f59a004f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59a9e4d640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1159a20 0x55f2a115bee0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59abb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59abb46800 20 realm 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115ca40 con 0x55f2a1159a20 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59abb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59abb46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.610+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d310 con 0x55f2a1159a20 2024-05-07T13:56:09.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59abb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a1159a20 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59abb46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59abb46800 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a115e1a0 0x55f2a1160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1160cf0 con 0x55f2a115e1a0 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59a964c640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a115e1a0 0x55f2a1160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.611+0000 7f59a964c640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a115e1a0 0x55f2a1160590 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.612+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.612+0000 7f59abb46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.612+0000 7f59abb46800 20 searching for the correct realm 2024-05-07T13:56:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.612+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a11626d0 con 0x55f2a115e1a0 2024-05-07T13:56:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.612+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.612+0000 7f59a964c640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f599c01c440 0x7f599c03d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.612+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a11626d0 con 0x7f599c01c440 2024-05-07T13:56:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.612+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f599c01c440 0x7f599c03d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.613+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f599c01c440 0x7f599c03d8a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.613+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.613+0000 7f59a8e4b640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f59a0083040 0x7f59a0075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.613+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a11626d0 con 0x7f59a0083040 2024-05-07T13:56:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.613+0000 7f59a9e4d640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f59a0083040 0x7f59a0075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.614+0000 7f59a9e4d640 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f59a0083040 0x7f59a0075430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.614+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.614+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a1159a20 2024-05-07T13:56:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.614+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.614+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a1159a20 2024-05-07T13:56:09.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.614+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.614+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f59a0083040 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.615+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.615+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f59a0083040 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.615+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.615+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f599c01c440 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.615+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.615+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a115e1a0 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.615+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.615+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a1159a20 2024-05-07T13:56:09.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.616+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.616+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f59a0083040 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.616+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.616+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a1159a20 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.616+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.616+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f599c01c440 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.617+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.617+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a115e1a0 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.617+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.617+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a115e1a0 2024-05-07T13:56:09.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.617+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.617+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f59a0083040 2024-05-07T13:56:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.617+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.617+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a115e1a0 2024-05-07T13:56:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.618+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.618+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a115e1a0 2024-05-07T13:56:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.618+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.618+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a1159a20 2024-05-07T13:56:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.618+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.618+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a1159a20 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.619+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.619+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f59a0083040 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.619+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.619+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a115e1a0 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.619+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.619+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f599c01c440 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.620+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.620+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a1159a20 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.620+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.620+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f59a0083040 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.620+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.620+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a115e1a0 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.620+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.620+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f59a0083040 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.621+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.621+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f599c01c440 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.621+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.621+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a115e1a0 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.621+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.621+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f59a0083040 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.621+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x55f2a1159a20 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f2a115d6b0 con 0x7f599c01c440 2024-05-07T13:56:09.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a11616a0 con 0x55f2a1159a20 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1161a90 con 0x55f2a1159a20 2024-05-07T13:56:09.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.622+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1161a90 con 0x7f59a0083040 2024-05-07T13:56:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 20 zone default found 2024-05-07T13:56:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 4 Realm: () 2024-05-07T13:56:09.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 20 zonegroup default 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1161eb0 con 0x7f59a0083040 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a11622d0 con 0x55f2a115e1a0 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.623+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1164580 con 0x55f2a115e1a0 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.624+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.624+0000 7f59abb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.624+0000 7f59abb46800 20 started sync module instance, tier type = 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.624+0000 7f59abb46800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.624+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1163a20 con 0x7f599c01c440 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.625+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.625+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94500573036096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1163680 con 0x7f599c01c440 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.625+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a11652e0 con 0x55f2a1159a20 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.626+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94500573036096] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.626+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.626+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94500573038880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a11656d0 con 0x55f2a1159a20 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.626+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1166110 con 0x55f2a115e1a0 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.627+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94500573038880] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.627+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.627+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94500573043680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1166500 con 0x55f2a115e1a0 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.627+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1166f30 con 0x7f599c01c440 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.628+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94500573043680] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.628+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.629+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94500573039936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1167800 con 0x7f599c01c440 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.629+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a11681c0 con 0x55f2a1159a20 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.630+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94500573039936] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.630+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.630+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94500573052176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1168130 con 0x55f2a1159a20 2024-05-07T13:56:09.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.630+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1169080 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.631+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.631+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94500573055952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1168ff0 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.631+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1169fe0 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.631+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94500573052176] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.632+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94500573055952] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.632+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.632+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94500573054336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1169fe0 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.632+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1169550 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94500573054336] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94500573059776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1169550 con 0x7f59a0083040 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59abb46800 20 add_watcher() i=0 2024-05-07T13:56:09.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59abb46800 20 add_watcher() i=1 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59abb46800 20 add_watcher() i=2 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59abb46800 20 add_watcher() i=3 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59abb46800 20 add_watcher() i=4 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59abb46800 20 add_watcher() i=5 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.633+0000 7f59abb46800 20 add_watcher() i=6 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.634+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94500573059776] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.634+0000 7f59abb46800 20 add_watcher() i=7 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.634+0000 7f59abb46800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.634+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a116d8b0 con 0x55f2a1159a20 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.635+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.635+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94500573062096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a116adb0 con 0x55f2a1159a20 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.636+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94500573062096] v27'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.636+0000 7f585f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.636+0000 7f59abb46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.636+0000 7f59abb46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.636+0000 7f59abb46800 5 note: GC not initialized 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.636+0000 7f585e7e4640 20 reqs_thread_entry: start 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.636+0000 7f59abb46800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.636+0000 7f59abb46800 20 Filter name: none 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.636+0000 7f57cffff640 20 reqs_thread_entry: start 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.637+0000 7f59abb46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.637+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f2a11a08a0 con 0x55f2a1159a20 2024-05-07T13:56:09.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.637+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.637+0000 7f59abb46800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:09.641 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:09.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.638+0000 7f585f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.638+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94500573062096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a119f7f0 con 0x55f2a1159a20 2024-05-07T13:56:09.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.639+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94500573062096] v27'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.639+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94500573036096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a119f340 con 0x7f599c01c440 2024-05-07T13:56:09.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.640+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94500573036096] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.640+0000 7f59abb46800 20 remove_watcher() i=0 2024-05-07T13:56:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.640+0000 7f59abb46800 2 removed watcher, disabling cache 2024-05-07T13:56:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.640+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94500573038880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1163e40 con 0x55f2a1159a20 2024-05-07T13:56:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.641+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94500573038880] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.641+0000 7f59abb46800 20 remove_watcher() i=1 2024-05-07T13:56:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.641+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94500573043680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1164920 con 0x55f2a115e1a0 2024-05-07T13:56:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.642+0000 7f59a964c640 1 -- 172.21.15.50:0/2915120249 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94500573043680] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f599c02d070 con 0x55f2a115e1a0 2024-05-07T13:56:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.642+0000 7f59abb46800 20 remove_watcher() i=2 2024-05-07T13:56:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.642+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94500573039936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1164920 con 0x7f599c01c440 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.643+0000 7f59a8e4b640 1 -- 172.21.15.50:0/2915120249 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94500573039936] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0070030 con 0x7f599c01c440 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.643+0000 7f59abb46800 20 remove_watcher() i=3 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.643+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94500573052176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1165be0 con 0x55f2a1159a20 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.644+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94500573052176] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x55f2a1159a20 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.644+0000 7f59abb46800 20 remove_watcher() i=4 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.644+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94500573055952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1165be0 con 0x7f59a0083040 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.645+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94500573055952] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.645+0000 7f59abb46800 20 remove_watcher() i=5 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.645+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94500573054336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1168bd0 con 0x7f59a0083040 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.646+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94500573054336] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.646+0000 7f59abb46800 20 remove_watcher() i=6 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.646+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94500573059776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f2a1168bd0 con 0x7f59a0083040 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94500573059776] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a400a4a0 con 0x7f59a0083040 2024-05-07T13:56:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 20 remove_watcher() i=7 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f59a0083040 msgr2=0x7f59a0075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f59a0083040 0x7f59a0075430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1159a20 msgr2=0x55f2a115bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1159a20 0x55f2a115bee0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f599c01c440 msgr2=0x7f599c03d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f599c01c440 0x7f599c03d8a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a115e1a0 msgr2=0x55f2a1160590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a115e1a0 0x55f2a1160590 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5874036950 msgr2=0x7f5874038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5874036950 0x7f5874038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59a001ced0 tx=0x7f59a004f000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 msgr2=0x55f2a114e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 --2- 172.21.15.50:0/2915120249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a10202b0 0x55f2a114e3b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f599c03f760 tx=0x7f599c019f90 comp rx=0 tx=0).stop 2024-05-07T13:56:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 reap_dead start 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59a9e4d640 1 -- 172.21.15.50:0/2915120249 reap_dead start 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 shutdown_connections 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 >> 172.21.15.50:0/2915120249 conn(0x55f2a1141080 msgr2=0x55f2a113e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 shutdown_connections 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.647+0000 7f59abb46800 1 -- 172.21.15.50:0/2915120249 wait complete. 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/1664109940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5880036950 msgr2=0x7f5880038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 --2- 172.21.15.50:0/1664109940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5880036950 0x7f5880038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55f2a1121120 tx=0x7f59a0005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/1664109940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1137a80 msgr2=0x55f2a1137ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 --2- 172.21.15.50:0/1664109940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1137a80 0x55f2a1137ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f599c00ffd0 tx=0x7f599c01a700 comp rx=0 tx=0).stop 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/1664109940 shutdown_connections 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 --2- 172.21.15.50:0/1664109940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5880036950 0x7f5880038e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 --2- 172.21.15.50:0/1664109940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1137a80 0x55f2a1137ea0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/1664109940 >> 172.21.15.50:0/1664109940 conn(0x55f2a112bb20 msgr2=0x55f2a112bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/1664109940 shutdown_connections 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/1664109940 wait complete. 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f2a1126ab0 msgr2=0x55f2a1128f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f2a1126ab0 0x55f2a1128f00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1024700 msgr2=0x55f2a11202c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f2a1024700 0x55f2a11202c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a1122b70 msgr2=0x55f2a1124f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f2a1122b70 0x55f2a1124f60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5890036900 msgr2=0x7f5890038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5890036900 0x7f5890038dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59a0054000 tx=0x7f59a004e000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 msgr2=0x55f2a1119080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 --2- 172.21.15.50:0/134382246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a1020bf0 0x55f2a1119080 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f599c00b210 tx=0x7f599c000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59a9e4d640 1 -- 172.21.15.50:0/134382246 reap_dead start 2024-05-07T13:56:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 shutdown_connections 2024-05-07T13:56:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 >> 172.21.15.50:0/134382246 conn(0x55f2a101a5a0 msgr2=0x55f2a110b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 shutdown_connections 2024-05-07T13:56:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.648+0000 7f59abb46800 1 -- 172.21.15.50:0/134382246 wait complete. 2024-05-07T13:56:09.653 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:09.653 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-07T13:56:09.653 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-07T13:56:09.654 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-05-07T13:56:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:09.704 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8eb736800 1 Processor -- start 2024-05-07T13:56:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8eb736800 1 -- start start 2024-05-07T13:56:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8eb736800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ff4938b480 0x55ff4938d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8eb736800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff4938de40 con 0x55ff49386ff0 2024-05-07T13:56:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8eb736800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55ff49219050 con 0x55ff4938b480 2024-05-07T13:56:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8e6ccb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ff4938b480 0x55ff4938d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8e74cc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55ff49386ff0 0x55ff49387410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39578/0 (socket says 172.21.15.50:39578) 2024-05-07T13:56:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8e74cc640 1 -- 172.21.15.50:0/1519215333 learned_addr learned my addr 172.21.15.50:0/1519215333 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8e64ca640 1 -- 172.21.15.50:0/1519215333 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758842295 0 0) 0x55ff4938de40 con 0x55ff49386ff0 2024-05-07T13:56:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8e64ca640 1 -- 172.21.15.50:0/1519215333 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8d0001e10 con 0x55ff49386ff0 2024-05-07T13:56:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/1519215333 >> v1:172.21.15.22:6789/0 conn(0x55ff49386ff0 legacy=0x55ff49387410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.716+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/1519215333 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4938f070 con 0x55ff4938b480 2024-05-07T13:56:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.718+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/1519215333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4938b480 0x55ff4938d870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00a470 tx=0x7fd8dc01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9679518dac42 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8e64ca640 1 -- 172.21.15.50:0/1519215333 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc057070 con 0x55ff4938b480 2024-05-07T13:56:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8e64ca640 1 -- 172.21.15.50:0/1519215333 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc052570 con 0x55ff4938b480 2024-05-07T13:56:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8e64ca640 1 -- 172.21.15.50:0/1519215333 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8dc052870 con 0x55ff4938b480 2024-05-07T13:56:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8eb736800 1 -- 172.21.15.50:0/1519215333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4938b480 msgr2=0x55ff4938d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8eb736800 1 --2- 172.21.15.50:0/1519215333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4938b480 0x55ff4938d870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00a470 tx=0x7fd8dc01cdb0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8eb736800 1 -- 172.21.15.50:0/1519215333 shutdown_connections 2024-05-07T13:56:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8eb736800 1 --2- 172.21.15.50:0/1519215333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4938b480 0x55ff4938d870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8eb736800 1 -- 172.21.15.50:0/1519215333 >> 172.21.15.50:0/1519215333 conn(0x55ff493825d0 msgr2=0x55ff493849f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8eb736800 1 -- 172.21.15.50:0/1519215333 shutdown_connections 2024-05-07T13:56:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.719+0000 7fd8eb736800 1 -- 172.21.15.50:0/1519215333 wait complete. 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.734+0000 7fd8eb736800 1 Processor -- start 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.734+0000 7fd8eb736800 1 -- start start 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.734+0000 7fd8eb736800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff494784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.734+0000 7fd8eb736800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ff492d31f0 con 0x55ff49386ff0 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.735+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff494784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.735+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff494784d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44958/0 (socket says 172.21.15.50:44958) 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.735+0000 7fd8e74cc640 1 -- 172.21.15.50:0/3953560062 learned_addr learned my addr 172.21.15.50:0/3953560062 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.735+0000 7fd8e74cc640 1 -- 172.21.15.50:0/3953560062 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff49478aa0 con 0x55ff49386ff0 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.735+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/3953560062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff494784d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8001e30 tx=0x7fd8d800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec12570a9fdb4cd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.735+0000 7fd7d560a640 1 -- 172.21.15.50:0/3953560062 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d8012020 con 0x55ff49386ff0 2024-05-07T13:56:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.735+0000 7fd7d560a640 1 -- 172.21.15.50:0/3953560062 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d800e5a0 con 0x55ff49386ff0 2024-05-07T13:56:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.735+0000 7fd7d560a640 1 -- 172.21.15.50:0/3953560062 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d800e8e0 con 0x55ff49386ff0 2024-05-07T13:56:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 -- 172.21.15.50:0/3953560062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 msgr2=0x55ff494784d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3953560062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff494784d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8001e30 tx=0x7fd8d800b780 comp rx=0 tx=0).stop 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 -- 172.21.15.50:0/3953560062 shutdown_connections 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3953560062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff494784d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 -- 172.21.15.50:0/3953560062 >> 172.21.15.50:0/3953560062 conn(0x55ff493825d0 msgr2=0x55ff49473df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 -- 172.21.15.50:0/3953560062 shutdown_connections 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 -- 172.21.15.50:0/3953560062 wait complete. 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 Processor -- start 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 -- start start 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.736+0000 7fd8eb736800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff492faea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.737+0000 7fd8eb736800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ff4938e310 con 0x55ff49386ff0 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.737+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff492faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.737+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff492faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44972/0 (socket says 172.21.15.50:44972) 2024-05-07T13:56:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.737+0000 7fd8e74cc640 1 -- 172.21.15.50:0/3685260495 learned_addr learned my addr 172.21.15.50:0/3685260495 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.737+0000 7fd8e74cc640 1 -- 172.21.15.50:0/3685260495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff49483dd0 con 0x55ff49386ff0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.737+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff492faea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8001e30 tx=0x7fd8d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.738+0000 7fd7d3e07640 1 -- 172.21.15.50:0/3685260495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d8012030 con 0x55ff49386ff0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.738+0000 7fd7d3e07640 1 -- 172.21.15.50:0/3685260495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8001490 con 0x55ff49386ff0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.738+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff49483fa0 con 0x55ff49386ff0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.738+0000 7fd7d3e07640 1 -- 172.21.15.50:0/3685260495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d801a8a0 con 0x55ff49386ff0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.738+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff494844c0 con 0x55ff49386ff0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.738+0000 7fd7d3e07640 1 -- 172.21.15.50:0/3685260495 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd8d8015020 con 0x55ff49386ff0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.739+0000 7fd7d3e07640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7cc036950 0x7fd7cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.739+0000 7fd7d3e07640 1 -- 172.21.15.50:0/3685260495 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd8d8020030 con 0x55ff49386ff0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.739+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7cc036950 0x7fd7cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.739+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff4938b480 0x55ff494882e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.739+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494888b0 con 0x55ff4938b480 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.739+0000 7fd8e7ccd640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff4938b480 0x55ff494882e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.739+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7cc036950 0x7fd7cc038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc054000 tx=0x7fd8dc04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.739+0000 7fd8e7ccd640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff4938b480 0x55ff494882e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.739+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/3685260495 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff4938b480 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.740+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494858b0 con 0x55ff4938b480 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.740+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/3685260495 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff4938b480 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.740+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff4948ac00 0x55ff4948cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.740+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff4948d6e0 con 0x55ff4948ac00 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.740+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff4948ac00 0x55ff4948cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.740+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff4948ac00 0x55ff4948cff0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.740+0000 7fd8e74cc640 1 -- 172.21.15.50:0/3685260495 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8d800dcd0 con 0x55ff4948ac00 2024-05-07T13:56:09.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.741+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff49489bb0 con 0x55ff4938b480 2024-05-07T13:56:09.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.741+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/3685260495 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff4938b480 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.741+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ff4948eb40 0x55ff49490fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.741+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff49491760 con 0x55ff4948eb40 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.741+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ff4948eb40 0x55ff49490fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.741+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ff4948eb40 0x55ff49490fd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.742+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/3685260495 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8dc05a040 con 0x55ff4948eb40 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.742+0000 7fd8eb736800 1 Processor -- start 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.742+0000 7fd8eb736800 1 -- start start 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.742+0000 7fd8eb736800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4949fbc0 0x55ff4949ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.742+0000 7fd8eb736800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ff49279cf0 con 0x55ff4949fbc0 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.742+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4949fbc0 0x55ff4949ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.742+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4949fbc0 0x55ff4949ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44976/0 (socket says 172.21.15.50:44976) 2024-05-07T13:56:09.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.742+0000 7fd8e74cc640 1 -- 172.21.15.50:0/3451902767 learned_addr learned my addr 172.21.15.50:0/3451902767 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.743+0000 7fd8e74cc640 1 -- 172.21.15.50:0/3451902767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff494a0520 con 0x55ff4949fbc0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.743+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/3451902767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4949fbc0 0x55ff4949ffe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd8d804abe0 tx=0x7fd8d8018570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.743+0000 7fd7d1602640 1 -- 172.21.15.50:0/3451902767 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d8045ab0 con 0x55ff4949fbc0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.743+0000 7fd7d1602640 1 -- 172.21.15.50:0/3451902767 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8044020 con 0x55ff4949fbc0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.743+0000 7fd7d1602640 1 -- 172.21.15.50:0/3451902767 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d8045dc0 con 0x55ff4949fbc0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.743+0000 7fd8eb736800 1 -- 172.21.15.50:0/3451902767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff494a0f90 con 0x55ff4949fbc0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.743+0000 7fd8eb736800 1 -- 172.21.15.50:0/3451902767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff494a1490 con 0x55ff4949fbc0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.744+0000 7fd7d1602640 1 -- 172.21.15.50:0/3451902767 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd8d8044210 con 0x55ff4949fbc0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.744+0000 7fd7d1602640 1 --2- 172.21.15.50:0/3451902767 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7c0036900 0x7fd7c0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.744+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/3451902767 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7c0036900 0x7fd7c0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.744+0000 7fd7d1602640 1 -- 172.21.15.50:0/3451902767 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd8d802e000 con 0x55ff4949fbc0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.744+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/3451902767 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7c0036900 0x7fd7c0038dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55ff494891b0 tx=0x7fd8dc005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.745+0000 7fd8eb736800 1 Processor -- start 2024-05-07T13:56:09.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.745+0000 7fd8eb736800 1 -- start start 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.745+0000 7fd8eb736800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff4947fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.745+0000 7fd8eb736800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ff49478e20 con 0x55ff494814c0 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.745+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff4947fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.745+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff4947fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44980/0 (socket says 172.21.15.50:44980) 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.745+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4056400097 learned_addr learned my addr 172.21.15.50:0/4056400097 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.745+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4056400097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff49481970 con 0x55ff494814c0 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.745+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/4056400097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff4947fbb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd8d804bfd0 tx=0x7fd8d8034430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db94e3d329a2875d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd7caffd640 1 -- 172.21.15.50:0/4056400097 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d805a020 con 0x55ff494814c0 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd7caffd640 1 -- 172.21.15.50:0/4056400097 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d80446e0 con 0x55ff494814c0 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd7caffd640 1 -- 172.21.15.50:0/4056400097 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d804c590 con 0x55ff494814c0 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd8eb736800 1 -- 172.21.15.50:0/4056400097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 msgr2=0x55ff4947fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4056400097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff4947fbb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd8d804bfd0 tx=0x7fd8d8034430 comp rx=0 tx=0).stop 2024-05-07T13:56:09.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd8eb736800 1 -- 172.21.15.50:0/4056400097 shutdown_connections 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4056400097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff4947fbb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd8eb736800 1 -- 172.21.15.50:0/4056400097 >> 172.21.15.50:0/4056400097 conn(0x55ff494a8fb0 msgr2=0x55ff494a7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd8eb736800 1 -- 172.21.15.50:0/4056400097 shutdown_connections 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd8eb736800 1 -- 172.21.15.50:0/4056400097 wait complete. 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd8eb736800 1 Processor -- start 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.746+0000 7fd8eb736800 1 -- start start 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd8eb736800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff494b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd8eb736800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ff494800f0 con 0x55ff494814c0 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff494b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd8e74cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff494b6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44996/0 (socket says 172.21.15.50:44996) 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 learned_addr learned my addr 172.21.15.50:0/4201362320 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff494b6760 con 0x55ff494814c0 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff494b6220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8036f50 tx=0x7fd8d800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd7c97fa640 1 -- 172.21.15.50:0/4201362320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d806f070 con 0x55ff494814c0 2024-05-07T13:56:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd7c97fa640 1 -- 172.21.15.50:0/4201362320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d804c070 con 0x55ff494814c0 2024-05-07T13:56:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff494b6760 con 0x55ff494814c0 2024-05-07T13:56:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.747+0000 7fd7c97fa640 1 -- 172.21.15.50:0/4201362320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d800d3d0 con 0x55ff494814c0 2024-05-07T13:56:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.748+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff494b6760 con 0x55ff494814c0 2024-05-07T13:56:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.748+0000 7fd7c97fa640 1 -- 172.21.15.50:0/4201362320 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd8d8072070 con 0x55ff494814c0 2024-05-07T13:56:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.748+0000 7fd7c97fa640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7b0036900 0x7fd7b0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.748+0000 7fd7c97fa640 1 -- 172.21.15.50:0/4201362320 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd8d8066030 con 0x55ff494814c0 2024-05-07T13:56:09.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.749+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7b0036900 0x7fd7b0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.749+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7b0036900 0x7fd7b0038dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ff49491b60 tx=0x7fd8dc04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.749+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.749+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff494c1880 0x55ff494c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.749+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c4490 con 0x55ff494c1880 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.749+0000 7fd8e7ccd640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff494c1880 0x55ff494c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8e7ccd640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff494c1880 0x55ff494c3d40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff494c1880 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 20 realm 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c48a0 con 0x55ff494c1880 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff494c1880 2024-05-07T13:56:09.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5170 con 0x55ff494c1880 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff494c1880 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.750+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x55ff494c1880 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff494c1880 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8eb736800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff494c6270 0x55ff494c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c8c20 con 0x55ff494c6270 2024-05-07T13:56:09.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff494c6270 0x55ff494c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff494c6270 0x55ff494c8660 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8eb736800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8eb736800 20 searching for the correct realm 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.751+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494ca550 con 0x55ff494c6270 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.752+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.752+0000 7fd8e74cc640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd8d8074060 0x7fd8d80421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.752+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494ca550 con 0x7fd8d8074060 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.752+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd8d8074060 0x7fd8d80421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.752+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd8d8074060 0x7fd8d80421f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.753+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.753+0000 7fd8e6ccb640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd8dc074040 0x7fd8dc081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.753+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494ca550 con 0x7fd8dc074040 2024-05-07T13:56:09.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.753+0000 7fd8e7ccd640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd8dc074040 0x7fd8dc081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.753+0000 7fd8e7ccd640 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd8dc074040 0x7fd8dc081410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.753+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e000a4a0 con 0x7fd8dc074040 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.753+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x55ff494c1880 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.754+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff494c1880 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.754+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x55ff494c1880 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.754+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff494c1880 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.754+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x7fd8dc074040 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.754+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e000a4a0 con 0x7fd8dc074040 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.754+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x7fd8dc074040 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.754+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd8e000a4a0 con 0x7fd8dc074040 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.754+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x7fd8d8074060 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.755+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.755+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x55ff494c6270 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.755+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.755+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x55ff494c1880 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.755+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff494c1880 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.755+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x7fd8dc074040 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.756+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e000a4a0 con 0x7fd8dc074040 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.756+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x55ff494c1880 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.756+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff494c1880 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.756+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c5510 con 0x7fd8d8074060 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.756+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.756+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c6270 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.756+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.756+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c6270 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.756+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.757+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x7fd8dc074040 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.757+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e000a4a0 con 0x7fd8dc074040 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.757+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c6270 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.757+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.757+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c6270 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.758+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.758+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c1880 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.758+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e000a4a0 con 0x55ff494c1880 2024-05-07T13:56:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.758+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c1880 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.758+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.758+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x7fd8dc074040 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.759+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.759+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c6270 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.759+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.759+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x7fd8d8074060 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.759+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.759+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c1880 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.760+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.760+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x7fd8dc074040 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.760+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.760+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c6270 2024-05-07T13:56:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.760+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.760+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x7fd8dc074040 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.760+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.760+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x7fd8d8074060 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.761+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.761+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c6270 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.761+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.761+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x7fd8dc074040 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.761+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.761+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x55ff494c1880 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.761+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.761+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd8dc08e060 con 0x7fd8d8074060 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c94e0 con 0x55ff494c1880 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c98d0 con 0x55ff494c1880 2024-05-07T13:56:09.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.762+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494c98d0 con 0x7fd8dc074040 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 20 zone default found 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 4 Realm: () 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 20 zonegroup default 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494ca9d0 con 0x7fd8dc074040 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cc3b0 con 0x55ff494c6270 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cc750 con 0x55ff494c6270 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.763+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.764+0000 7fd8eb736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.764+0000 7fd8eb736800 20 started sync module instance, tier type = 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.764+0000 7fd8eb736800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.764+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cb850 con 0x7fd8d8074060 2024-05-07T13:56:09.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.764+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.764+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94554934784928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494ccaf0 con 0x7fd8d8074060 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.765+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cd380 con 0x55ff494c1880 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.766+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.766+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94554934784928] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.766+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94554934791824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cdc20 con 0x55ff494c1880 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.766+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cbc90 con 0x55ff494c6270 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.766+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94554934791824] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.767+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.767+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94554934794576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494ce6c0 con 0x55ff494c6270 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.767+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cf080 con 0x7fd8d8074060 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.768+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.768+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94554934799312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cf8d0 con 0x7fd8d8074060 2024-05-07T13:56:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.768+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d0350 con 0x55ff494c1880 2024-05-07T13:56:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.768+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94554934794576] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.769+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.769+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94554934804032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d0740 con 0x55ff494c1880 2024-05-07T13:56:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.769+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d1160 con 0x7fd8dc074040 2024-05-07T13:56:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.769+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94554934799312] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.770+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94554934804032] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.770+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.770+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94554934796816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d1120 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.770+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d1a00 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.771+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94554934796816] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.771+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.771+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94554934807632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d1120 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.771+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d2020 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94554934807632] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94554934809856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d2020 con 0x7fd8dc074040 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8eb736800 20 add_watcher() i=0 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8eb736800 20 add_watcher() i=1 2024-05-07T13:56:09.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8eb736800 20 add_watcher() i=2 2024-05-07T13:56:09.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8eb736800 20 add_watcher() i=3 2024-05-07T13:56:09.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8eb736800 20 add_watcher() i=4 2024-05-07T13:56:09.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8eb736800 20 add_watcher() i=5 2024-05-07T13:56:09.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.772+0000 7fd8eb736800 20 add_watcher() i=6 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.773+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94554934809856] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.773+0000 7fd8eb736800 20 add_watcher() i=7 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.773+0000 7fd8eb736800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.773+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d5480 con 0x55ff494c1880 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.773+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.773+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94554934811968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d2940 con 0x55ff494c1880 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.774+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94554934811968] v27'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.774+0000 7fd79dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.774+0000 7fd8eb736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:09.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.774+0000 7fd8eb736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.774+0000 7fd8eb736800 5 note: GC not initialized 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd79cfe1640 20 reqs_thread_entry: start 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8eb736800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8eb736800 20 Filter name: none 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd7167fc640 20 reqs_thread_entry: start 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8eb736800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff495089e0 con 0x55ff494c1880 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8eb736800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:09.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8eb736800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8eb736800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.775+0000 7fd8eb736800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.776+0000 7fd8eb736800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.776+0000 7fd8eb736800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.776+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff495092f0 con 0x7fd8dc074040 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.776+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.776+0000 7fd8eb736800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.776+0000 7fd8eb736800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.776+0000 7fd8eb736800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.776+0000 7fd8eb736800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.776+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff4950eb40 con 0x55ff494c1880 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v27'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd8eb736800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd8eb736800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd8eb736800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94554935059888 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff4950d690 con 0x55ff494c1880 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94554934804032 notify 115964116995 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7fd8e001e040 con 0x55ff494c1880 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd7caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94554934804032 notifier 4334 bl.length()=678 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd7caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify cookie 94554935059888 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd7caffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.777+0000 7fd7caffd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fd7ac003ea0 con 0x55ff494c1880 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.778+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.778+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 94554935059888 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd8e0027d00 con 0x55ff494c1880 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.778+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff4950e5b0 con 0x7fd8dc074040 2024-05-07T13:56:09.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.779+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.779+0000 7fd8eb736800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.779+0000 7fd8eb736800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.779+0000 7fd8eb736800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.779+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94554935059888 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ff4950d1e0 con 0x55ff494c6270 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.780+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== watch-notify(notify (1) cookie 94554934794576 notify 115964116992 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55ff494a0f90 con 0x55ff494c6270 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.780+0000 7fd7caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94554934794576 notifier 4334 bl.length()=177 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.780+0000 7fd7caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.780+0000 7fd7caffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.780+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(68 notify.2 [notify cookie 94554935059888 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.780+0000 7fd7caffd640 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fd7ac003ea0 con 0x55ff494c6270 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.780+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.780+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== watch-notify(notify_complete (2) cookie 94554935059888 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ff494a0520 con 0x55ff494c6270 2024-05-07T13:56:09.782 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-07T13:56:09.777719Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.781+0000 7fd79dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.781+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94554934811968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff4950d360 con 0x55ff494c1880 2024-05-07T13:56:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.782+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94554934811968] v27'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.782+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94554934784928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d1d10 con 0x7fd8d8074060 2024-05-07T13:56:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.783+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94554934784928] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.783+0000 7fd8eb736800 20 remove_watcher() i=0 2024-05-07T13:56:09.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.783+0000 7fd8eb736800 2 removed watcher, disabling cache 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.783+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94554934791824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cb3a0 con 0x55ff494c1880 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.784+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94554934791824] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.784+0000 7fd8eb736800 20 remove_watcher() i=1 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.784+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94554934794576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cb3a0 con 0x55ff494c6270 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.785+0000 7fd8e74cc640 1 -- 172.21.15.50:0/4201362320 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94554934794576] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d8071030 con 0x55ff494c6270 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.785+0000 7fd8eb736800 20 remove_watcher() i=2 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.785+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94554934799312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cb3a0 con 0x7fd8d8074060 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.786+0000 7fd8e6ccb640 1 -- 172.21.15.50:0/4201362320 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94554934799312] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8dc07f070 con 0x7fd8d8074060 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.786+0000 7fd8eb736800 20 remove_watcher() i=3 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.786+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94554934804032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cb3a0 con 0x55ff494c1880 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.787+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94554934804032] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x55ff494c1880 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.787+0000 7fd8eb736800 20 remove_watcher() i=4 2024-05-07T13:56:09.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.787+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94554934796816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494cfe40 con 0x7fd8dc074040 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.788+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94554934796816] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.788+0000 7fd8eb736800 20 remove_watcher() i=5 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.788+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94554934807632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494ce210 con 0x7fd8dc074040 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.789+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94554934807632] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.789+0000 7fd8eb736800 20 remove_watcher() i=6 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.789+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94554934809856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ff494d0c50 con 0x7fd8dc074040 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94554934809856] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8e002f060 con 0x7fd8dc074040 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 20 remove_watcher() i=7 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd8dc074040 msgr2=0x7fd8dc081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd8dc074040 0x7fd8dc081410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff494c1880 msgr2=0x55ff494c3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff494c1880 0x55ff494c3d40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd8d8074060 msgr2=0x7fd8d80421f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd8d8074060 0x7fd8d80421f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff494c6270 msgr2=0x55ff494c8660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff494c6270 0x55ff494c8660 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7b0036900 msgr2=0x7fd7b0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7b0036900 0x7fd7b0038dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ff49491b60 tx=0x7fd8dc04f000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 msgr2=0x55ff494b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 --2- 172.21.15.50:0/4201362320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff494814c0 0x55ff494b6220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8036f50 tx=0x7fd8d800cc50 comp rx=0 tx=0).stop 2024-05-07T13:56:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 reap_dead start 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/4201362320 reap_dead start 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 shutdown_connections 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 >> 172.21.15.50:0/4201362320 conn(0x55ff494a8fb0 msgr2=0x55ff494a6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 shutdown_connections 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.790+0000 7fd8eb736800 1 -- 172.21.15.50:0/4201362320 wait complete. 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3451902767 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7c0036900 msgr2=0x7fd7c0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3451902767 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7c0036900 0x7fd7c0038dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55ff494891b0 tx=0x7fd8dc005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3451902767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4949fbc0 msgr2=0x55ff4949ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3451902767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4949fbc0 0x55ff4949ffe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd8d804abe0 tx=0x7fd8d8018570 comp rx=0 tx=0).stop 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3451902767 shutdown_connections 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3451902767 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7c0036900 0x7fd7c0038dc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3451902767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff4949fbc0 0x55ff4949ffe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3451902767 >> 172.21.15.50:0/3451902767 conn(0x55ff49493c60 msgr2=0x55ff49494060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3451902767 shutdown_connections 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3451902767 wait complete. 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ff4948eb40 msgr2=0x55ff49490fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ff4948eb40 0x55ff49490fd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff4938b480 msgr2=0x55ff494882e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ff4938b480 0x55ff494882e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff4948ac00 msgr2=0x55ff4948cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ff4948ac00 0x55ff4948cff0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7cc036950 msgr2=0x7fd7cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd7cc036950 0x7fd7cc038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc054000 tx=0x7fd8dc04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 msgr2=0x55ff492faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 --2- 172.21.15.50:0/3685260495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ff49386ff0 0x55ff492faea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8001e30 tx=0x7fd8d8000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8e7ccd640 1 -- 172.21.15.50:0/3685260495 reap_dead start 2024-05-07T13:56:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 shutdown_connections 2024-05-07T13:56:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 >> 172.21.15.50:0/3685260495 conn(0x55ff493825d0 msgr2=0x55ff494725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 shutdown_connections 2024-05-07T13:56:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.791+0000 7fd8eb736800 1 -- 172.21.15.50:0/3685260495 wait complete. 2024-05-07T13:56:09.794 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-07T13:56:09.777719Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:09.794 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-07T13:56:09.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-07T13:56:09.794 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-07T13:56:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c3887800 1 Processor -- start 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c3887800 1 -- start start 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c3887800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x557690b419b0 0x557690b3fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c3887800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557690b40920 con 0x557690b40400 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c3887800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x557690a5d050 con 0x557690b419b0 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c1386640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x557690b419b0 0x557690b3fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c0b85640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x557690b40400 0x557690bd3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39582/0 (socket says 172.21.15.50:39582) 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c0b85640 1 -- 172.21.15.50:0/3495826288 learned_addr learned my addr 172.21.15.50:0/3495826288 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c1386640 1 -- 172.21.15.50:0/3495826288 >> v1:172.21.15.22:6789/0 conn(0x557690b40400 legacy=0x557690bd3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.852+0000 7f38c1386640 1 -- 172.21.15.50:0/3495826288 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557690b40b40 con 0x557690b419b0 2024-05-07T13:56:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.854+0000 7f38c1386640 1 --2- 172.21.15.50:0/3495826288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b419b0 0x557690b3fec0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f38b400a470 tx=0x7f38b401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2c3c3b679fa017 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.854+0000 7f38b3fff640 1 -- 172.21.15.50:0/3495826288 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4057070 con 0x557690b419b0 2024-05-07T13:56:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.854+0000 7f38b3fff640 1 -- 172.21.15.50:0/3495826288 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b4052570 con 0x557690b419b0 2024-05-07T13:56:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.854+0000 7f38b3fff640 1 -- 172.21.15.50:0/3495826288 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4052870 con 0x557690b419b0 2024-05-07T13:56:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.855+0000 7f38c3887800 1 -- 172.21.15.50:0/3495826288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b419b0 msgr2=0x557690b3fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.855+0000 7f38c3887800 1 --2- 172.21.15.50:0/3495826288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b419b0 0x557690b3fec0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f38b400a470 tx=0x7f38b401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.855+0000 7f38c3887800 1 -- 172.21.15.50:0/3495826288 shutdown_connections 2024-05-07T13:56:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.855+0000 7f38c3887800 1 --2- 172.21.15.50:0/3495826288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b419b0 0x557690b3fec0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.855+0000 7f38c3887800 1 -- 172.21.15.50:0/3495826288 >> 172.21.15.50:0/3495826288 conn(0x557690bc7780 msgr2=0x557690bc9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.855+0000 7f38c3887800 1 -- 172.21.15.50:0/3495826288 shutdown_connections 2024-05-07T13:56:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.855+0000 7f38c3887800 1 -- 172.21.15.50:0/3495826288 wait complete. 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.870+0000 7f38c3887800 1 Processor -- start 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.870+0000 7f38c3887800 1 -- start start 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.870+0000 7f38c3887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cbf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.870+0000 7f38c3887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557690b171d0 con 0x557690b40400 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.870+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cbf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.870+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cbf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45008/0 (socket says 172.21.15.50:45008) 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.870+0000 7f38c1386640 1 -- 172.21.15.50:0/2298148184 learned_addr learned my addr 172.21.15.50:0/2298148184 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.871+0000 7f38c1386640 1 -- 172.21.15.50:0/2298148184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557690cbfe70 con 0x557690b40400 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.871+0000 7f38c1386640 1 --2- 172.21.15.50:0/2298148184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cbf8a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f38b4055040 tx=0x7f38b404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671abfb27dd5731a server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.871+0000 7f37af606640 1 -- 172.21.15.50:0/2298148184 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4057040 con 0x557690b40400 2024-05-07T13:56:09.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.871+0000 7f37af606640 1 -- 172.21.15.50:0/2298148184 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b4052990 con 0x557690b40400 2024-05-07T13:56:09.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.871+0000 7f37af606640 1 -- 172.21.15.50:0/2298148184 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4052c70 con 0x557690b40400 2024-05-07T13:56:09.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 -- 172.21.15.50:0/2298148184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 msgr2=0x557690cbf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 --2- 172.21.15.50:0/2298148184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cbf8a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f38b4055040 tx=0x7f38b404c000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 -- 172.21.15.50:0/2298148184 shutdown_connections 2024-05-07T13:56:09.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 --2- 172.21.15.50:0/2298148184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cbf8a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 -- 172.21.15.50:0/2298148184 >> 172.21.15.50:0/2298148184 conn(0x557690bc7780 msgr2=0x557690cbb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 -- 172.21.15.50:0/2298148184 shutdown_connections 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 -- 172.21.15.50:0/2298148184 wait complete. 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 Processor -- start 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 -- start start 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cc7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c3887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557690bd7910 con 0x557690b40400 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.872+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cc7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.873+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cc7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45016/0 (socket says 172.21.15.50:45016) 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.873+0000 7f38c1386640 1 -- 172.21.15.50:0/1624430804 learned_addr learned my addr 172.21.15.50:0/1624430804 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.873+0000 7f38c1386640 1 -- 172.21.15.50:0/1624430804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557690cc7860 con 0x557690b40400 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.873+0000 7f38c1386640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cc7320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38b400a470 tx=0x7f38b4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.873+0000 7f37ade03640 1 -- 172.21.15.50:0/1624430804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4073070 con 0x557690b40400 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.873+0000 7f37ade03640 1 -- 172.21.15.50:0/1624430804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b405d650 con 0x557690b40400 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.873+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557690cc7af0 con 0x557690b40400 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.873+0000 7f37ade03640 1 -- 172.21.15.50:0/1624430804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4057070 con 0x557690b40400 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.873+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557690cca7a0 con 0x557690b40400 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.874+0000 7f37ade03640 1 -- 172.21.15.50:0/1624430804 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f38b4076070 con 0x557690b40400 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.874+0000 7f37ade03640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37a8036950 0x7f37a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.874+0000 7f37ade03640 1 -- 172.21.15.50:0/1624430804 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f38b408dfc0 con 0x557690b40400 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.874+0000 7f38c0b85640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37a8036950 0x7f37a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.874+0000 7f38c3887800 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690b419b0 0x557690cce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.874+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690cceaa0 con 0x557690b419b0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.875+0000 7f38c1b87640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690b419b0 0x557690cce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.875+0000 7f38c0b85640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37a8036950 0x7f37a8038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38b8000f60 tx=0x7f38b80012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.875+0000 7f38c1b87640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690b419b0 0x557690cce560 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.875+0000 7f38c1b87640 1 -- 172.21.15.50:0/1624430804 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690b419b0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.875+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690ccbb30 con 0x557690b419b0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.875+0000 7f38c1b87640 1 -- 172.21.15.50:0/1624430804 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690b419b0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.875+0000 7f38c3887800 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690cd0df0 0x557690cd31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.875+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690cd38d0 con 0x557690cd0df0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.876+0000 7f38c1386640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690cd0df0 0x557690cd31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.876+0000 7f38c1386640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690cd0df0 0x557690cd31e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.876+0000 7f38c1386640 1 -- 172.21.15.50:0/1624430804 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f38b4075030 con 0x557690cd0df0 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.876+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690ccfda0 con 0x557690b419b0 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.876+0000 7f38c1b87640 1 -- 172.21.15.50:0/1624430804 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690b419b0 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.876+0000 7f38c3887800 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557690cd4d80 0x557690cd71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.876+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690cd7930 con 0x557690cd4d80 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.877+0000 7f38c0b85640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557690cd4d80 0x557690cd71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.877+0000 7f38c0b85640 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557690cd4d80 0x557690cd71d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.877+0000 7f38c0b85640 1 -- 172.21.15.50:0/1624430804 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f38b8009050 con 0x557690cd4d80 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f38c3887800 1 Processor -- start 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f38c3887800 1 -- start start 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f38c3887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690ce5d90 0x557690ce61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f38c3887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557690abdcf0 con 0x557690ce5d90 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690ce5d90 0x557690ce61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690ce5d90 0x557690ce61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45028/0 (socket says 172.21.15.50:45028) 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f38c1386640 1 -- 172.21.15.50:0/3807791106 learned_addr learned my addr 172.21.15.50:0/3807791106 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f38c1386640 1 -- 172.21.15.50:0/3807791106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557690ce66f0 con 0x557690ce5d90 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f38c1386640 1 --2- 172.21.15.50:0/3807791106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690ce5d90 0x557690ce61b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38b408c690 tx=0x7f38b4006440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f37a6ffd640 1 -- 172.21.15.50:0/3807791106 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4076ba0 con 0x557690ce5d90 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.878+0000 7f37a6ffd640 1 -- 172.21.15.50:0/3807791106 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b4076d40 con 0x557690ce5d90 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.879+0000 7f37a6ffd640 1 -- 172.21.15.50:0/3807791106 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b405cbc0 con 0x557690ce5d90 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.879+0000 7f38c3887800 1 -- 172.21.15.50:0/3807791106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557690ce7160 con 0x557690ce5d90 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.879+0000 7f38c3887800 1 -- 172.21.15.50:0/3807791106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557690ce7660 con 0x557690ce5d90 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.879+0000 7f37a6ffd640 1 -- 172.21.15.50:0/3807791106 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f38b405d950 con 0x557690ce5d90 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.879+0000 7f37a6ffd640 1 --2- 172.21.15.50:0/3807791106 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37980369a0 0x7f3798038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.879+0000 7f37a6ffd640 1 -- 172.21.15.50:0/3807791106 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f38b4093cd0 con 0x557690ce5d90 2024-05-07T13:56:09.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c0b85640 1 --2- 172.21.15.50:0/3807791106 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37980369a0 0x7f3798038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c3887800 1 Processor -- start 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c3887800 1 -- start start 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c0b85640 1 --2- 172.21.15.50:0/3807791106 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37980369a0 0x7f3798038e60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f38b800bf50 tx=0x7f38b800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c3887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cf3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c3887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557690cc0130 con 0x557690cf2f10 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cf3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cf3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45034/0 (socket says 172.21.15.50:45034) 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c1386640 1 -- 172.21.15.50:0/3077876772 learned_addr learned my addr 172.21.15.50:0/3077876772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.880+0000 7f38c1386640 1 -- 172.21.15.50:0/3077876772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557690cf38e0 con 0x557690cf2f10 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f38c1386640 1 --2- 172.21.15.50:0/3077876772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cf3310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f38b4094000 tx=0x7f38b405f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df899a7007d1abce server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f37a4ff9640 1 -- 172.21.15.50:0/3077876772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4095d90 con 0x557690cf2f10 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f37a4ff9640 1 -- 172.21.15.50:0/3077876772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b406eb20 con 0x557690cf2f10 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f37a4ff9640 1 -- 172.21.15.50:0/3077876772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4076360 con 0x557690cf2f10 2024-05-07T13:56:09.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f38c3887800 1 -- 172.21.15.50:0/3077876772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 msgr2=0x557690cf3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f38c3887800 1 --2- 172.21.15.50:0/3077876772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cf3310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f38b4094000 tx=0x7f38b405f440 comp rx=0 tx=0).stop 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f38c3887800 1 -- 172.21.15.50:0/3077876772 shutdown_connections 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f38c3887800 1 --2- 172.21.15.50:0/3077876772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cf3310 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f38c3887800 1 -- 172.21.15.50:0/3077876772 >> 172.21.15.50:0/3077876772 conn(0x557690cef1e0 msgr2=0x557690ced240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f38c3887800 1 -- 172.21.15.50:0/3077876772 shutdown_connections 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f38c3887800 1 -- 172.21.15.50:0/3077876772 wait complete. 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.881+0000 7f38c3887800 1 Processor -- start 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.882+0000 7f38c3887800 1 -- start start 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.882+0000 7f38c3887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cfa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.882+0000 7f38c3887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557690cf3fd0 con 0x557690cf2f10 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.882+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cfa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.882+0000 7f38c1386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cfa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45048/0 (socket says 172.21.15.50:45048) 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.882+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 learned_addr learned my addr 172.21.15.50:0/1394981741 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.882+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557690cfa830 con 0x557690cf2f10 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.882+0000 7f38c1386640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cfa2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38b4052d40 tx=0x7f38b405f590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.882+0000 7f3796ffd640 1 -- 172.21.15.50:0/1394981741 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b4084aa0 con 0x557690cf2f10 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.883+0000 7f3796ffd640 1 -- 172.21.15.50:0/1394981741 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b4084c40 con 0x557690cf2f10 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.883+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557690cfa830 con 0x557690cf2f10 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.883+0000 7f3796ffd640 1 -- 172.21.15.50:0/1394981741 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38b405f6c0 con 0x557690cf2f10 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.883+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557690cfa830 con 0x557690cf2f10 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.883+0000 7f3796ffd640 1 -- 172.21.15.50:0/1394981741 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f38b40b8060 con 0x557690cf2f10 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.883+0000 7f3796ffd640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f378c036900 0x7f378c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.884+0000 7f3796ffd640 1 -- 172.21.15.50:0/1394981741 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f38b40b2ce0 con 0x557690cf2f10 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.884+0000 7f38c0b85640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f378c036900 0x7f378c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.884+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.884+0000 7f38c3887800 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690d05a50 0x557690d07f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.884+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d08660 con 0x557690d05a50 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.884+0000 7f38c1b87640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690d05a50 0x557690d07f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.884+0000 7f38c0b85640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f378c036900 0x7f378c038dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38b8001b60 tx=0x7f38b8010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.884+0000 7f38c1b87640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690d05a50 0x557690d07f10 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 20 realm 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d08a70 con 0x557690d05a50 2024-05-07T13:56:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d09340 con 0x557690d05a50 2024-05-07T13:56:09.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d05a50 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690d0a1d0 0x557690d0c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.885+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d0cd20 con 0x557690d0a1d0 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.886+0000 7f38c1386640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690d0a1d0 0x557690d0c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.886+0000 7f38c1386640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690d0a1d0 0x557690d0c5c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.886+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.886+0000 7f38c3887800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:09.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.886+0000 7f38c3887800 20 searching for the correct realm 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.886+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d0e6f0 con 0x557690d0a1d0 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.887+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.887+0000 7f38c1386640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f38b40ba070 0x7f38b409c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.887+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d0e6f0 con 0x7f38b40ba070 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.887+0000 7f38c0b85640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f38b40ba070 0x7f38b409c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.887+0000 7f38c0b85640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f38b40ba070 0x7f38b409c450 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.887+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b8009050 con 0x7f38b40ba070 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.887+0000 7f38c0b85640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f38b8038040 0x7f38b801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.887+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d0e6f0 con 0x7f38b8038040 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.888+0000 7f38c1b87640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f38b8038040 0x7f38b801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.888+0000 7f38c1b87640 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f38b8038040 0x7f38b801bab0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.888+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.888+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d05a50 2024-05-07T13:56:09.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.888+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.889+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d05a50 2024-05-07T13:56:09.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.889+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.889+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b8038040 2024-05-07T13:56:09.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.889+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.889+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b8038040 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.889+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.889+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b40ba070 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.889+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b8009050 con 0x7f38b40ba070 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.889+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d0a1d0 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.890+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.890+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d05a50 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.890+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.890+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b8038040 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.890+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.890+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d05a50 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.890+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.890+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b40ba070 2024-05-07T13:56:09.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.891+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f38b8009050 con 0x7f38b40ba070 2024-05-07T13:56:09.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.891+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d0a1d0 2024-05-07T13:56:09.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.891+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.891+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d0a1d0 2024-05-07T13:56:09.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.891+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.891+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b8038040 2024-05-07T13:56:09.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d0a1d0 2024-05-07T13:56:09.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d0a1d0 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d05a50 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d05a50 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.892+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b8038040 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.893+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.893+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d0a1d0 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.893+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.893+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b40ba070 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.893+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b8009050 con 0x7f38b40ba070 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.893+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d05a50 2024-05-07T13:56:09.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.894+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.894+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b8038040 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.894+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.894+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d0a1d0 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.894+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.894+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b8038040 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.894+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.894+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b40ba070 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.895+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b8009050 con 0x7f38b40ba070 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.895+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d0a1d0 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.895+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.895+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b8038040 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.895+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.895+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x557690d05a50 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557690d096e0 con 0x7f38b40ba070 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38b8045040 con 0x7f38b40ba070 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d0d6c0 con 0x557690d05a50 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d0dab0 con 0x557690d05a50 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.896+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d0dab0 con 0x7f38b8038040 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 20 zone default found 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 4 Realm: () 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:09.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 20 zonegroup default 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d0ded0 con 0x7f38b8038040 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d0e2f0 con 0x557690d0a1d0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.897+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d105a0 con 0x557690d0a1d0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.898+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.898+0000 7f38c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:09.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.898+0000 7f38c3887800 20 started sync module instance, tier type = 2024-05-07T13:56:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.898+0000 7f38c3887800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.898+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d0fa40 con 0x7f38b40ba070 2024-05-07T13:56:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.899+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38b8045040 con 0x7f38b40ba070 2024-05-07T13:56:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.899+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93967724117552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d0f6a0 con 0x7f38b40ba070 2024-05-07T13:56:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.899+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d11410 con 0x557690d05a50 2024-05-07T13:56:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.900+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.900+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93967724122432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d11bd0 con 0x557690d05a50 2024-05-07T13:56:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.900+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d126c0 con 0x557690d0a1d0 2024-05-07T13:56:09.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.900+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93967724117552] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38b8045040 con 0x7f38b40ba070 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.901+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93967724122432] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.901+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.901+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93967724126608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d11620 con 0x557690d0a1d0 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.901+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d13100 con 0x7f38b40ba070 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.902+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93967724126608] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.902+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38b8045040 con 0x7f38b40ba070 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.902+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93967724120384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d13950 con 0x7f38b40ba070 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.902+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d14200 con 0x557690d05a50 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.903+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.903+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93967724133616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d14aa0 con 0x557690d05a50 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.903+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d15520 con 0x7f38b8038040 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.903+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93967724120384] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38b8045040 con 0x7f38b40ba070 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.904+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93967724133616] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.904+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.904+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93967724138512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d145a0 con 0x7f38b8038040 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.904+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d15df0 con 0x7f38b8038040 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.905+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93967724138512] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.905+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.905+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93967724135712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d15940 con 0x7f38b8038040 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.905+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d163f0 con 0x7f38b8038040 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93967724142288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d168a0 con 0x7f38b8038040 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c3887800 20 add_watcher() i=0 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c3887800 20 add_watcher() i=1 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c3887800 20 add_watcher() i=2 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c3887800 20 add_watcher() i=3 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c3887800 20 add_watcher() i=4 2024-05-07T13:56:09.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c3887800 20 add_watcher() i=5 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93967724135712] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.906+0000 7f38c3887800 20 add_watcher() i=6 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.907+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93967724142288] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.907+0000 7f38c3887800 20 add_watcher() i=7 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.907+0000 7f38c3887800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.907+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d134a0 con 0x557690d05a50 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.907+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.907+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93967724143600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d134a0 con 0x557690d05a50 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.908+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93967724143600] v27'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.908+0000 7f3777fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.909+0000 7f38c3887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.909+0000 7f38c3887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:09.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.909+0000 7f38c3887800 5 note: GC not initialized 2024-05-07T13:56:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.909+0000 7f3776fe5640 20 reqs_thread_entry: start 2024-05-07T13:56:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.909+0000 7f38c3887800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.909+0000 7f38c3887800 20 Filter name: none 2024-05-07T13:56:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.909+0000 7f3774fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.909+0000 7f38c3887800 20 rados->read ofs=0 len=0 2024-05-07T13:56:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.909+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557690d4c820 con 0x557690d05a50 2024-05-07T13:56:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.910+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.910+0000 7f38c3887800 20 rados_obj.operate() r=0 bl.length=502 2024-05-07T13:56:09.915 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-07T13:56:09.777719Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.910+0000 7f3777fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.910+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93967724143600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d4b3d0 con 0x557690d05a50 2024-05-07T13:56:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.911+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93967724143600] v27'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.911+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93967724117552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d163f0 con 0x7f38b40ba070 2024-05-07T13:56:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.912+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93967724117552] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38b8045040 con 0x7f38b40ba070 2024-05-07T13:56:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.912+0000 7f38c3887800 20 remove_watcher() i=0 2024-05-07T13:56:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.912+0000 7f38c3887800 2 removed watcher, disabling cache 2024-05-07T13:56:09.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.912+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93967724122432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d0fe30 con 0x557690d05a50 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.914+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93967724122432] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.914+0000 7f38c3887800 20 remove_watcher() i=1 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.914+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93967724126608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d0fe30 con 0x557690d0a1d0 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.915+0000 7f38c1386640 1 -- 172.21.15.50:0/1394981741 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93967724126608] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38b4099070 con 0x557690d0a1d0 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.915+0000 7f38c3887800 20 remove_watcher() i=2 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.915+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93967724120384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d12190 con 0x7f38b40ba070 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.916+0000 7f38c0b85640 1 -- 172.21.15.50:0/1394981741 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93967724120384] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38b8045040 con 0x7f38b40ba070 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.916+0000 7f38c3887800 20 remove_watcher() i=3 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.916+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93967724133616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d12190 con 0x557690d05a50 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.917+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93967724133616] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x557690d05a50 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.917+0000 7f38c3887800 20 remove_watcher() i=4 2024-05-07T13:56:09.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.917+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93967724138512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d13cf0 con 0x7f38b8038040 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.918+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93967724138512] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.918+0000 7f38c3887800 20 remove_watcher() i=5 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.918+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93967724135712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d12190 con 0x7f38b8038040 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.919+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93967724135712] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.919+0000 7f38c3887800 20 remove_watcher() i=6 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.919+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93967724142288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557690d13cf0 con 0x7f38b8038040 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93967724142288] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38bc00a4a0 con 0x7f38b8038040 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 20 remove_watcher() i=7 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f38b8038040 msgr2=0x7f38b801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f38b8038040 0x7f38b801bab0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690d05a50 msgr2=0x557690d07f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690d05a50 0x557690d07f10 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f38b40ba070 msgr2=0x7f38b409c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f38b40ba070 0x7f38b409c450 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690d0a1d0 msgr2=0x557690d0c5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690d0a1d0 0x557690d0c5c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f378c036900 msgr2=0x7f378c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f378c036900 0x7f378c038dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38b8001b60 tx=0x7f38b8010000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 msgr2=0x557690cfa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 --2- 172.21.15.50:0/1394981741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690cf2f10 0x557690cfa2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38b4052d40 tx=0x7f38b405f590 comp rx=0 tx=0).stop 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 reap_dead start 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c1b87640 1 -- 172.21.15.50:0/1394981741 reap_dead start 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 shutdown_connections 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 >> 172.21.15.50:0/1394981741 conn(0x557690cef1e0 msgr2=0x557690cec840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 shutdown_connections 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.920+0000 7f38c3887800 1 -- 172.21.15.50:0/1394981741 wait complete. 2024-05-07T13:56:09.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/3807791106 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37980369a0 msgr2=0x7f3798038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 --2- 172.21.15.50:0/3807791106 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37980369a0 0x7f3798038e60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f38b800bf50 tx=0x7f38b800f000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/3807791106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690ce5d90 msgr2=0x557690ce61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 --2- 172.21.15.50:0/3807791106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690ce5d90 0x557690ce61b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38b408c690 tx=0x7f38b4006440 comp rx=0 tx=0).stop 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/3807791106 shutdown_connections 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 --2- 172.21.15.50:0/3807791106 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37980369a0 0x7f3798038e60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 --2- 172.21.15.50:0/3807791106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690ce5d90 0x557690ce61b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/3807791106 >> 172.21.15.50:0/3807791106 conn(0x557690cd9e30 msgr2=0x557690cda230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/3807791106 shutdown_connections 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/3807791106 wait complete. 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557690cd4d80 msgr2=0x557690cd71d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557690cd4d80 0x557690cd71d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690b419b0 msgr2=0x557690cce560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557690b419b0 0x557690cce560 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690cd0df0 msgr2=0x557690cd31e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557690cd0df0 0x557690cd31e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37a8036950 msgr2=0x7f37a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f37a8036950 0x7f37a8038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38b8000f60 tx=0x7f38b80012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 msgr2=0x557690cc7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 --2- 172.21.15.50:0/1624430804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557690b40400 0x557690cc7320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38b400a470 tx=0x7f38b4003020 comp rx=0 tx=0).stop 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c1b87640 1 -- 172.21.15.50:0/1624430804 reap_dead start 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 shutdown_connections 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 >> 172.21.15.50:0/1624430804 conn(0x557690bc7780 msgr2=0x557690cb99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 shutdown_connections 2024-05-07T13:56:09.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.921+0000 7f38c3887800 1 -- 172.21.15.50:0/1624430804 wait complete. 2024-05-07T13:56:09.926 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-07T13:56:09.777719Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:09.927 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-07T13:56:09.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-07T13:56:09.927 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-05-07T13:56:09.975 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.987+0000 7f6f5f487800 1 Processor -- start 2024-05-07T13:56:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.987+0000 7f6f5f487800 1 -- start start 2024-05-07T13:56:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.987+0000 7f6f5f487800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561d72d87fe0 0x561d72d88400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.987+0000 7f6f5f487800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d72d88a80 con 0x561d72d89240 2024-05-07T13:56:09.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.987+0000 7f6f5f487800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x561d72c1a050 con 0x561d72d87fe0 2024-05-07T13:56:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.987+0000 7f6f5cf86640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561d72d87fe0 0x561d72d88400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.987+0000 7f6f57fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x561d72d89240 0x561d72d896c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39588/0 (socket says 172.21.15.50:39588) 2024-05-07T13:56:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.987+0000 7f6f57fff640 1 -- 172.21.15.50:0/750780669 learned_addr learned my addr 172.21.15.50:0/750780669 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.988+0000 7f6f5cf86640 1 -- 172.21.15.50:0/750780669 >> v1:172.21.15.22:6789/0 conn(0x561d72d89240 legacy=0x561d72d896c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.988+0000 7f6f5cf86640 1 -- 172.21.15.50:0/750780669 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d72d89e00 con 0x561d72d87fe0 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/750780669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72d88400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000a470 tx=0x7f6f5001cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b407eebc1b05fb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f577fe640 1 -- 172.21.15.50:0/750780669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f50057070 con 0x561d72d87fe0 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f577fe640 1 -- 172.21.15.50:0/750780669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5004ab60 con 0x561d72d87fe0 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f577fe640 1 -- 172.21.15.50:0/750780669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5004ae60 con 0x561d72d87fe0 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f5f487800 1 -- 172.21.15.50:0/750780669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 msgr2=0x561d72d88400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f5f487800 1 --2- 172.21.15.50:0/750780669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72d88400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000a470 tx=0x7f6f5001cce0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f5f487800 1 -- 172.21.15.50:0/750780669 shutdown_connections 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f5f487800 1 --2- 172.21.15.50:0/750780669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72d88400 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f5f487800 1 -- 172.21.15.50:0/750780669 >> 172.21.15.50:0/750780669 conn(0x561d72d835c0 msgr2=0x561d72d859e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f5f487800 1 -- 172.21.15.50:0/750780669 shutdown_connections 2024-05-07T13:56:09.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:09.990+0000 7f6f5f487800 1 -- 172.21.15.50:0/750780669 wait complete. 2024-05-07T13:56:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.006+0000 7f6f5f487800 1 Processor -- start 2024-05-07T13:56:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.006+0000 7f6f5f487800 1 -- start start 2024-05-07T13:56:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.006+0000 7f6f5f487800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72cfbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.006+0000 7f6f5f487800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561d72cd41c0 con 0x561d72d87fe0 2024-05-07T13:56:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.006+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72cfbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.006+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72cfbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45074/0 (socket says 172.21.15.50:45074) 2024-05-07T13:56:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.006+0000 7f6f5cf86640 1 -- 172.21.15.50:0/1544197699 learned_addr learned my addr 172.21.15.50:0/1544197699 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.006+0000 7f6f5cf86640 1 -- 172.21.15.50:0/1544197699 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d72e7d600 con 0x561d72d87fe0 2024-05-07T13:56:09.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.007+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/1544197699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72cfbe50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6f50055040 tx=0x7f6f5004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1c3492590f8ff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.007+0000 7f6e4ae05640 1 -- 172.21.15.50:0/1544197699 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f50057040 con 0x561d72d87fe0 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.007+0000 7f6e4ae05640 1 -- 172.21.15.50:0/1544197699 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f50063070 con 0x561d72d87fe0 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.007+0000 7f6e4ae05640 1 -- 172.21.15.50:0/1544197699 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f500527e0 con 0x561d72d87fe0 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 -- 172.21.15.50:0/1544197699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 msgr2=0x561d72cfbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 --2- 172.21.15.50:0/1544197699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72cfbe50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6f50055040 tx=0x7f6f5004c000 comp rx=0 tx=0).stop 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 -- 172.21.15.50:0/1544197699 shutdown_connections 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 --2- 172.21.15.50:0/1544197699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72cfbe50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 -- 172.21.15.50:0/1544197699 >> 172.21.15.50:0/1544197699 conn(0x561d72d835c0 msgr2=0x561d72e750f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 -- 172.21.15.50:0/1544197699 shutdown_connections 2024-05-07T13:56:09.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 -- 172.21.15.50:0/1544197699 wait complete. 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 Processor -- start 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 -- start start 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72e822f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5f487800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561d72d91710 con 0x561d72d87fe0 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.008+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72e822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.009+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72e822f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45084/0 (socket says 172.21.15.50:45084) 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.009+0000 7f6f5cf86640 1 -- 172.21.15.50:0/707962476 learned_addr learned my addr 172.21.15.50:0/707962476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.009+0000 7f6f5cf86640 1 -- 172.21.15.50:0/707962476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d72e82830 con 0x561d72d87fe0 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.009+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72e822f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6f50060040 tx=0x7f6f50002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.009+0000 7f6e49602640 1 -- 172.21.15.50:0/707962476 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f50057050 con 0x561d72d87fe0 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.009+0000 7f6e49602640 1 -- 172.21.15.50:0/707962476 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f50052d10 con 0x561d72d87fe0 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.009+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d72e82ac0 con 0x561d72d87fe0 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.009+0000 7f6e49602640 1 -- 172.21.15.50:0/707962476 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5005d470 con 0x561d72d87fe0 2024-05-07T13:56:09.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.009+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d72e85770 con 0x561d72d87fe0 2024-05-07T13:56:10.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.010+0000 7f6e49602640 1 -- 172.21.15.50:0/707962476 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f5004ad10 con 0x561d72d87fe0 2024-05-07T13:56:10.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.010+0000 7f6e49602640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e44036950 0x7f6e44038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.010+0000 7f6e49602640 1 -- 172.21.15.50:0/707962476 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6f5008da30 con 0x561d72d87fe0 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.010+0000 7f6f57fff640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e44036950 0x7f6e44038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.010+0000 7f6f5f487800 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72d89240 0x561d72e89530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.010+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72e89b00 con 0x561d72d89240 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.011+0000 7f6f5d787640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72d89240 0x561d72e89530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.011+0000 7f6f57fff640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e44036950 0x7f6e44038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800b340 tx=0x7f6f48001520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.011+0000 7f6f5d787640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72d89240 0x561d72e89530 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.011+0000 7f6f5d787640 1 -- 172.21.15.50:0/707962476 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72d89240 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.011+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72e86ae0 con 0x561d72d89240 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.011+0000 7f6f5d787640 1 -- 172.21.15.50:0/707962476 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72d89240 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.012+0000 7f6f5f487800 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72e8be40 0x561d72e8e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.012+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72e8e8d0 con 0x561d72e8be40 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.012+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72e8be40 0x561d72e8e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.012+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72e8be40 0x561d72e8e230 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.012+0000 7f6f5cf86640 1 -- 172.21.15.50:0/707962476 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6f50078070 con 0x561d72e8be40 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.012+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72e8adf0 con 0x561d72d89240 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.012+0000 7f6f5d787640 1 -- 172.21.15.50:0/707962476 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72d89240 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.012+0000 7f6f5f487800 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561d72e8fd80 0x561d72e921d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.013+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72e92930 con 0x561d72e8fd80 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.013+0000 7f6f57fff640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561d72e8fd80 0x561d72e921d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.013+0000 7f6f57fff640 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561d72e8fd80 0x561d72e921d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.013+0000 7f6f57fff640 1 -- 172.21.15.50:0/707962476 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6f4800f870 con 0x561d72e8fd80 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.014+0000 7f6f5f487800 1 Processor -- start 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.014+0000 7f6f5f487800 1 -- start start 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.014+0000 7f6f5f487800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72ea0d90 0x561d72ea11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.014+0000 7f6f5f487800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561d72c7acf0 con 0x561d72ea0d90 2024-05-07T13:56:10.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.014+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72ea0d90 0x561d72ea11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.014+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72ea0d90 0x561d72ea11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45100/0 (socket says 172.21.15.50:45100) 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.014+0000 7f6f5cf86640 1 -- 172.21.15.50:0/4148288683 learned_addr learned my addr 172.21.15.50:0/4148288683 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.014+0000 7f6f5cf86640 1 -- 172.21.15.50:0/4148288683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d72ea16f0 con 0x561d72ea0d90 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.014+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/4148288683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72ea0d90 0x561d72ea11b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6f5008bdc0 tx=0x7f6f50008130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.015+0000 7f6e427fc640 1 -- 172.21.15.50:0/4148288683 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5008d040 con 0x561d72ea0d90 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.015+0000 7f6e427fc640 1 -- 172.21.15.50:0/4148288683 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f50066590 con 0x561d72ea0d90 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.015+0000 7f6e427fc640 1 -- 172.21.15.50:0/4148288683 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5005d610 con 0x561d72ea0d90 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.015+0000 7f6f5f487800 1 -- 172.21.15.50:0/4148288683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d72ea2160 con 0x561d72ea0d90 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.015+0000 7f6f5f487800 1 -- 172.21.15.50:0/4148288683 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d72ea2160 con 0x561d72ea0d90 2024-05-07T13:56:10.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.015+0000 7f6e427fc640 1 -- 172.21.15.50:0/4148288683 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f5005d7b0 con 0x561d72ea0d90 2024-05-07T13:56:10.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.015+0000 7f6e427fc640 1 --2- 172.21.15.50:0/4148288683 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e34036950 0x7f6e34038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6e427fc640 1 -- 172.21.15.50:0/4148288683 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6f50069070 con 0x561d72ea0d90 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f57fff640 1 --2- 172.21.15.50:0/4148288683 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e34036950 0x7f6e34038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f5f487800 1 Processor -- start 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f5f487800 1 -- start start 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f57fff640 1 --2- 172.21.15.50:0/4148288683 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e34036950 0x7f6e34038e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x561d72e86a20 tx=0x7f6f48006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f5f487800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72e793e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f5f487800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561d72e7d890 con 0x561d72e7acb0 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72e793e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72e793e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45114/0 (socket says 172.21.15.50:45114) 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3836565227 learned_addr learned my addr 172.21.15.50:0/3836565227 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.016+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3836565227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d72e7b160 con 0x561d72e7acb0 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/3836565227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72e793e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6f50052850 tx=0x7f6f5005dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fb2d9bb6f4cd01 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6e33fff640 1 -- 172.21.15.50:0/3836565227 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f50086e10 con 0x561d72e7acb0 2024-05-07T13:56:10.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6e33fff640 1 -- 172.21.15.50:0/3836565227 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5005e790 con 0x561d72e7acb0 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6e33fff640 1 -- 172.21.15.50:0/3836565227 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5007b3f0 con 0x561d72e7acb0 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6f5f487800 1 -- 172.21.15.50:0/3836565227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 msgr2=0x561d72e793e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3836565227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72e793e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6f50052850 tx=0x7f6f5005dbc0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6f5f487800 1 -- 172.21.15.50:0/3836565227 shutdown_connections 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3836565227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72e793e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6f5f487800 1 -- 172.21.15.50:0/3836565227 >> 172.21.15.50:0/3836565227 conn(0x561d72eaa000 msgr2=0x561d72ea8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6f5f487800 1 -- 172.21.15.50:0/3836565227 shutdown_connections 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.017+0000 7f6f5f487800 1 -- 172.21.15.50:0/3836565227 wait complete. 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.018+0000 7f6f5f487800 1 Processor -- start 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.018+0000 7f6f5f487800 1 -- start start 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.018+0000 7f6f5f487800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72eb72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.018+0000 7f6f5f487800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561d72e79920 con 0x561d72e7acb0 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.018+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72eb72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.018+0000 7f6f5cf86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72eb72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45116/0 (socket says 172.21.15.50:45116) 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.018+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 learned_addr learned my addr 172.21.15.50:0/3030123564 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.018+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d72eb7800 con 0x561d72e7acb0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.019+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72eb72c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6f50052850 tx=0x7f6f50065ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.019+0000 7f6e327fc640 1 -- 172.21.15.50:0/3030123564 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5008d310 con 0x561d72e7acb0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.019+0000 7f6e327fc640 1 -- 172.21.15.50:0/3030123564 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5008d4b0 con 0x561d72e7acb0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.019+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d72eb7800 con 0x561d72e7acb0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.019+0000 7f6e327fc640 1 -- 172.21.15.50:0/3030123564 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5008a750 con 0x561d72e7acb0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.019+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d72eb7800 con 0x561d72e7acb0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.019+0000 7f6e327fc640 1 -- 172.21.15.50:0/3030123564 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f500a8040 con 0x561d72e7acb0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.020+0000 7f6e327fc640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e28036950 0x7f6e28038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.020+0000 7f6e327fc640 1 -- 172.21.15.50:0/3030123564 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6f500a6020 con 0x561d72e7acb0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.020+0000 7f6f57fff640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e28036950 0x7f6e28038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.020+0000 7f6f57fff640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e28036950 0x7f6e28038e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x561d72e92d30 tx=0x7f6f48010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.020+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.020+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72ec2920 0x561d72ec4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec5530 con 0x561d72ec2920 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5d787640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72ec2920 0x561d72ec4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5d787640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72ec2920 0x561d72ec4de0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72ec2920 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5f487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5f487800 20 realm 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec5940 con 0x561d72ec2920 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72ec2920 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5f487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5f487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.021+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec6210 con 0x561d72ec2920 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72ec2920 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5f487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec2920 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72ec2920 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5f487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72ec7310 0x561d72ec9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec9d10 con 0x561d72ec7310 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72ec7310 0x561d72ec9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.022+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72ec7310 0x561d72ec9700 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.023+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.023+0000 7f6f5f487800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.023+0000 7f6f5f487800 20 searching for the correct realm 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.023+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecb640 con 0x561d72ec7310 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.023+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.023+0000 7f6f5cf86640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f500ab050 0x7f6f50002460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.023+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecb640 con 0x7f6f500ab050 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.023+0000 7f6f57fff640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f500ab050 0x7f6f50002460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.024+0000 7f6f57fff640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f500ab050 0x7f6f50002460 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.024+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.024+0000 7f6f57fff640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f4803a3c0 0x7f6f4803a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.024+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecb640 con 0x7f6f4803a3c0 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.024+0000 7f6f5d787640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f4803a3c0 0x7f6f4803a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.025+0000 7f6f5d787640 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f4803a3c0 0x7f6f4803a7c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.025+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5800a4a0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.025+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec2920 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.025+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72ec2920 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.025+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec2920 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.025+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72ec2920 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.025+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.026+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5800a4a0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.026+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.026+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6f5800a4a0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.026+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f500ab050 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.026+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.026+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec7310 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.026+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.026+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec2920 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.027+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72ec2920 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.027+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.027+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5800a4a0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.027+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec2920 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.027+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72ec2920 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.027+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f500ab050 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.027+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.027+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec7310 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.028+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.028+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec7310 2024-05-07T13:56:10.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.028+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.028+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5800a4a0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec7310 2024-05-07T13:56:10.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec7310 2024-05-07T13:56:10.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec2920 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5800a4a0 con 0x561d72ec2920 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec2920 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.029+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.030+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.030+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec7310 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.030+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.030+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f500ab050 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.030+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.030+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec2920 2024-05-07T13:56:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.031+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.031+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.031+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.031+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec7310 2024-05-07T13:56:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.031+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.031+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.032+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.032+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f500ab050 2024-05-07T13:56:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.032+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.032+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec7310 2024-05-07T13:56:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.032+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.032+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x561d72ec2920 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561d72ec65b0 con 0x7f6f500ab050 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72eca5d0 con 0x561d72ec2920 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.033+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72eca9c0 con 0x561d72ec2920 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72eca9c0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 20 zone default found 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 4 Realm: () 2024-05-07T13:56:10.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 20 zonegroup default 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecbac0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.034+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecd4a0 con 0x561d72ec7310 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.035+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.035+0000 7f6f5f487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.035+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.035+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecd840 con 0x561d72ec7310 2024-05-07T13:56:10.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.035+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.035+0000 7f6f5f487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.035+0000 7f6f5f487800 20 started sync module instance, tier type = 2024-05-07T13:56:10.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.035+0000 7f6f5f487800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:10.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.035+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecc940 con 0x7f6f500ab050 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.036+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.036+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94684482159760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecdbe0 con 0x7f6f500ab050 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.036+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ece4b0 con 0x561d72ec2920 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.037+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.037+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94684482166656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72eced50 con 0x561d72ec2920 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.037+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94684482159760] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.037+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecf680 con 0x561d72ec7310 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.038+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94684482166656] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.038+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.038+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94684482168992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72eced20 con 0x561d72ec7310 2024-05-07T13:56:10.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.038+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecfdc0 con 0x7f6f500ab050 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.039+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.039+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94684482168992] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.039+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94684482173040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed0660 con 0x7f6f500ab050 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.039+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecf210 con 0x561d72ec2920 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.040+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.040+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94684482173040] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.040+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94684482178080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed14f0 con 0x561d72ec2920 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.040+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed01d0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.041+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94684482178080] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.041+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.041+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94684482179136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed1460 con 0x7f6f4803a3c0 2024-05-07T13:56:10.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.041+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed23d0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.042+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94684482179136] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.042+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.042+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94684482181680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed23d0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.042+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed2d90 con 0x7f6f4803a3c0 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94684482181680] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94684482185440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed31b0 con 0x7f6f4803a3c0 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5f487800 20 add_watcher() i=0 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5f487800 20 add_watcher() i=1 2024-05-07T13:56:10.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5f487800 20 add_watcher() i=2 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5f487800 20 add_watcher() i=3 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5f487800 20 add_watcher() i=4 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5f487800 20 add_watcher() i=5 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.043+0000 7f6f5f487800 20 add_watcher() i=6 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.044+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94684482185440] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.044+0000 7f6f5f487800 20 add_watcher() i=7 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.044+0000 7f6f5f487800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.044+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed31b0 con 0x561d72ec2920 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.045+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.045+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94684482186496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed3160 con 0x561d72ec2920 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94684482186496] v27'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6e12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6f5f487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6f5f487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6f5f487800 5 note: GC not initialized 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6e11fe3640 20 reqs_thread_entry: start 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6f5f487800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6f5f487800 20 Filter name: none 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6d837fe640 20 reqs_thread_entry: start 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6f5f487800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6f5f487800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.046+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72f09750 con 0x561d72ec2920 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.047+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.047+0000 7f6f5f487800 20 rados_obj.operate() r=0 bl.length=502 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.047+0000 7f6f5f487800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.047+0000 7f6f5f487800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.047+0000 7f6f5f487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.047+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72f0fb10 con 0x561d72ec2920 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6f5f487800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6f5f487800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6f5f487800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94684482434432 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72f0e6a0 con 0x561d72ec2920 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94684482178080 notify 115964116996 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f6f5801e040 con 0x561d72ec2920 2024-05-07T13:56:10.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6e33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94684482178080 notifier 4348 bl.length()=567 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6e33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6e33fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(64 notify.4 [notify cookie 94684482434432 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.048+0000 7f6e33fff640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f6e20003ea0 con 0x561d72ec2920 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.049+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.049+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 94684482434432 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6f58027ca0 con 0x561d72ec2920 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.049+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72f0f580 con 0x7f6f4803a3c0 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.050+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v27'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.050+0000 7f6f5f487800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.050+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94684482434432 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561d72f0e1f0 con 0x561d72ec7310 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.051+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== watch-notify(notify (1) cookie 94684482168992 notify 115964116993 ret 0) ==== 212+0+0 (crc 0 0 0) 0x561d72ea16f0 con 0x561d72ec7310 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.051+0000 7f6e337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94684482168992 notifier 4348 bl.length()=170 2024-05-07T13:56:10.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.051+0000 7f6e337fe640 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f6d900032c0 con 0x561d72ec7310 2024-05-07T13:56:10.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.051+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 notify.2 [notify cookie 94684482434432 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.051+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== watch-notify(notify_complete (2) cookie 94684482434432 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561d72e85770 con 0x561d72ec7310 2024-05-07T13:56:10.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.051+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.052 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.052+0000 7f6e12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.052+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94684482186496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72f09cb0 con 0x561d72ec2920 2024-05-07T13:56:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.053+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94684482186496] v27'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.053+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94684482159760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed2d00 con 0x7f6f500ab050 2024-05-07T13:56:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.054+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94684482159760] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.054+0000 7f6f5f487800 20 remove_watcher() i=0 2024-05-07T13:56:10.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.054+0000 7f6f5f487800 2 removed watcher, disabling cache 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.054+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94684482166656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed2d00 con 0x561d72ec2920 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.055+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94684482166656] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.055+0000 7f6f5f487800 20 remove_watcher() i=1 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.055+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94684482168992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed2d00 con 0x561d72ec7310 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.056+0000 7f6f5cf86640 1 -- 172.21.15.50:0/3030123564 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94684482168992] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f500bb020 con 0x561d72ec7310 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.056+0000 7f6f5f487800 20 remove_watcher() i=2 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.056+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94684482173040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ece8a0 con 0x7f6f500ab050 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.057+0000 7f6f57fff640 1 -- 172.21.15.50:0/3030123564 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94684482173040] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f48037040 con 0x7f6f500ab050 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.057+0000 7f6f5f487800 20 remove_watcher() i=3 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.057+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94684482178080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed2d00 con 0x561d72ec2920 2024-05-07T13:56:10.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.058+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94684482178080] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x561d72ec2920 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.058+0000 7f6f5f487800 20 remove_watcher() i=4 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.058+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94684482179136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecf870 con 0x7f6f4803a3c0 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.059+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94684482179136] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.059+0000 7f6f5f487800 20 remove_watcher() i=5 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.059+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94684482181680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ed2d00 con 0x7f6f4803a3c0 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.060+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94684482181680] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.060+0000 7f6f5f487800 20 remove_watcher() i=6 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.060+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94684482185440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561d72ecf870 con 0x7f6f4803a3c0 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94684482185440] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5802f060 con 0x7f6f4803a3c0 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 20 remove_watcher() i=7 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f4803a3c0 msgr2=0x7f6f4803a7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f4803a3c0 0x7f6f4803a7c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72ec2920 msgr2=0x561d72ec4de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72ec2920 0x561d72ec4de0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f500ab050 msgr2=0x7f6f50002460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f500ab050 0x7f6f50002460 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72ec7310 msgr2=0x561d72ec9700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72ec7310 0x561d72ec9700 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e28036950 msgr2=0x7f6e28038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e28036950 0x7f6e28038e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x561d72e92d30 tx=0x7f6f48010000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 msgr2=0x561d72eb72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72eb72c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6f50052850 tx=0x7f6f50065ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5d787640 1 -- 172.21.15.50:0/3030123564 reap_dead start 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 shutdown_connections 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 --2- 172.21.15.50:0/3030123564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72e7acb0 0x561d72eb72c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 >> 172.21.15.50:0/3030123564 conn(0x561d72eaa000 msgr2=0x561d72ea7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 shutdown_connections 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.061+0000 7f6f5f487800 1 -- 172.21.15.50:0/3030123564 wait complete. 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/4148288683 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e34036950 msgr2=0x7f6e34038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 --2- 172.21.15.50:0/4148288683 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e34036950 0x7f6e34038e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x561d72e86a20 tx=0x7f6f48006000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/4148288683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72ea0d90 msgr2=0x561d72ea11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 --2- 172.21.15.50:0/4148288683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72ea0d90 0x561d72ea11b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6f5008bdc0 tx=0x7f6f50008130 comp rx=0 tx=0).stop 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/4148288683 shutdown_connections 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 --2- 172.21.15.50:0/4148288683 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e34036950 0x7f6e34038e10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 --2- 172.21.15.50:0/4148288683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72ea0d90 0x561d72ea11b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/4148288683 >> 172.21.15.50:0/4148288683 conn(0x561d72e94e30 msgr2=0x561d72e95230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/4148288683 shutdown_connections 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/4148288683 wait complete. 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561d72e8fd80 msgr2=0x561d72e921d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561d72e8fd80 0x561d72e921d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72d89240 msgr2=0x561d72e89530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561d72d89240 0x561d72e89530 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72e8be40 msgr2=0x561d72e8e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561d72e8be40 0x561d72e8e230 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e44036950 msgr2=0x7f6e44038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e44036950 0x7f6e44038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800b340 tx=0x7f6f48001520 comp rx=0 tx=0).stop 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 msgr2=0x561d72e822f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 --2- 172.21.15.50:0/707962476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561d72d87fe0 0x561d72e822f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6f50060040 tx=0x7f6f50002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5d787640 1 -- 172.21.15.50:0/707962476 reap_dead start 2024-05-07T13:56:10.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 shutdown_connections 2024-05-07T13:56:10.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 >> 172.21.15.50:0/707962476 conn(0x561d72d835c0 msgr2=0x561d72e738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 shutdown_connections 2024-05-07T13:56:10.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.062+0000 7f6f5f487800 1 -- 172.21.15.50:0/707962476 wait complete. 2024-05-07T13:56:10.064 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:10.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-07T13:56:10.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-07T13:56:10.064 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-05-07T13:56:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:10.112 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:10.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.124+0000 7f8ea6546800 1 Processor -- start 2024-05-07T13:56:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.124+0000 7f8ea6546800 1 -- start start 2024-05-07T13:56:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.124+0000 7f8ea6546800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x563d8a987470 0x563d8a989860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.124+0000 7f8ea6546800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d8a989e30 con 0x563d8a982fe0 2024-05-07T13:56:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.124+0000 7f8ea6546800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x563d8a815050 con 0x563d8a987470 2024-05-07T13:56:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.125+0000 7f8ea384b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x563d8a987470 0x563d8a989860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.125+0000 7f8ea384b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x563d8a987470 0x563d8a989860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45120/0 (socket says 172.21.15.50:45120) 2024-05-07T13:56:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.125+0000 7f8ea384b640 1 -- 172.21.15.50:0/4035538294 learned_addr learned my addr 172.21.15.50:0/4035538294 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.125+0000 7f8ea384b640 1 -- 172.21.15.50:0/4035538294 >> v1:172.21.15.22:6789/0 conn(0x563d8a982fe0 legacy=0x563d8a983400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.125+0000 7f8ea384b640 1 -- 172.21.15.50:0/4035538294 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8a98b060 con 0x563d8a987470 2024-05-07T13:56:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.127+0000 7f8ea384b640 1 --2- 172.21.15.50:0/4035538294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a987470 0x563d8a989860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800a6b0 tx=0x7f8e9801eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76aded9f4f1e9d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.127+0000 7f8ea304a640 1 -- 172.21.15.50:0/4035538294 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e98059070 con 0x563d8a987470 2024-05-07T13:56:10.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.127+0000 7f8ea304a640 1 -- 172.21.15.50:0/4035538294 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e98050050 con 0x563d8a987470 2024-05-07T13:56:10.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.127+0000 7f8ea304a640 1 -- 172.21.15.50:0/4035538294 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e9800a350 con 0x563d8a987470 2024-05-07T13:56:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.127+0000 7f8ea6546800 1 -- 172.21.15.50:0/4035538294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a987470 msgr2=0x563d8a989860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.127+0000 7f8ea6546800 1 --2- 172.21.15.50:0/4035538294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a987470 0x563d8a989860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800a6b0 tx=0x7f8e9801eed0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.127+0000 7f8ea6546800 1 -- 172.21.15.50:0/4035538294 shutdown_connections 2024-05-07T13:56:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.127+0000 7f8ea6546800 1 --2- 172.21.15.50:0/4035538294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a987470 0x563d8a989860 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.127+0000 7f8ea6546800 1 -- 172.21.15.50:0/4035538294 >> 172.21.15.50:0/4035538294 conn(0x563d8a97e5c0 msgr2=0x563d8a9809e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.128+0000 7f8ea6546800 1 -- 172.21.15.50:0/4035538294 shutdown_connections 2024-05-07T13:56:10.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.128+0000 7f8ea6546800 1 -- 172.21.15.50:0/4035538294 wait complete. 2024-05-07T13:56:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.143+0000 7f8ea6546800 1 Processor -- start 2024-05-07T13:56:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.143+0000 7f8ea6546800 1 -- start start 2024-05-07T13:56:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.143+0000 7f8ea6546800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa73520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.143+0000 7f8ea6546800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d8a8cf1c0 con 0x563d8a982fe0 2024-05-07T13:56:10.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.143+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa73520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.143+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa73520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45132/0 (socket says 172.21.15.50:45132) 2024-05-07T13:56:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.143+0000 7f8ea404c640 1 -- 172.21.15.50:0/1291601386 learned_addr learned my addr 172.21.15.50:0/1291601386 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.143+0000 7f8ea404c640 1 -- 172.21.15.50:0/1291601386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8aa73af0 con 0x563d8a982fe0 2024-05-07T13:56:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.144+0000 7f8ea404c640 1 --2- 172.21.15.50:0/1291601386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa73520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8e94001d50 tx=0x7f8e9400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a440663670d626 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.144+0000 7f8d9260c640 1 -- 172.21.15.50:0/1291601386 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e9400f400 con 0x563d8a982fe0 2024-05-07T13:56:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.144+0000 7f8d9260c640 1 -- 172.21.15.50:0/1291601386 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9400f5a0 con 0x563d8a982fe0 2024-05-07T13:56:10.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.144+0000 7f8d9260c640 1 -- 172.21.15.50:0/1291601386 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e9400f7d0 con 0x563d8a982fe0 2024-05-07T13:56:10.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.144+0000 7f8ea6546800 1 -- 172.21.15.50:0/1291601386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 msgr2=0x563d8aa73520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.144+0000 7f8ea6546800 1 --2- 172.21.15.50:0/1291601386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa73520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8e94001d50 tx=0x7f8e9400b5b0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea6546800 1 -- 172.21.15.50:0/1291601386 shutdown_connections 2024-05-07T13:56:10.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea6546800 1 --2- 172.21.15.50:0/1291601386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa73520 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea6546800 1 -- 172.21.15.50:0/1291601386 >> 172.21.15.50:0/1291601386 conn(0x563d8a97e5c0 msgr2=0x563d8aa6ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea6546800 1 -- 172.21.15.50:0/1291601386 shutdown_connections 2024-05-07T13:56:10.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea6546800 1 -- 172.21.15.50:0/1291601386 wait complete. 2024-05-07T13:56:10.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea6546800 1 Processor -- start 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea6546800 1 -- start start 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea6546800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa7b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea6546800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d8a98a300 con 0x563d8a982fe0 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa7b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa7b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45142/0 (socket says 172.21.15.50:45142) 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.145+0000 7f8ea404c640 1 -- 172.21.15.50:0/3421397343 learned_addr learned my addr 172.21.15.50:0/3421397343 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.146+0000 7f8ea404c640 1 -- 172.21.15.50:0/3421397343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8aa7b670 con 0x563d8a982fe0 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.146+0000 7f8ea404c640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa7b130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x563d8aa742b0 tx=0x7f8e94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.146+0000 7f8d90e09640 1 -- 172.21.15.50:0/3421397343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e9401a7c0 con 0x563d8a982fe0 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.146+0000 7f8d90e09640 1 -- 172.21.15.50:0/3421397343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9401a960 con 0x563d8a982fe0 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.146+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d8aa7b900 con 0x563d8a982fe0 2024-05-07T13:56:10.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.146+0000 7f8d90e09640 1 -- 172.21.15.50:0/3421397343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e9401ac60 con 0x563d8a982fe0 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.146+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d8aa7e560 con 0x563d8a982fe0 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.147+0000 7f8d90e09640 1 -- 172.21.15.50:0/3421397343 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8e94017070 con 0x563d8a982fe0 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.147+0000 7f8d90e09640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d8c0369a0 0x7f8d8c038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.147+0000 7f8d90e09640 1 -- 172.21.15.50:0/3421397343 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8e94015020 con 0x563d8a982fe0 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.147+0000 7f8ea384b640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d8c0369a0 0x7f8d8c038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.147+0000 7f8ea6546800 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8a987470 0x563d8aa82320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.147+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aa82860 con 0x563d8a987470 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.147+0000 7f8ea484d640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8a987470 0x563d8aa82320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.148+0000 7f8ea384b640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d8c0369a0 0x7f8d8c038e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e98056000 tx=0x7f8e9800a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.148+0000 7f8ea484d640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8a987470 0x563d8aa82320 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.148+0000 7f8ea484d640 1 -- 172.21.15.50:0/3421397343 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8a987470 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.148+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aa7f8f0 con 0x563d8a987470 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.148+0000 7f8ea484d640 1 -- 172.21.15.50:0/3421397343 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8a987470 2024-05-07T13:56:10.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.148+0000 7f8ea6546800 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aa84bb0 0x563d8aa86fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.148+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aa87690 con 0x563d8aa84bb0 2024-05-07T13:56:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.148+0000 7f8ea404c640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aa84bb0 0x563d8aa86fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.149+0000 7f8ea404c640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aa84bb0 0x563d8aa86fa0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.149+0000 7f8ea404c640 1 -- 172.21.15.50:0/3421397343 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8e9402e070 con 0x563d8aa84bb0 2024-05-07T13:56:10.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.149+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aa83b60 con 0x563d8a987470 2024-05-07T13:56:10.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.149+0000 7f8ea484d640 1 -- 172.21.15.50:0/3421397343 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8a987470 2024-05-07T13:56:10.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.149+0000 7f8ea6546800 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563d8aa88b40 0x563d8aa8af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.149+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aa8b6f0 con 0x563d8aa88b40 2024-05-07T13:56:10.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.150+0000 7f8ea384b640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563d8aa88b40 0x563d8aa8af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.150+0000 7f8ea384b640 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563d8aa88b40 0x563d8aa8af90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.150+0000 7f8ea384b640 1 -- 172.21.15.50:0/3421397343 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8e9805c040 con 0x563d8aa88b40 2024-05-07T13:56:10.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.151+0000 7f8ea6546800 1 Processor -- start 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.151+0000 7f8ea6546800 1 -- start start 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.151+0000 7f8ea6546800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aa9def0 0x563d8aa9e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.151+0000 7f8ea6546800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d8a875cf0 con 0x563d8aa9def0 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.151+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aa9def0 0x563d8aa9e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.151+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aa9def0 0x563d8aa9e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45152/0 (socket says 172.21.15.50:45152) 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.151+0000 7f8ea404c640 1 -- 172.21.15.50:0/1486755171 learned_addr learned my addr 172.21.15.50:0/1486755171 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.151+0000 7f8ea404c640 1 -- 172.21.15.50:0/1486755171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8aa9e850 con 0x563d8aa9def0 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.151+0000 7f8ea404c640 1 --2- 172.21.15.50:0/1486755171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aa9def0 0x563d8aa9e310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e94001310 tx=0x7f8e94017ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.152+0000 7f8d89ffb640 1 -- 172.21.15.50:0/1486755171 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e9402c420 con 0x563d8aa9def0 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.152+0000 7f8d89ffb640 1 -- 172.21.15.50:0/1486755171 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9401b500 con 0x563d8aa9def0 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.152+0000 7f8ea6546800 1 -- 172.21.15.50:0/1486755171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d8aa9f2c0 con 0x563d8aa9def0 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.152+0000 7f8d89ffb640 1 -- 172.21.15.50:0/1486755171 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e9401b7e0 con 0x563d8aa9def0 2024-05-07T13:56:10.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.152+0000 7f8ea6546800 1 -- 172.21.15.50:0/1486755171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d8aa9f2c0 con 0x563d8aa9def0 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.152+0000 7f8d89ffb640 1 -- 172.21.15.50:0/1486755171 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8e9400e070 con 0x563d8aa9def0 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8d89ffb640 1 --2- 172.21.15.50:0/1486755171 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d7c036900 0x7f8d7c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8d89ffb640 1 -- 172.21.15.50:0/1486755171 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8e9403cc90 con 0x563d8aa9def0 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8ea384b640 1 --2- 172.21.15.50:0/1486755171 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d7c036900 0x7f8d7c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8ea6546800 1 Processor -- start 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8ea6546800 1 -- start start 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8ea384b640 1 --2- 172.21.15.50:0/1486755171 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d7c036900 0x7f8d7c038dc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x563d8aa83160 tx=0x7f8e98005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8ea6546800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aaab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8ea6546800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d8aa73e70 con 0x563d8aaaae40 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aaab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aaab260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45168/0 (socket says 172.21.15.50:45168) 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.153+0000 7f8ea404c640 1 -- 172.21.15.50:0/971808304 learned_addr learned my addr 172.21.15.50:0/971808304 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8ea404c640 1 -- 172.21.15.50:0/971808304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8aaab830 con 0x563d8aaaae40 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8ea404c640 1 --2- 172.21.15.50:0/971808304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aaab260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400efd0 tx=0x7f8e94031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66acc0849475255d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8d837fe640 1 -- 172.21.15.50:0/971808304 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e9405a070 con 0x563d8aaaae40 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8d837fe640 1 -- 172.21.15.50:0/971808304 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e94031d70 con 0x563d8aaaae40 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8d837fe640 1 -- 172.21.15.50:0/971808304 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e9401b980 con 0x563d8aaaae40 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8ea6546800 1 -- 172.21.15.50:0/971808304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 msgr2=0x563d8aaab260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8ea6546800 1 --2- 172.21.15.50:0/971808304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aaab260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400efd0 tx=0x7f8e94031bb0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8ea6546800 1 -- 172.21.15.50:0/971808304 shutdown_connections 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8ea6546800 1 --2- 172.21.15.50:0/971808304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aaab260 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8ea6546800 1 -- 172.21.15.50:0/971808304 >> 172.21.15.50:0/971808304 conn(0x563d8aaa71a0 msgr2=0x563d8aaa5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8ea6546800 1 -- 172.21.15.50:0/971808304 shutdown_connections 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.154+0000 7f8ea6546800 1 -- 172.21.15.50:0/971808304 wait complete. 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.155+0000 7f8ea6546800 1 Processor -- start 2024-05-07T13:56:10.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.155+0000 7f8ea6546800 1 -- start start 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.155+0000 7f8ea6546800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aab22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.155+0000 7f8ea6546800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d8aaabee0 con 0x563d8aaaae40 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.155+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aab22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.155+0000 7f8ea404c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aab22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45172/0 (socket says 172.21.15.50:45172) 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.155+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 learned_addr learned my addr 172.21.15.50:0/2838219541 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.156+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8aab27e0 con 0x563d8aaaae40 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.156+0000 7f8ea404c640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aab22a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8e9401c760 tx=0x7f8e9404ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.156+0000 7f8d81ffb640 1 -- 172.21.15.50:0/2838219541 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e940193e0 con 0x563d8aaaae40 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.156+0000 7f8d81ffb640 1 -- 172.21.15.50:0/2838219541 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e94065040 con 0x563d8aaaae40 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.156+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d8aab27e0 con 0x563d8aaaae40 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.156+0000 7f8d81ffb640 1 -- 172.21.15.50:0/2838219541 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e94027430 con 0x563d8aaaae40 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.156+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d8aab27e0 con 0x563d8aaaae40 2024-05-07T13:56:10.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.157+0000 7f8d81ffb640 1 -- 172.21.15.50:0/2838219541 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8e94031450 con 0x563d8aaaae40 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.157+0000 7f8d81ffb640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d74036900 0x7f8d74038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.157+0000 7f8d81ffb640 1 -- 172.21.15.50:0/2838219541 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8e94075c50 con 0x563d8aaaae40 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.157+0000 7f8ea384b640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d74036900 0x7f8d74038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.157+0000 7f8ea384b640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d74036900 0x7f8d74038dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e98008560 tx=0x7f8e98062040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea6546800 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8aabda40 0x563d8aabff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac0650 con 0x563d8aabda40 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea484d640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8aabda40 0x563d8aabff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea484d640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8aabda40 0x563d8aabff00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8aabda40 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea6546800 20 realm 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.158+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac0a60 con 0x563d8aabda40 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8aabda40 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac1330 con 0x563d8aabda40 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8aabda40 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aabda40 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8aabda40 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aac2430 0x563d8aac4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac4e30 con 0x563d8aac2430 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.159+0000 7f8ea404c640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aac2430 0x563d8aac4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.160+0000 7f8ea404c640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aac2430 0x563d8aac4820 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.160+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.160+0000 7f8ea6546800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.160+0000 7f8ea6546800 20 searching for the correct realm 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.160+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac6760 con 0x563d8aac2430 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.160+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.161+0000 7f8ea404c640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e94040040 0x7f8e94019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.161+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac6760 con 0x7f8e94040040 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.161+0000 7f8ea384b640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e94040040 0x7f8e94019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.161+0000 7f8ea384b640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e94040040 0x7f8e94019860 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.161+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.161+0000 7f8ea384b640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e98085040 0x7f8e98054950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.161+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac6760 con 0x7f8e98085040 2024-05-07T13:56:10.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.161+0000 7f8ea484d640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e98085040 0x7f8e98054950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.162+0000 7f8ea484d640 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e98085040 0x7f8e98054950 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.162+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x7f8e98085040 2024-05-07T13:56:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.162+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aabda40 2024-05-07T13:56:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.162+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8aabda40 2024-05-07T13:56:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.162+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aabda40 2024-05-07T13:56:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8aabda40 2024-05-07T13:56:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e98085040 2024-05-07T13:56:10.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x7f8e98085040 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e98085040 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x7f8e98085040 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e94040040 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aac2430 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.163+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aabda40 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.164+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8aabda40 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.164+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e98085040 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.164+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x7f8e98085040 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.164+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aabda40 2024-05-07T13:56:10.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.164+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8aabda40 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.164+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e94040040 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.164+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.164+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aac2430 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.165+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.165+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aac2430 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.165+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.165+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e98085040 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.165+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x7f8e98085040 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.165+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aac2430 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.166+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.166+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aac2430 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.166+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.166+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aabda40 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.166+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c00a4a0 con 0x563d8aabda40 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.166+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aabda40 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.166+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.166+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e98085040 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.167+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.167+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aac2430 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.167+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.167+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e94040040 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.167+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.167+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aabda40 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.167+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.167+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e98085040 2024-05-07T13:56:10.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.168+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.168+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aac2430 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.168+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.168+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e98085040 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.168+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.168+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e94040040 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.169+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.169+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aac2430 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.169+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.169+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e98085040 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.169+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.169+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x563d8aabda40 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.169+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.169+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac16d0 con 0x7f8e94040040 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac56f0 con 0x563d8aabda40 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac5ae0 con 0x563d8aabda40 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.170+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac5ae0 con 0x7f8e98085040 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 20 zone default found 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 4 Realm: () 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 20 zonegroup default 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac6be0 con 0x7f8e98085040 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac85c0 con 0x563d8aac2430 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac8960 con 0x563d8aac2430 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.171+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.172+0000 7f8ea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.172+0000 7f8ea6546800 20 started sync module instance, tier type = 2024-05-07T13:56:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.172+0000 7f8ea6546800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.172+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac7a60 con 0x7f8e94040040 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.173+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.173+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94822319551920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac8d00 con 0x7f8e94040040 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.173+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac9550 con 0x563d8aabda40 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.174+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94822319551920] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.174+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.174+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94822319558816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac94c0 con 0x563d8aabda40 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.174+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aaca410 con 0x563d8aac2430 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.175+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94822319558816] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.175+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.175+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94822319562592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aaca800 con 0x563d8aac2430 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.175+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacb220 con 0x7f8e94040040 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.176+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94822319562592] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.176+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.176+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94822319561024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacbac0 con 0x7f8e94040040 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.176+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacc480 con 0x563d8aabda40 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.177+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.177+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94822319571376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aaccc00 con 0x563d8aabda40 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.177+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacd720 con 0x7f8e98085040 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.177+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94822319561024] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.178+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94822319571376] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.178+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.178+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94822319575536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacd6e0 con 0x7f8e98085040 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.178+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacdfc0 con 0x7f8e98085040 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.179+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94822319575536] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.179+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.179+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94822319568400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacdb90 con 0x7f8e98085040 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.179+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aace5b0 con 0x7f8e98085040 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94822319568400] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94822319579296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aace570 con 0x7f8e98085040 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea6546800 20 add_watcher() i=0 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea6546800 20 add_watcher() i=1 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea6546800 20 add_watcher() i=2 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea6546800 20 add_watcher() i=3 2024-05-07T13:56:10.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea6546800 20 add_watcher() i=4 2024-05-07T13:56:10.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea6546800 20 add_watcher() i=5 2024-05-07T13:56:10.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.180+0000 7f8ea6546800 20 add_watcher() i=6 2024-05-07T13:56:10.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.181+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94822319579296] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.181+0000 7f8ea6546800 20 add_watcher() i=7 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.181+0000 7f8ea6546800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.181+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8aad1a30 con 0x563d8aabda40 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.181+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.182+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94822319576800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacef50 con 0x563d8aabda40 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.182+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94822319576800] v27'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.182+0000 7f8d5a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8ea6546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8ea6546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8ea6546800 5 note: GC not initialized 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8d597e2640 20 reqs_thread_entry: start 2024-05-07T13:56:10.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8ea6546800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8ea6546800 20 Filter name: none 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8ccaffd640 20 reqs_thread_entry: start 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8ea6546800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.183+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8ab04f20 con 0x563d8aabda40 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8ab05830 con 0x563d8aabda40 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.184+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8ab0b0b0 con 0x563d8aabda40 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v27'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8ea6546800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8ea6546800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8ea6546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94822319827744 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8ab06870 con 0x563d8aabda40 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== watch-notify(notify (1) cookie 94822319571376 notify 115964116997 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f8e9c01e040 con 0x563d8aabda40 2024-05-07T13:56:10.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8d837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94822319571376 notifier 4355 bl.length()=732 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(65 notify.4 [notify cookie 94822319827744 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8d837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8d837fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.185+0000 7f8d837fe640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8d68003ea0 con 0x563d8aabda40 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.186+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.186+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== watch-notify(notify_complete (2) cookie 94822319827744 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8e9c0279c0 con 0x563d8aabda40 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.186+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8ab0ab20 con 0x563d8aabda40 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8ea6546800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8ea6546800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8ea6546800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-07T13:56:10.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94822319811744 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563d8ab0ab20 con 0x7f8e94040040 2024-05-07T13:56:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== watch-notify(notify (1) cookie 94822319551920 notify 115964116994 ret 0) ==== 208+0+0 (crc 0 0 0) 0x563d8a98b060 con 0x7f8e94040040 2024-05-07T13:56:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8d837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94822319551920 notifier 4355 bl.length()=166 2024-05-07T13:56:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8d837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-07T13:56:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8d837fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-07T13:56:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(68 notify.0 [notify cookie 94822319811744 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.187+0000 7f8d837fe640 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8d68003ea0 con 0x7f8e94040040 2024-05-07T13:56:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.188+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.188+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== watch-notify(notify_complete (2) cookie 94822319811744 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8e9805f8e0 con 0x7f8e94040040 2024-05-07T13:56:10.189 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"ozNhCxOUCHFJBMKjE34hIiCLdawqHSQW7lXU0ERR","active":true,"create_date":"2024-05-07T13:56:10.185774Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:10.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.189+0000 7f8d5a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.189+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94822319576800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8ab09750 con 0x563d8aabda40 2024-05-07T13:56:10.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.189+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94822319576800] v27'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.190+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94822319551920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacd6e0 con 0x7f8e94040040 2024-05-07T13:56:10.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.190+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94822319551920] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.190+0000 7f8ea6546800 20 remove_watcher() i=0 2024-05-07T13:56:10.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.190+0000 7f8ea6546800 2 removed watcher, disabling cache 2024-05-07T13:56:10.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.190+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94822319558816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac75b0 con 0x563d8aabda40 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.192+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94822319558816] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.192+0000 7f8ea6546800 20 remove_watcher() i=1 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.192+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94822319562592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac75b0 con 0x563d8aac2430 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.193+0000 7f8ea404c640 1 -- 172.21.15.50:0/2838219541 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94822319562592] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e94071020 con 0x563d8aac2430 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.193+0000 7f8ea6546800 20 remove_watcher() i=2 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.193+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94822319561024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac9f60 con 0x7f8e94040040 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.194+0000 7f8ea384b640 1 -- 172.21.15.50:0/2838219541 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94822319561024] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9805c040 con 0x7f8e94040040 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.194+0000 7f8ea6546800 20 remove_watcher() i=3 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.194+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94822319571376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac9940 con 0x563d8aabda40 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.195+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94822319571376] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x563d8aabda40 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.195+0000 7f8ea6546800 20 remove_watcher() i=4 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.195+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94822319575536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac9f60 con 0x7f8e98085040 2024-05-07T13:56:10.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.196+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94822319575536] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.196+0000 7f8ea6546800 20 remove_watcher() i=5 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.196+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94822319568400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aacc1b0 con 0x7f8e98085040 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.197+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94822319568400] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.197+0000 7f8ea6546800 20 remove_watcher() i=6 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.197+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94822319579296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563d8aac9f60 con 0x7f8e98085040 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94822319579296] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c02f060 con 0x7f8e98085040 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 20 remove_watcher() i=7 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e98085040 msgr2=0x7f8e98054950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8e98085040 0x7f8e98054950 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8aabda40 msgr2=0x563d8aabff00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8aabda40 0x563d8aabff00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e94040040 msgr2=0x7f8e94019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8e94040040 0x7f8e94019860 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aac2430 msgr2=0x563d8aac4820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aac2430 0x563d8aac4820 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d74036900 msgr2=0x7f8d74038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d74036900 0x7f8d74038dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e98008560 tx=0x7f8e98062040 comp rx=0 tx=0).stop 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 msgr2=0x563d8aab22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/2838219541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aaaae40 0x563d8aab22a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8e9401c760 tx=0x7f8e9404ca80 comp rx=0 tx=0).stop 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 reap_dead start 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea484d640 1 -- 172.21.15.50:0/2838219541 reap_dead start 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 shutdown_connections 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 >> 172.21.15.50:0/2838219541 conn(0x563d8aaa71a0 msgr2=0x563d8aaa4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 shutdown_connections 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/2838219541 wait complete. 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/1486755171 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d7c036900 msgr2=0x7f8d7c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/1486755171 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d7c036900 0x7f8d7c038dc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x563d8aa83160 tx=0x7f8e98005ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/1486755171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aa9def0 msgr2=0x563d8aa9e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/1486755171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aa9def0 0x563d8aa9e310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e94001310 tx=0x7f8e94017ab0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/1486755171 shutdown_connections 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/1486755171 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d7c036900 0x7f8d7c038dc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 --2- 172.21.15.50:0/1486755171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8aa9def0 0x563d8aa9e310 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.198+0000 7f8ea6546800 1 -- 172.21.15.50:0/1486755171 >> 172.21.15.50:0/1486755171 conn(0x563d8aa8db80 msgr2=0x563d8aa8df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/1486755171 shutdown_connections 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/1486755171 wait complete. 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563d8aa88b40 msgr2=0x563d8aa8af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563d8aa88b40 0x563d8aa8af90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8a987470 msgr2=0x563d8aa82320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563d8a987470 0x563d8aa82320 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aa84bb0 msgr2=0x563d8aa86fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563d8aa84bb0 0x563d8aa86fa0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d8c0369a0 msgr2=0x7f8d8c038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d8c0369a0 0x7f8d8c038e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e98056000 tx=0x7f8e9800a000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 msgr2=0x563d8aa7b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 --2- 172.21.15.50:0/3421397343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d8a982fe0 0x563d8aa7b130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x563d8aa742b0 tx=0x7f8e94000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea484d640 1 -- 172.21.15.50:0/3421397343 reap_dead start 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 shutdown_connections 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 >> 172.21.15.50:0/3421397343 conn(0x563d8a97e5c0 msgr2=0x563d8aa6d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 shutdown_connections 2024-05-07T13:56:10.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.199+0000 7f8ea6546800 1 -- 172.21.15.50:0/3421397343 wait complete. 2024-05-07T13:56:10.201 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'ozNhCxOUCHFJBMKjE34hIiCLdawqHSQW7lXU0ERR', 'active': True, 'create_date': '2024-05-07T13:56:10.185774Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:10.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-07T13:56:10.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-07T13:56:10.202 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-05-07T13:56:10.251 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:10.251 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:10.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.263+0000 7fcbea20f800 1 Processor -- start 2024-05-07T13:56:10.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.263+0000 7fcbea20f800 1 -- start start 2024-05-07T13:56:10.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.264+0000 7fcbea20f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e34f9285f0 0x55e34f9bd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.264+0000 7fcbea20f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e34f928b10 con 0x55e34f9299d0 2024-05-07T13:56:10.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.264+0000 7fcbea20f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55e34f845050 con 0x55e34f9285f0 2024-05-07T13:56:10.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.264+0000 7fcbe5146640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e34f9285f0 0x55e34f9bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.264+0000 7fcbe5947640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55e34f9299d0 0x55e34f927ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39612/0 (socket says 172.21.15.50:39612) 2024-05-07T13:56:10.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.264+0000 7fcbe5947640 1 -- 172.21.15.50:0/2016777730 learned_addr learned my addr 172.21.15.50:0/2016777730 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:10.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.264+0000 7fcbe5146640 1 -- 172.21.15.50:0/2016777730 >> v1:172.21.15.22:6789/0 conn(0x55e34f9299d0 legacy=0x55e34f927ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.264+0000 7fcbe5146640 1 -- 172.21.15.50:0/2016777730 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34f9be550 con 0x55e34f9285f0 2024-05-07T13:56:10.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.264+0000 7fcbe4945640 1 -- 172.21.15.50:0/2016777730 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432574318 0 0) 0x55e34f928b10 con 0x55e34f9299d0 2024-05-07T13:56:10.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.266+0000 7fcbe5146640 1 --2- 172.21.15.50:0/2016777730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34f9bd000 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00a470 tx=0x7fcbdc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610966f45c684a4f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.266+0000 7fcbe4945640 1 -- 172.21.15.50:0/2016777730 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc057070 con 0x55e34f9285f0 2024-05-07T13:56:10.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.266+0000 7fcbe4945640 1 -- 172.21.15.50:0/2016777730 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc052570 con 0x55e34f9285f0 2024-05-07T13:56:10.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.266+0000 7fcbe4945640 1 -- 172.21.15.50:0/2016777730 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbdc052870 con 0x55e34f9285f0 2024-05-07T13:56:10.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.267+0000 7fcbea20f800 1 -- 172.21.15.50:0/2016777730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 msgr2=0x55e34f9bd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.267+0000 7fcbea20f800 1 --2- 172.21.15.50:0/2016777730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34f9bd000 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00a470 tx=0x7fcbdc01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:10.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.267+0000 7fcbea20f800 1 -- 172.21.15.50:0/2016777730 shutdown_connections 2024-05-07T13:56:10.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.267+0000 7fcbea20f800 1 --2- 172.21.15.50:0/2016777730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34f9bd000 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.267+0000 7fcbea20f800 1 -- 172.21.15.50:0/2016777730 >> 172.21.15.50:0/2016777730 conn(0x55e34f9af7a0 msgr2=0x55e34f9b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.267+0000 7fcbea20f800 1 -- 172.21.15.50:0/2016777730 shutdown_connections 2024-05-07T13:56:10.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.267+0000 7fcbea20f800 1 -- 172.21.15.50:0/2016777730 wait complete. 2024-05-07T13:56:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.282+0000 7fcbea20f800 1 Processor -- start 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.282+0000 7fcbea20f800 1 -- start start 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.282+0000 7fcbea20f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faa7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.282+0000 7fcbea20f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e34f8ff1f0 con 0x55e34f9285f0 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.283+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faa7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.283+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faa7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45194/0 (socket says 172.21.15.50:45194) 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.283+0000 7fcbe5947640 1 -- 172.21.15.50:0/4067212092 learned_addr learned my addr 172.21.15.50:0/4067212092 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.283+0000 7fcbe5947640 1 -- 172.21.15.50:0/4067212092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34faa7d30 con 0x55e34f9285f0 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.283+0000 7fcbe5947640 1 --2- 172.21.15.50:0/4067212092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faa7760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8001e00 tx=0x7fcbd800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6ddb01fad61096 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.283+0000 7fcad3e07640 1 -- 172.21.15.50:0/4067212092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd8012020 con 0x55e34f9285f0 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.283+0000 7fcad3e07640 1 -- 172.21.15.50:0/4067212092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd800e5c0 con 0x55e34f9285f0 2024-05-07T13:56:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.283+0000 7fcad3e07640 1 -- 172.21.15.50:0/4067212092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd800e8e0 con 0x55e34f9285f0 2024-05-07T13:56:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 -- 172.21.15.50:0/4067212092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 msgr2=0x55e34faa7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 --2- 172.21.15.50:0/4067212092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faa7760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8001e00 tx=0x7fcbd800b780 comp rx=0 tx=0).stop 2024-05-07T13:56:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 -- 172.21.15.50:0/4067212092 shutdown_connections 2024-05-07T13:56:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 --2- 172.21.15.50:0/4067212092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faa7760 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 -- 172.21.15.50:0/4067212092 >> 172.21.15.50:0/4067212092 conn(0x55e34f9af7a0 msgr2=0x55e34faa3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 -- 172.21.15.50:0/4067212092 shutdown_connections 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 -- 172.21.15.50:0/4067212092 wait complete. 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 Processor -- start 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 -- start start 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faaf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.284+0000 7fcbea20f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e34f9bd780 con 0x55e34f9285f0 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faaf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faaf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45204/0 (socket says 172.21.15.50:45204) 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcbe5947640 1 -- 172.21.15.50:0/3650688878 learned_addr learned my addr 172.21.15.50:0/3650688878 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcbe5947640 1 -- 172.21.15.50:0/3650688878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34faaf810 con 0x55e34f9285f0 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcbe5947640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faaf2d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55e34faa84f0 tx=0x7fcbd8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcad2604640 1 -- 172.21.15.50:0/3650688878 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd8012030 con 0x55e34f9285f0 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcad2604640 1 -- 172.21.15.50:0/3650688878 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd801a700 con 0x55e34f9285f0 2024-05-07T13:56:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e34faafaa0 con 0x55e34f9285f0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcad2604640 1 -- 172.21.15.50:0/3650688878 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd801a9e0 con 0x55e34f9285f0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.285+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e34fab2750 con 0x55e34f9285f0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.286+0000 7fcad2604640 1 -- 172.21.15.50:0/3650688878 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcbd8015020 con 0x55e34f9285f0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.286+0000 7fcad2604640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcacc036950 0x7fcacc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.286+0000 7fcad2604640 1 -- 172.21.15.50:0/3650688878 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcbd8020030 con 0x55e34f9285f0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.286+0000 7fcbe5146640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcacc036950 0x7fcacc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.286+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34f9299d0 0x55e34fab6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.286+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34fab6a50 con 0x55e34f9299d0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.287+0000 7fcbe6148640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34f9299d0 0x55e34fab6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.287+0000 7fcbe5146640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcacc036950 0x7fcacc038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc054000 tx=0x7fcbdc04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.287+0000 7fcbe6148640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34f9299d0 0x55e34fab6510 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.287+0000 7fcbe6148640 1 -- 172.21.15.50:0/3650688878 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34f9299d0 2024-05-07T13:56:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.287+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34fab3ae0 con 0x55e34f9299d0 2024-05-07T13:56:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.288+0000 7fcbe6148640 1 -- 172.21.15.50:0/3650688878 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34f9299d0 2024-05-07T13:56:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.288+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34fab8d40 0x55e34fabb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.288+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34fabb820 con 0x55e34fab8d40 2024-05-07T13:56:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.288+0000 7fcbe5947640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34fab8d40 0x55e34fabb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.288+0000 7fcbe5947640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34fab8d40 0x55e34fabb130 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.288+0000 7fcbe5947640 1 -- 172.21.15.50:0/3650688878 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcbd800dcd0 con 0x55e34fab8d40 2024-05-07T13:56:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.288+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34fab7cf0 con 0x55e34f9299d0 2024-05-07T13:56:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.289+0000 7fcbe6148640 1 -- 172.21.15.50:0/3650688878 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34f9299d0 2024-05-07T13:56:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.289+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e34fabccd0 0x55e34fabf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.289+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34fabf880 con 0x55e34fabccd0 2024-05-07T13:56:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.289+0000 7fcbe5146640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e34fabccd0 0x55e34fabf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.289+0000 7fcbe5146640 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e34fabccd0 0x55e34fabf120 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.290+0000 7fcbe5146640 1 -- 172.21.15.50:0/3650688878 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcbdc05a040 con 0x55e34fabccd0 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.290+0000 7fcbea20f800 1 Processor -- start 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.290+0000 7fcbea20f800 1 -- start start 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.290+0000 7fcbea20f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34facdce0 0x55e34face100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.290+0000 7fcbea20f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e34f8a5cf0 con 0x55e34facdce0 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34facdce0 0x55e34face100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34facdce0 0x55e34face100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45208/0 (socket says 172.21.15.50:45208) 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcbe5947640 1 -- 172.21.15.50:0/3973213640 learned_addr learned my addr 172.21.15.50:0/3973213640 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcbe5947640 1 -- 172.21.15.50:0/3973213640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34face640 con 0x55e34facdce0 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcbe5947640 1 --2- 172.21.15.50:0/3973213640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34facdce0 0x55e34face100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800bd20 tx=0x7fcbd8017f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcacb7fe640 1 -- 172.21.15.50:0/3973213640 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd8040040 con 0x55e34facdce0 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcacb7fe640 1 -- 172.21.15.50:0/3973213640 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd8027d70 con 0x55e34facdce0 2024-05-07T13:56:10.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcbea20f800 1 -- 172.21.15.50:0/3973213640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e34facf0b0 con 0x55e34facdce0 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcacb7fe640 1 -- 172.21.15.50:0/3973213640 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd8045ba0 con 0x55e34facdce0 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.291+0000 7fcbea20f800 1 -- 172.21.15.50:0/3973213640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e34facf5b0 con 0x55e34facdce0 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.292+0000 7fcacb7fe640 1 -- 172.21.15.50:0/3973213640 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcbd8044300 con 0x55e34facdce0 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.292+0000 7fcacb7fe640 1 --2- 172.21.15.50:0/3973213640 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcac00368b0 0x7fcac0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.292+0000 7fcacb7fe640 1 -- 172.21.15.50:0/3973213640 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcbd8037c80 con 0x55e34facdce0 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.292+0000 7fcbe5146640 1 --2- 172.21.15.50:0/3973213640 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcac00368b0 0x7fcac0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.292+0000 7fcbea20f800 1 Processor -- start 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcbea20f800 1 -- start start 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcbe5146640 1 --2- 172.21.15.50:0/3973213640 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcac00368b0 0x7fcac0038d70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55e34fab72f0 tx=0x7fcbdc005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcbea20f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fadb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcbea20f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e34faa80b0 con 0x55e34fadb0c0 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fadb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fadb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45216/0 (socket says 172.21.15.50:45216) 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcbe5947640 1 -- 172.21.15.50:0/3247458281 learned_addr learned my addr 172.21.15.50:0/3247458281 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcbe5947640 1 -- 172.21.15.50:0/3247458281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34fadbab0 con 0x55e34fadb0c0 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcbe5947640 1 --2- 172.21.15.50:0/3247458281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fadb4e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcbd801efc0 tx=0x7fcbd800c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913d30a9cb996faa server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcac97fa640 1 -- 172.21.15.50:0/3247458281 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd805d070 con 0x55e34fadb0c0 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcac97fa640 1 -- 172.21.15.50:0/3247458281 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd8022320 con 0x55e34fadb0c0 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.293+0000 7fcac97fa640 1 -- 172.21.15.50:0/3247458281 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd8052040 con 0x55e34fadb0c0 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 -- 172.21.15.50:0/3247458281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 msgr2=0x55e34fadb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3247458281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fadb4e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcbd801efc0 tx=0x7fcbd800c630 comp rx=0 tx=0).stop 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 -- 172.21.15.50:0/3247458281 shutdown_connections 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3247458281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fadb4e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 -- 172.21.15.50:0/3247458281 >> 172.21.15.50:0/3247458281 conn(0x55e34fad7340 msgr2=0x55e34fad53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 -- 172.21.15.50:0/3247458281 shutdown_connections 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 -- 172.21.15.50:0/3247458281 wait complete. 2024-05-07T13:56:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 Processor -- start 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 -- start start 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fae2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.294+0000 7fcbea20f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e34fadc120 con 0x55e34fadb0c0 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fae2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcbe5947640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fae2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45222/0 (socket says 172.21.15.50:45222) 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 learned_addr learned my addr 172.21.15.50:0/469704303 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34fae2970 con 0x55e34fadb0c0 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcbe5947640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fae2430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80224d0 tx=0x7fcbd8012e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcab77fe640 1 -- 172.21.15.50:0/469704303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd805d030 con 0x55e34fadb0c0 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcab77fe640 1 -- 172.21.15.50:0/469704303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd8069070 con 0x55e34fadb0c0 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcab77fe640 1 -- 172.21.15.50:0/469704303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbd804c070 con 0x55e34fadb0c0 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e34fae2970 con 0x55e34fadb0c0 2024-05-07T13:56:10.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.295+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e34fae2970 con 0x55e34fadb0c0 2024-05-07T13:56:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.296+0000 7fcab77fe640 1 -- 172.21.15.50:0/469704303 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcbd8023380 con 0x55e34fadb0c0 2024-05-07T13:56:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.296+0000 7fcab77fe640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcab0036900 0x7fcab0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.296+0000 7fcab77fe640 1 -- 172.21.15.50:0/469704303 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcbd805e070 con 0x55e34fadb0c0 2024-05-07T13:56:10.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.297+0000 7fcbe5146640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcab0036900 0x7fcab0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.297+0000 7fcbe5146640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcab0036900 0x7fcab0038dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55e34fabfc80 tx=0x7fcbdc04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.297+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.297+0000 7fcbea20f800 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34faedb60 0x55e34faf0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.297+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf0770 con 0x55e34faedb60 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.297+0000 7fcbe6148640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34faedb60 0x55e34faf0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.297+0000 7fcbe6148640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34faedb60 0x55e34faf0020 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34faedb60 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 20 realm 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf0b80 con 0x55e34faedb60 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34faedb60 2024-05-07T13:56:10.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf1450 con 0x55e34faedb60 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34faedb60 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x55e34faedb60 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34faedb60 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34faf2550 0x55e34faf4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.298+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf4f50 con 0x55e34faf2550 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.299+0000 7fcbe5947640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34faf2550 0x55e34faf4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.299+0000 7fcbe5947640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34faf2550 0x55e34faf4940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.299+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.299+0000 7fcbea20f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.299+0000 7fcbea20f800 20 searching for the correct realm 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.299+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf6880 con 0x55e34faf2550 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.300+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.300+0000 7fcbe5947640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcbd80490c0 0x7fcbd8043890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.300+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf6880 con 0x7fcbd80490c0 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.300+0000 7fcbe5146640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcbd80490c0 0x7fcbd8043890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.300+0000 7fcbe5146640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcbd80490c0 0x7fcbd8043890 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.300+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.300+0000 7fcbe5146640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcbdc074040 0x7fcbdc081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.300+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf6880 con 0x7fcbdc074040 2024-05-07T13:56:10.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.301+0000 7fcbe6148640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcbdc074040 0x7fcbdc081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.301+0000 7fcbe6148640 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcbdc074040 0x7fcbdc081410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.301+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe000a4a0 con 0x7fcbdc074040 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.301+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x55e34faedb60 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.301+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34faedb60 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.301+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x55e34faedb60 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.302+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34faedb60 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.302+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x7fcbdc074040 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.302+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe000a4a0 con 0x7fcbdc074040 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.302+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x7fcbdc074040 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.302+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcbe000a4a0 con 0x7fcbdc074040 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.302+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x7fcbd80490c0 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.302+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.302+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x55e34faf2550 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.303+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.303+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x55e34faedb60 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.303+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34faedb60 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.303+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x7fcbdc074040 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.303+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe000a4a0 con 0x7fcbdc074040 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.303+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x55e34faedb60 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.303+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34faedb60 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.303+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf17f0 con 0x7fcbd80490c0 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.304+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.304+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faf2550 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.304+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.304+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faf2550 2024-05-07T13:56:10.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.304+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.304+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x7fcbdc074040 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.304+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe000a4a0 con 0x7fcbdc074040 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.305+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faf2550 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.305+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.305+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faf2550 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.305+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.305+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faedb60 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.305+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe000a4a0 con 0x55e34faedb60 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.305+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faedb60 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.305+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.305+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x7fcbdc074040 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.306+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.306+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faf2550 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.306+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.306+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x7fcbd80490c0 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.306+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.306+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faedb60 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.306+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.306+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x7fcbdc074040 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.307+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.307+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faf2550 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.307+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.307+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x7fcbdc074040 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.307+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.307+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x7fcbd80490c0 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.307+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.308+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faf2550 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.308+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.308+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x7fcbdc074040 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.308+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.308+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x55e34faedb60 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcbdc08e060 con 0x7fcbd80490c0 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:10.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf5810 con 0x55e34faedb60 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf5c00 con 0x55e34faedb60 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.309+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf5c00 con 0x7fcbdc074040 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 20 zone default found 2024-05-07T13:56:10.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 4 Realm: () 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 20 zonegroup default 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf5390 con 0x7fcbdc074040 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.310+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf5390 con 0x55e34faf2550 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.311+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.311+0000 7fcbea20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.311+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.311+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf8760 con 0x55e34faf2550 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.311+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.311+0000 7fcbea20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.311+0000 7fcbea20f800 20 started sync module instance, tier type = 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.311+0000 7fcbea20f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.311+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf7b80 con 0x7fcbd80490c0 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.312+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.312+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94434782838640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf77e0 con 0x7fcbd80490c0 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.312+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf9690 con 0x55e34faedb60 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.313+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94434782838640] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.313+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.313+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94434782843360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf9ab0 con 0x55e34faedb60 2024-05-07T13:56:10.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.313+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafa470 con 0x55e34faf2550 2024-05-07T13:56:10.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.314+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94434782843360] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.314+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.314+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94434782847392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf9ab0 con 0x55e34faf2550 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.314+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafaf00 con 0x7fcbd80490c0 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.315+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94434782847392] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.315+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.315+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94434782844416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34faf9a20 con 0x7fcbd80490c0 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.315+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafbdc0 con 0x55e34faedb60 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.316+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.316+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94434782844416] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.316+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94434782853872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafc660 con 0x55e34faedb60 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.316+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafb310 con 0x7fcbdc074040 2024-05-07T13:56:10.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.317+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.317+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94434782858272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafb310 con 0x7fcbdc074040 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.317+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafdb50 con 0x7fcbdc074040 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.317+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94434782853872] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.319+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.319+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94434782855600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafdb10 con 0x7fcbdc074040 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.319+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafe550 con 0x7fcbdc074040 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.319+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94434782858272] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94434782863392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafe510 con 0x7fcbdc074040 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbea20f800 20 add_watcher() i=0 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbea20f800 20 add_watcher() i=1 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbea20f800 20 add_watcher() i=2 2024-05-07T13:56:10.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbea20f800 20 add_watcher() i=3 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbea20f800 20 add_watcher() i=4 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbea20f800 20 add_watcher() i=5 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94434782855600] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbea20f800 20 add_watcher() i=6 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.320+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94434782863392] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.321+0000 7fcbea20f800 20 add_watcher() i=7 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.321+0000 7fcbea20f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.321+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafd660 con 0x55e34faedb60 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.321+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.321+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94434782859328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafd660 con 0x55e34faedb60 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.322+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94434782859328] v27'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.322+0000 7fca977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.322+0000 7fcbea20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:10.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.322+0000 7fcbea20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.322+0000 7fcbea20f800 5 note: GC not initialized 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.322+0000 7fca967fc640 20 reqs_thread_entry: start 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.322+0000 7fcbea20f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.322+0000 7fcbea20f800 20 Filter name: none 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fca07fff640 20 reqs_thread_entry: start 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fcbea20f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fcbea20f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34fb34990 con 0x55e34faedb60 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fcbea20f800 20 rados_obj.operate() r=0 bl.length=556 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fcbea20f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fcbea20f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fcbea20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:10.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.323+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fb3ae50 con 0x55e34faedb60 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.324+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v27'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.324+0000 7fcbea20f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.324+0000 7fcbea20f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.324+0000 7fcbea20f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.324+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94434783111360 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e34fb399a0 con 0x55e34faedb60 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.325+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94434782853872 notify 115964116998 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fcbe001e040 con 0x55e34faedb60 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.325+0000 7fcac97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94434782853872 notifier 4362 bl.length()=732 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.325+0000 7fcac97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.325+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(64 notify.4 [notify cookie 94434783111360 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.325+0000 7fcac97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.325+0000 7fcac97fa640 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcaa8003ea0 con 0x55e34faedb60 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.325+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94434783111360 notify 115964116998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcbe00279c0 con 0x55e34faedb60 2024-05-07T13:56:10.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.325+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.323 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.326+0000 7fca977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.326+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94434782859328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fb394f0 con 0x55e34faedb60 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.327+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94434782859328] v27'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.327+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94434782838640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fb399a0 con 0x7fcbd80490c0 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.329+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94434782838640] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.329+0000 7fcbea20f800 20 remove_watcher() i=0 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.329+0000 7fcbea20f800 2 removed watcher, disabling cache 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.329+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94434782843360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fb399a0 con 0x55e34faedb60 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.330+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94434782843360] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.330+0000 7fcbea20f800 20 remove_watcher() i=1 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.330+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94434782847392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fb399a0 con 0x55e34faf2550 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.331+0000 7fcbe5947640 1 -- 172.21.15.50:0/469704303 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94434782847392] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbd8055040 con 0x55e34faf2550 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.331+0000 7fcbea20f800 20 remove_watcher() i=2 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.331+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94434782844416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fb399a0 con 0x7fcbd80490c0 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.332+0000 7fcbe5146640 1 -- 172.21.15.50:0/469704303 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94434782844416] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbdc07f070 con 0x7fcbd80490c0 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.332+0000 7fcbea20f800 20 remove_watcher() i=3 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.332+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94434782853872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafa1a0 con 0x55e34faedb60 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.333+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94434782853872] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x55e34faedb60 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.333+0000 7fcbea20f800 20 remove_watcher() i=4 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.333+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94434782858272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafa1a0 con 0x7fcbdc074040 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.334+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94434782858272] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.334+0000 7fcbea20f800 20 remove_watcher() i=5 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.334+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94434782855600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafa1a0 con 0x7fcbdc074040 2024-05-07T13:56:10.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.335+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94434782855600] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.335+0000 7fcbea20f800 20 remove_watcher() i=6 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.335+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94434782863392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e34fafa1a0 con 0x7fcbdc074040 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94434782863392] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe002f060 con 0x7fcbdc074040 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 20 remove_watcher() i=7 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcbdc074040 msgr2=0x7fcbdc081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcbdc074040 0x7fcbdc081410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34faedb60 msgr2=0x55e34faf0020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34faedb60 0x55e34faf0020 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcbd80490c0 msgr2=0x7fcbd8043890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcbd80490c0 0x7fcbd8043890 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34faf2550 msgr2=0x55e34faf4940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34faf2550 0x55e34faf4940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcab0036900 msgr2=0x7fcab0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcab0036900 0x7fcab0038dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55e34fabfc80 tx=0x7fcbdc04f000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 msgr2=0x55e34fae2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fae2430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80224d0 tx=0x7fcbd8012e90 comp rx=0 tx=0).stop 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbe6148640 1 -- 172.21.15.50:0/469704303 reap_dead start 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 shutdown_connections 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 --2- 172.21.15.50:0/469704303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34fadb0c0 0x55e34fae2430 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 >> 172.21.15.50:0/469704303 conn(0x55e34fad7340 msgr2=0x55e34fad49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 shutdown_connections 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/469704303 wait complete. 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/3973213640 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcac00368b0 msgr2=0x7fcac0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3973213640 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcac00368b0 0x7fcac0038d70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55e34fab72f0 tx=0x7fcbdc005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 -- 172.21.15.50:0/3973213640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34facdce0 msgr2=0x55e34face100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.336+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3973213640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34facdce0 0x55e34face100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800bd20 tx=0x7fcbd8017f70 comp rx=0 tx=0).stop 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3973213640 shutdown_connections 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3973213640 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcac00368b0 0x7fcac0038d70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3973213640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34facdce0 0x55e34face100 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3973213640 >> 172.21.15.50:0/3973213640 conn(0x55e34fac1d80 msgr2=0x55e34fac2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3973213640 shutdown_connections 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3973213640 wait complete. 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e34fabccd0 msgr2=0x55e34fabf120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e34fabccd0 0x55e34fabf120 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34f9299d0 msgr2=0x55e34fab6510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e34f9299d0 0x55e34fab6510 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34fab8d40 msgr2=0x55e34fabb130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e34fab8d40 0x55e34fabb130 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcacc036950 msgr2=0x7fcacc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcacc036950 0x7fcacc038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc054000 tx=0x7fcbdc04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 msgr2=0x55e34faaf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 --2- 172.21.15.50:0/3650688878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e34f9285f0 0x55e34faaf2d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55e34faa84f0 tx=0x7fcbd8000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbe6148640 1 -- 172.21.15.50:0/3650688878 reap_dead start 2024-05-07T13:56:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 shutdown_connections 2024-05-07T13:56:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 >> 172.21.15.50:0/3650688878 conn(0x55e34f9af7a0 msgr2=0x55e34faa1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 shutdown_connections 2024-05-07T13:56:10.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.337+0000 7fcbea20f800 1 -- 172.21.15.50:0/3650688878 wait complete. 2024-05-07T13:56:10.335 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:10.335 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-07T13:56:10.335 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-07T13:56:10.335 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-07T13:56:10.381 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:10.381 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:10.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.393+0000 7fb43292d800 1 Processor -- start 2024-05-07T13:56:10.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.393+0000 7fb43292d800 1 -- start start 2024-05-07T13:56:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.393+0000 7fb43292d800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558dfa97a520 0x558dfa983020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.394+0000 7fb43292d800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558dfa8ed920 con 0x558dfa9789e0 2024-05-07T13:56:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.394+0000 7fb43292d800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x558dfa80b050 con 0x558dfa97a520 2024-05-07T13:56:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.394+0000 7fb42dd7e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558dfa97a520 0x558dfa983020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.394+0000 7fb42e57f640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x558dfa9789e0 0x558dfa978e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39616/0 (socket says 172.21.15.50:39616) 2024-05-07T13:56:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.394+0000 7fb42dd7e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558dfa97a520 0x558dfa983020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45228/0 (socket says 172.21.15.50:45228) 2024-05-07T13:56:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.394+0000 7fb42e57f640 1 -- 172.21.15.50:0/4236551623 learned_addr learned my addr 172.21.15.50:0/4236551623 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.394+0000 7fb42dd7e640 1 -- 172.21.15.50:0/4236551623 >> v1:172.21.15.22:6789/0 conn(0x558dfa9789e0 legacy=0x558dfa978e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.394+0000 7fb42dd7e640 1 -- 172.21.15.50:0/4236551623 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dfa984570 con 0x558dfa97a520 2024-05-07T13:56:10.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.396+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/4236551623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa97a520 0x558dfa983020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb42400a470 tx=0x7fb42401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499ee7a51879b6cf server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.396+0000 7fb42d57d640 1 -- 172.21.15.50:0/4236551623 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb424057070 con 0x558dfa97a520 2024-05-07T13:56:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.396+0000 7fb42d57d640 1 -- 172.21.15.50:0/4236551623 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42404adc0 con 0x558dfa97a520 2024-05-07T13:56:10.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.396+0000 7fb42d57d640 1 -- 172.21.15.50:0/4236551623 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb424052590 con 0x558dfa97a520 2024-05-07T13:56:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.397+0000 7fb43292d800 1 -- 172.21.15.50:0/4236551623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa97a520 msgr2=0x558dfa983020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.397+0000 7fb43292d800 1 --2- 172.21.15.50:0/4236551623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa97a520 0x558dfa983020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb42400a470 tx=0x7fb42401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.397+0000 7fb43292d800 1 -- 172.21.15.50:0/4236551623 shutdown_connections 2024-05-07T13:56:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.397+0000 7fb43292d800 1 --2- 172.21.15.50:0/4236551623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa97a520 0x558dfa983020 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.397+0000 7fb43292d800 1 -- 172.21.15.50:0/4236551623 >> 172.21.15.50:0/4236551623 conn(0x558dfa974560 msgr2=0x558dfa976980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.397+0000 7fb43292d800 1 -- 172.21.15.50:0/4236551623 shutdown_connections 2024-05-07T13:56:10.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.397+0000 7fb43292d800 1 -- 172.21.15.50:0/4236551623 wait complete. 2024-05-07T13:56:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.412+0000 7fb43292d800 1 Processor -- start 2024-05-07T13:56:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.412+0000 7fb43292d800 1 -- start start 2024-05-07T13:56:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.412+0000 7fb43292d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa6d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.412+0000 7fb43292d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558dfa8c51d0 con 0x558dfa9789e0 2024-05-07T13:56:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.413+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa6d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.413+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa6d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45242/0 (socket says 172.21.15.50:45242) 2024-05-07T13:56:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.413+0000 7fb42e57f640 1 -- 172.21.15.50:0/6701842 learned_addr learned my addr 172.21.15.50:0/6701842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.413+0000 7fb42e57f640 1 -- 172.21.15.50:0/6701842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dfaa6dfc0 con 0x558dfa9789e0 2024-05-07T13:56:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.413+0000 7fb42e57f640 1 --2- 172.21.15.50:0/6701842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa6d9f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb420001de0 tx=0x7fb42000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3356f6385857d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.413+0000 7fb31c608640 1 -- 172.21.15.50:0/6701842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420012020 con 0x558dfa9789e0 2024-05-07T13:56:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.413+0000 7fb31c608640 1 -- 172.21.15.50:0/6701842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42000e5a0 con 0x558dfa9789e0 2024-05-07T13:56:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.413+0000 7fb31c608640 1 -- 172.21.15.50:0/6701842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42000e8c0 con 0x558dfa9789e0 2024-05-07T13:56:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 -- 172.21.15.50:0/6701842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 msgr2=0x558dfaa6d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 --2- 172.21.15.50:0/6701842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa6d9f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb420001de0 tx=0x7fb42000b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 -- 172.21.15.50:0/6701842 shutdown_connections 2024-05-07T13:56:10.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 --2- 172.21.15.50:0/6701842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa6d9f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 -- 172.21.15.50:0/6701842 >> 172.21.15.50:0/6701842 conn(0x558dfa974560 msgr2=0x558dfaa69310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 -- 172.21.15.50:0/6701842 shutdown_connections 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 -- 172.21.15.50:0/6701842 wait complete. 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 Processor -- start 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 -- start start 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa75560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.414+0000 7fb43292d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558dfa983830 con 0x558dfa9789e0 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa75560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa75560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45244/0 (socket says 172.21.15.50:45244) 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb42e57f640 1 -- 172.21.15.50:0/3662927639 learned_addr learned my addr 172.21.15.50:0/3662927639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb42e57f640 1 -- 172.21.15.50:0/3662927639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dfaa75aa0 con 0x558dfa9789e0 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb42e57f640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa75560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb42000c010 tx=0x7fb420000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb31ae05640 1 -- 172.21.15.50:0/3662927639 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420012070 con 0x558dfa9789e0 2024-05-07T13:56:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb31ae05640 1 -- 172.21.15.50:0/3662927639 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42001a7a0 con 0x558dfa9789e0 2024-05-07T13:56:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dfaa75d30 con 0x558dfa9789e0 2024-05-07T13:56:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb31ae05640 1 -- 172.21.15.50:0/3662927639 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42001aa80 con 0x558dfa9789e0 2024-05-07T13:56:10.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.415+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dfaa789e0 con 0x558dfa9789e0 2024-05-07T13:56:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.416+0000 7fb31ae05640 1 -- 172.21.15.50:0/3662927639 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb420015020 con 0x558dfa9789e0 2024-05-07T13:56:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.416+0000 7fb31ae05640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb314036950 0x7fb314038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.416+0000 7fb31ae05640 1 -- 172.21.15.50:0/3662927639 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb420020070 con 0x558dfa9789e0 2024-05-07T13:56:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.417+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb314036950 0x7fb314038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.417+0000 7fb43292d800 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfa97a520 0x558dfaa7c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.417+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaa7cce0 con 0x558dfa97a520 2024-05-07T13:56:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.417+0000 7fb42ed80640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfa97a520 0x558dfaa7c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.417+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb314036950 0x7fb314038e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb424054000 tx=0x7fb42404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.417+0000 7fb42ed80640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfa97a520 0x558dfaa7c7a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.417+0000 7fb42ed80640 1 -- 172.21.15.50:0/3662927639 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfa97a520 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.417+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaa79d70 con 0x558dfa97a520 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.418+0000 7fb42ed80640 1 -- 172.21.15.50:0/3662927639 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfa97a520 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.418+0000 7fb43292d800 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaa7f030 0x558dfaa81420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.418+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaa81b10 con 0x558dfaa7f030 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.418+0000 7fb42e57f640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaa7f030 0x558dfaa81420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.418+0000 7fb42e57f640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaa7f030 0x558dfaa81420 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.418+0000 7fb42e57f640 1 -- 172.21.15.50:0/3662927639 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaa7f030 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.418+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaa7dfe0 con 0x558dfa97a520 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.419+0000 7fb42ed80640 1 -- 172.21.15.50:0/3662927639 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfa97a520 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.419+0000 7fb43292d800 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558dfaa82fc0 0x558dfaa85410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.419+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaa85b70 con 0x558dfaa82fc0 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.419+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558dfaa82fc0 0x558dfaa85410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.419+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558dfaa82fc0 0x558dfaa85410 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.420+0000 7fb42dd7e640 1 -- 172.21.15.50:0/3662927639 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb42405a040 con 0x558dfaa82fc0 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.420+0000 7fb43292d800 1 Processor -- start 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.420+0000 7fb43292d800 1 -- start start 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.420+0000 7fb43292d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaa93fd0 0x558dfaa943f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.420+0000 7fb43292d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558dfa86bcf0 con 0x558dfaa93fd0 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.420+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaa93fd0 0x558dfaa943f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.420+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaa93fd0 0x558dfaa943f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45252/0 (socket says 172.21.15.50:45252) 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.420+0000 7fb42e57f640 1 -- 172.21.15.50:0/3602409459 learned_addr learned my addr 172.21.15.50:0/3602409459 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.421+0000 7fb42e57f640 1 -- 172.21.15.50:0/3602409459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dfaa94930 con 0x558dfaa93fd0 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.421+0000 7fb42e57f640 1 --2- 172.21.15.50:0/3602409459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaa93fd0 0x558dfaa943f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb42004aa30 tx=0x7fb42004ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.421+0000 7fb313fff640 1 -- 172.21.15.50:0/3602409459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42004c3f0 con 0x558dfaa93fd0 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.421+0000 7fb313fff640 1 -- 172.21.15.50:0/3602409459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4200490e0 con 0x558dfaa93fd0 2024-05-07T13:56:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.421+0000 7fb43292d800 1 -- 172.21.15.50:0/3602409459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dfaa953a0 con 0x558dfaa93fd0 2024-05-07T13:56:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.421+0000 7fb313fff640 1 -- 172.21.15.50:0/3602409459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4200493c0 con 0x558dfaa93fd0 2024-05-07T13:56:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.421+0000 7fb43292d800 1 -- 172.21.15.50:0/3602409459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dfaa953a0 con 0x558dfaa93fd0 2024-05-07T13:56:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.422+0000 7fb313fff640 1 -- 172.21.15.50:0/3602409459 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb420044000 con 0x558dfaa93fd0 2024-05-07T13:56:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.422+0000 7fb313fff640 1 --2- 172.21.15.50:0/3602409459 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb308036900 0x7fb308038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.422+0000 7fb313fff640 1 -- 172.21.15.50:0/3602409459 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb42000a800 con 0x558dfaa93fd0 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.422+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/3602409459 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb308036900 0x7fb308038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.422+0000 7fb43292d800 1 Processor -- start 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.422+0000 7fb43292d800 1 -- start start 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.422+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/3602409459 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb308036900 0x7fb308038dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x558dfaa7d5e0 tx=0x7fb424005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.422+0000 7fb43292d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.422+0000 7fb43292d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558dfaa6e340 con 0x558dfaaa0f50 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.423+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.423+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45264/0 (socket says 172.21.15.50:45264) 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.423+0000 7fb42e57f640 1 -- 172.21.15.50:0/3033317242 learned_addr learned my addr 172.21.15.50:0/3033317242 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.423+0000 7fb42e57f640 1 -- 172.21.15.50:0/3033317242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dfaaa1940 con 0x558dfaaa0f50 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.423+0000 7fb42e57f640 1 --2- 172.21.15.50:0/3033317242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa1370 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb42004c5b0 tx=0x7fb420049560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd23c9227c48a15 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.423+0000 7fb311ffb640 1 -- 172.21.15.50:0/3033317242 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42003d070 con 0x558dfaaa0f50 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.423+0000 7fb311ffb640 1 -- 172.21.15.50:0/3033317242 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42005b070 con 0x558dfaaa0f50 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.423+0000 7fb311ffb640 1 -- 172.21.15.50:0/3033317242 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420044de0 con 0x558dfaaa0f50 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 -- 172.21.15.50:0/3033317242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 msgr2=0x558dfaaa1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 --2- 172.21.15.50:0/3033317242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa1370 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb42004c5b0 tx=0x7fb420049560 comp rx=0 tx=0).stop 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 -- 172.21.15.50:0/3033317242 shutdown_connections 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 --2- 172.21.15.50:0/3033317242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa1370 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 -- 172.21.15.50:0/3033317242 >> 172.21.15.50:0/3033317242 conn(0x558dfaa9d220 msgr2=0x558dfaa9b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 -- 172.21.15.50:0/3033317242 shutdown_connections 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 -- 172.21.15.50:0/3033317242 wait complete. 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 Processor -- start 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 -- start start 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb43292d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558dfaaa1fa0 con 0x558dfaaa0f50 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb42e57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45280/0 (socket says 172.21.15.50:45280) 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.424+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 learned_addr learned my addr 172.21.15.50:0/2124253807 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.425+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dfaaa8780 con 0x558dfaaa0f50 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.425+0000 7fb42e57f640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa8240 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4200497a0 tx=0x7fb42000a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.425+0000 7fb2fffff640 1 -- 172.21.15.50:0/2124253807 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4200442f0 con 0x558dfaaa0f50 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.425+0000 7fb2fffff640 1 -- 172.21.15.50:0/2124253807 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42000aad0 con 0x558dfaaa0f50 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.425+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558dfaaa8780 con 0x558dfaaa0f50 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.425+0000 7fb2fffff640 1 -- 172.21.15.50:0/2124253807 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420044490 con 0x558dfaaa0f50 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.425+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dfaaa8780 con 0x558dfaaa0f50 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.426+0000 7fb2fffff640 1 -- 172.21.15.50:0/2124253807 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb420055070 con 0x558dfaaa0f50 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.426+0000 7fb2fffff640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb2f8036950 0x7fb2f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.426+0000 7fb2fffff640 1 -- 172.21.15.50:0/2124253807 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb420052070 con 0x558dfaaa0f50 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.426+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb2f8036950 0x7fb2f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfaab3870 0x558dfaab5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab6480 con 0x558dfaab3870 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb42ed80640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfaab3870 0x558dfaab5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb2f8036950 0x7fb2f8038e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb424055040 tx=0x7fb424060040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb42ed80640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfaab3870 0x558dfaab5d30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 20 realm 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab6890 con 0x558dfaab3870 2024-05-07T13:56:10.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.427+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7160 con 0x558dfaab3870 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb43292d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab3870 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb43292d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb43292d800 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaab7ff0 0x558dfaaba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabab40 con 0x558dfaab7ff0 2024-05-07T13:56:10.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb42e57f640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaab7ff0 0x558dfaaba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.428+0000 7fb42e57f640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaab7ff0 0x558dfaaba3e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.429+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.429+0000 7fb43292d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.429+0000 7fb43292d800 20 searching for the correct realm 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.429+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabc510 con 0x558dfaab7ff0 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.429+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.429+0000 7fb42e57f640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb4200225a0 0x7fb42002e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.429+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabc510 con 0x7fb4200225a0 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.429+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb4200225a0 0x7fb42002e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.430+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb4200225a0 0x7fb42002e450 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.430+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.430+0000 7fb42dd7e640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb424081040 0x7fb424082940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.430+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabc510 con 0x7fb424081040 2024-05-07T13:56:10.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.430+0000 7fb42ed80640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb424081040 0x7fb424082940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.430+0000 7fb42ed80640 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb424081040 0x7fb424082940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.431+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.431+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab3870 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.431+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.431+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab3870 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.431+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.431+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb424081040 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.431+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.431+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb424081040 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.432+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.432+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb4200225a0 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.432+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.432+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab7ff0 2024-05-07T13:56:10.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.432+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.432+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab3870 2024-05-07T13:56:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.432+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.432+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb424081040 2024-05-07T13:56:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.433+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.433+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab3870 2024-05-07T13:56:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.433+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.433+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb4200225a0 2024-05-07T13:56:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.433+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.433+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab7ff0 2024-05-07T13:56:10.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.433+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.433+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab7ff0 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.434+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.434+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb424081040 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.434+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.434+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab7ff0 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.434+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.434+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab7ff0 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.434+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.434+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab3870 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.435+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.435+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab3870 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.435+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.435+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb424081040 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.435+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.435+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab7ff0 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.436+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.436+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb4200225a0 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.436+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.436+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab3870 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.436+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.436+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb424081040 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.437+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.437+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab7ff0 2024-05-07T13:56:10.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.437+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.437+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb424081040 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.437+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.437+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb4200225a0 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.437+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.437+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab7ff0 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.438+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.438+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb424081040 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.438+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.438+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x558dfaab3870 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.438+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.438+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558dfaab7500 con 0x7fb4200225a0 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabb4e0 con 0x558dfaab3870 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabb8d0 con 0x558dfaab3870 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.439+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabb8d0 con 0x7fb424081040 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 zone default found 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 4 Realm: () 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 zonegroup default 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabbcf0 con 0x7fb424081040 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabc110 con 0x558dfaab7ff0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabe3c0 con 0x558dfaab7ff0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 started sync module instance, tier type = 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.440+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabd860 con 0x7fb4200225a0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.441+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.442+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94068284314544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabe760 con 0x7fb4200225a0 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.442+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabf120 con 0x558dfaab3870 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.442+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94068284314544] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.443+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.443+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94068284320880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabf540 con 0x558dfaab3870 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.443+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabff00 con 0x558dfaab7ff0 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.444+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.444+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94068284324432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac07a0 con 0x558dfaab7ff0 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.444+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac1280 con 0x7fb4200225a0 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.444+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94068284320880] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.445+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.445+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94068284321936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac1b20 con 0x7fb4200225a0 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.445+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac24e0 con 0x558dfaab3870 2024-05-07T13:56:10.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.445+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94068284324432] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.446+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94068284321936] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.446+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.446+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94068284326640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac24e0 con 0x558dfaab3870 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.446+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac2d30 con 0x7fb424081040 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.447+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94068284326640] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.447+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.447+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94068284334608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac2b60 con 0x7fb424081040 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.447+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac3680 con 0x7fb424081040 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.448+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.448+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94068284338512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac3af0 con 0x7fb424081040 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.448+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac45c0 con 0x7fb424081040 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.448+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94068284334608] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94068284338512] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94068284342448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac3640 con 0x7fb424081040 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb43292d800 20 add_watcher() i=0 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb43292d800 20 add_watcher() i=1 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb43292d800 20 add_watcher() i=2 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb43292d800 20 add_watcher() i=3 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb43292d800 20 add_watcher() i=4 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb43292d800 20 add_watcher() i=5 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.449+0000 7fb43292d800 20 add_watcher() i=6 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.450+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94068284342448] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.450+0000 7fb43292d800 20 add_watcher() i=7 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.450+0000 7fb43292d800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.450+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac75b0 con 0x558dfaab3870 2024-05-07T13:56:10.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.451+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.451+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94068284335664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac4ad0 con 0x558dfaab3870 2024-05-07T13:56:10.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.451+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94068284335664] v27'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb2e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb43292d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb43292d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb43292d800 5 note: GC not initialized 2024-05-07T13:56:10.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb25f7fe640 20 reqs_thread_entry: start 2024-05-07T13:56:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb43292d800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb43292d800 20 Filter name: none 2024-05-07T13:56:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb25d7fa640 20 reqs_thread_entry: start 2024-05-07T13:56:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb43292d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.452+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558dfaafa550 con 0x558dfaab3870 2024-05-07T13:56:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.453+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.453+0000 7fb43292d800 20 rados_obj.operate() r=0 bl.length=556 2024-05-07T13:56:10.451 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:10.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.453+0000 7fb2e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.453+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94068284335664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaaf9100 con 0x558dfaab3870 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.454+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94068284335664] v27'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.454+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94068284314544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac2630 con 0x7fb4200225a0 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.455+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94068284314544] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.455+0000 7fb43292d800 20 remove_watcher() i=0 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.455+0000 7fb43292d800 2 removed watcher, disabling cache 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.455+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94068284320880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabd3b0 con 0x558dfaab3870 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.456+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94068284320880] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.456+0000 7fb43292d800 20 remove_watcher() i=1 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.456+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94068284324432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabd3b0 con 0x558dfaab7ff0 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.457+0000 7fb42e57f640 1 -- 172.21.15.50:0/2124253807 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94068284324432] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42002b070 con 0x558dfaab7ff0 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.457+0000 7fb43292d800 20 remove_watcher() i=2 2024-05-07T13:56:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.457+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94068284321936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabd3b0 con 0x7fb4200225a0 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.458+0000 7fb42dd7e640 1 -- 172.21.15.50:0/2124253807 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94068284321936] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424070070 con 0x7fb4200225a0 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.458+0000 7fb43292d800 20 remove_watcher() i=3 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.458+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94068284326640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabd3b0 con 0x558dfaab3870 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.459+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94068284326640] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x558dfaab3870 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.459+0000 7fb43292d800 20 remove_watcher() i=4 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.459+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94068284334608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabd3b0 con 0x7fb424081040 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.460+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94068284334608] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.460+0000 7fb43292d800 20 remove_watcher() i=5 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.460+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94068284338512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaabd3b0 con 0x7fb424081040 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.461+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94068284338512] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.461+0000 7fb43292d800 20 remove_watcher() i=6 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.461+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94068284342448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558dfaac3150 con 0x7fb424081040 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94068284342448] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42800a4a0 con 0x7fb424081040 2024-05-07T13:56:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 20 remove_watcher() i=7 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb424081040 msgr2=0x7fb424082940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb424081040 0x7fb424082940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfaab3870 msgr2=0x558dfaab5d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfaab3870 0x558dfaab5d30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb4200225a0 msgr2=0x7fb42002e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb4200225a0 0x7fb42002e450 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaab7ff0 msgr2=0x558dfaaba3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaab7ff0 0x558dfaaba3e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb2f8036950 msgr2=0x7fb2f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb2f8036950 0x7fb2f8038e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb424055040 tx=0x7fb424060040 comp rx=0 tx=0).stop 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 msgr2=0x558dfaaa8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb43292d800 1 --2- 172.21.15.50:0/2124253807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaaa0f50 0x558dfaaa8240 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4200497a0 tx=0x7fb42000a4d0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 reap_dead start 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.462+0000 7fb42ed80640 1 -- 172.21.15.50:0/2124253807 reap_dead start 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 shutdown_connections 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 >> 172.21.15.50:0/2124253807 conn(0x558dfaa9d220 msgr2=0x558dfaa9a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 shutdown_connections 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/2124253807 wait complete. 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3602409459 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb308036900 msgr2=0x7fb308038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 --2- 172.21.15.50:0/3602409459 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb308036900 0x7fb308038dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x558dfaa7d5e0 tx=0x7fb424005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3602409459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaa93fd0 msgr2=0x558dfaa943f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 --2- 172.21.15.50:0/3602409459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaa93fd0 0x558dfaa943f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb42004aa30 tx=0x7fb42004ac30 comp rx=0 tx=0).stop 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3602409459 shutdown_connections 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 --2- 172.21.15.50:0/3602409459 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb308036900 0x7fb308038dc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 --2- 172.21.15.50:0/3602409459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfaa93fd0 0x558dfaa943f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3602409459 >> 172.21.15.50:0/3602409459 conn(0x558dfaa88070 msgr2=0x558dfaa88470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3602409459 shutdown_connections 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3602409459 wait complete. 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558dfaa82fc0 msgr2=0x558dfaa85410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558dfaa82fc0 0x558dfaa85410 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfa97a520 msgr2=0x558dfaa7c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558dfa97a520 0x558dfaa7c7a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaa7f030 msgr2=0x558dfaa81420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558dfaa7f030 0x558dfaa81420 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb314036950 msgr2=0x7fb314038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.463+0000 7fb43292d800 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb314036950 0x7fb314038e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb424054000 tx=0x7fb42404e000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.464+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 msgr2=0x558dfaa75560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.464+0000 7fb43292d800 1 --2- 172.21.15.50:0/3662927639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dfa9789e0 0x558dfaa75560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb42000c010 tx=0x7fb420000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.464+0000 7fb42ed80640 1 -- 172.21.15.50:0/3662927639 reap_dead start 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.464+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 shutdown_connections 2024-05-07T13:56:10.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.464+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 >> 172.21.15.50:0/3662927639 conn(0x558dfa974560 msgr2=0x558dfaa67b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.464+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 shutdown_connections 2024-05-07T13:56:10.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.464+0000 7fb43292d800 1 -- 172.21.15.50:0/3662927639 wait complete. 2024-05-07T13:56:10.463 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:10.463 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-07T13:56:10.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-07T13:56:10.463 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-07T13:56:10.508 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:10.509 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6eab135800 1 Processor -- start 2024-05-07T13:56:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6eab135800 1 -- start start 2024-05-07T13:56:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6eab135800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x560e3e587a10 0x560e3e587e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6eab135800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e3e4fc1b0 con 0x560e3e588370 2024-05-07T13:56:10.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6eab135800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x560e3e41a050 con 0x560e3e587a10 2024-05-07T13:56:10.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6ea6ef9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x560e3e587a10 0x560e3e587e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6ea66f8640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x560e3e588370 0x560e3e588820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39630/0 (socket says 172.21.15.50:39630) 2024-05-07T13:56:10.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1876484448 learned_addr learned my addr 172.21.15.50:0/1876484448 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:10.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1876484448 >> v1:172.21.15.22:6789/0 conn(0x560e3e588370 legacy=0x560e3e588820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.521+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1876484448 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3e588f30 con 0x560e3e587a10 2024-05-07T13:56:10.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.523+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/1876484448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e587e30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800a470 tx=0x7f6e9801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a67ef66718e5c85 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6ea5ef7640 1 -- 172.21.15.50:0/1876484448 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98057070 con 0x560e3e587a10 2024-05-07T13:56:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6ea5ef7640 1 -- 172.21.15.50:0/1876484448 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e98052570 con 0x560e3e587a10 2024-05-07T13:56:10.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6ea5ef7640 1 -- 172.21.15.50:0/1876484448 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98052870 con 0x560e3e587a10 2024-05-07T13:56:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6eab135800 1 -- 172.21.15.50:0/1876484448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 msgr2=0x560e3e587e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6eab135800 1 --2- 172.21.15.50:0/1876484448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e587e30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800a470 tx=0x7f6e9801ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6eab135800 1 -- 172.21.15.50:0/1876484448 shutdown_connections 2024-05-07T13:56:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6eab135800 1 --2- 172.21.15.50:0/1876484448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e587e30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6eab135800 1 -- 172.21.15.50:0/1876484448 >> 172.21.15.50:0/1876484448 conn(0x560e3e5835b0 msgr2=0x560e3e5859d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6eab135800 1 -- 172.21.15.50:0/1876484448 shutdown_connections 2024-05-07T13:56:10.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.524+0000 7f6eab135800 1 -- 172.21.15.50:0/1876484448 wait complete. 2024-05-07T13:56:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.539+0000 7f6eab135800 1 Processor -- start 2024-05-07T13:56:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.539+0000 7f6eab135800 1 -- start start 2024-05-07T13:56:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.540+0000 7f6eab135800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e67cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.540+0000 7f6eab135800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560e3e4d41d0 con 0x560e3e587a10 2024-05-07T13:56:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.540+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e67cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.540+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e67cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45310/0 (socket says 172.21.15.50:45310) 2024-05-07T13:56:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.540+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/3512793245 learned_addr learned my addr 172.21.15.50:0/3512793245 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.540+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/3512793245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3e67d120 con 0x560e3e587a10 2024-05-07T13:56:10.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.540+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/3512793245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e67cb50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e98055040 tx=0x7f6e9804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b37646b36800c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6d94e09640 1 -- 172.21.15.50:0/3512793245 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98057040 con 0x560e3e587a10 2024-05-07T13:56:10.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6d94e09640 1 -- 172.21.15.50:0/3512793245 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e98052990 con 0x560e3e587a10 2024-05-07T13:56:10.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6d94e09640 1 -- 172.21.15.50:0/3512793245 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98052c70 con 0x560e3e587a10 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6eab135800 1 -- 172.21.15.50:0/3512793245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 msgr2=0x560e3e67cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6eab135800 1 --2- 172.21.15.50:0/3512793245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e67cb50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e98055040 tx=0x7f6e9804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6eab135800 1 -- 172.21.15.50:0/3512793245 shutdown_connections 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6eab135800 1 --2- 172.21.15.50:0/3512793245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e67cb50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6eab135800 1 -- 172.21.15.50:0/3512793245 >> 172.21.15.50:0/3512793245 conn(0x560e3e5835b0 msgr2=0x560e3e678470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6eab135800 1 -- 172.21.15.50:0/3512793245 shutdown_connections 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.541+0000 7f6eab135800 1 -- 172.21.15.50:0/3512793245 wait complete. 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.542+0000 7f6eab135800 1 Processor -- start 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.542+0000 7f6eab135800 1 -- start start 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.542+0000 7f6eab135800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e6845d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.542+0000 7f6eab135800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560e3e589460 con 0x560e3e587a10 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.542+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e6845d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.542+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e6845d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45316/0 (socket says 172.21.15.50:45316) 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.542+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/3752235383 learned_addr learned my addr 172.21.15.50:0/3752235383 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.542+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/3752235383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3e684b10 con 0x560e3e587a10 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.542+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e6845d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800a470 tx=0x7f6e98003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.543+0000 7f6d93606640 1 -- 172.21.15.50:0/3752235383 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98073070 con 0x560e3e587a10 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.543+0000 7f6d93606640 1 -- 172.21.15.50:0/3752235383 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9805d650 con 0x560e3e587a10 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.543+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e3e684da0 con 0x560e3e587a10 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.543+0000 7f6d93606640 1 -- 172.21.15.50:0/3752235383 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98057070 con 0x560e3e587a10 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.543+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3e687a50 con 0x560e3e587a10 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.543+0000 7f6d93606640 1 -- 172.21.15.50:0/3752235383 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e98076070 con 0x560e3e587a10 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.544+0000 7f6d93606640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d8c036900 0x7f6d8c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.544+0000 7f6d93606640 1 -- 172.21.15.50:0/3752235383 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6e9808e010 con 0x560e3e587a10 2024-05-07T13:56:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.544+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d8c036900 0x7f6d8c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.544+0000 7f6eab135800 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e588370 0x560e3e68b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.544+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e68bd50 con 0x560e3e588370 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.544+0000 7f6ea76fa640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e588370 0x560e3e68b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.544+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d8c036900 0x7f6d8c038dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c000f60 tx=0x7f6e9c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.544+0000 7f6ea76fa640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e588370 0x560e3e68b810 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.545+0000 7f6ea76fa640 1 -- 172.21.15.50:0/3752235383 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e588370 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.545+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e688de0 con 0x560e3e588370 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.545+0000 7f6ea76fa640 1 -- 172.21.15.50:0/3752235383 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e588370 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.545+0000 7f6eab135800 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e68e080 0x560e3e690470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.545+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e690b60 con 0x560e3e68e080 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.545+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e68e080 0x560e3e690470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.545+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e68e080 0x560e3e690470 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.546+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/3752235383 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e98075030 con 0x560e3e68e080 2024-05-07T13:56:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.546+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e68d030 con 0x560e3e588370 2024-05-07T13:56:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.546+0000 7f6ea76fa640 1 -- 172.21.15.50:0/3752235383 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e588370 2024-05-07T13:56:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.546+0000 7f6eab135800 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x560e3e692010 0x560e3e694460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.546+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e694bc0 con 0x560e3e692010 2024-05-07T13:56:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.546+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x560e3e692010 0x560e3e694460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.546+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x560e3e692010 0x560e3e694460 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.547+0000 7f6ea66f8640 1 -- 172.21.15.50:0/3752235383 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e9c009050 con 0x560e3e692010 2024-05-07T13:56:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.547+0000 7f6eab135800 1 Processor -- start 2024-05-07T13:56:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.547+0000 7f6eab135800 1 -- start start 2024-05-07T13:56:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.547+0000 7f6eab135800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6a3020 0x560e3e6a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.547+0000 7f6eab135800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560e3e47acf0 con 0x560e3e6a3020 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6a3020 0x560e3e6a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6a3020 0x560e3e6a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45328/0 (socket says 172.21.15.50:45328) 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1075669443 learned_addr learned my addr 172.21.15.50:0/1075669443 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1075669443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3e6a3980 con 0x560e3e6a3020 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/1075669443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6a3020 0x560e3e6a3440 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6e98066fd0 tx=0x7f6e9805cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6d90e01640 1 -- 172.21.15.50:0/1075669443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98006950 con 0x560e3e6a3020 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6d90e01640 1 -- 172.21.15.50:0/1075669443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9805ea70 con 0x560e3e6a3020 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6eab135800 1 -- 172.21.15.50:0/1075669443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e3e6a43f0 con 0x560e3e6a3020 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6d90e01640 1 -- 172.21.15.50:0/1075669443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9805ed50 con 0x560e3e6a3020 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.548+0000 7f6eab135800 1 -- 172.21.15.50:0/1075669443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3e6a48f0 con 0x560e3e6a3020 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.549+0000 7f6d90e01640 1 -- 172.21.15.50:0/1075669443 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e980773b0 con 0x560e3e6a3020 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.549+0000 7f6d90e01640 1 --2- 172.21.15.50:0/1075669443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d80036900 0x7f6d80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.549+0000 7f6d90e01640 1 -- 172.21.15.50:0/1075669443 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6e98085040 con 0x560e3e6a3020 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.549+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/1075669443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d80036900 0x7f6d80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.549+0000 7f6eab135800 1 Processor -- start 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.550+0000 7f6eab135800 1 -- start start 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.550+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/1075669443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d80036900 0x7f6d80038dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00bf50 tx=0x7f6e9c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.550+0000 7f6eab135800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.550+0000 7f6eab135800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560e3e67d3e0 con 0x560e3e6b00b0 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.550+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.550+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45334/0 (socket says 172.21.15.50:45334) 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.550+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1067973067 learned_addr learned my addr 172.21.15.50:0/1067973067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.550+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1067973067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3e6b0aa0 con 0x560e3e6b00b0 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.550+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/1067973067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b04d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e98052d20 tx=0x7f6e98091ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ba46a818031ed3 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6d8a7fc640 1 -- 172.21.15.50:0/1067973067 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9808c8a0 con 0x560e3e6b00b0 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6d8a7fc640 1 -- 172.21.15.50:0/1067973067 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e980a9070 con 0x560e3e6b00b0 2024-05-07T13:56:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6d8a7fc640 1 -- 172.21.15.50:0/1067973067 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9805dd30 con 0x560e3e6b00b0 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6eab135800 1 -- 172.21.15.50:0/1067973067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 msgr2=0x560e3e6b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6eab135800 1 --2- 172.21.15.50:0/1067973067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b04d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e98052d20 tx=0x7f6e98091ef0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6eab135800 1 -- 172.21.15.50:0/1067973067 shutdown_connections 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6eab135800 1 --2- 172.21.15.50:0/1067973067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b04d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6eab135800 1 -- 172.21.15.50:0/1067973067 >> 172.21.15.50:0/1067973067 conn(0x560e3e6ac410 msgr2=0x560e3e6aa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6eab135800 1 -- 172.21.15.50:0/1067973067 shutdown_connections 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6eab135800 1 -- 172.21.15.50:0/1067973067 wait complete. 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6eab135800 1 Processor -- start 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.551+0000 7f6eab135800 1 -- start start 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6eab135800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6eab135800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560e3e6b1150 con 0x560e3e6b00b0 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6ea6ef9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45344/0 (socket says 172.21.15.50:45344) 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 learned_addr learned my addr 172.21.15.50:0/1734475937 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3e6b7990 con 0x560e3e6b00b0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b7450 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e98002260 tx=0x7f6e98051f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6d88ff9640 1 -- 172.21.15.50:0/1734475937 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e980bb070 con 0x560e3e6b00b0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6d88ff9640 1 -- 172.21.15.50:0/1734475937 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e98078bd0 con 0x560e3e6b00b0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.552+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e3e6b7990 con 0x560e3e6b00b0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.553+0000 7f6d88ff9640 1 -- 172.21.15.50:0/1734475937 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9808ac90 con 0x560e3e6b00b0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.553+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3e6b7990 con 0x560e3e6b00b0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.553+0000 7f6d88ff9640 1 -- 172.21.15.50:0/1734475937 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e980be070 con 0x560e3e6b00b0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.553+0000 7f6d88ff9640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d70036950 0x7f6d70038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.553+0000 7f6d88ff9640 1 -- 172.21.15.50:0/1734475937 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6e980b3070 con 0x560e3e6b00b0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.554+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d70036950 0x7f6d70038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.554+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.554+0000 7f6eab135800 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e6c2b30 0x560e3e6c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.554+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c5740 con 0x560e3e6c2b30 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.554+0000 7f6ea76fa640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e6c2b30 0x560e3e6c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.554+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d70036950 0x7f6d70038e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001b60 tx=0x7f6e9c010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.554+0000 7f6ea76fa640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e6c2b30 0x560e3e6c4ff0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 20 realm 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c5b50 con 0x560e3e6c2b30 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c6420 con 0x560e3e6c2b30 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c2b30 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e6c72b0 0x560e3e6c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c9e00 con 0x560e3e6c72b0 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.555+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e6c72b0 0x560e3e6c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.556+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e6c72b0 0x560e3e6c96a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.556+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.556+0000 7f6eab135800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.556+0000 7f6eab135800 20 searching for the correct realm 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.556+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cb7d0 con 0x560e3e6c72b0 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.557+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.557+0000 7f6ea6ef9640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e980c0060 0x7f6e9809f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.557+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cb7d0 con 0x7f6e980c0060 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.557+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e980c0060 0x7f6e9809f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.557+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e980c0060 0x7f6e9809f1d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.557+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9c009050 con 0x7f6e980c0060 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.557+0000 7f6ea66f8640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e9c038040 0x7f6e9c01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.557+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cb7d0 con 0x7f6e9c038040 2024-05-07T13:56:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.558+0000 7f6ea76fa640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e9c038040 0x7f6e9c01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.558+0000 7f6ea76fa640 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e9c038040 0x7f6e9c01bab0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.558+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.558+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c2b30 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.558+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.558+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c2b30 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.559+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.559+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e9c038040 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.559+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.559+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e9c038040 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.559+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.559+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e980c0060 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.560+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9c009050 con 0x7f6e980c0060 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.560+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c72b0 2024-05-07T13:56:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.560+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.560+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c2b30 2024-05-07T13:56:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.560+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.560+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e9c038040 2024-05-07T13:56:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.560+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.560+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c2b30 2024-05-07T13:56:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.561+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.561+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e980c0060 2024-05-07T13:56:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.561+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e9c009050 con 0x7f6e980c0060 2024-05-07T13:56:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.561+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c72b0 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.561+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.561+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c72b0 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.561+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.561+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e9c038040 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.562+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.562+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c72b0 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.562+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.562+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c72b0 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.562+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.562+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c2b30 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.562+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.562+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c2b30 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.563+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.563+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e9c038040 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.563+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.563+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c72b0 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.563+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.563+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e980c0060 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.564+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9c009050 con 0x7f6e980c0060 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.564+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c2b30 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.564+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.564+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e9c038040 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.564+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.564+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c72b0 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.565+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.565+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e9c038040 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.565+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.565+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e980c0060 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.565+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9c009050 con 0x7f6e980c0060 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.565+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c72b0 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.565+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.565+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e9c038040 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x560e3e6c2b30 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6c67c0 con 0x7f6e980c0060 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e9c045040 con 0x7f6e980c0060 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ca7a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.566+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cab90 con 0x560e3e6c2b30 2024-05-07T13:56:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.567+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.567+0000 7f6eab135800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.567+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.567+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cab90 con 0x7f6e9c038040 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.567+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 zone default found 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 4 Realm: () 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 zonegroup default 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cafb0 con 0x7f6e9c038040 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cb3d0 con 0x560e3e6c72b0 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cd680 con 0x560e3e6c72b0 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 started sync module instance, tier type = 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.568+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ccb20 con 0x7f6e980c0060 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.569+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9c045040 con 0x7f6e980c0060 2024-05-07T13:56:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.569+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94619176849216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cded0 con 0x7f6e980c0060 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.569+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ce720 con 0x560e3e6c2b30 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.570+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94619176849216] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9c045040 con 0x7f6e980c0060 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.571+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.571+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94619176854128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ceb40 con 0x560e3e6c2b30 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.571+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cf390 con 0x560e3e6c72b0 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.572+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.572+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94619176856864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6cfbe0 con 0x560e3e6c72b0 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.572+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d0690 con 0x7f6e980c0060 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.572+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94619176854128] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.573+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94619176856864] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.573+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9c045040 con 0x7f6e980c0060 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.573+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94619176855184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d0ab0 con 0x7f6e980c0060 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.573+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d1340 con 0x560e3e6c2b30 2024-05-07T13:56:10.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.574+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94619176855184] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9c045040 con 0x7f6e980c0060 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.574+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.574+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94619176862112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d1730 con 0x560e3e6c2b30 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.574+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d21a0 con 0x7f6e9c038040 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.575+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94619176862112] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.575+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.575+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94619176868976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d2160 con 0x7f6e9c038040 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.575+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d2bb0 con 0x7f6e9c038040 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.576+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94619176868976] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.576+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.576+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94619176865360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d2bb0 con 0x7f6e9c038040 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.576+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d2bb0 con 0x7f6e9c038040 2024-05-07T13:56:10.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94619176865360] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94619176871680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d3750 con 0x7f6e9c038040 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6eab135800 20 add_watcher() i=0 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6eab135800 20 add_watcher() i=1 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6eab135800 20 add_watcher() i=2 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6eab135800 20 add_watcher() i=3 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6eab135800 20 add_watcher() i=4 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6eab135800 20 add_watcher() i=5 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.577+0000 7f6eab135800 20 add_watcher() i=6 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.578+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94619176871680] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.578+0000 7f6eab135800 20 add_watcher() i=7 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.578+0000 7f6eab135800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.578+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d6900 con 0x560e3e6c2b30 2024-05-07T13:56:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.578+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.578+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94619176886928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d36a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94619176886928] v27'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6d5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6eab135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6eab135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6eab135800 5 note: GC not initialized 2024-05-07T13:56:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6cd7fff640 20 reqs_thread_entry: start 2024-05-07T13:56:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6eab135800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6eab135800 20 Filter name: none 2024-05-07T13:56:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6cd5ffb640 20 reqs_thread_entry: start 2024-05-07T13:56:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6eab135800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.580+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560e3e709950 con 0x560e3e6c2b30 2024-05-07T13:56:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.581+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.581+0000 7f6eab135800 20 rados_obj.operate() r=0 bl.length=556 2024-05-07T13:56:10.579 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:10.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.582+0000 7f6d5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.582+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94619176886928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e708520 con 0x560e3e6c2b30 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.583+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94619176886928] v27'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.583+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94619176849216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d6290 con 0x7f6e980c0060 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.584+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94619176849216] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9c045040 con 0x7f6e980c0060 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.584+0000 7f6eab135800 20 remove_watcher() i=0 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.584+0000 7f6eab135800 2 removed watcher, disabling cache 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.584+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94619176854128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ccf40 con 0x560e3e6c2b30 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.585+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94619176854128] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.585+0000 7f6eab135800 20 remove_watcher() i=1 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.585+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94619176856864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ccf40 con 0x560e3e6c72b0 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.586+0000 7f6ea6ef9640 1 -- 172.21.15.50:0/1734475937 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94619176856864] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e980bd030 con 0x560e3e6c72b0 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.586+0000 7f6eab135800 20 remove_watcher() i=2 2024-05-07T13:56:10.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.586+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94619176855184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ccf40 con 0x7f6e980c0060 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.587+0000 7f6ea66f8640 1 -- 172.21.15.50:0/1734475937 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94619176855184] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e9c045040 con 0x7f6e980c0060 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.587+0000 7f6eab135800 20 remove_watcher() i=3 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.587+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94619176862112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ce720 con 0x560e3e6c2b30 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.588+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94619176862112] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x560e3e6c2b30 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.588+0000 7f6eab135800 20 remove_watcher() i=4 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.588+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94619176868976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ccf40 con 0x7f6e9c038040 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.589+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94619176868976] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.589+0000 7f6eab135800 20 remove_watcher() i=5 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.589+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94619176865360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6ccf40 con 0x7f6e9c038040 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.590+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94619176865360] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.590+0000 7f6eab135800 20 remove_watcher() i=6 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.590+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94619176871680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560e3e6d0e50 con 0x7f6e9c038040 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94619176871680] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ea000a4a0 con 0x7f6e9c038040 2024-05-07T13:56:10.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 20 remove_watcher() i=7 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e9c038040 msgr2=0x7f6e9c01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e9c038040 0x7f6e9c01bab0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e6c2b30 msgr2=0x560e3e6c4ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e6c2b30 0x560e3e6c4ff0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e980c0060 msgr2=0x7f6e9809f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e980c0060 0x7f6e9809f1d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e6c72b0 msgr2=0x560e3e6c96a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e6c72b0 0x560e3e6c96a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d70036950 msgr2=0x7f6d70038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d70036950 0x7f6d70038e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001b60 tx=0x7f6e9c010000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 msgr2=0x560e3e6b7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6ea76fa640 1 -- 172.21.15.50:0/1734475937 reap_dead start 2024-05-07T13:56:10.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b7450 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e98002260 tx=0x7f6e98051f80 comp rx=0 tx=0).stop 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.591+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 shutdown_connections 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/1734475937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6b00b0 0x560e3e6b7450 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 >> 172.21.15.50:0/1734475937 conn(0x560e3e6ac410 msgr2=0x560e3e6a9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 shutdown_connections 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/1734475937 wait complete. 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/1075669443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d80036900 msgr2=0x7f6d80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/1075669443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d80036900 0x7f6d80038dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00bf50 tx=0x7f6e9c00f000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/1075669443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6a3020 msgr2=0x560e3e6a3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/1075669443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6a3020 0x560e3e6a3440 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6e98066fd0 tx=0x7f6e9805cef0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/1075669443 shutdown_connections 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/1075669443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d80036900 0x7f6d80038dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/1075669443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e6a3020 0x560e3e6a3440 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/1075669443 >> 172.21.15.50:0/1075669443 conn(0x560e3e6970c0 msgr2=0x560e3e6974c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/1075669443 shutdown_connections 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/1075669443 wait complete. 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x560e3e692010 msgr2=0x560e3e694460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x560e3e692010 0x560e3e694460 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e588370 msgr2=0x560e3e68b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x560e3e588370 0x560e3e68b810 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e68e080 msgr2=0x560e3e690470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x560e3e68e080 0x560e3e690470 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d8c036900 msgr2=0x7f6d8c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d8c036900 0x7f6d8c038dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c000f60 tx=0x7f6e9c0012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 msgr2=0x560e3e6845d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6eab135800 1 --2- 172.21.15.50:0/3752235383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e3e587a10 0x560e3e6845d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800a470 tx=0x7f6e98003020 comp rx=0 tx=0).stop 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.592+0000 7f6ea76fa640 1 -- 172.21.15.50:0/3752235383 reap_dead start 2024-05-07T13:56:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.593+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 shutdown_connections 2024-05-07T13:56:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.593+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 >> 172.21.15.50:0/3752235383 conn(0x560e3e5835b0 msgr2=0x560e3e676c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.593+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 shutdown_connections 2024-05-07T13:56:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.593+0000 7f6eab135800 1 -- 172.21.15.50:0/3752235383 wait complete. 2024-05-07T13:56:10.591 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:10.591 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-07T13:56:10.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-07T13:56:10.591 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-05-07T13:56:10.641 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:10.641 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:10.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.653+0000 7fdeda616800 1 Processor -- start 2024-05-07T13:56:10.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.653+0000 7fdeda616800 1 -- start start 2024-05-07T13:56:10.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.653+0000 7fdeda616800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x564442b9c160 0x564442b9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.653+0000 7fdeda616800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564442b9cc00 con 0x564442b9d370 2024-05-07T13:56:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.653+0000 7fdeda616800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x564442a2d050 con 0x564442b9c160 2024-05-07T13:56:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.654+0000 7fded5c84640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x564442b9c160 0x564442b9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.654+0000 7fded5483640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x564442b9d370 0x564442b9d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39636/0 (socket says 172.21.15.50:39636) 2024-05-07T13:56:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.654+0000 7fded5483640 1 -- 172.21.15.50:0/2872481269 learned_addr learned my addr 172.21.15.50:0/2872481269 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.654+0000 7fded5c84640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x564442b9c160 0x564442b9c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45358/0 (socket says 172.21.15.50:45358) 2024-05-07T13:56:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.654+0000 7fded5c84640 1 -- 172.21.15.50:0/2872481269 >> v1:172.21.15.22:6789/0 conn(0x564442b9d370 legacy=0x564442b9d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.654+0000 7fded5c84640 1 -- 172.21.15.50:0/2872481269 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564442b9df30 con 0x564442b9c160 2024-05-07T13:56:10.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fded5c84640 1 --2- 172.21.15.50:0/2872481269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442b9c580 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdec800a470 tx=0x7fdec801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c79b196e118f00 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fded4c82640 1 -- 172.21.15.50:0/2872481269 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec8057070 con 0x564442b9c160 2024-05-07T13:56:10.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fded4c82640 1 -- 172.21.15.50:0/2872481269 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec804adc0 con 0x564442b9c160 2024-05-07T13:56:10.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fded4c82640 1 -- 172.21.15.50:0/2872481269 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec8052590 con 0x564442b9c160 2024-05-07T13:56:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fdeda616800 1 -- 172.21.15.50:0/2872481269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 msgr2=0x564442b9c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fdeda616800 1 --2- 172.21.15.50:0/2872481269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442b9c580 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdec800a470 tx=0x7fdec801ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fdeda616800 1 -- 172.21.15.50:0/2872481269 shutdown_connections 2024-05-07T13:56:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fdeda616800 1 --2- 172.21.15.50:0/2872481269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442b9c580 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fdeda616800 1 -- 172.21.15.50:0/2872481269 >> 172.21.15.50:0/2872481269 conn(0x564442b977a0 msgr2=0x564442b99bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fdeda616800 1 -- 172.21.15.50:0/2872481269 shutdown_connections 2024-05-07T13:56:10.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.656+0000 7fdeda616800 1 -- 172.21.15.50:0/2872481269 wait complete. 2024-05-07T13:56:10.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.671+0000 7fdeda616800 1 Processor -- start 2024-05-07T13:56:10.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.671+0000 7fdeda616800 1 -- start start 2024-05-07T13:56:10.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.672+0000 7fdeda616800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c8d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.672+0000 7fdeda616800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564442ae71f0 con 0x564442b9c160 2024-05-07T13:56:10.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.672+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c8d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.672+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c8d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45372/0 (socket says 172.21.15.50:45372) 2024-05-07T13:56:10.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.672+0000 7fded5c84640 1 -- 172.21.15.50:0/1588110599 learned_addr learned my addr 172.21.15.50:0/1588110599 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.672+0000 7fded5c84640 1 -- 172.21.15.50:0/1588110599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564442c8de40 con 0x564442b9c160 2024-05-07T13:56:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.672+0000 7fded5c84640 1 --2- 172.21.15.50:0/1588110599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c8d870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdec8055040 tx=0x7fdec804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be36749ad977a1f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fddc3e07640 1 -- 172.21.15.50:0/1588110599 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec8057040 con 0x564442b9c160 2024-05-07T13:56:10.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fddc3e07640 1 -- 172.21.15.50:0/1588110599 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec8063070 con 0x564442b9c160 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fddc3e07640 1 -- 172.21.15.50:0/1588110599 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec805d790 con 0x564442b9c160 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fdeda616800 1 -- 172.21.15.50:0/1588110599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 msgr2=0x564442c8d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fdeda616800 1 --2- 172.21.15.50:0/1588110599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c8d870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdec8055040 tx=0x7fdec804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fdeda616800 1 -- 172.21.15.50:0/1588110599 shutdown_connections 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fdeda616800 1 --2- 172.21.15.50:0/1588110599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c8d870 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fdeda616800 1 -- 172.21.15.50:0/1588110599 >> 172.21.15.50:0/1588110599 conn(0x564442b977a0 msgr2=0x564442c89190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fdeda616800 1 -- 172.21.15.50:0/1588110599 shutdown_connections 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.673+0000 7fdeda616800 1 -- 172.21.15.50:0/1588110599 wait complete. 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.674+0000 7fdeda616800 1 Processor -- start 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.674+0000 7fdeda616800 1 -- start start 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.674+0000 7fdeda616800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c95300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.674+0000 7fdeda616800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564442ba5840 con 0x564442b9c160 2024-05-07T13:56:10.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.674+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c95300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.674+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c95300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45380/0 (socket says 172.21.15.50:45380) 2024-05-07T13:56:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.674+0000 7fded5c84640 1 -- 172.21.15.50:0/3279387222 learned_addr learned my addr 172.21.15.50:0/3279387222 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.674+0000 7fded5c84640 1 -- 172.21.15.50:0/3279387222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564442c95840 con 0x564442b9c160 2024-05-07T13:56:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.675+0000 7fded5c84640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c95300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdec800a470 tx=0x7fdec8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.675+0000 7fddc2604640 1 -- 172.21.15.50:0/3279387222 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec8057050 con 0x564442b9c160 2024-05-07T13:56:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.675+0000 7fddc2604640 1 -- 172.21.15.50:0/3279387222 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec805dc90 con 0x564442b9c160 2024-05-07T13:56:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.675+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564442c95ad0 con 0x564442b9c160 2024-05-07T13:56:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.675+0000 7fddc2604640 1 -- 172.21.15.50:0/3279387222 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec8052440 con 0x564442b9c160 2024-05-07T13:56:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.675+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564442c98780 con 0x564442b9c160 2024-05-07T13:56:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.676+0000 7fddc2604640 1 -- 172.21.15.50:0/3279387222 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdec80525e0 con 0x564442b9c160 2024-05-07T13:56:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.676+0000 7fddc2604640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddbc036950 0x7fddbc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.676+0000 7fddc2604640 1 -- 172.21.15.50:0/3279387222 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdec808dba0 con 0x564442b9c160 2024-05-07T13:56:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.676+0000 7fded5483640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddbc036950 0x7fddbc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.676+0000 7fdeda616800 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442b9d370 0x564442c9c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.676+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442c9cac0 con 0x564442b9d370 2024-05-07T13:56:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.676+0000 7fded6485640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442b9d370 0x564442c9c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.676+0000 7fded5483640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddbc036950 0x7fddbc038e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdecc000f60 tx=0x7fdecc0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.676+0000 7fded6485640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442b9d370 0x564442c9c540 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.677+0000 7fded6485640 1 -- 172.21.15.50:0/3279387222 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fded000a4a0 con 0x564442b9d370 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.677+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442c99b10 con 0x564442b9d370 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.677+0000 7fded6485640 1 -- 172.21.15.50:0/3279387222 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fded000a4a0 con 0x564442b9d370 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.677+0000 7fdeda616800 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442c9edd0 0x564442ca11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.677+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442ca18b0 con 0x564442c9edd0 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.677+0000 7fded5c84640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442c9edd0 0x564442ca11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.677+0000 7fded5c84640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442c9edd0 0x564442ca11c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.678+0000 7fded5c84640 1 -- 172.21.15.50:0/3279387222 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdec8078070 con 0x564442c9edd0 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.678+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442c9dd80 con 0x564442b9d370 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.678+0000 7fded6485640 1 -- 172.21.15.50:0/3279387222 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fded000a4a0 con 0x564442b9d370 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.678+0000 7fdeda616800 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564442ca2d60 0x564442ca51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.678+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442ca5910 con 0x564442ca2d60 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.679+0000 7fded5483640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564442ca2d60 0x564442ca51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.679+0000 7fded5483640 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564442ca2d60 0x564442ca51b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.679+0000 7fded5483640 1 -- 172.21.15.50:0/3279387222 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdecc009050 con 0x564442ca2d60 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.679+0000 7fdeda616800 1 Processor -- start 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fdeda616800 1 -- start start 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fdeda616800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b11a90 0x564442b0ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fdeda616800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564442a8dcf0 con 0x564442b11a90 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b11a90 0x564442b0ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b11a90 0x564442b0ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45390/0 (socket says 172.21.15.50:45390) 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fded5c84640 1 -- 172.21.15.50:0/3603906046 learned_addr learned my addr 172.21.15.50:0/3603906046 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fded5c84640 1 -- 172.21.15.50:0/3603906046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564442b10440 con 0x564442b11a90 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fded5c84640 1 --2- 172.21.15.50:0/3603906046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b11a90 0x564442b0ff00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdec805cb40 tx=0x7fdec805cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fddbb7fe640 1 -- 172.21.15.50:0/3603906046 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec8076040 con 0x564442b11a90 2024-05-07T13:56:10.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fddbb7fe640 1 -- 172.21.15.50:0/3603906046 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec8008170 con 0x564442b11a90 2024-05-07T13:56:10.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fdeda616800 1 -- 172.21.15.50:0/3603906046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564442b106d0 con 0x564442b11a90 2024-05-07T13:56:10.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.680+0000 7fddbb7fe640 1 -- 172.21.15.50:0/3603906046 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec8066b50 con 0x564442b11a90 2024-05-07T13:56:10.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.681+0000 7fdeda616800 1 -- 172.21.15.50:0/3603906046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564442b10bd0 con 0x564442b11a90 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.681+0000 7fddbb7fe640 1 -- 172.21.15.50:0/3603906046 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdec8066cf0 con 0x564442b11a90 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.681+0000 7fddbb7fe640 1 --2- 172.21.15.50:0/3603906046 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddb0036900 0x7fddb0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.681+0000 7fddbb7fe640 1 -- 172.21.15.50:0/3603906046 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdec8069070 con 0x564442b11a90 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fded5483640 1 --2- 172.21.15.50:0/3603906046 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddb0036900 0x7fddb0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fdeda616800 1 Processor -- start 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fdeda616800 1 -- start start 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fded5483640 1 --2- 172.21.15.50:0/3603906046 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddb0036900 0x7fddb0038dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00bf50 tx=0x7fdecc00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fdeda616800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cc34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fdeda616800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564442c8e100 con 0x564442cc30b0 2024-05-07T13:56:10.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cc34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cc34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45402/0 (socket says 172.21.15.50:45402) 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fded5c84640 1 -- 172.21.15.50:0/3826047658 learned_addr learned my addr 172.21.15.50:0/3826047658 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.682+0000 7fded5c84640 1 -- 172.21.15.50:0/3826047658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564442cc3aa0 con 0x564442cc30b0 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fded5c84640 1 --2- 172.21.15.50:0/3826047658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cc34d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdec807b890 tx=0x7fdec805e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59ded18affdd03f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fddb97fa640 1 -- 172.21.15.50:0/3826047658 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec805eae0 con 0x564442cc30b0 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fddb97fa640 1 -- 172.21.15.50:0/3826047658 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec80a6070 con 0x564442cc30b0 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fddb97fa640 1 -- 172.21.15.50:0/3826047658 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec8074120 con 0x564442cc30b0 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fdeda616800 1 -- 172.21.15.50:0/3826047658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 msgr2=0x564442cc34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fdeda616800 1 --2- 172.21.15.50:0/3826047658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cc34d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdec807b890 tx=0x7fdec805e880 comp rx=0 tx=0).stop 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fdeda616800 1 -- 172.21.15.50:0/3826047658 shutdown_connections 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fdeda616800 1 --2- 172.21.15.50:0/3826047658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cc34d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fdeda616800 1 -- 172.21.15.50:0/3826047658 >> 172.21.15.50:0/3826047658 conn(0x564442cbf410 msgr2=0x564442cbd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fdeda616800 1 -- 172.21.15.50:0/3826047658 shutdown_connections 2024-05-07T13:56:10.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.683+0000 7fdeda616800 1 -- 172.21.15.50:0/3826047658 wait complete. 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.684+0000 7fdeda616800 1 Processor -- start 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.684+0000 7fdeda616800 1 -- start start 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.684+0000 7fdeda616800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.684+0000 7fdeda616800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564442cc4150 con 0x564442cc30b0 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.684+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.684+0000 7fded5c84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45416/0 (socket says 172.21.15.50:45416) 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.684+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 learned_addr learned my addr 172.21.15.50:0/1671102613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.684+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564442cca990 con 0x564442cc30b0 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.684+0000 7fded5c84640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cca450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdec805d800 tx=0x7fdec8050f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.685+0000 7fdda77fe640 1 -- 172.21.15.50:0/1671102613 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec80963f0 con 0x564442cc30b0 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.685+0000 7fdda77fe640 1 -- 172.21.15.50:0/1671102613 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec8096590 con 0x564442cc30b0 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.685+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564442cca990 con 0x564442cc30b0 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.685+0000 7fdda77fe640 1 -- 172.21.15.50:0/1671102613 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdec808a2f0 con 0x564442cc30b0 2024-05-07T13:56:10.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.685+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564442cca990 con 0x564442cc30b0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.686+0000 7fdda77fe640 1 -- 172.21.15.50:0/1671102613 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdec8066380 con 0x564442cc30b0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.686+0000 7fdda77fe640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdda0036950 0x7fdda0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.686+0000 7fdda77fe640 1 -- 172.21.15.50:0/1671102613 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdec80b5c50 con 0x564442cc30b0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.686+0000 7fded5483640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdda0036950 0x7fdda0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.686+0000 7fded5483640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdda0036950 0x7fdda0038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001b60 tx=0x7fdecc010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fdeda616800 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442cd5ac0 0x564442cd7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442cd86d0 con 0x564442cd5ac0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fded6485640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442cd5ac0 0x564442cd7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fded6485640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442cd5ac0 0x564442cd7f80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fded000a4a0 con 0x564442cd5ac0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fdeda616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fdeda616800 20 realm 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442cd8ae0 con 0x564442cd5ac0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fded000a4a0 con 0x564442cd5ac0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fdeda616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.687+0000 7fdeda616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442cd93b0 con 0x564442cd5ac0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fded000a4a0 con 0x564442cd5ac0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fdeda616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cd5ac0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fded000a4a0 con 0x564442cd5ac0 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fdeda616800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fdeda616800 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442cda4b0 0x564442cdc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442cdceb0 con 0x564442cda4b0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fded5c84640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442cda4b0 0x564442cdc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.688+0000 7fded5c84640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442cda4b0 0x564442cdc8a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.689+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.689+0000 7fdeda616800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.689+0000 7fdeda616800 20 searching for the correct realm 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.689+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cde7e0 con 0x564442cda4b0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.689+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.689+0000 7fded5c84640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdec80744a0 0x7fdec80a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.689+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cde7e0 con 0x7fdec80744a0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.690+0000 7fded5483640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdec80744a0 0x7fdec80a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.690+0000 7fded5483640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdec80744a0 0x7fdec80a1470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.690+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdecc009050 con 0x7fdec80744a0 2024-05-07T13:56:10.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.690+0000 7fded5483640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdecc038040 0x7fdecc01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.690+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cde7e0 con 0x7fdecc038040 2024-05-07T13:56:10.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.690+0000 7fded6485640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdecc038040 0x7fdecc01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.691+0000 7fded6485640 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdecc038040 0x7fdecc01bab0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.691+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded000a4a0 con 0x7fdecc038040 2024-05-07T13:56:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.691+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cd5ac0 2024-05-07T13:56:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.691+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded000a4a0 con 0x564442cd5ac0 2024-05-07T13:56:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.691+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cd5ac0 2024-05-07T13:56:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.691+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded000a4a0 con 0x564442cd5ac0 2024-05-07T13:56:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.691+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdecc038040 2024-05-07T13:56:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.692+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded000a4a0 con 0x7fdecc038040 2024-05-07T13:56:10.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.692+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdecc038040 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.692+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fded000a4a0 con 0x7fdecc038040 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.692+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdec80744a0 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.692+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdecc009050 con 0x7fdec80744a0 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.692+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cda4b0 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.692+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.692+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cd5ac0 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.693+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded000a4a0 con 0x564442cd5ac0 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.693+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdecc038040 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.693+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded000a4a0 con 0x7fdecc038040 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.693+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cd5ac0 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.694+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded000a4a0 con 0x564442cd5ac0 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.694+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdec80744a0 2024-05-07T13:56:10.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.694+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdecc009050 con 0x7fdec80744a0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.694+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cda4b0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.694+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.694+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cda4b0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.694+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.694+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdecc038040 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.695+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded000a4a0 con 0x7fdecc038040 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.695+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cda4b0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.695+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.695+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cda4b0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.695+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.695+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cd5ac0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.695+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded000a4a0 con 0x564442cd5ac0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.695+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cd5ac0 2024-05-07T13:56:10.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.696+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.696+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdecc038040 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.696+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.696+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cda4b0 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.696+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.696+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdec80744a0 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.697+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdecc009050 con 0x7fdec80744a0 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.697+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cd5ac0 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.697+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.697+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdecc038040 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.697+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.697+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cda4b0 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.697+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.697+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdecc038040 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.698+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.698+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdec80744a0 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.698+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdecc009050 con 0x7fdec80744a0 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.698+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cda4b0 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.698+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.698+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdecc038040 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.698+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x564442cd5ac0 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564442cd9750 con 0x7fdec80744a0 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:10.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442cdd770 con 0x564442cd5ac0 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.699+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442cddb60 con 0x564442cd5ac0 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442cddb60 con 0x7fdecc038040 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 20 zone default found 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 4 Realm: () 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 20 zonegroup default 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442cdec60 con 0x7fdecc038040 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.700+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442ce0640 con 0x564442cda4b0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.701+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.701+0000 7fdeda616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.701+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.701+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442ce09e0 con 0x564442cda4b0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.701+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.701+0000 7fdeda616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.701+0000 7fdeda616800 20 started sync module instance, tier type = 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.701+0000 7fdeda616800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.701+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442cdfae0 con 0x7fdec80744a0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.702+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.702+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94851178559024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce0d80 con 0x7fdec80744a0 2024-05-07T13:56:10.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.702+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce1630 con 0x564442cd5ac0 2024-05-07T13:56:10.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.703+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94851178559024] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.703+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.703+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94851178565920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce1a20 con 0x564442cd5ac0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.703+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce2480 con 0x564442cda4b0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.704+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94851178565920] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.704+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.704+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94851178561280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce2820 con 0x564442cda4b0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.704+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce32d0 con 0x7fdec80744a0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.705+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94851178561280] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.705+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.705+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94851178569616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce3670 con 0x7fdec80744a0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.705+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce4150 con 0x564442cd5ac0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.706+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.706+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94851178576992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce49f0 con 0x564442cd5ac0 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.707+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce54b0 con 0x7fdecc038040 2024-05-07T13:56:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.707+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94851178569616] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.707+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94851178576992] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.708+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.708+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94851178581888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce4450 con 0x7fdecc038040 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.708+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce5d50 con 0x7fdecc038040 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.708+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94851178581888] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.709+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.709+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94851178573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce4450 con 0x7fdecc038040 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.709+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce6370 con 0x7fdecc038040 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94851178585792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce6790 con 0x7fdecc038040 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fdeda616800 20 add_watcher() i=0 2024-05-07T13:56:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fdeda616800 20 add_watcher() i=1 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fdeda616800 20 add_watcher() i=2 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fdeda616800 20 add_watcher() i=3 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fdeda616800 20 add_watcher() i=4 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fdeda616800 20 add_watcher() i=5 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94851178573280] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.710+0000 7fdeda616800 20 add_watcher() i=6 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.711+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94851178585792] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.711+0000 7fdeda616800 20 add_watcher() i=7 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.711+0000 7fdeda616800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.711+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442ce6790 con 0x564442cd5ac0 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.711+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.711+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94851178586848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce6700 con 0x564442cd5ac0 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.712+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94851178586848] v27'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.712+0000 7fdd877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.712+0000 7fdeda616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.712+0000 7fdeda616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.712+0000 7fdeda616800 5 note: GC not initialized 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.712+0000 7fdd867fc640 20 reqs_thread_entry: start 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.712+0000 7fdeda616800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.712+0000 7fdeda616800 20 Filter name: none 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdcf7fff640 20 reqs_thread_entry: start 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442d1cdc0 con 0x564442cd5ac0 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 20 rados_obj.operate() r=0 bl.length=556 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:10.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442d1d890 con 0x7fdec80744a0 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.713+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442d23890 con 0x564442cd5ac0 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v27'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fdeda616800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fdeda616800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fdeda616800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94851178836768 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442d1f170 con 0x564442cd5ac0 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94851178576992 notify 115964116999 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7fded001e040 con 0x564442cd5ac0 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fddb97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 94851178576992 notifier 4383 bl.length()=849 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fddb97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fddb97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify cookie 94851178836768 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fddb97fa640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdd98003ea0 con 0x564442cd5ac0 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 94851178836768 notify 115964116999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fded00279c0 con 0x564442cd5ac0 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.715+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442d23320 con 0x7fdec80744a0 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fdeda616800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-07T13:56:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fdeda616800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fdeda616800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94851178814640 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564442d23320 con 0x7fdec80744a0 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== watch-notify(notify (1) cookie 94851178559024 notify 115964116995 ret 0) ==== 208+0+0 (crc 0 0 0) 0x564442b9cc00 con 0x7fdec80744a0 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fddb97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94851178559024 notifier 4383 bl.length()=166 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fddb97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fddb97fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fddb97fa640 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdd98003ea0 con 0x7fdec80744a0 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(68 notify.0 [notify cookie 94851178814640 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== watch-notify(notify_complete (2) cookie 94851178814640 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdecc049430 con 0x7fdec80744a0 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.717+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.717 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-07T13:56:10.715259Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.718+0000 7fdd877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.718+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94851178586848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442d22400 con 0x564442cd5ac0 2024-05-07T13:56:10.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.720+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94851178586848] v27'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.720+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94851178559024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce62e0 con 0x7fdec80744a0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.721+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94851178559024] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.721+0000 7fdeda616800 20 remove_watcher() i=0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.721+0000 7fdeda616800 2 removed watcher, disabling cache 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.721+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94851178565920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce62e0 con 0x564442cd5ac0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.722+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94851178565920] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.722+0000 7fdeda616800 20 remove_watcher() i=1 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.722+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94851178561280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce62e0 con 0x564442cda4b0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.723+0000 7fded5c84640 1 -- 172.21.15.50:0/1671102613 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94851178561280] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec8078070 con 0x564442cda4b0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.723+0000 7fdeda616800 20 remove_watcher() i=2 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.723+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94851178569616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce62e0 con 0x7fdec80744a0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.724+0000 7fded5483640 1 -- 172.21.15.50:0/1671102613 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94851178569616] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdecc045040 con 0x7fdec80744a0 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.724+0000 7fdeda616800 20 remove_watcher() i=3 2024-05-07T13:56:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.724+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94851178576992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce1f90 con 0x564442cd5ac0 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.725+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94851178576992] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x564442cd5ac0 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.725+0000 7fdeda616800 20 remove_watcher() i=4 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.725+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94851178581888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce62e0 con 0x7fdecc038040 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.725+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94851178581888] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.726+0000 7fdeda616800 20 remove_watcher() i=5 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.726+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94851178573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce3c60 con 0x7fdecc038040 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.726+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94851178573280] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.726+0000 7fdeda616800 20 remove_watcher() i=6 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.726+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94851178585792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564442ce1f90 con 0x7fdecc038040 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.727+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94851178585792] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fded002f060 con 0x7fdecc038040 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.727+0000 7fdeda616800 20 remove_watcher() i=7 2024-05-07T13:56:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdecc038040 msgr2=0x7fdecc01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdecc038040 0x7fdecc01bab0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442cd5ac0 msgr2=0x564442cd7f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442cd5ac0 0x564442cd7f80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdec80744a0 msgr2=0x7fdec80a1470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdec80744a0 0x7fdec80a1470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442cda4b0 msgr2=0x564442cdc8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442cda4b0 0x564442cdc8a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdda0036950 msgr2=0x7fdda0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdda0036950 0x7fdda0038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001b60 tx=0x7fdecc010000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fded6485640 1 -- 172.21.15.50:0/1671102613 reap_dead start 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 msgr2=0x564442cca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cca450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdec805d800 tx=0x7fdec8050f80 comp rx=0 tx=0).stop 2024-05-07T13:56:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 shutdown_connections 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/1671102613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442cc30b0 0x564442cca450 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 >> 172.21.15.50:0/1671102613 conn(0x564442cbf410 msgr2=0x564442cbca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 shutdown_connections 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/1671102613 wait complete. 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/3603906046 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddb0036900 msgr2=0x7fddb0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/3603906046 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddb0036900 0x7fddb0038dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00bf50 tx=0x7fdecc00f000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/3603906046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b11a90 msgr2=0x564442b0ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/3603906046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b11a90 0x564442b0ff00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdec805cb40 tx=0x7fdec805cea0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/3603906046 shutdown_connections 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/3603906046 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddb0036900 0x7fddb0038dc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 --2- 172.21.15.50:0/3603906046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b11a90 0x564442b0ff00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/3603906046 >> 172.21.15.50:0/3603906046 conn(0x564442ca7e10 msgr2=0x564442ca8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/3603906046 shutdown_connections 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.728+0000 7fdeda616800 1 -- 172.21.15.50:0/3603906046 wait complete. 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564442ca2d60 msgr2=0x564442ca51b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564442ca2d60 0x564442ca51b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442b9d370 msgr2=0x564442c9c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564442b9d370 0x564442c9c540 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442c9edd0 msgr2=0x564442ca11c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564442c9edd0 0x564442ca11c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddbc036950 msgr2=0x7fddbc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fddbc036950 0x7fddbc038e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdecc000f60 tx=0x7fdecc0012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 msgr2=0x564442c95300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 --2- 172.21.15.50:0/3279387222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564442b9c160 0x564442c95300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdec800a470 tx=0x7fdec8002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fded6485640 1 -- 172.21.15.50:0/3279387222 reap_dead start 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 shutdown_connections 2024-05-07T13:56:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 >> 172.21.15.50:0/3279387222 conn(0x564442b977a0 msgr2=0x564442c87990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 shutdown_connections 2024-05-07T13:56:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.729+0000 7fdeda616800 1 -- 172.21.15.50:0/3279387222 wait complete. 2024-05-07T13:56:10.729 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-07T13:56:10.715259Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:10.729 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-07T13:56:10.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-07T13:56:10.729 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-07T13:56:10.774 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:10.775 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f7512b1f800 1 Processor -- start 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f7512b1f800 1 -- start start 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f7512b1f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x564e07fc3600 0x564e07fc59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f7512b1f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e07fc5f30 con 0x564e07fbd390 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f7512b1f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x564e07e50050 con 0x564e07fc3600 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f750dfc9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x564e07fc3600 0x564e07fc59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f750dfc9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x564e07fc3600 0x564e07fc59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45420/0 (socket says 172.21.15.50:45420) 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f750dfc9640 1 -- 172.21.15.50:0/183192630 learned_addr learned my addr 172.21.15.50:0/183192630 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f750e7ca640 1 --1- 172.21.15.50:0/183192630 >> v1:172.21.15.22:6789/0 conn(0x564e07fbd390 0x564e07fbd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39652/0 (socket says 172.21.15.50:39652) 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f750dfc9640 1 -- 172.21.15.50:0/183192630 >> v1:172.21.15.22:6789/0 conn(0x564e07fbd390 legacy=0x564e07fbd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.787+0000 7f750dfc9640 1 -- 172.21.15.50:0/183192630 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e07fc7140 con 0x564e07fc3600 2024-05-07T13:56:10.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.789+0000 7f750dfc9640 1 --2- 172.21.15.50:0/183192630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fc3600 0x564e07fc59f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f750400a520 tx=0x7f750401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6fb17db41f98f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.789+0000 7f750d7c8640 1 -- 172.21.15.50:0/183192630 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7504057070 con 0x564e07fc3600 2024-05-07T13:56:10.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.790+0000 7f750d7c8640 1 -- 172.21.15.50:0/183192630 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7504052570 con 0x564e07fc3600 2024-05-07T13:56:10.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.790+0000 7f750d7c8640 1 -- 172.21.15.50:0/183192630 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750404ae60 con 0x564e07fc3600 2024-05-07T13:56:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.790+0000 7f7512b1f800 1 -- 172.21.15.50:0/183192630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fc3600 msgr2=0x564e07fc59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.790+0000 7f7512b1f800 1 --2- 172.21.15.50:0/183192630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fc3600 0x564e07fc59f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f750400a520 tx=0x7f750401d010 comp rx=0 tx=0).stop 2024-05-07T13:56:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.790+0000 7f7512b1f800 1 -- 172.21.15.50:0/183192630 shutdown_connections 2024-05-07T13:56:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.790+0000 7f7512b1f800 1 --2- 172.21.15.50:0/183192630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fc3600 0x564e07fc59f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.790+0000 7f7512b1f800 1 -- 172.21.15.50:0/183192630 >> 172.21.15.50:0/183192630 conn(0x564e07fb8d30 msgr2=0x564e07fbb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.790+0000 7f7512b1f800 1 -- 172.21.15.50:0/183192630 shutdown_connections 2024-05-07T13:56:10.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.790+0000 7f7512b1f800 1 -- 172.21.15.50:0/183192630 wait complete. 2024-05-07T13:56:10.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.805+0000 7f7512b1f800 1 Processor -- start 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.805+0000 7f7512b1f800 1 -- start start 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.805+0000 7f7512b1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e07fbfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.805+0000 7f7512b1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564e07f0a1d0 con 0x564e07fbd390 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.806+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e07fbfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.806+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e07fbfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45426/0 (socket says 172.21.15.50:45426) 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.806+0000 7f750e7ca640 1 -- 172.21.15.50:0/3562358172 learned_addr learned my addr 172.21.15.50:0/3562358172 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.806+0000 7f750e7ca640 1 -- 172.21.15.50:0/3562358172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e07fbe2d0 con 0x564e07fbd390 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.806+0000 7f750e7ca640 1 --2- 172.21.15.50:0/3562358172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e07fbfd10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f750000b230 tx=0x7f750000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99586ba292a5ad4f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.806+0000 7f73fc608640 1 -- 172.21.15.50:0/3562358172 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750000e5c0 con 0x564e07fbd390 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.806+0000 7f73fc608640 1 -- 172.21.15.50:0/3562358172 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7500006070 con 0x564e07fbd390 2024-05-07T13:56:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.806+0000 7f73fc608640 1 -- 172.21.15.50:0/3562358172 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750000e890 con 0x564e07fbd390 2024-05-07T13:56:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.807+0000 7f7512b1f800 1 -- 172.21.15.50:0/3562358172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 msgr2=0x564e07fbfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.807+0000 7f7512b1f800 1 --2- 172.21.15.50:0/3562358172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e07fbfd10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f750000b230 tx=0x7f750000b6f0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.807+0000 7f7512b1f800 1 -- 172.21.15.50:0/3562358172 shutdown_connections 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.807+0000 7f7512b1f800 1 --2- 172.21.15.50:0/3562358172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e07fbfd10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.807+0000 7f7512b1f800 1 -- 172.21.15.50:0/3562358172 >> 172.21.15.50:0/3562358172 conn(0x564e07fb8d30 msgr2=0x564e080ac000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.807+0000 7f7512b1f800 1 -- 172.21.15.50:0/3562358172 shutdown_connections 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.807+0000 7f7512b1f800 1 -- 172.21.15.50:0/3562358172 wait complete. 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.807+0000 7f7512b1f800 1 Processor -- start 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.807+0000 7f7512b1f800 1 -- start start 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.808+0000 7f7512b1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e080ba460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.808+0000 7f7512b1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564e07fc6400 con 0x564e07fbd390 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.808+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e080ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.808+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e080ba460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45438/0 (socket says 172.21.15.50:45438) 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.808+0000 7f750e7ca640 1 -- 172.21.15.50:0/35457217 learned_addr learned my addr 172.21.15.50:0/35457217 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.808+0000 7f750e7ca640 1 -- 172.21.15.50:0/35457217 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e080ba9a0 con 0x564e07fbd390 2024-05-07T13:56:10.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.808+0000 7f750e7ca640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e080ba460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7500000fd0 tx=0x7f7500000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.808+0000 7f73fae05640 1 -- 172.21.15.50:0/35457217 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750000f8d0 con 0x564e07fbd390 2024-05-07T13:56:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.809+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e080bac30 con 0x564e07fbd390 2024-05-07T13:56:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.809+0000 7f73fae05640 1 -- 172.21.15.50:0/35457217 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750000fa90 con 0x564e07fbd390 2024-05-07T13:56:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.809+0000 7f73fae05640 1 -- 172.21.15.50:0/35457217 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750000fdb0 con 0x564e07fbd390 2024-05-07T13:56:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.809+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e080bd8e0 con 0x564e07fbd390 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.809+0000 7f73fae05640 1 -- 172.21.15.50:0/35457217 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7500017070 con 0x564e07fbd390 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.810+0000 7f73fae05640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73f4036900 0x7f73f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.810+0000 7f73fae05640 1 -- 172.21.15.50:0/35457217 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7500015020 con 0x564e07fbd390 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.810+0000 7f750dfc9640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73f4036900 0x7f73f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.810+0000 7f7512b1f800 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e07fc3600 0x564e080c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.810+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080c1c20 con 0x564e07fc3600 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.810+0000 7f750efcb640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e07fc3600 0x564e080c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.810+0000 7f750dfc9640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73f4036900 0x7f73f4038dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7504054000 tx=0x7f750404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.810+0000 7f750efcb640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e07fc3600 0x564e080c16a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.811+0000 7f750efcb640 1 -- 172.21.15.50:0/35457217 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e07fc3600 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.811+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080bec70 con 0x564e07fc3600 2024-05-07T13:56:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.811+0000 7f750efcb640 1 -- 172.21.15.50:0/35457217 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f750800a4a0 con 0x564e07fc3600 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.811+0000 7f7512b1f800 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080c3f50 0x564e080c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.811+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080c6a30 con 0x564e080c3f50 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.811+0000 7f750e7ca640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080c3f50 0x564e080c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.811+0000 7f750e7ca640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080c3f50 0x564e080c6340 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.812+0000 7f750e7ca640 1 -- 172.21.15.50:0/35457217 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f750002e070 con 0x564e080c3f50 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.812+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080c2f00 con 0x564e07fc3600 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.812+0000 7f750efcb640 1 -- 172.21.15.50:0/35457217 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f750800a4a0 con 0x564e07fc3600 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.812+0000 7f7512b1f800 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564e080c7ee0 0x564e080ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.812+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080caa90 con 0x564e080c7ee0 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.812+0000 7f750dfc9640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564e080c7ee0 0x564e080ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.812+0000 7f750dfc9640 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564e080c7ee0 0x564e080ca330 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.813+0000 7f750dfc9640 1 -- 172.21.15.50:0/35457217 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f750405a040 con 0x564e080c7ee0 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.813+0000 7f7512b1f800 1 Processor -- start 2024-05-07T13:56:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.813+0000 7f7512b1f800 1 -- start start 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.813+0000 7f7512b1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080d8ef0 0x564e080d9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.813+0000 7f7512b1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564e07eb0cf0 con 0x564e080d8ef0 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080d8ef0 0x564e080d9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080d8ef0 0x564e080d9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45450/0 (socket says 172.21.15.50:45450) 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f750e7ca640 1 -- 172.21.15.50:0/2881476973 learned_addr learned my addr 172.21.15.50:0/2881476973 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f750e7ca640 1 -- 172.21.15.50:0/2881476973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e080d9850 con 0x564e080d8ef0 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f750e7ca640 1 --2- 172.21.15.50:0/2881476973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080d8ef0 0x564e080d9310 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f750000ff70 tx=0x7f7500017d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f73f3fff640 1 -- 172.21.15.50:0/2881476973 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7500017e60 con 0x564e080d8ef0 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f73f3fff640 1 -- 172.21.15.50:0/2881476973 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7500040900 con 0x564e080d8ef0 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f73f3fff640 1 -- 172.21.15.50:0/2881476973 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7500040be0 con 0x564e080d8ef0 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f7512b1f800 1 -- 172.21.15.50:0/2881476973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e080da2c0 con 0x564e080d8ef0 2024-05-07T13:56:10.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.814+0000 7f7512b1f800 1 -- 172.21.15.50:0/2881476973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e080da7c0 con 0x564e080d8ef0 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.815+0000 7f73f3fff640 1 -- 172.21.15.50:0/2881476973 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7500044a80 con 0x564e080d8ef0 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.815+0000 7f73f3fff640 1 --2- 172.21.15.50:0/2881476973 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73e8036900 0x7f73e8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.815+0000 7f73f3fff640 1 -- 172.21.15.50:0/2881476973 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f750003dc50 con 0x564e080d8ef0 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.815+0000 7f750dfc9640 1 --2- 172.21.15.50:0/2881476973 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73e8036900 0x7f73e8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f7512b1f800 1 Processor -- start 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f7512b1f800 1 -- start start 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f750dfc9640 1 --2- 172.21.15.50:0/2881476973 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73e8036900 0x7f73e8038dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x564e080c2500 tx=0x7f7504005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f7512b1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080e6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f7512b1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564e07fbe650 con 0x564e080e6070 2024-05-07T13:56:10.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080e6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080e6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45454/0 (socket says 172.21.15.50:45454) 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f750e7ca640 1 -- 172.21.15.50:0/2297857800 learned_addr learned my addr 172.21.15.50:0/2297857800 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f750e7ca640 1 -- 172.21.15.50:0/2297857800 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e080e6a60 con 0x564e080e6070 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.816+0000 7f750e7ca640 1 --2- 172.21.15.50:0/2297857800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080e6490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f750003dfd0 tx=0x7f7500040e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7b37e95f3e0735 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f73f1ffb640 1 -- 172.21.15.50:0/2297857800 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7500026750 con 0x564e080e6070 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f73f1ffb640 1 -- 172.21.15.50:0/2297857800 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7500026960 con 0x564e080e6070 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f73f1ffb640 1 -- 172.21.15.50:0/2297857800 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750003f640 con 0x564e080e6070 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f7512b1f800 1 -- 172.21.15.50:0/2297857800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 msgr2=0x564e080e6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2297857800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080e6490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f750003dfd0 tx=0x7f7500040e40 comp rx=0 tx=0).stop 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f7512b1f800 1 -- 172.21.15.50:0/2297857800 shutdown_connections 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2297857800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080e6490 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f7512b1f800 1 -- 172.21.15.50:0/2297857800 >> 172.21.15.50:0/2297857800 conn(0x564e080e23d0 msgr2=0x564e080e0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f7512b1f800 1 -- 172.21.15.50:0/2297857800 shutdown_connections 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f7512b1f800 1 -- 172.21.15.50:0/2297857800 wait complete. 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f7512b1f800 1 Processor -- start 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.817+0000 7f7512b1f800 1 -- start start 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f7512b1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f7512b1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564e080e7110 con 0x564e080e6070 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f750e7ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080ed430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45460/0 (socket says 172.21.15.50:45460) 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 learned_addr learned my addr 172.21.15.50:0/2133074871 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e080ed970 con 0x564e080e6070 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f750e7ca640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080ed430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7500005d50 tx=0x7f750001ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f73dffff640 1 -- 172.21.15.50:0/2133074871 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750006d020 con 0x564e080e6070 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f73dffff640 1 -- 172.21.15.50:0/2133074871 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750003f120 con 0x564e080e6070 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e080ed970 con 0x564e080e6070 2024-05-07T13:56:10.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f73dffff640 1 -- 172.21.15.50:0/2133074871 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7500044dc0 con 0x564e080e6070 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.818+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e080ed970 con 0x564e080e6070 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.819+0000 7f73dffff640 1 -- 172.21.15.50:0/2133074871 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7500070020 con 0x564e080e6070 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.819+0000 7f73dffff640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73d8036950 0x7f73d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.819+0000 7f73dffff640 1 -- 172.21.15.50:0/2133074871 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7500063030 con 0x564e080e6070 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.819+0000 7f750dfc9640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73d8036950 0x7f73d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.820+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.820+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e080f8bd0 0x564e080fb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.820+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080fb7e0 con 0x564e080f8bd0 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.820+0000 7f750dfc9640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73d8036950 0x7f73d8038e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7504052fd0 tx=0x7f750404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.820+0000 7f750efcb640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e080f8bd0 0x564e080fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.820+0000 7f750efcb640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e080f8bd0 0x564e080fb090 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 20 realm 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080fbbf0 con 0x564e080f8bd0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc4c0 con 0x564e080f8bd0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x564e080f8bd0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080fd350 0x564e080ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e080ffea0 con 0x564e080fd350 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.821+0000 7f750e7ca640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080fd350 0x564e080ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.822+0000 7f750e7ca640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080fd350 0x564e080ff740 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.822+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.822+0000 7f7512b1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.822+0000 7f7512b1f800 20 searching for the correct realm 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.822+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e08101880 con 0x564e080fd350 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.823+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.823+0000 7f750e7ca640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7500072020 0x7f7500023240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.823+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e08101880 con 0x7f7500072020 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.823+0000 7f750dfc9640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7500072020 0x7f7500023240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.823+0000 7f750dfc9640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7500072020 0x7f7500023240 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.823+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.823+0000 7f750dfc9640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7504074040 0x7f7504081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.823+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e08101880 con 0x7f7504074040 2024-05-07T13:56:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.824+0000 7f750efcb640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7504074040 0x7f7504081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.824+0000 7f750efcb640 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7504074040 0x7f7504081410 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.824+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.824+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x564e080f8bd0 2024-05-07T13:56:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.824+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.825+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x564e080f8bd0 2024-05-07T13:56:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.825+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.825+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x7f7504074040 2024-05-07T13:56:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.825+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.825+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x7f7504074040 2024-05-07T13:56:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.825+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.825+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x7f7500072020 2024-05-07T13:56:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.826+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.826+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x564e080fd350 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.826+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.826+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x564e080f8bd0 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.826+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.826+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x7f7504074040 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.826+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.826+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x564e080f8bd0 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.827+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.827+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564e080fc860 con 0x7f7500072020 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.827+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.827+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080fd350 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.827+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.827+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080fd350 2024-05-07T13:56:10.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.827+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.827+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x7f7504074040 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.828+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.828+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080fd350 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.828+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.828+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080fd350 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.828+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.828+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080f8bd0 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.828+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.828+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080f8bd0 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.828+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.829+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x7f7504074040 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.829+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.829+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080fd350 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.829+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.829+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x7f7500072020 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.830+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.830+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080f8bd0 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.830+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.830+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x7f7504074040 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.830+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.830+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080fd350 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.831+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.831+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x7f7504074040 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.831+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.831+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x7f7500072020 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.831+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.831+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080fd350 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.831+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.831+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x7f7504074040 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x564e080f8bd0 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f750408e060 con 0x7f7500072020 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:10.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e08100850 con 0x564e080f8bd0 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.832+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e08100c40 con 0x564e080f8bd0 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.833+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.833+0000 7f7512b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.833+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.833+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e08100c40 con 0x7f7504074040 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.833+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:10.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 zone default found 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 4 Realm: () 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 zonegroup default 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e08101060 con 0x7f7504074040 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e08101480 con 0x564e080fd350 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e08103730 con 0x564e080fd350 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 started sync module instance, tier type = 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.834+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08102bd0 con 0x7f7500072020 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.835+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.835+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94893142716400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08103f80 con 0x7f7500072020 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.835+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081047d0 con 0x564e080f8bd0 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.836+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94893142716400] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.837+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.837+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94893142719184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081047d0 con 0x564e080f8bd0 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.837+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081052f0 con 0x564e080fd350 2024-05-07T13:56:10.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.838+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94893142719184] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.838+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.838+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94893142721312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08104740 con 0x564e080fd350 2024-05-07T13:56:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.838+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081061b0 con 0x7f7500072020 2024-05-07T13:56:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.839+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94893142721312] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.839+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.839+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94893142726368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08106a00 con 0x7f7500072020 2024-05-07T13:56:10.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.839+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081072b0 con 0x564e080f8bd0 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.840+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94893142726368] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.840+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.840+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94893142732192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081076a0 con 0x564e080f8bd0 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.840+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081080c0 con 0x7f7504074040 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.841+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94893142732192] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.841+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.841+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94893142735792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08108080 con 0x7f7504074040 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.841+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08108af0 con 0x7f7504074040 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.842+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94893142735792] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.842+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.842+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94893142738464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08108af0 con 0x7f7504074040 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.842+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081094f0 con 0x7f7504074040 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94893142738464] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94893142730064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081094b0 con 0x7f7504074040 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f7512b1f800 20 add_watcher() i=0 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f7512b1f800 20 add_watcher() i=1 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f7512b1f800 20 add_watcher() i=2 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f7512b1f800 20 add_watcher() i=3 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f7512b1f800 20 add_watcher() i=4 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f7512b1f800 20 add_watcher() i=5 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.843+0000 7f7512b1f800 20 add_watcher() i=6 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.844+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94893142730064] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.844+0000 7f7512b1f800 20 add_watcher() i=7 2024-05-07T13:56:10.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.844+0000 7f7512b1f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.845+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e0810c910 con 0x564e080f8bd0 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.845+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.845+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94893142741456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08109e10 con 0x564e080f8bd0 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.846+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94893142741456] v27'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.846+0000 7f73c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.846+0000 7f7512b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.846+0000 7f7512b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.846+0000 7f7512b1f800 5 note: GC not initialized 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.846+0000 7f733f7fe640 20 reqs_thread_entry: start 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.846+0000 7f7512b1f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.846+0000 7f7512b1f800 20 Filter name: none 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.846+0000 7f733d7fa640 20 reqs_thread_entry: start 2024-05-07T13:56:10.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.847+0000 7f7512b1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.847+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564e0813f960 con 0x564e080f8bd0 2024-05-07T13:56:10.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.847+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.847+0000 7f7512b1f800 20 rados_obj.operate() r=0 bl.length=673 2024-05-07T13:56:10.843 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-07T13:56:10.715259Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.848+0000 7f73c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.848+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94893142741456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e0813fd40 con 0x564e080f8bd0 2024-05-07T13:56:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.849+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94893142741456] v27'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.849+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94893142716400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081091a0 con 0x7f7500072020 2024-05-07T13:56:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.850+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94893142716400] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.850+0000 7f7512b1f800 20 remove_watcher() i=0 2024-05-07T13:56:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.850+0000 7f7512b1f800 2 removed watcher, disabling cache 2024-05-07T13:56:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.850+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94893142719184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08102ff0 con 0x564e080f8bd0 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.851+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94893142719184] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.851+0000 7f7512b1f800 20 remove_watcher() i=1 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.851+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94893142721312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08102ff0 con 0x564e080fd350 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.852+0000 7f750e7ca640 1 -- 172.21.15.50:0/2133074871 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94893142721312] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7500066070 con 0x564e080fd350 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.852+0000 7f7512b1f800 20 remove_watcher() i=2 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.852+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94893142726368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08102ff0 con 0x7f7500072020 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.853+0000 7f750dfc9640 1 -- 172.21.15.50:0/2133074871 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94893142726368] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750407f070 con 0x7f7500072020 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.853+0000 7f7512b1f800 20 remove_watcher() i=3 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.853+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94893142732192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081056e0 con 0x564e080f8bd0 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.854+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94893142732192] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x564e080f8bd0 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.854+0000 7f7512b1f800 20 remove_watcher() i=4 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.854+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94893142735792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08102ff0 con 0x7f7504074040 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.855+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94893142735792] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.855+0000 7f7512b1f800 20 remove_watcher() i=5 2024-05-07T13:56:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.855+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94893142738464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e081056e0 con 0x7f7504074040 2024-05-07T13:56:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.856+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94893142738464] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.856+0000 7f7512b1f800 20 remove_watcher() i=6 2024-05-07T13:56:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.856+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94893142730064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564e08102ff0 con 0x7f7504074040 2024-05-07T13:56:10.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94893142730064] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f750800a4a0 con 0x7f7504074040 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 20 remove_watcher() i=7 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7504074040 msgr2=0x7f7504081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7504074040 0x7f7504081410 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e080f8bd0 msgr2=0x564e080fb090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e080f8bd0 0x564e080fb090 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7500072020 msgr2=0x7f7500023240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7500072020 0x7f7500023240 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080fd350 msgr2=0x564e080ff740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080fd350 0x564e080ff740 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73d8036950 msgr2=0x7f73d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73d8036950 0x7f73d8038e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7504052fd0 tx=0x7f750404f000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 msgr2=0x564e080ed430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080ed430 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7500005d50 tx=0x7f750001ff90 comp rx=0 tx=0).stop 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.857+0000 7f750efcb640 1 -- 172.21.15.50:0/2133074871 reap_dead start 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 shutdown_connections 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2133074871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080e6070 0x564e080ed430 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 >> 172.21.15.50:0/2133074871 conn(0x564e080e23d0 msgr2=0x564e080dfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 shutdown_connections 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2133074871 wait complete. 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2881476973 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73e8036900 msgr2=0x7f73e8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2881476973 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73e8036900 0x7f73e8038dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x564e080c2500 tx=0x7f7504005ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2881476973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080d8ef0 msgr2=0x564e080d9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2881476973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080d8ef0 0x564e080d9310 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f750000ff70 tx=0x7f7500017d30 comp rx=0 tx=0).stop 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2881476973 shutdown_connections 2024-05-07T13:56:10.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2881476973 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73e8036900 0x7f73e8038dc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 --2- 172.21.15.50:0/2881476973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e080d8ef0 0x564e080d9310 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2881476973 >> 172.21.15.50:0/2881476973 conn(0x564e080ccf90 msgr2=0x564e080cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2881476973 shutdown_connections 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/2881476973 wait complete. 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564e080c7ee0 msgr2=0x564e080ca330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x564e080c7ee0 0x564e080ca330 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e07fc3600 msgr2=0x564e080c16a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x564e07fc3600 0x564e080c16a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080c3f50 msgr2=0x564e080c6340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.858+0000 7f7512b1f800 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x564e080c3f50 0x564e080c6340 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.859+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73f4036900 msgr2=0x7f73f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.859+0000 7f7512b1f800 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f73f4036900 0x7f73f4038dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7504054000 tx=0x7f750404e000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.859+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 msgr2=0x564e080ba460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.859+0000 7f7512b1f800 1 --2- 172.21.15.50:0/35457217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564e07fbd390 0x564e080ba460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7500000fd0 tx=0x7f7500000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.859+0000 7f750efcb640 1 -- 172.21.15.50:0/35457217 reap_dead start 2024-05-07T13:56:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.859+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 shutdown_connections 2024-05-07T13:56:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.859+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 >> 172.21.15.50:0/35457217 conn(0x564e07fb8d30 msgr2=0x564e07fbebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.859+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 shutdown_connections 2024-05-07T13:56:10.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.859+0000 7f7512b1f800 1 -- 172.21.15.50:0/35457217 wait complete. 2024-05-07T13:56:10.856 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-07T13:56:10.715259Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:10.857 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-07T13:56:10.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-07T13:56:10.857 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-05-07T13:56:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.916+0000 7fd79392d800 1 Processor -- start 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.916+0000 7fd79392d800 1 -- start start 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.917+0000 7fd79392d800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d069dc7470 0x55d069dc9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.917+0000 7fd79392d800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d069dc9e30 con 0x55d069dc2fe0 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.917+0000 7fd79392d800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55d069c55050 con 0x55d069dc7470 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.917+0000 7fd78ed7e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d069dc7470 0x55d069dc9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.917+0000 7fd78ed7e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d069dc7470 0x55d069dc9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45468/0 (socket says 172.21.15.50:45468) 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.917+0000 7fd78f57f640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55d069dc2fe0 0x55d069dc3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39658/0 (socket says 172.21.15.50:39658) 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.917+0000 7fd78ed7e640 1 -- 172.21.15.50:0/237351816 learned_addr learned my addr 172.21.15.50:0/237351816 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.917+0000 7fd78ed7e640 1 -- 172.21.15.50:0/237351816 >> v1:172.21.15.22:6789/0 conn(0x55d069dc2fe0 legacy=0x55d069dc3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.917+0000 7fd78ed7e640 1 -- 172.21.15.50:0/237351816 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d069dcb060 con 0x55d069dc7470 2024-05-07T13:56:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.919+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/237351816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc7470 0x55d069dc9860 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd78400a520 tx=0x7fd78401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c636beabcf683be1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.919+0000 7fd78e57d640 1 -- 172.21.15.50:0/237351816 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd784057070 con 0x55d069dc7470 2024-05-07T13:56:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.919+0000 7fd78e57d640 1 -- 172.21.15.50:0/237351816 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd784052570 con 0x55d069dc7470 2024-05-07T13:56:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.919+0000 7fd78e57d640 1 -- 172.21.15.50:0/237351816 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd78404ae60 con 0x55d069dc7470 2024-05-07T13:56:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.920+0000 7fd79392d800 1 -- 172.21.15.50:0/237351816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc7470 msgr2=0x55d069dc9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.920+0000 7fd79392d800 1 --2- 172.21.15.50:0/237351816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc7470 0x55d069dc9860 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd78400a520 tx=0x7fd78401d010 comp rx=0 tx=0).stop 2024-05-07T13:56:10.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.920+0000 7fd79392d800 1 -- 172.21.15.50:0/237351816 shutdown_connections 2024-05-07T13:56:10.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.920+0000 7fd79392d800 1 --2- 172.21.15.50:0/237351816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc7470 0x55d069dc9860 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.920+0000 7fd79392d800 1 -- 172.21.15.50:0/237351816 >> 172.21.15.50:0/237351816 conn(0x55d069dbe5c0 msgr2=0x55d069dc09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.920+0000 7fd79392d800 1 -- 172.21.15.50:0/237351816 shutdown_connections 2024-05-07T13:56:10.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.920+0000 7fd79392d800 1 -- 172.21.15.50:0/237351816 wait complete. 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.935+0000 7fd79392d800 1 Processor -- start 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.935+0000 7fd79392d800 1 -- start start 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.935+0000 7fd79392d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069eb5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.935+0000 7fd79392d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d069d0f1c0 con 0x55d069dc2fe0 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.936+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069eb5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.936+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069eb5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45478/0 (socket says 172.21.15.50:45478) 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.936+0000 7fd78f57f640 1 -- 172.21.15.50:0/3806015923 learned_addr learned my addr 172.21.15.50:0/3806015923 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.936+0000 7fd78f57f640 1 -- 172.21.15.50:0/3806015923 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d069eb5ce0 con 0x55d069dc2fe0 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.936+0000 7fd78f57f640 1 --2- 172.21.15.50:0/3806015923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069eb5710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd78000b230 tx=0x7fd78000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165d8b25d53f0394 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.936+0000 7fd67d60a640 1 -- 172.21.15.50:0/3806015923 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd78000e5c0 con 0x55d069dc2fe0 2024-05-07T13:56:10.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.936+0000 7fd67d60a640 1 -- 172.21.15.50:0/3806015923 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd780006070 con 0x55d069dc2fe0 2024-05-07T13:56:10.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.936+0000 7fd67d60a640 1 -- 172.21.15.50:0/3806015923 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd78000e890 con 0x55d069dc2fe0 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.937+0000 7fd79392d800 1 -- 172.21.15.50:0/3806015923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 msgr2=0x55d069eb5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.937+0000 7fd79392d800 1 --2- 172.21.15.50:0/3806015923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069eb5710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd78000b230 tx=0x7fd78000b6f0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.937+0000 7fd79392d800 1 -- 172.21.15.50:0/3806015923 shutdown_connections 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.937+0000 7fd79392d800 1 --2- 172.21.15.50:0/3806015923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069eb5710 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.937+0000 7fd79392d800 1 -- 172.21.15.50:0/3806015923 >> 172.21.15.50:0/3806015923 conn(0x55d069dbe5c0 msgr2=0x55d069eb3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.937+0000 7fd79392d800 1 -- 172.21.15.50:0/3806015923 shutdown_connections 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.937+0000 7fd79392d800 1 -- 172.21.15.50:0/3806015923 wait complete. 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.937+0000 7fd79392d800 1 Processor -- start 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.937+0000 7fd79392d800 1 -- start start 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.938+0000 7fd79392d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069ebd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.938+0000 7fd79392d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d069dca300 con 0x55d069dc2fe0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.938+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069ebd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.938+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069ebd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45488/0 (socket says 172.21.15.50:45488) 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.938+0000 7fd78f57f640 1 -- 172.21.15.50:0/1477805100 learned_addr learned my addr 172.21.15.50:0/1477805100 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.938+0000 7fd78f57f640 1 -- 172.21.15.50:0/1477805100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d069ebd7d0 con 0x55d069dc2fe0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.938+0000 7fd78f57f640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069ebd290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd780000fd0 tx=0x7fd780000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.939+0000 7fd67be07640 1 -- 172.21.15.50:0/1477805100 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd78000f8d0 con 0x55d069dc2fe0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.939+0000 7fd67be07640 1 -- 172.21.15.50:0/1477805100 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78000fa90 con 0x55d069dc2fe0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.939+0000 7fd67be07640 1 -- 172.21.15.50:0/1477805100 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd78000fdb0 con 0x55d069dc2fe0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.939+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d069ebda60 con 0x55d069dc2fe0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.939+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d069ec0710 con 0x55d069dc2fe0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.939+0000 7fd67be07640 1 -- 172.21.15.50:0/1477805100 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd780017070 con 0x55d069dc2fe0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.940+0000 7fd67be07640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd674036950 0x7fd674038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.940+0000 7fd67be07640 1 -- 172.21.15.50:0/1477805100 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd780015020 con 0x55d069dc2fe0 2024-05-07T13:56:10.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.940+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd674036950 0x7fd674038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.940+0000 7fd79392d800 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069dc7470 0x55d069ec44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.940+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069ec4a50 con 0x55d069dc7470 2024-05-07T13:56:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.940+0000 7fd78fd80640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069dc7470 0x55d069ec44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.940+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd674036950 0x7fd674038e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd784054000 tx=0x7fd78404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.940+0000 7fd78fd80640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069dc7470 0x55d069ec44d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.941+0000 7fd78fd80640 1 -- 172.21.15.50:0/1477805100 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069dc7470 2024-05-07T13:56:10.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.941+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069ec1aa0 con 0x55d069dc7470 2024-05-07T13:56:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.941+0000 7fd78fd80640 1 -- 172.21.15.50:0/1477805100 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069dc7470 2024-05-07T13:56:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.941+0000 7fd79392d800 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069ec6d80 0x55d069ec9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.941+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069ec9860 con 0x55d069ec6d80 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.941+0000 7fd78f57f640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069ec6d80 0x55d069ec9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.941+0000 7fd78f57f640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069ec6d80 0x55d069ec9170 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.942+0000 7fd78f57f640 1 -- 172.21.15.50:0/1477805100 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd78002e070 con 0x55d069ec6d80 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.942+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069ec5d00 con 0x55d069dc7470 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.942+0000 7fd78fd80640 1 -- 172.21.15.50:0/1477805100 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069dc7470 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.942+0000 7fd79392d800 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d069ecacc0 0x55d069ecd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.942+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069ecd890 con 0x55d069ecacc0 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.942+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d069ecacc0 0x55d069ecd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.943+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d069ecacc0 0x55d069ecd130 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.943+0000 7fd78ed7e640 1 -- 172.21.15.50:0/1477805100 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd78405a040 con 0x55d069ecacc0 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.943+0000 7fd79392d800 1 Processor -- start 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.943+0000 7fd79392d800 1 -- start start 2024-05-07T13:56:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd79392d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eb1650 0x55d069eafac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd79392d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d069cb5cf0 con 0x55d069eb1650 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eb1650 0x55d069eafac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eb1650 0x55d069eafac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45504/0 (socket says 172.21.15.50:45504) 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd78f57f640 1 -- 172.21.15.50:0/318877248 learned_addr learned my addr 172.21.15.50:0/318877248 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd78f57f640 1 -- 172.21.15.50:0/318877248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d069eb0000 con 0x55d069eb1650 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd78f57f640 1 --2- 172.21.15.50:0/318877248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eb1650 0x55d069eafac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd78001d5c0 tx=0x7fd780017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd679602640 1 -- 172.21.15.50:0/318877248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd780044c60 con 0x55d069eb1650 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd679602640 1 -- 172.21.15.50:0/318877248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd780044e00 con 0x55d069eb1650 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd79392d800 1 -- 172.21.15.50:0/318877248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d069eb0230 con 0x55d069eb1650 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.944+0000 7fd679602640 1 -- 172.21.15.50:0/318877248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7800408d0 con 0x55d069eb1650 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.945+0000 7fd79392d800 1 -- 172.21.15.50:0/318877248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d069eb0730 con 0x55d069eb1650 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.945+0000 7fd679602640 1 -- 172.21.15.50:0/318877248 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd780051020 con 0x55d069eb1650 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.945+0000 7fd679602640 1 --2- 172.21.15.50:0/318877248 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd668036900 0x7fd668038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.945+0000 7fd679602640 1 -- 172.21.15.50:0/318877248 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd78003dc90 con 0x55d069eb1650 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/318877248 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd668036900 0x7fd668038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd79392d800 1 Processor -- start 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd79392d800 1 -- start start 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/318877248 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd668036900 0x7fd668038dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55d069ec5330 tx=0x7fd784005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd79392d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069eeb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd79392d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d069eb6060 con 0x55d069eeb080 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069eeb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069eeb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45518/0 (socket says 172.21.15.50:45518) 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd78f57f640 1 -- 172.21.15.50:0/2538483689 learned_addr learned my addr 172.21.15.50:0/2538483689 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.946+0000 7fd78f57f640 1 -- 172.21.15.50:0/2538483689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d069eeba70 con 0x55d069eeb080 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd78f57f640 1 --2- 172.21.15.50:0/2538483689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069eeb4a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd780045140 tx=0x7fd780026570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369d17952c7b0d09 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd672ffd640 1 -- 172.21.15.50:0/2538483689 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd780058030 con 0x55d069eeb080 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd672ffd640 1 -- 172.21.15.50:0/2538483689 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd780005dd0 con 0x55d069eeb080 2024-05-07T13:56:10.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd672ffd640 1 -- 172.21.15.50:0/2538483689 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd780031d20 con 0x55d069eeb080 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd79392d800 1 -- 172.21.15.50:0/2538483689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 msgr2=0x55d069eeb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd79392d800 1 --2- 172.21.15.50:0/2538483689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069eeb4a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd780045140 tx=0x7fd780026570 comp rx=0 tx=0).stop 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd79392d800 1 -- 172.21.15.50:0/2538483689 shutdown_connections 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd79392d800 1 --2- 172.21.15.50:0/2538483689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069eeb4a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd79392d800 1 -- 172.21.15.50:0/2538483689 >> 172.21.15.50:0/2538483689 conn(0x55d069ee73a0 msgr2=0x55d069ee5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd79392d800 1 -- 172.21.15.50:0/2538483689 shutdown_connections 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.947+0000 7fd79392d800 1 -- 172.21.15.50:0/2538483689 wait complete. 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.948+0000 7fd79392d800 1 Processor -- start 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.948+0000 7fd79392d800 1 -- start start 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.948+0000 7fd79392d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069ef24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.948+0000 7fd79392d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d069eec190 con 0x55d069eeb080 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.948+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069ef24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.948+0000 7fd78f57f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069ef24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45524/0 (socket says 172.21.15.50:45524) 2024-05-07T13:56:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.948+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 learned_addr learned my addr 172.21.15.50:0/3107120127 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.948+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d069ef2a10 con 0x55d069eeb080 2024-05-07T13:56:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.949+0000 7fd78f57f640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069ef24d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd780045140 tx=0x7fd7800282b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.949+0000 7fd6717fa640 1 -- 172.21.15.50:0/3107120127 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd780031580 con 0x55d069eeb080 2024-05-07T13:56:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.949+0000 7fd6717fa640 1 -- 172.21.15.50:0/3107120127 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78003f4a0 con 0x55d069eeb080 2024-05-07T13:56:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.949+0000 7fd6717fa640 1 -- 172.21.15.50:0/3107120127 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd78001c620 con 0x55d069eeb080 2024-05-07T13:56:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.949+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d069ef2a10 con 0x55d069eeb080 2024-05-07T13:56:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.949+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d069ef2a10 con 0x55d069eeb080 2024-05-07T13:56:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.950+0000 7fd6717fa640 1 -- 172.21.15.50:0/3107120127 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd78006b070 con 0x55d069eeb080 2024-05-07T13:56:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.950+0000 7fd6717fa640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd658036900 0x7fd658038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.950+0000 7fd6717fa640 1 -- 172.21.15.50:0/3107120127 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd78005c070 con 0x55d069eeb080 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.950+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd658036900 0x7fd658038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.950+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd658036900 0x7fd658038dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd784052fd0 tx=0x7fd78404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd79392d800 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069efdba0 0x55d069f00060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f007b0 con 0x55d069efdba0 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd78fd80640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069efdba0 0x55d069f00060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd78fd80640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069efdba0 0x55d069f00060 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069efdba0 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd79392d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd79392d800 20 realm 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.951+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f00bc0 con 0x55d069efdba0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069efdba0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01490 con 0x55d069efdba0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069efdba0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x55d069efdba0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069efdba0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069f02590 0x55d069f04980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f04f90 con 0x55d069f02590 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd78f57f640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069f02590 0x55d069f04980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.952+0000 7fd78f57f640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069f02590 0x55d069f04980 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.953+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.953+0000 7fd79392d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.953+0000 7fd79392d800 20 searching for the correct realm 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.953+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f068a0 con 0x55d069f02590 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.953+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.953+0000 7fd78f57f640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd780054040 0x7fd780021ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.953+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f068a0 con 0x7fd780054040 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.954+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd780054040 0x7fd780021ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.954+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd780054040 0x7fd780021ab0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.954+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.954+0000 7fd78ed7e640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd784074040 0x7fd784081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.954+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f068a0 con 0x7fd784074040 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.954+0000 7fd78fd80640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd784074040 0x7fd784081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.955+0000 7fd78fd80640 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd784074040 0x7fd784081410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.955+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78800a4a0 con 0x7fd784074040 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.955+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x55d069efdba0 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.955+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069efdba0 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.955+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x55d069efdba0 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.955+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069efdba0 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.955+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x7fd784074040 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.956+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78800a4a0 con 0x7fd784074040 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.956+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x7fd784074040 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.956+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd78800a4a0 con 0x7fd784074040 2024-05-07T13:56:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.956+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x7fd780054040 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.956+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.956+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x55d069f02590 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.956+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.956+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x55d069efdba0 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069efdba0 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x7fd784074040 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78800a4a0 con 0x7fd784074040 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x55d069efdba0 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069efdba0 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d069f01830 con 0x7fd780054040 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069f02590 2024-05-07T13:56:10.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.957+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069f02590 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.958+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.958+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x7fd784074040 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.958+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78800a4a0 con 0x7fd784074040 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.958+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069f02590 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.958+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.958+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069f02590 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.959+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.959+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069efdba0 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.959+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78800a4a0 con 0x55d069efdba0 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.959+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069efdba0 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.959+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.959+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x7fd784074040 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.960+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.960+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069f02590 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.960+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.960+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x7fd780054040 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.960+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.960+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069efdba0 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.960+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.960+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x7fd784074040 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.961+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.961+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069f02590 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.961+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.961+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x7fd784074040 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.961+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.962+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x7fd780054040 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.962+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.962+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069f02590 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.962+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.962+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x7fd784074040 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.962+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.962+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x55d069efdba0 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd78408e060 con 0x7fd780054040 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:10.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f05850 con 0x55d069efdba0 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f05c40 con 0x55d069efdba0 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.963+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f05c40 con 0x7fd784074040 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 20 zone default found 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 4 Realm: () 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 20 zonegroup default 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f053d0 con 0x7fd784074040 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f053d0 con 0x55d069f02590 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.964+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f087a0 con 0x55d069f02590 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.965+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.965+0000 7fd79392d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.965+0000 7fd79392d800 20 started sync module instance, tier type = 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.965+0000 7fd79392d800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.965+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f07ba0 con 0x7fd780054040 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.966+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.966+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94353618927504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f07800 con 0x7fd780054040 2024-05-07T13:56:10.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.966+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f096d0 con 0x55d069efdba0 2024-05-07T13:56:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.967+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.967+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94353618927504] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.967+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94353618932736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f09e90 con 0x55d069efdba0 2024-05-07T13:56:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.967+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f08c40 con 0x55d069f02590 2024-05-07T13:56:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.968+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94353618932736] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.968+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.968+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94353618933984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0a930 con 0x55d069f02590 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.968+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0b2f0 con 0x7fd780054040 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.969+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94353618933984] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.969+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.969+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94353618936960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0a8a0 con 0x7fd780054040 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.969+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0c1b0 con 0x55d069efdba0 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.970+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94353618936960] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.970+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.970+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94353618943232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0c5d0 con 0x55d069efdba0 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.970+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0cf90 con 0x7fd784074040 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.971+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94353618943232] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.971+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.971+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94353618944768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0cf90 con 0x7fd784074040 2024-05-07T13:56:10.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.971+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0d950 con 0x7fd784074040 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.972+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94353618944768] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.972+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.972+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94353618946784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0db30 con 0x7fd784074040 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.972+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0e380 con 0x7fd784074040 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94353618951440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0e720 con 0x7fd784074040 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd79392d800 20 add_watcher() i=0 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd79392d800 20 add_watcher() i=1 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd79392d800 20 add_watcher() i=2 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd79392d800 20 add_watcher() i=3 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd79392d800 20 add_watcher() i=4 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd79392d800 20 add_watcher() i=5 2024-05-07T13:56:10.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94353618946784] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.973+0000 7fd79392d800 20 add_watcher() i=6 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.974+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94353618951440] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.974+0000 7fd79392d800 20 add_watcher() i=7 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.974+0000 7fd79392d800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.974+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0d680 con 0x55d069efdba0 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.975+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.975+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94353618952624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f0d680 con 0x55d069efdba0 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94353618952624] v27'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd79392d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd79392d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd79392d800 5 note: GC not initialized 2024-05-07T13:56:10.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd644fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd79392d800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd79392d800 20 Filter name: none 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd5be7fc640 20 reqs_thread_entry: start 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.976+0000 7fd79392d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.977+0000 7fd79392d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.977+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f44cb0 con 0x55d069efdba0 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.977+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.977+0000 7fd79392d800 20 rados_obj.operate() r=0 bl.length=673 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.977+0000 7fd79392d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.977+0000 7fd79392d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.977+0000 7fd79392d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.977+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f4b490 con 0x55d069efdba0 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v27'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd79392d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd79392d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd79392d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94353619201792 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f4a0f0 con 0x55d069efdba0 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94353618943232 notify 115964117000 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7fd78801e040 con 0x55d069efdba0 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd672ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 94353618943232 notifier 4397 bl.length()=758 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd672ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd672ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd672ffd640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fd654003ea0 con 0x55d069efdba0 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.978+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(64 notify.4 [notify cookie 94353619201792 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.979+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.979+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 94353619201792 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd7880279c0 con 0x55d069efdba0 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.979+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f4af00 con 0x55d069efdba0 2024-05-07T13:56:10.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.980+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(66 foo:foo1 [delete] v27'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.980+0000 7fd79392d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-07T13:56:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.980+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94353619201792 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x7fd780054040 2024-05-07T13:56:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.980+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== watch-notify(notify (1) cookie 94353618927504 notify 115964116996 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fd784088040 con 0x7fd780054040 2024-05-07T13:56:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.980+0000 7fd6727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94353618927504 notifier 4397 bl.length()=159 2024-05-07T13:56:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.980+0000 7fd6727fc640 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fd5c40032c0 con 0x7fd780054040 2024-05-07T13:56:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.980+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.0 [notify cookie 94353619201792 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.980+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.980+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== watch-notify(notify_complete (2) cookie 94353619201792 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d069dcb060 con 0x7fd780054040 2024-05-07T13:56:10.978 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-07T13:56:10.715259Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:10.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.981+0000 7fd645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.981+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94353618952624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x55d069efdba0 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.982+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94353618952624] v27'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.982+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94353618927504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x7fd780054040 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.983+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94353618927504] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.983+0000 7fd79392d800 20 remove_watcher() i=0 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.983+0000 7fd79392d800 2 removed watcher, disabling cache 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.983+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94353618932736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x55d069efdba0 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.985+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94353618932736] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.985+0000 7fd79392d800 20 remove_watcher() i=1 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.985+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94353618933984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x55d069f02590 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.986+0000 7fd78f57f640 1 -- 172.21.15.50:0/3107120127 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94353618933984] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd780080040 con 0x55d069f02590 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.986+0000 7fd79392d800 20 remove_watcher() i=2 2024-05-07T13:56:10.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.986+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94353618936960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x7fd780054040 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.987+0000 7fd78ed7e640 1 -- 172.21.15.50:0/3107120127 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94353618936960] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78407f070 con 0x7fd780054040 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.987+0000 7fd79392d800 20 remove_watcher() i=3 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.987+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94353618943232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x55d069efdba0 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.988+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94353618943232] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x55d069efdba0 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.988+0000 7fd79392d800 20 remove_watcher() i=4 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.988+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94353618944768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x7fd784074040 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.989+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94353618944768] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.989+0000 7fd79392d800 20 remove_watcher() i=5 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.989+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94353618946784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x7fd784074040 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.990+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94353618946784] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.990+0000 7fd79392d800 20 remove_watcher() i=6 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.990+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94353618951440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d069f49c40 con 0x7fd784074040 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94353618951440] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd78802f060 con 0x7fd784074040 2024-05-07T13:56:10.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 20 remove_watcher() i=7 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd784074040 msgr2=0x7fd784081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd784074040 0x7fd784081410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069efdba0 msgr2=0x55d069f00060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069efdba0 0x55d069f00060 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd780054040 msgr2=0x7fd780021ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd780054040 0x7fd780021ab0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069f02590 msgr2=0x55d069f04980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069f02590 0x55d069f04980 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd658036900 msgr2=0x7fd658038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd658036900 0x7fd658038dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd784052fd0 tx=0x7fd78404f000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 msgr2=0x55d069ef24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 --2- 172.21.15.50:0/3107120127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eeb080 0x55d069ef24d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd780045140 tx=0x7fd7800282b0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 reap_dead start 2024-05-07T13:56:10.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd78fd80640 1 -- 172.21.15.50:0/3107120127 reap_dead start 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 shutdown_connections 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 >> 172.21.15.50:0/3107120127 conn(0x55d069ee73a0 msgr2=0x55d069ee4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 shutdown_connections 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/3107120127 wait complete. 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/318877248 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd668036900 msgr2=0x7fd668038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 --2- 172.21.15.50:0/318877248 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd668036900 0x7fd668038dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55d069ec5330 tx=0x7fd784005ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 -- 172.21.15.50:0/318877248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eb1650 msgr2=0x55d069eafac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.991+0000 7fd79392d800 1 --2- 172.21.15.50:0/318877248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eb1650 0x55d069eafac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd78001d5c0 tx=0x7fd780017d70 comp rx=0 tx=0).stop 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/318877248 shutdown_connections 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 --2- 172.21.15.50:0/318877248 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd668036900 0x7fd668038dc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 --2- 172.21.15.50:0/318877248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069eb1650 0x55d069eafac0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/318877248 >> 172.21.15.50:0/318877248 conn(0x55d069ecfd90 msgr2=0x55d069ed0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/318877248 shutdown_connections 2024-05-07T13:56:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/318877248 wait complete. 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d069ecacc0 msgr2=0x55d069ecd130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d069ecacc0 0x55d069ecd130 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069dc7470 msgr2=0x55d069ec44d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d069dc7470 0x55d069ec44d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069ec6d80 msgr2=0x55d069ec9170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d069ec6d80 0x55d069ec9170 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd674036950 msgr2=0x7fd674038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd674036950 0x7fd674038e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd784054000 tx=0x7fd78404e000 comp rx=0 tx=0).stop 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 msgr2=0x55d069ebd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 --2- 172.21.15.50:0/1477805100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d069dc2fe0 0x55d069ebd290 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd780000fd0 tx=0x7fd780000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd78fd80640 1 -- 172.21.15.50:0/1477805100 reap_dead start 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 shutdown_connections 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 >> 172.21.15.50:0/1477805100 conn(0x55d069dbe5c0 msgr2=0x55d069eaefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 shutdown_connections 2024-05-07T13:56:10.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:10.992+0000 7fd79392d800 1 -- 172.21.15.50:0/1477805100 wait complete. 2024-05-07T13:56:10.990 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-07T13:56:10.715259Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:10.990 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-07T13:56:10.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-07T13:56:10.991 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-05-07T13:56:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:11.036 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:11.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.048+0000 7f52c9b19800 1 Processor -- start 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.048+0000 7f52c9b19800 1 -- start start 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.048+0000 7f52c9b19800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ea069c9520 0x55ea069d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.048+0000 7f52c9b19800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea0693c920 con 0x55ea069c79e0 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.048+0000 7f52c9b19800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55ea0685a050 con 0x55ea069c9520 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.049+0000 7f52c6e17640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ea069c9520 0x55ea069d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.049+0000 7f52c6e17640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ea069c9520 0x55ea069d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45538/0 (socket says 172.21.15.50:45538) 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.049+0000 7f52c6e17640 1 -- 172.21.15.50:0/3472226050 learned_addr learned my addr 172.21.15.50:0/3472226050 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.049+0000 7f52c7618640 1 --1- 172.21.15.50:0/3472226050 >> v1:172.21.15.22:6789/0 conn(0x55ea069c79e0 0x55ea069c7e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39672/0 (socket says 172.21.15.50:39672) 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.049+0000 7f52c6e17640 1 -- 172.21.15.50:0/3472226050 >> v1:172.21.15.22:6789/0 conn(0x55ea069c79e0 legacy=0x55ea069c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.049+0000 7f52c6e17640 1 -- 172.21.15.50:0/3472226050 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea069d3570 con 0x55ea069c9520 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.051+0000 7f52c6e17640 1 --2- 172.21.15.50:0/3472226050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c9520 0x55ea069d2020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00a520 tx=0x7f52bc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a94d6b118fe0d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.051+0000 7f52c6616640 1 -- 172.21.15.50:0/3472226050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52bc057070 con 0x55ea069c9520 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.051+0000 7f52c6616640 1 -- 172.21.15.50:0/3472226050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52bc052570 con 0x55ea069c9520 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.051+0000 7f52c6616640 1 -- 172.21.15.50:0/3472226050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52bc052870 con 0x55ea069c9520 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.051+0000 7f52c9b19800 1 -- 172.21.15.50:0/3472226050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c9520 msgr2=0x55ea069d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.051+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3472226050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c9520 0x55ea069d2020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00a520 tx=0x7f52bc01d010 comp rx=0 tx=0).stop 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.051+0000 7f52c9b19800 1 -- 172.21.15.50:0/3472226050 shutdown_connections 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.051+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3472226050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c9520 0x55ea069d2020 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.051+0000 7f52c9b19800 1 -- 172.21.15.50:0/3472226050 >> 172.21.15.50:0/3472226050 conn(0x55ea069c35a0 msgr2=0x55ea069c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.052+0000 7f52c9b19800 1 -- 172.21.15.50:0/3472226050 shutdown_connections 2024-05-07T13:56:11.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.052+0000 7f52c9b19800 1 -- 172.21.15.50:0/3472226050 wait complete. 2024-05-07T13:56:11.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.066+0000 7f52c9b19800 1 Processor -- start 2024-05-07T13:56:11.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.067+0000 7f52c9b19800 1 -- start start 2024-05-07T13:56:11.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.067+0000 7f52c9b19800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06abc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.067+0000 7f52c9b19800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ea069141d0 con 0x55ea069c79e0 2024-05-07T13:56:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.067+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06abc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.067+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06abc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45552/0 (socket says 172.21.15.50:45552) 2024-05-07T13:56:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.067+0000 7f52c7618640 1 -- 172.21.15.50:0/2150481932 learned_addr learned my addr 172.21.15.50:0/2150481932 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.067+0000 7f52c7618640 1 -- 172.21.15.50:0/2150481932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea06abcfc0 con 0x55ea069c79e0 2024-05-07T13:56:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.067+0000 7f52c7618640 1 --2- 172.21.15.50:0/2150481932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06abc9f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f52b8001e90 tx=0x7f52b800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1720071312e11ddd server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f51b560a640 1 -- 172.21.15.50:0/2150481932 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b800e5c0 con 0x55ea069c79e0 2024-05-07T13:56:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f51b560a640 1 -- 172.21.15.50:0/2150481932 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b8006070 con 0x55ea069c79e0 2024-05-07T13:56:11.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f51b560a640 1 -- 172.21.15.50:0/2150481932 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b800e890 con 0x55ea069c79e0 2024-05-07T13:56:11.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f52c9b19800 1 -- 172.21.15.50:0/2150481932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 msgr2=0x55ea06abc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f52c9b19800 1 --2- 172.21.15.50:0/2150481932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06abc9f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f52b8001e90 tx=0x7f52b800b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f52c9b19800 1 -- 172.21.15.50:0/2150481932 shutdown_connections 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f52c9b19800 1 --2- 172.21.15.50:0/2150481932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06abc9f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f52c9b19800 1 -- 172.21.15.50:0/2150481932 >> 172.21.15.50:0/2150481932 conn(0x55ea069c35a0 msgr2=0x55ea06ab8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f52c9b19800 1 -- 172.21.15.50:0/2150481932 shutdown_connections 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.068+0000 7f52c9b19800 1 -- 172.21.15.50:0/2150481932 wait complete. 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.069+0000 7f52c9b19800 1 Processor -- start 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.069+0000 7f52c9b19800 1 -- start start 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.069+0000 7f52c9b19800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06ac4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.069+0000 7f52c9b19800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ea069d2830 con 0x55ea069c79e0 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.069+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06ac4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.069+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06ac4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45566/0 (socket says 172.21.15.50:45566) 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.069+0000 7f52c7618640 1 -- 172.21.15.50:0/1479083610 learned_addr learned my addr 172.21.15.50:0/1479083610 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.069+0000 7f52c7618640 1 -- 172.21.15.50:0/1479083610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea06ac4ad0 con 0x55ea069c79e0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.069+0000 7f52c7618640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06ac4590 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f52b8001ed0 tx=0x7f52b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.070+0000 7f51b3e07640 1 -- 172.21.15.50:0/1479083610 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b801a880 con 0x55ea069c79e0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.070+0000 7f51b3e07640 1 -- 172.21.15.50:0/1479083610 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b801aa20 con 0x55ea069c79e0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.070+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea06ac4d60 con 0x55ea069c79e0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.070+0000 7f51b3e07640 1 -- 172.21.15.50:0/1479083610 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b801ad40 con 0x55ea069c79e0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.070+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea06ac7a10 con 0x55ea069c79e0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.071+0000 7f51b3e07640 1 -- 172.21.15.50:0/1479083610 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f52b8017070 con 0x55ea069c79e0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.071+0000 7f51b3e07640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51ac036950 0x7f51ac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.071+0000 7f51b3e07640 1 -- 172.21.15.50:0/1479083610 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f52b8015020 con 0x55ea069c79e0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.071+0000 7f52c6e17640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51ac036950 0x7f51ac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.071+0000 7f52c9b19800 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea069c9520 0x55ea06acb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.071+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06acbda0 con 0x55ea069c9520 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.071+0000 7f52c7e19640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea069c9520 0x55ea06acb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.071+0000 7f52c6e17640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51ac036950 0x7f51ac038e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f52bc054000 tx=0x7f52bc04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.071+0000 7f52c7e19640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea069c9520 0x55ea06acb7d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.072+0000 7f52c7e19640 1 -- 172.21.15.50:0/1479083610 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea069c9520 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.072+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06ac8da0 con 0x55ea069c9520 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.072+0000 7f52c7e19640 1 -- 172.21.15.50:0/1479083610 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea069c9520 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.072+0000 7f52c9b19800 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06ace0b0 0x55ea06ad04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.072+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06ad0b40 con 0x55ea06ace0b0 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.072+0000 7f52c7618640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06ace0b0 0x55ea06ad04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.072+0000 7f52c7618640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06ace0b0 0x55ea06ad04a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.073+0000 7f52c7618640 1 -- 172.21.15.50:0/1479083610 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f52b802e070 con 0x55ea06ace0b0 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.073+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06acd060 con 0x55ea069c9520 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.073+0000 7f52c7e19640 1 -- 172.21.15.50:0/1479083610 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea069c9520 2024-05-07T13:56:11.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.073+0000 7f52c9b19800 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ea06ad1ff0 0x55ea06ad4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.073+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06ad4ba0 con 0x55ea06ad1ff0 2024-05-07T13:56:11.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.073+0000 7f52c6e17640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ea06ad1ff0 0x55ea06ad4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.074+0000 7f52c6e17640 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ea06ad1ff0 0x55ea06ad4440 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.074+0000 7f52c6e17640 1 -- 172.21.15.50:0/1479083610 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f52bc05a040 con 0x55ea06ad1ff0 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.074+0000 7f52c9b19800 1 Processor -- start 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f52c9b19800 1 -- start start 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f52c9b19800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06ae3000 0x55ea06ae3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f52c9b19800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ea068bacf0 con 0x55ea06ae3000 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06ae3000 0x55ea06ae3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06ae3000 0x55ea06ae3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45570/0 (socket says 172.21.15.50:45570) 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f52c7618640 1 -- 172.21.15.50:0/2381491427 learned_addr learned my addr 172.21.15.50:0/2381491427 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f52c7618640 1 -- 172.21.15.50:0/2381491427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea06ae3960 con 0x55ea06ae3000 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f52c7618640 1 --2- 172.21.15.50:0/2381491427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06ae3000 0x55ea06ae3420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f52b801cfd0 tx=0x7f52b801b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f51b1602640 1 -- 172.21.15.50:0/2381491427 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8017d60 con 0x55ea06ae3000 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f51b1602640 1 -- 172.21.15.50:0/2381491427 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b8046040 con 0x55ea06ae3000 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f51b1602640 1 -- 172.21.15.50:0/2381491427 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b801d580 con 0x55ea06ae3000 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.075+0000 7f52c9b19800 1 -- 172.21.15.50:0/2381491427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea06ae43d0 con 0x55ea06ae3000 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.076+0000 7f52c9b19800 1 -- 172.21.15.50:0/2381491427 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea06ae48d0 con 0x55ea06ae3000 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.076+0000 7f51b1602640 1 -- 172.21.15.50:0/2381491427 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f52b801d720 con 0x55ea06ae3000 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.076+0000 7f51b1602640 1 --2- 172.21.15.50:0/2381491427 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51a0036950 0x7f51a0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.076+0000 7f51b1602640 1 -- 172.21.15.50:0/2381491427 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f52b803cc90 con 0x55ea06ae3000 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c6e17640 1 --2- 172.21.15.50:0/2381491427 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51a0036950 0x7f51a0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c9b19800 1 Processor -- start 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c9b19800 1 -- start start 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c6e17640 1 --2- 172.21.15.50:0/2381491427 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51a0036950 0x7f51a0038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55ea06ac8cc0 tx=0x7f52bc005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c9b19800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c9b19800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ea06abd340 con 0x55ea06af0180 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45572/0 (socket says 172.21.15.50:45572) 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c7618640 1 -- 172.21.15.50:0/3632223582 learned_addr learned my addr 172.21.15.50:0/3632223582 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.077+0000 7f52c7618640 1 -- 172.21.15.50:0/3632223582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea06af0b70 con 0x55ea06af0180 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f52c7618640 1 --2- 172.21.15.50:0/3632223582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af05a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f52b801bab0 tx=0x7f52b803a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5a98aa4451cbaf server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f51aaffd640 1 -- 172.21.15.50:0/3632223582 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b804be60 con 0x55ea06af0180 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f51aaffd640 1 -- 172.21.15.50:0/3632223582 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b804bba0 con 0x55ea06af0180 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f51aaffd640 1 -- 172.21.15.50:0/3632223582 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8019d20 con 0x55ea06af0180 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f52c9b19800 1 -- 172.21.15.50:0/3632223582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 msgr2=0x55ea06af05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3632223582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af05a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f52b801bab0 tx=0x7f52b803a3e0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f52c9b19800 1 -- 172.21.15.50:0/3632223582 shutdown_connections 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3632223582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af05a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f52c9b19800 1 -- 172.21.15.50:0/3632223582 >> 172.21.15.50:0/3632223582 conn(0x55ea06aec4e0 msgr2=0x55ea06aea540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f52c9b19800 1 -- 172.21.15.50:0/3632223582 shutdown_connections 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f52c9b19800 1 -- 172.21.15.50:0/3632223582 wait complete. 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.078+0000 7f52c9b19800 1 Processor -- start 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.079+0000 7f52c9b19800 1 -- start start 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.079+0000 7f52c9b19800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.079+0000 7f52c9b19800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ea06af1220 con 0x55ea06af0180 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.079+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.079+0000 7f52c7618640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45576/0 (socket says 172.21.15.50:45576) 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.079+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 learned_addr learned my addr 172.21.15.50:0/3639322772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.079+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea06af7b00 con 0x55ea06af0180 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.080+0000 7f52c7618640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af75c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f52b800bc10 tx=0x7f52b8044870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.080+0000 7f51a97fa640 1 -- 172.21.15.50:0/3639322772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b806f070 con 0x55ea06af0180 2024-05-07T13:56:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.080+0000 7f51a97fa640 1 -- 172.21.15.50:0/3639322772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b8031450 con 0x55ea06af0180 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.080+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea06af7b00 con 0x55ea06af0180 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.080+0000 7f51a97fa640 1 -- 172.21.15.50:0/3639322772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b804be60 con 0x55ea06af0180 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.080+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea06af7b00 con 0x55ea06af0180 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.081+0000 7f51a97fa640 1 -- 172.21.15.50:0/3639322772 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f52b8072070 con 0x55ea06af0180 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.081+0000 7f51a97fa640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51900368d0 0x7f5190038d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.081+0000 7f51a97fa640 1 -- 172.21.15.50:0/3639322772 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f52b8066030 con 0x55ea06af0180 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.081+0000 7f52c6e17640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51900368d0 0x7f5190038d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea06b02bc0 0x55ea06b05080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b057d0 con 0x55ea06b02bc0 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c7e19640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea06b02bc0 0x55ea06b05080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c6e17640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51900368d0 0x7f5190038d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f52bc055040 tx=0x7f52bc04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c7e19640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea06b02bc0 0x55ea06b05080 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c9b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c9b19800 20 realm 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.082+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b05be0 con 0x55ea06b02bc0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b064b0 con 0x55ea06b02bc0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x55ea06b02bc0 2024-05-07T13:56:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06b075b0 0x55ea06b099a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b09fb0 con 0x55ea06b075b0 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.083+0000 7f52c7618640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06b075b0 0x55ea06b099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.084+0000 7f52c7618640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06b075b0 0x55ea06b099a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.084+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.084+0000 7f52c9b19800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.084+0000 7f52c9b19800 20 searching for the correct realm 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.084+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0b8e0 con 0x55ea06b075b0 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.084+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.085+0000 7f52c7618640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f52b8074060 0x7f52b805f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.085+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0b8e0 con 0x7f52b8074060 2024-05-07T13:56:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.085+0000 7f52c6e17640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f52b8074060 0x7f52b805f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.085+0000 7f52c6e17640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f52b8074060 0x7f52b805f430 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.085+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.085+0000 7f52c6e17640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f52bc074040 0x7f52bc081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.085+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0b8e0 con 0x7f52bc074040 2024-05-07T13:56:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.085+0000 7f52c7e19640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f52bc074040 0x7f52bc081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.086+0000 7f52c7e19640 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f52bc074040 0x7f52bc081410 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.086+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c000a4a0 con 0x7f52bc074040 2024-05-07T13:56:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.086+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x55ea06b02bc0 2024-05-07T13:56:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.086+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.086+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x55ea06b02bc0 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.087+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.087+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x7f52bc074040 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.087+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c000a4a0 con 0x7f52bc074040 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.087+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x7f52bc074040 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.087+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f52c000a4a0 con 0x7f52bc074040 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.087+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x7f52b8074060 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.087+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.087+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x55ea06b075b0 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.088+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.088+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x55ea06b02bc0 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.088+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.088+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x7f52bc074040 2024-05-07T13:56:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.088+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c000a4a0 con 0x7f52bc074040 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.088+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x55ea06b02bc0 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.089+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.089+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b06850 con 0x7f52b8074060 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.089+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.089+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b075b0 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.089+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.089+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b075b0 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.089+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.089+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x7f52bc074040 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.090+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c000a4a0 con 0x7f52bc074040 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.090+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b075b0 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.090+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.090+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b075b0 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.090+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.090+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b02bc0 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.090+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c000a4a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.090+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b02bc0 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.091+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.091+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x7f52bc074040 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.091+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.091+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b075b0 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.091+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.091+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x7f52b8074060 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.092+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.092+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b02bc0 2024-05-07T13:56:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.092+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.092+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x7f52bc074040 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.092+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.092+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b075b0 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.092+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.092+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x7f52bc074040 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.093+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.093+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x7f52b8074060 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.093+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.093+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b075b0 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.093+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.093+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x7f52bc074040 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.093+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.093+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x55ea06b02bc0 2024-05-07T13:56:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f52bc08e060 con 0x7f52b8074060 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0a870 con 0x55ea06b02bc0 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0ac60 con 0x55ea06b02bc0 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.094+0000 7f52c9b19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0ac60 con 0x7f52bc074040 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 20 zone default found 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 4 Realm: () 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 20 zonegroup default 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0bd60 con 0x7f52bc074040 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0d740 con 0x55ea06b075b0 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.095+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0dae0 con 0x55ea06b075b0 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.096+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.096+0000 7f52c9b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.096+0000 7f52c9b19800 20 started sync module instance, tier type = 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.096+0000 7f52c9b19800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.096+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0cbe0 con 0x7f52b8074060 2024-05-07T13:56:11.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.097+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.097+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94463622956848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0de80 con 0x7f52b8074060 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.097+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0e6d0 con 0x55ea06b02bc0 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.098+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94463622956848] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.098+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.098+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94463622963744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0e640 con 0x55ea06b02bc0 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.098+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0f590 con 0x55ea06b075b0 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.099+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94463622963744] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.099+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.099+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94463622967520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b0f930 con 0x55ea06b075b0 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.099+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b10370 con 0x7f52b8074060 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.100+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94463622967520] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.100+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.100+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94463622970944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b10760 con 0x7f52b8074060 2024-05-07T13:56:11.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.100+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b111c0 con 0x55ea06b02bc0 2024-05-07T13:56:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.101+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.101+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94463622974672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b11a90 con 0x55ea06b02bc0 2024-05-07T13:56:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.101+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b12560 con 0x7f52bc074040 2024-05-07T13:56:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.101+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94463622970944] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.102+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94463622974672] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.102+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.102+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94463622979664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b11520 con 0x7f52bc074040 2024-05-07T13:56:11.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.103+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b12a00 con 0x7f52bc074040 2024-05-07T13:56:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.104+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94463622979664] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.104+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.104+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94463622965952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b11520 con 0x7f52bc074040 2024-05-07T13:56:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.104+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b13490 con 0x7f52bc074040 2024-05-07T13:56:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94463622965952] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94463622982080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b13490 con 0x7f52bc074040 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c9b19800 20 add_watcher() i=0 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c9b19800 20 add_watcher() i=1 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c9b19800 20 add_watcher() i=2 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c9b19800 20 add_watcher() i=3 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c9b19800 20 add_watcher() i=4 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c9b19800 20 add_watcher() i=5 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.105+0000 7f52c9b19800 20 add_watcher() i=6 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.106+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94463622982080] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.106+0000 7f52c9b19800 20 add_watcher() i=7 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.106+0000 7f52c9b19800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.106+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b167a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.106+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.106+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94463622984016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b13a20 con 0x55ea06b02bc0 2024-05-07T13:56:11.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.107+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94463622984016] v27'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.107+0000 7f517dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.107+0000 7f52c9b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.107+0000 7f52c9b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.107+0000 7f52c9b19800 5 note: GC not initialized 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.107+0000 7f517cfe1640 20 reqs_thread_entry: start 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 20 Filter name: none 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f50f67fc640 20 reqs_thread_entry: start 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b49d20 con 0x55ea06b02bc0 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 20 rados_obj.operate() r=0 bl.length=582 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.108+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b500e0 con 0x55ea06b02bc0 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.109+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v27'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.109+0000 7f52c9b19800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.109+0000 7f52c9b19800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.109+0000 7f52c9b19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.109+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94463623232336 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4bbc0 con 0x55ea06b02bc0 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.110+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94463622974672 notify 115964117001 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f52c001e040 con 0x55ea06b02bc0 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.110+0000 7f51aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 94463622974672 notifier 4404 bl.length()=732 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.110+0000 7f51aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.110+0000 7f51aaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:11.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.110+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(64 notify.4 [notify cookie 94463623232336 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.110+0000 7f51aaffd640 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f518c003ea0 con 0x55ea06b02bc0 2024-05-07T13:56:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.110+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.110+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 94463623232336 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f52c0005040 con 0x55ea06b02bc0 2024-05-07T13:56:11.108 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-07T13:56:10.715259Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.111+0000 7f517dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.111+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94463622984016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4f6a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.112+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94463622984016] v27'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.112+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94463622956848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4f6a0 con 0x7f52b8074060 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.113+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94463622956848] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.113+0000 7f52c9b19800 20 remove_watcher() i=0 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.113+0000 7f52c9b19800 2 removed watcher, disabling cache 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.113+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94463622963744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4f6a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.114+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94463622963744] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.114+0000 7f52c9b19800 20 remove_watcher() i=1 2024-05-07T13:56:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.114+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94463622967520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4f6a0 con 0x55ea06b075b0 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.115+0000 7f52c7618640 1 -- 172.21.15.50:0/3639322772 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94463622967520] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b8071030 con 0x55ea06b075b0 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.115+0000 7f52c9b19800 20 remove_watcher() i=2 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.115+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94463622970944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4f6a0 con 0x7f52b8074060 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.116+0000 7f52c6e17640 1 -- 172.21.15.50:0/3639322772 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94463622970944] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52bc07f070 con 0x7f52b8074060 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.116+0000 7f52c9b19800 20 remove_watcher() i=3 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.116+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94463622974672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4f6a0 con 0x55ea06b02bc0 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.117+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94463622974672] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x55ea06b02bc0 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.117+0000 7f52c9b19800 20 remove_watcher() i=4 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.117+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94463622979664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4f6a0 con 0x7f52bc074040 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.118+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94463622979664] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.118+0000 7f52c9b19800 20 remove_watcher() i=5 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.118+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94463622965952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4f6a0 con 0x7f52bc074040 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.119+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94463622965952] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.119+0000 7f52c9b19800 20 remove_watcher() i=6 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.119+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94463622982080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ea06b4f6a0 con 0x7f52bc074040 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94463622982080] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52c002f060 con 0x7f52bc074040 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 20 remove_watcher() i=7 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f52bc074040 msgr2=0x7f52bc081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f52bc074040 0x7f52bc081410 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea06b02bc0 msgr2=0x55ea06b05080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea06b02bc0 0x55ea06b05080 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f52b8074060 msgr2=0x7f52b805f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f52b8074060 0x7f52b805f430 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06b075b0 msgr2=0x55ea06b099a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06b075b0 0x55ea06b099a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51900368d0 msgr2=0x7f5190038d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51900368d0 0x7f5190038d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f52bc055040 tx=0x7f52bc04f000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 msgr2=0x55ea06af75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c7e19640 1 -- 172.21.15.50:0/3639322772 reap_dead start 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af75c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f52b800bc10 tx=0x7f52b8044870 comp rx=0 tx=0).stop 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 shutdown_connections 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 --2- 172.21.15.50:0/3639322772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06af0180 0x55ea06af75c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 >> 172.21.15.50:0/3639322772 conn(0x55ea06aec4e0 msgr2=0x55ea06ae9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 shutdown_connections 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.120+0000 7f52c9b19800 1 -- 172.21.15.50:0/3639322772 wait complete. 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/2381491427 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51a0036950 msgr2=0x7f51a0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 --2- 172.21.15.50:0/2381491427 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51a0036950 0x7f51a0038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55ea06ac8cc0 tx=0x7f52bc005ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/2381491427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06ae3000 msgr2=0x55ea06ae3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 --2- 172.21.15.50:0/2381491427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06ae3000 0x55ea06ae3420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f52b801cfd0 tx=0x7f52b801b960 comp rx=0 tx=0).stop 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/2381491427 shutdown_connections 2024-05-07T13:56:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 --2- 172.21.15.50:0/2381491427 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51a0036950 0x7f51a0038e10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 --2- 172.21.15.50:0/2381491427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea06ae3000 0x55ea06ae3420 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/2381491427 >> 172.21.15.50:0/2381491427 conn(0x55ea06ad70a0 msgr2=0x55ea06ad74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/2381491427 shutdown_connections 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/2381491427 wait complete. 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ea06ad1ff0 msgr2=0x55ea06ad4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ea06ad1ff0 0x55ea06ad4440 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea069c9520 msgr2=0x55ea06acb7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ea069c9520 0x55ea06acb7d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06ace0b0 msgr2=0x55ea06ad04a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ea06ace0b0 0x55ea06ad04a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51ac036950 msgr2=0x7f51ac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f51ac036950 0x7f51ac038e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f52bc054000 tx=0x7f52bc04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 msgr2=0x55ea06ac4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 --2- 172.21.15.50:0/1479083610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ea069c79e0 0x55ea06ac4590 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f52b8001ed0 tx=0x7f52b8000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c7e19640 1 -- 172.21.15.50:0/1479083610 reap_dead start 2024-05-07T13:56:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 shutdown_connections 2024-05-07T13:56:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 >> 172.21.15.50:0/1479083610 conn(0x55ea069c35a0 msgr2=0x55ea06ab6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 shutdown_connections 2024-05-07T13:56:11.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.121+0000 7f52c9b19800 1 -- 172.21.15.50:0/1479083610 wait complete. 2024-05-07T13:56:11.121 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-07T13:56:10.715259Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:11.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-07T13:56:11.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-07T13:56:11.121 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-05-07T13:56:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.182+0000 7ff7c432c800 1 Processor -- start 2024-05-07T13:56:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.182+0000 7ff7c432c800 1 -- start start 2024-05-07T13:56:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.182+0000 7ff7c432c800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x555b8e06e470 0x555b8e070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.182+0000 7ff7c432c800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b8e070e30 con 0x555b8e069fe0 2024-05-07T13:56:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.182+0000 7ff7c432c800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x555b8defc050 con 0x555b8e06e470 2024-05-07T13:56:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.182+0000 7ff7b7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x555b8e06e470 0x555b8e070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.182+0000 7ff7b7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x555b8e06e470 0x555b8e070860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45582/0 (socket says 172.21.15.50:45582) 2024-05-07T13:56:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.182+0000 7ff7b7fff640 1 -- 172.21.15.50:0/1705573398 learned_addr learned my addr 172.21.15.50:0/1705573398 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.182+0000 7ff7c0064640 1 --1- 172.21.15.50:0/1705573398 >> v1:172.21.15.22:6789/0 conn(0x555b8e069fe0 0x555b8e06a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39676/0 (socket says 172.21.15.50:39676) 2024-05-07T13:56:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.183+0000 7ff7bf863640 1 -- 172.21.15.50:0/1705573398 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788773692 0 0) 0x555b8e070e30 con 0x555b8e069fe0 2024-05-07T13:56:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.183+0000 7ff7bf863640 1 -- 172.21.15.50:0/1705573398 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7ac001e10 con 0x555b8e069fe0 2024-05-07T13:56:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.183+0000 7ff7b7fff640 1 -- 172.21.15.50:0/1705573398 >> v1:172.21.15.22:6789/0 conn(0x555b8e069fe0 legacy=0x555b8e06a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.183+0000 7ff7b7fff640 1 -- 172.21.15.50:0/1705573398 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e072060 con 0x555b8e06e470 2024-05-07T13:56:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/1705573398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e06e470 0x555b8e070860 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800a520 tx=0x7ff7a801cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1451a51b2716e14c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7bf863640 1 -- 172.21.15.50:0/1705573398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a8057070 con 0x555b8e06e470 2024-05-07T13:56:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7bf863640 1 -- 172.21.15.50:0/1705573398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a8052570 con 0x555b8e06e470 2024-05-07T13:56:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7bf863640 1 -- 172.21.15.50:0/1705573398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a8052850 con 0x555b8e06e470 2024-05-07T13:56:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7c432c800 1 -- 172.21.15.50:0/1705573398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e06e470 msgr2=0x555b8e070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7c432c800 1 --2- 172.21.15.50:0/1705573398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e06e470 0x555b8e070860 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800a520 tx=0x7ff7a801cf30 comp rx=0 tx=0).stop 2024-05-07T13:56:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7c432c800 1 -- 172.21.15.50:0/1705573398 shutdown_connections 2024-05-07T13:56:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7c432c800 1 --2- 172.21.15.50:0/1705573398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e06e470 0x555b8e070860 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7c432c800 1 -- 172.21.15.50:0/1705573398 >> 172.21.15.50:0/1705573398 conn(0x555b8e065580 msgr2=0x555b8e0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7c432c800 1 -- 172.21.15.50:0/1705573398 shutdown_connections 2024-05-07T13:56:11.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.185+0000 7ff7c432c800 1 -- 172.21.15.50:0/1705573398 wait complete. 2024-05-07T13:56:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.200+0000 7ff7c432c800 1 Processor -- start 2024-05-07T13:56:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.200+0000 7ff7c432c800 1 -- start start 2024-05-07T13:56:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.201+0000 7ff7c432c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8dfde6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.201+0000 7ff7c432c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555b8dfb61f0 con 0x555b8e069fe0 2024-05-07T13:56:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.201+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8dfde6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.201+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8dfde6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45590/0 (socket says 172.21.15.50:45590) 2024-05-07T13:56:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.201+0000 7ff7c0064640 1 -- 172.21.15.50:0/557363839 learned_addr learned my addr 172.21.15.50:0/557363839 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.201+0000 7ff7c0064640 1 -- 172.21.15.50:0/557363839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e15f1a0 con 0x555b8e069fe0 2024-05-07T13:56:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.201+0000 7ff7c0064640 1 --2- 172.21.15.50:0/557363839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8dfde6f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0001e60 tx=0x7ff7b000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f6539353fbb7e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.201+0000 7ff6ae60c640 1 -- 172.21.15.50:0/557363839 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b000e5c0 con 0x555b8e069fe0 2024-05-07T13:56:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.202+0000 7ff6ae60c640 1 -- 172.21.15.50:0/557363839 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b0006070 con 0x555b8e069fe0 2024-05-07T13:56:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.202+0000 7ff6ae60c640 1 -- 172.21.15.50:0/557363839 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b000e910 con 0x555b8e069fe0 2024-05-07T13:56:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.202+0000 7ff7c432c800 1 -- 172.21.15.50:0/557363839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 msgr2=0x555b8dfde6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.202+0000 7ff7c432c800 1 --2- 172.21.15.50:0/557363839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8dfde6f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0001e60 tx=0x7ff7b000b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.202+0000 7ff7c432c800 1 -- 172.21.15.50:0/557363839 shutdown_connections 2024-05-07T13:56:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.202+0000 7ff7c432c800 1 --2- 172.21.15.50:0/557363839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8dfde6f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.202+0000 7ff7c432c800 1 -- 172.21.15.50:0/557363839 >> 172.21.15.50:0/557363839 conn(0x555b8e065580 msgr2=0x555b8e156c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.202+0000 7ff7c432c800 1 -- 172.21.15.50:0/557363839 shutdown_connections 2024-05-07T13:56:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.202+0000 7ff7c432c800 1 -- 172.21.15.50:0/557363839 wait complete. 2024-05-07T13:56:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.203+0000 7ff7c432c800 1 Processor -- start 2024-05-07T13:56:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.203+0000 7ff7c432c800 1 -- start start 2024-05-07T13:56:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.203+0000 7ff7c432c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8e164040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.203+0000 7ff7c432c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555b8e071300 con 0x555b8e069fe0 2024-05-07T13:56:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.203+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8e164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.203+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8e164040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45606/0 (socket says 172.21.15.50:45606) 2024-05-07T13:56:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.203+0000 7ff7c0064640 1 -- 172.21.15.50:0/3990493580 learned_addr learned my addr 172.21.15.50:0/3990493580 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.203+0000 7ff7c0064640 1 -- 172.21.15.50:0/3990493580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e164580 con 0x555b8e069fe0 2024-05-07T13:56:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.203+0000 7ff7c0064640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8e164040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000bc10 tx=0x7ff7b0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.204+0000 7ff6ace09640 1 -- 172.21.15.50:0/3990493580 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b000f8d0 con 0x555b8e069fe0 2024-05-07T13:56:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.204+0000 7ff6ace09640 1 -- 172.21.15.50:0/3990493580 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b000fa70 con 0x555b8e069fe0 2024-05-07T13:56:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.204+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b8e164810 con 0x555b8e069fe0 2024-05-07T13:56:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.204+0000 7ff6ace09640 1 -- 172.21.15.50:0/3990493580 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b000fd50 con 0x555b8e069fe0 2024-05-07T13:56:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.204+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8e1674c0 con 0x555b8e069fe0 2024-05-07T13:56:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.205+0000 7ff6ace09640 1 -- 172.21.15.50:0/3990493580 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff7b0017070 con 0x555b8e069fe0 2024-05-07T13:56:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.205+0000 7ff6ace09640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff6a8036950 0x7ff6a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.205+0000 7ff6ace09640 1 -- 172.21.15.50:0/3990493580 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff7b0015020 con 0x555b8e069fe0 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.205+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff6a8036950 0x7ff6a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.205+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e06e470 0x555b8e16b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.205+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e16b850 con 0x555b8e06e470 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.205+0000 7ff7c0865640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e06e470 0x555b8e16b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.205+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff6a8036950 0x7ff6a8038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8054000 tx=0x7ff7a804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.205+0000 7ff7c0865640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e06e470 0x555b8e16b280 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.206+0000 7ff7c0865640 1 -- 172.21.15.50:0/3990493580 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e06e470 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.206+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e168830 con 0x555b8e06e470 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.206+0000 7ff7c0865640 1 -- 172.21.15.50:0/3990493580 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e06e470 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.206+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e16db60 0x555b8e16ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.206+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1705f0 con 0x555b8e16db60 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.206+0000 7ff7c0064640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e16db60 0x555b8e16ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.206+0000 7ff7c0064640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e16db60 0x555b8e16ff50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.207+0000 7ff7c0064640 1 -- 172.21.15.50:0/3990493580 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff7b002e070 con 0x555b8e16db60 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.207+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e16cb10 con 0x555b8e06e470 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.207+0000 7ff7c0865640 1 -- 172.21.15.50:0/3990493580 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e06e470 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.207+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555b8e171aa0 0x555b8e173ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.207+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e174650 con 0x555b8e171aa0 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.207+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555b8e171aa0 0x555b8e173ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.208+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555b8e171aa0 0x555b8e173ef0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.208+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3990493580 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff7a805a040 con 0x555b8e171aa0 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.208+0000 7ff7c432c800 1 Processor -- start 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.208+0000 7ff7c432c800 1 -- start start 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.208+0000 7ff7c432c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e15cd10 0x555b8e15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.208+0000 7ff7c432c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555b8df5ccf0 con 0x555b8e15cd10 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e15cd10 0x555b8e15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e15cd10 0x555b8e15b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45608/0 (socket says 172.21.15.50:45608) 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff7c0064640 1 -- 172.21.15.50:0/2455489601 learned_addr learned my addr 172.21.15.50:0/2455489601 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff7c0064640 1 -- 172.21.15.50:0/2455489601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e15b6c0 con 0x555b8e15cd10 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff7c0064640 1 --2- 172.21.15.50:0/2455489601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e15cd10 0x555b8e15b180 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff7b004b470 tx=0x7ff7b0017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff6a5ffb640 1 -- 172.21.15.50:0/2455489601 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b001f210 con 0x555b8e15cd10 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff6a5ffb640 1 -- 172.21.15.50:0/2455489601 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b001f3b0 con 0x555b8e15cd10 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff7c432c800 1 -- 172.21.15.50:0/2455489601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b8e15b8f0 con 0x555b8e15cd10 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff6a5ffb640 1 -- 172.21.15.50:0/2455489601 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b0044aa0 con 0x555b8e15cd10 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.209+0000 7ff7c432c800 1 -- 172.21.15.50:0/2455489601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8e15bdf0 con 0x555b8e15cd10 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.210+0000 7ff6a5ffb640 1 -- 172.21.15.50:0/2455489601 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff7b0044c40 con 0x555b8e15cd10 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.210+0000 7ff6a5ffb640 1 --2- 172.21.15.50:0/2455489601 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff698036900 0x7ff698038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.210+0000 7ff6a5ffb640 1 -- 172.21.15.50:0/2455489601 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff7b0039070 con 0x555b8e15cd10 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.210+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/2455489601 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff698036900 0x7ff698038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.210+0000 7ff7c432c800 1 Processor -- start 2024-05-07T13:56:11.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff7c432c800 1 -- start start 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/2455489601 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff698036900 0x7ff698038dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x555b8e168770 tx=0x7ff7a8005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff7c432c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e1921f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff7c432c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555b8e15f4f0 con 0x555b8e191dd0 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e1921f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e1921f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45610/0 (socket says 172.21.15.50:45610) 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff7c0064640 1 -- 172.21.15.50:0/3910398789 learned_addr learned my addr 172.21.15.50:0/3910398789 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff7c0064640 1 -- 172.21.15.50:0/3910398789 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e1927c0 con 0x555b8e191dd0 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff7c0064640 1 --2- 172.21.15.50:0/3910398789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e1921f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0024fa0 tx=0x7ff7b003f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc4a21bf9cbf2c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.211+0000 7ff69f7fe640 1 -- 172.21.15.50:0/3910398789 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b0065070 con 0x555b8e191dd0 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff69f7fe640 1 -- 172.21.15.50:0/3910398789 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b004e030 con 0x555b8e191dd0 2024-05-07T13:56:11.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff69f7fe640 1 -- 172.21.15.50:0/3910398789 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b0059040 con 0x555b8e191dd0 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff7c432c800 1 -- 172.21.15.50:0/3910398789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 msgr2=0x555b8e1921f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3910398789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e1921f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0024fa0 tx=0x7ff7b003f800 comp rx=0 tx=0).stop 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff7c432c800 1 -- 172.21.15.50:0/3910398789 shutdown_connections 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3910398789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e1921f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff7c432c800 1 -- 172.21.15.50:0/3910398789 >> 172.21.15.50:0/3910398789 conn(0x555b8e18e130 msgr2=0x555b8e18c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff7c432c800 1 -- 172.21.15.50:0/3910398789 shutdown_connections 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff7c432c800 1 -- 172.21.15.50:0/3910398789 wait complete. 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff7c432c800 1 Processor -- start 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.212+0000 7ff7c432c800 1 -- start start 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff7c432c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff7c432c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555b8e192e70 con 0x555b8e191dd0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff7c0064640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45614/0 (socket says 172.21.15.50:45614) 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 learned_addr learned my addr 172.21.15.50:0/3305692290 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8e1997d0 con 0x555b8e191dd0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff7c0064640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e199290 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0026550 tx=0x7ff7b0024f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff69dffb640 1 -- 172.21.15.50:0/3305692290 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b0065070 con 0x555b8e191dd0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff69dffb640 1 -- 172.21.15.50:0/3305692290 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b0066040 con 0x555b8e191dd0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b8e1997d0 con 0x555b8e191dd0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.213+0000 7ff69dffb640 1 -- 172.21.15.50:0/3305692290 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b0035040 con 0x555b8e191dd0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.214+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8e1997d0 con 0x555b8e191dd0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.214+0000 7ff69dffb640 1 -- 172.21.15.50:0/3305692290 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff7b0072020 con 0x555b8e191dd0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.214+0000 7ff69dffb640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff690036950 0x7ff690038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.214+0000 7ff69dffb640 1 -- 172.21.15.50:0/3305692290 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff7b0070020 con 0x555b8e191dd0 2024-05-07T13:56:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.214+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff690036950 0x7ff690038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.215+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff690036950 0x7ff690038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8052bb0 tx=0x7ff7a804f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.215+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.215+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e1a49e0 0x555b8e1a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.215+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a75f0 con 0x555b8e1a49e0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.215+0000 7ff7c0865640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e1a49e0 0x555b8e1a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.215+0000 7ff7c0865640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e1a49e0 0x555b8e1a6ea0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 20 realm 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a7a00 con 0x555b8e1a49e0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a82d0 con 0x555b8e1a49e0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.216+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x555b8e1a49e0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c432c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e1a93d0 0x555b8e1ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1abdd0 con 0x555b8e1a93d0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c0064640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e1a93d0 0x555b8e1ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c0064640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e1a93d0 0x555b8e1ab7c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c432c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c432c800 20 searching for the correct realm 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.217+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1ad700 con 0x555b8e1a93d0 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.218+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.218+0000 7ff7c0064640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff7b0053030 0x7ff7b00441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.218+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1ad700 con 0x7ff7b0053030 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.218+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff7b0053030 0x7ff7b00441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.218+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff7b0053030 0x7ff7b00441a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.219+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.219+0000 7ff7b7fff640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff7a8074040 0x7ff7a8081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.219+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1ad700 con 0x7ff7a8074040 2024-05-07T13:56:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.219+0000 7ff7c0865640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff7a8074040 0x7ff7a8081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.219+0000 7ff7c0865640 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff7a8074040 0x7ff7a8081410 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.219+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b800a4a0 con 0x7ff7a8074040 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.219+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x555b8e1a49e0 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x555b8e1a49e0 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x7ff7a8074040 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b800a4a0 con 0x7ff7a8074040 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x7ff7a8074040 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff7b800a4a0 con 0x7ff7a8074040 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x7ff7b0053030 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.220+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x555b8e1a93d0 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.221+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.221+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x555b8e1a49e0 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.221+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.221+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x7ff7a8074040 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.221+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b800a4a0 con 0x7ff7a8074040 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.221+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x555b8e1a49e0 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.221+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.221+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1a8670 con 0x7ff7b0053030 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.222+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.222+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a93d0 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.222+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.222+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a93d0 2024-05-07T13:56:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.222+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.222+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x7ff7a8074040 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.222+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b800a4a0 con 0x7ff7a8074040 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.223+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a93d0 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.223+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.223+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a93d0 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.223+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.223+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a49e0 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.223+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b800a4a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.223+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a49e0 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.223+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.223+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x7ff7a8074040 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.224+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.224+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a93d0 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.224+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.224+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x7ff7b0053030 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.224+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.224+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a49e0 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.224+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.224+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x7ff7a8074040 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.225+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.225+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a93d0 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.225+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.225+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x7ff7a8074040 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.226+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.226+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x7ff7b0053030 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.226+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.226+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a93d0 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.226+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.226+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x7ff7a8074040 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.226+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.226+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x555b8e1a49e0 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7ff7a808e060 con 0x7ff7b0053030 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1ac690 con 0x555b8e1a49e0 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1aca80 con 0x555b8e1a49e0 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.227+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1aca80 con 0x7ff7a8074040 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 20 zone default found 2024-05-07T13:56:11.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 4 Realm: () 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 20 zonegroup default 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1adb80 con 0x7ff7a8074040 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.228+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1af560 con 0x555b8e1a93d0 2024-05-07T13:56:11.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.229+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.229+0000 7ff7c432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.229+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.229+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1af900 con 0x555b8e1a93d0 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.229+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.229+0000 7ff7c432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.229+0000 7ff7c432c800 20 started sync module instance, tier type = 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.229+0000 7ff7c432c800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.229+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1aea00 con 0x7ff7b0053030 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.230+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.230+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93851714512208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1afca0 con 0x7ff7b0053030 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.230+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b04f0 con 0x555b8e1a49e0 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.231+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93851714512208] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.231+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.231+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93851714519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b0910 con 0x555b8e1a49e0 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.231+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b12d0 con 0x555b8e1a93d0 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.232+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93851714519104] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.232+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.232+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93851714520640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b12d0 con 0x555b8e1a93d0 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.232+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b1d10 con 0x7ff7b0053030 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.233+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93851714520640] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.233+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.233+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93851714522656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b1240 con 0x7ff7b0053030 2024-05-07T13:56:11.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.233+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b2bd0 con 0x555b8e1a49e0 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.234+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.234+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93851714529568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b3470 con 0x555b8e1a49e0 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.234+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b3f20 con 0x7ff7a8074040 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.234+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93851714522656] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.235+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93851714529568] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.235+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.235+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93851714527488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b2ec0 con 0x7ff7a8074040 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.235+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b47c0 con 0x7ff7a8074040 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.236+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93851714527488] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.237+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.237+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93851714533888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b2ec0 con 0x7ff7a8074040 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.237+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b4d70 con 0x7ff7a8074040 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93851714533888] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93851714536016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b4d70 con 0x7ff7a8074040 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 20 add_watcher() i=0 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 20 add_watcher() i=1 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 20 add_watcher() i=2 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 20 add_watcher() i=3 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 20 add_watcher() i=4 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 20 add_watcher() i=5 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 20 add_watcher() i=6 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93851714536016] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 20 add_watcher() i=7 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.238+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b81a0 con 0x555b8e1a49e0 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.239+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.239+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93851714538128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b56c0 con 0x555b8e1a49e0 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.240+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93851714538128] v27'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.240+0000 7ff6767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.240+0000 7ff7c432c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.240+0000 7ff7c432c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.240+0000 7ff7c432c800 5 note: GC not initialized 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.240+0000 7ff6757e2640 20 reqs_thread_entry: start 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.240+0000 7ff7c432c800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.240+0000 7ff7c432c800 20 Filter name: none 2024-05-07T13:56:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.240+0000 7ff5e6ffd640 20 reqs_thread_entry: start 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.241+0000 7ff7c432c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.241+0000 7ff7c432c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.241+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1eb6b0 con 0x555b8e1a49e0 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.241+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.241+0000 7ff7c432c800 20 rados_obj.operate() r=0 bl.length=556 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.241+0000 7ff7c432c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.241+0000 7ff7c432c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.241+0000 7ff7c432c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.241+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1f1b40 con 0x555b8e1a49e0 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff7c432c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff7c432c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:11.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff7c432c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93851714786736 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1ed3b0 con 0x555b8e1a49e0 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 93851714529568 notify 115964117002 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7ff7b801e040 con 0x555b8e1a49e0 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff69f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 93851714529568 notifier 4411 bl.length()=567 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff69f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff69f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(64 notify.4 [notify cookie 93851714786736 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.242+0000 7ff69f7fe640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff684003ea0 con 0x555b8e1a49e0 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.243+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.243+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 93851714786736 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff7b8027c90 con 0x555b8e1a49e0 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.243+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1ed3b0 con 0x7ff7b0053030 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.244+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 foo:foo2 [delete] v27'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.244+0000 7ff7c432c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.244+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93851714786736 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1ed3b0 con 0x7ff7b0053030 2024-05-07T13:56:11.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.244+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== watch-notify(notify (1) cookie 93851714512208 notify 115964116997 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7ff7a8088040 con 0x7ff7b0053030 2024-05-07T13:56:11.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.244+0000 7ff69f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 93851714512208 notifier 4411 bl.length()=159 2024-05-07T13:56:11.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.244+0000 7ff69f7fe640 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff684003ea0 con 0x7ff7b0053030 2024-05-07T13:56:11.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.244+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [notify cookie 93851714786736 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.244+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.245+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== watch-notify(notify_complete (2) cookie 93851714786736 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b8e072060 con 0x7ff7b0053030 2024-05-07T13:56:11.246 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:11.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.245+0000 7ff6767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.245+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93851714538128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b78b0 con 0x555b8e1a49e0 2024-05-07T13:56:11.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.246+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93851714538128] v27'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.246+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93851714512208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b4a60 con 0x7ff7b0053030 2024-05-07T13:56:11.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.247+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93851714512208] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.247+0000 7ff7c432c800 20 remove_watcher() i=0 2024-05-07T13:56:11.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.247+0000 7ff7c432c800 2 removed watcher, disabling cache 2024-05-07T13:56:11.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.247+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93851714519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1ae550 con 0x555b8e1a49e0 2024-05-07T13:56:11.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.249+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93851714519104] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.249+0000 7ff7c432c800 20 remove_watcher() i=1 2024-05-07T13:56:11.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.249+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93851714520640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1ae550 con 0x555b8e1a93d0 2024-05-07T13:56:11.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.250+0000 7ff7c0064640 1 -- 172.21.15.50:0/3305692290 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93851714520640] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b005c040 con 0x555b8e1a93d0 2024-05-07T13:56:11.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.250+0000 7ff7c432c800 20 remove_watcher() i=2 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.250+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93851714522656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b0640 con 0x7ff7b0053030 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.250+0000 7ff7b7fff640 1 -- 172.21.15.50:0/3305692290 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93851714522656] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a807f070 con 0x7ff7b0053030 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.250+0000 7ff7c432c800 20 remove_watcher() i=3 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.250+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93851714529568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b0e20 con 0x555b8e1a49e0 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.251+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93851714529568] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x555b8e1a49e0 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.251+0000 7ff7c432c800 20 remove_watcher() i=4 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.251+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93851714527488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b0640 con 0x7ff7a8074040 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.252+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93851714527488] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.252+0000 7ff7c432c800 20 remove_watcher() i=5 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.252+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93851714533888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b2920 con 0x7ff7a8074040 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.253+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93851714533888] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.253+0000 7ff7c432c800 20 remove_watcher() i=6 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.253+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93851714536016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555b8e1b0e20 con 0x7ff7a8074040 2024-05-07T13:56:11.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.254+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93851714536016] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b802f060 con 0x7ff7a8074040 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.254+0000 7ff7c432c800 20 remove_watcher() i=7 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff7a8074040 msgr2=0x7ff7a8081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff7a8074040 0x7ff7a8081410 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e1a49e0 msgr2=0x555b8e1a6ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e1a49e0 0x555b8e1a6ea0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff7b0053030 msgr2=0x7ff7b00441a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff7b0053030 0x7ff7b00441a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e1a93d0 msgr2=0x555b8e1ab7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e1a93d0 0x555b8e1ab7c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff690036950 msgr2=0x7ff690038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff690036950 0x7ff690038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8052bb0 tx=0x7ff7a804f000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 msgr2=0x555b8e199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3305692290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e191dd0 0x555b8e199290 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0026550 tx=0x7ff7b0024f00 comp rx=0 tx=0).stop 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 reap_dead start 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c0865640 1 -- 172.21.15.50:0/3305692290 reap_dead start 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 shutdown_connections 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 >> 172.21.15.50:0/3305692290 conn(0x555b8e18e130 msgr2=0x555b8e18b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 shutdown_connections 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/3305692290 wait complete. 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/2455489601 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff698036900 msgr2=0x7ff698038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/2455489601 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff698036900 0x7ff698038dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x555b8e168770 tx=0x7ff7a8005ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/2455489601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e15cd10 msgr2=0x555b8e15b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/2455489601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e15cd10 0x555b8e15b180 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff7b004b470 tx=0x7ff7b0017d50 comp rx=0 tx=0).stop 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/2455489601 shutdown_connections 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/2455489601 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff698036900 0x7ff698038dc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 --2- 172.21.15.50:0/2455489601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e15cd10 0x555b8e15b180 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/2455489601 >> 172.21.15.50:0/2455489601 conn(0x555b8e176b50 msgr2=0x555b8e176f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/2455489601 shutdown_connections 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.255+0000 7ff7c432c800 1 -- 172.21.15.50:0/2455489601 wait complete. 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555b8e171aa0 msgr2=0x555b8e173ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555b8e171aa0 0x555b8e173ef0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e06e470 msgr2=0x555b8e16b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555b8e06e470 0x555b8e16b280 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e16db60 msgr2=0x555b8e16ff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555b8e16db60 0x555b8e16ff50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff6a8036950 msgr2=0x7ff6a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff6a8036950 0x7ff6a8038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8054000 tx=0x7ff7a804e000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 msgr2=0x555b8e164040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 --2- 172.21.15.50:0/3990493580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555b8e069fe0 0x555b8e164040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000bc10 tx=0x7ff7b0000bc0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c0865640 1 -- 172.21.15.50:0/3990493580 reap_dead start 2024-05-07T13:56:11.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 shutdown_connections 2024-05-07T13:56:11.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 >> 172.21.15.50:0/3990493580 conn(0x555b8e065580 msgr2=0x555b8e155490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 shutdown_connections 2024-05-07T13:56:11.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.256+0000 7ff7c432c800 1 -- 172.21.15.50:0/3990493580 wait complete. 2024-05-07T13:56:11.258 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:11.258 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-07T13:56:11.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-07T13:56:11.258 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-07T13:56:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.316+0000 7f1e7f63f800 1 Processor -- start 2024-05-07T13:56:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.316+0000 7f1e7f63f800 1 -- start start 2024-05-07T13:56:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.316+0000 7f1e7f63f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562f0c5fe5a0 0x562f0c5fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.316+0000 7f1e7f63f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562f0c5ffbd0 con 0x562f0c5fef00 2024-05-07T13:56:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.316+0000 7f1e7f63f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x562f0c490050 con 0x562f0c5fe5a0 2024-05-07T13:56:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.317+0000 7f1e7d13e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562f0c5fe5a0 0x562f0c5fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.317+0000 7f1e7d13e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562f0c5fe5a0 0x562f0c5fe9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45622/0 (socket says 172.21.15.50:45622) 2024-05-07T13:56:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.317+0000 7f1e7d13e640 1 -- 172.21.15.50:0/2776421291 learned_addr learned my addr 172.21.15.50:0/2776421291 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.317+0000 7f1e7d13e640 1 -- 172.21.15.50:0/2776421291 >> v1:172.21.15.22:6789/0 conn(0x562f0c5fef00 legacy=0x562f0c5ff380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.317+0000 7f1e7d13e640 1 -- 172.21.15.50:0/2776421291 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0c5ffdf0 con 0x562f0c5fe5a0 2024-05-07T13:56:11.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.319+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/2776421291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c5fe9c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000a6b0 tx=0x7f1e7001ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bee327c76b2b8fa server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.319+0000 7f1e6ffff640 1 -- 172.21.15.50:0/2776421291 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e7000a200 con 0x562f0c5fe5a0 2024-05-07T13:56:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.319+0000 7f1e6ffff640 1 -- 172.21.15.50:0/2776421291 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e7000a3a0 con 0x562f0c5fe5a0 2024-05-07T13:56:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.319+0000 7f1e6ffff640 1 -- 172.21.15.50:0/2776421291 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e700086e0 con 0x562f0c5fe5a0 2024-05-07T13:56:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.320+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2776421291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 msgr2=0x562f0c5fe9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.320+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2776421291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c5fe9c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000a6b0 tx=0x7f1e7001ee40 comp rx=0 tx=0).stop 2024-05-07T13:56:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.320+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2776421291 shutdown_connections 2024-05-07T13:56:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.320+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2776421291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c5fe9c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.320+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2776421291 >> 172.21.15.50:0/2776421291 conn(0x562f0c5f8d30 msgr2=0x562f0c5fb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.320+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2776421291 shutdown_connections 2024-05-07T13:56:11.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.320+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2776421291 wait complete. 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.334+0000 7f1e7f63f800 1 Processor -- start 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.335+0000 7f1e7f63f800 1 -- start start 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.335+0000 7f1e7f63f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.335+0000 7f1e7f63f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562f0c54a1d0 con 0x562f0c5fe5a0 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.335+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.335+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6ee7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45626/0 (socket says 172.21.15.50:45626) 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.335+0000 7f1e7d13e640 1 -- 172.21.15.50:0/3916036430 learned_addr learned my addr 172.21.15.50:0/3916036430 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.335+0000 7f1e7d13e640 1 -- 172.21.15.50:0/3916036430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0c6eed90 con 0x562f0c5fe5a0 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.336+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/3916036430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6ee7c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e70000c00 tx=0x7f1e7004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3ce8b480b3747e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.336+0000 7f1d6b606640 1 -- 172.21.15.50:0/3916036430 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e70065070 con 0x562f0c5fe5a0 2024-05-07T13:56:11.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.336+0000 7f1d6b606640 1 -- 172.21.15.50:0/3916036430 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e70008590 con 0x562f0c5fe5a0 2024-05-07T13:56:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.336+0000 7f1d6b606640 1 -- 172.21.15.50:0/3916036430 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e700088b0 con 0x562f0c5fe5a0 2024-05-07T13:56:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 -- 172.21.15.50:0/3916036430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 msgr2=0x562f0c6ee7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/3916036430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6ee7c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1e70000c00 tx=0x7f1e7004e000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 -- 172.21.15.50:0/3916036430 shutdown_connections 2024-05-07T13:56:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/3916036430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6ee7c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 -- 172.21.15.50:0/3916036430 >> 172.21.15.50:0/3916036430 conn(0x562f0c5f8d30 msgr2=0x562f0c6ea0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 -- 172.21.15.50:0/3916036430 shutdown_connections 2024-05-07T13:56:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 -- 172.21.15.50:0/3916036430 wait complete. 2024-05-07T13:56:11.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 Processor -- start 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 -- start start 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7f63f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562f0c5fd430 con 0x562f0c5fe5a0 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6fa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45632/0 (socket says 172.21.15.50:45632) 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.337+0000 7f1e7d13e640 1 -- 172.21.15.50:0/2948055042 learned_addr learned my addr 172.21.15.50:0/2948055042 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.338+0000 7f1e7d13e640 1 -- 172.21.15.50:0/2948055042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0c6fac00 con 0x562f0c5fe5a0 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.338+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6fa6c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e70005930 tx=0x7f1e70002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.339+0000 7f1d69e03640 1 -- 172.21.15.50:0/2948055042 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e70065040 con 0x562f0c5fe5a0 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.339+0000 7f1d69e03640 1 -- 172.21.15.50:0/2948055042 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e70008740 con 0x562f0c5fe5a0 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.339+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f0c6fae90 con 0x562f0c5fe5a0 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.339+0000 7f1d69e03640 1 -- 172.21.15.50:0/2948055042 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e700083f0 con 0x562f0c5fe5a0 2024-05-07T13:56:11.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.339+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0c6fdb40 con 0x562f0c5fe5a0 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.340+0000 7f1d69e03640 1 -- 172.21.15.50:0/2948055042 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e70008a40 con 0x562f0c5fe5a0 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.340+0000 7f1d69e03640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d64036950 0x7f1d64038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.340+0000 7f1d69e03640 1 -- 172.21.15.50:0/2948055042 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1e7008d7d0 con 0x562f0c5fe5a0 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.340+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d64036950 0x7f1d64038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.340+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c5fef00 0x562f0c701900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.340+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c701ed0 con 0x562f0c5fef00 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.340+0000 7f1e7d93f640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c5fef00 0x562f0c701900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.340+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d64036950 0x7f1d64038e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e74001e10 tx=0x7f1e74001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.341+0000 7f1e7d93f640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c5fef00 0x562f0c701900 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.341+0000 7f1e7d93f640 1 -- 172.21.15.50:0/2948055042 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c5fef00 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.341+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c7027b0 con 0x562f0c5fef00 2024-05-07T13:56:11.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.341+0000 7f1e7d93f640 1 -- 172.21.15.50:0/2948055042 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c5fef00 2024-05-07T13:56:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.341+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c7040c0 0x562f0c706560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.341+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c706cf0 con 0x562f0c7040c0 2024-05-07T13:56:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.341+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c7040c0 0x562f0c706560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.342+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c7040c0 0x562f0c706560 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.342+0000 7f1e7d13e640 1 -- 172.21.15.50:0/2948055042 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e70008d30 con 0x562f0c7040c0 2024-05-07T13:56:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.342+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c703030 con 0x562f0c5fef00 2024-05-07T13:56:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.342+0000 7f1e7d93f640 1 -- 172.21.15.50:0/2948055042 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c5fef00 2024-05-07T13:56:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.342+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562f0c7081a0 0x562f0c70a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.342+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c70ada0 con 0x562f0c7081a0 2024-05-07T13:56:11.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.342+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562f0c7081a0 0x562f0c70a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.343+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562f0c7081a0 0x562f0c70a610 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.343+0000 7f1e7c93d640 1 -- 172.21.15.50:0/2948055042 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e740106a0 con 0x562f0c7081a0 2024-05-07T13:56:11.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.343+0000 7f1e7f63f800 1 Processor -- start 2024-05-07T13:56:11.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.344+0000 7f1e7f63f800 1 -- start start 2024-05-07T13:56:11.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.344+0000 7f1e7f63f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c719200 0x562f0c719620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.344+0000 7f1e7f63f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562f0c4f0cf0 con 0x562f0c719200 2024-05-07T13:56:11.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.344+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c719200 0x562f0c719620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.344+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c719200 0x562f0c719620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45634/0 (socket says 172.21.15.50:45634) 2024-05-07T13:56:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.344+0000 7f1e7d13e640 1 -- 172.21.15.50:0/4009469638 learned_addr learned my addr 172.21.15.50:0/4009469638 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.344+0000 7f1e7d13e640 1 -- 172.21.15.50:0/4009469638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0c719b60 con 0x562f0c719200 2024-05-07T13:56:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.344+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/4009469638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c719200 0x562f0c719620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e7008bbc0 tx=0x7f1e70002c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.345+0000 7f1d62ffd640 1 -- 172.21.15.50:0/4009469638 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e70002d80 con 0x562f0c719200 2024-05-07T13:56:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.345+0000 7f1d62ffd640 1 -- 172.21.15.50:0/4009469638 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e70060680 con 0x562f0c719200 2024-05-07T13:56:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.345+0000 7f1e7f63f800 1 -- 172.21.15.50:0/4009469638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f0c71a5d0 con 0x562f0c719200 2024-05-07T13:56:11.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.345+0000 7f1d62ffd640 1 -- 172.21.15.50:0/4009469638 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e70060960 con 0x562f0c719200 2024-05-07T13:56:11.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.345+0000 7f1e7f63f800 1 -- 172.21.15.50:0/4009469638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0c71aad0 con 0x562f0c719200 2024-05-07T13:56:11.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.345+0000 7f1d62ffd640 1 -- 172.21.15.50:0/4009469638 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e70094060 con 0x562f0c719200 2024-05-07T13:56:11.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.345+0000 7f1d62ffd640 1 --2- 172.21.15.50:0/4009469638 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d54036900 0x7f1d54038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1d62ffd640 1 -- 172.21.15.50:0/4009469638 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1e70097c60 con 0x562f0c719200 2024-05-07T13:56:11.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/4009469638 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d54036900 0x7f1d54038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1e7f63f800 1 Processor -- start 2024-05-07T13:56:11.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1e7f63f800 1 -- start start 2024-05-07T13:56:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/4009469638 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d54036900 0x7f1d54038dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x562f0c6ff030 tx=0x7f1e74006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1e7f63f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c726710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1e7f63f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562f0c6ef0b0 con 0x562f0c7262f0 2024-05-07T13:56:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c726710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c726710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45640/0 (socket says 172.21.15.50:45640) 2024-05-07T13:56:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.346+0000 7f1e7d13e640 1 -- 172.21.15.50:0/779442048 learned_addr learned my addr 172.21.15.50:0/779442048 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1e7d13e640 1 -- 172.21.15.50:0/779442048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0c726ce0 con 0x562f0c7262f0 2024-05-07T13:56:11.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/779442048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c726710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1e70002f40 tx=0x7f1e70007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fb4abafde1f343 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1d60ff9640 1 -- 172.21.15.50:0/779442048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e700a5070 con 0x562f0c7262f0 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1d60ff9640 1 -- 172.21.15.50:0/779442048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e7004de60 con 0x562f0c7262f0 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1d60ff9640 1 -- 172.21.15.50:0/779442048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e7009c040 con 0x562f0c7262f0 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1e7f63f800 1 -- 172.21.15.50:0/779442048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 msgr2=0x562f0c726710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/779442048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c726710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1e70002f40 tx=0x7f1e70007de0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1e7f63f800 1 -- 172.21.15.50:0/779442048 shutdown_connections 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/779442048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c726710 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1e7f63f800 1 -- 172.21.15.50:0/779442048 >> 172.21.15.50:0/779442048 conn(0x562f0c722650 msgr2=0x562f0c7206b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1e7f63f800 1 -- 172.21.15.50:0/779442048 shutdown_connections 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.347+0000 7f1e7f63f800 1 -- 172.21.15.50:0/779442048 wait complete. 2024-05-07T13:56:11.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.348+0000 7f1e7f63f800 1 Processor -- start 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.348+0000 7f1e7f63f800 1 -- start start 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.348+0000 7f1e7f63f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c72d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.348+0000 7f1e7f63f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562f0c727390 con 0x562f0c7262f0 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.348+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c72d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.348+0000 7f1e7d13e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c72d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45648/0 (socket says 172.21.15.50:45648) 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.348+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 learned_addr learned my addr 172.21.15.50:0/23512058 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.348+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0c72dc40 con 0x562f0c7262f0 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.349+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c72d700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1e70097f00 tx=0x7f1e70078eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.349+0000 7f1d52ffd640 1 -- 172.21.15.50:0/23512058 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e700a5030 con 0x562f0c7262f0 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.349+0000 7f1d52ffd640 1 -- 172.21.15.50:0/23512058 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e700ae070 con 0x562f0c7262f0 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.349+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f0c72dc40 con 0x562f0c7262f0 2024-05-07T13:56:11.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.349+0000 7f1d52ffd640 1 -- 172.21.15.50:0/23512058 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e70007680 con 0x562f0c7262f0 2024-05-07T13:56:11.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.349+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0c72dc40 con 0x562f0c7262f0 2024-05-07T13:56:11.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.349+0000 7f1d52ffd640 1 -- 172.21.15.50:0/23512058 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e7008a380 con 0x562f0c7262f0 2024-05-07T13:56:11.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.350+0000 7f1d52ffd640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d48036950 0x7f1d48038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.350+0000 7f1d52ffd640 1 -- 172.21.15.50:0/23512058 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1e700a5740 con 0x562f0c7262f0 2024-05-07T13:56:11.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.350+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d48036950 0x7f1d48038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.350+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d48036950 0x7f1d48038e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x562f0c70b1a0 tx=0x7f1e74011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.350+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.350+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c738c90 0x562f0c73b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.350+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73b8a0 con 0x562f0c738c90 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7d93f640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c738c90 0x562f0c73b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7d93f640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c738c90 0x562f0c73b150 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7f63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7f63f800 20 realm 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73bcb0 con 0x562f0c738c90 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7f63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7f63f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.351+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c580 con 0x562f0c738c90 2024-05-07T13:56:11.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c738c90 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c73d410 0x562f0c73f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73ff40 con 0x562f0c73d410 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c73d410 0x562f0c73f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c73d410 0x562f0c73f800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 20 searching for the correct realm 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.352+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c741910 con 0x562f0c73d410 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.353+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.353+0000 7f1e7d13e640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e7004d850 0x7f1e700ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.353+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1e700c73f0 con 0x7f1e7004d850 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.353+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e7004d850 0x7f1e700ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.353+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e7004d850 0x7f1e700ae980 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.354+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.354+0000 7f1e7c93d640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e740393c0 0x7f1e740397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.354+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1e700c73f0 con 0x7f1e740393c0 2024-05-07T13:56:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.354+0000 7f1e7d93f640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e740393c0 0x7f1e740397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.354+0000 7f1e7d93f640 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e740393c0 0x7f1e740397e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.355+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.355+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c738c90 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.355+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.355+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c738c90 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.355+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.355+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e740393c0 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.355+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.355+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e740393c0 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.356+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.356+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e7004d850 2024-05-07T13:56:11.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.356+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.356+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c73d410 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.356+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.356+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c738c90 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.356+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.356+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e740393c0 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.357+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.357+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c738c90 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.357+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.357+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e7004d850 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.357+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.357+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c73d410 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.357+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.357+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c73d410 2024-05-07T13:56:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.358+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.358+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e740393c0 2024-05-07T13:56:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.358+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.358+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c73d410 2024-05-07T13:56:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.358+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.358+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c73d410 2024-05-07T13:56:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.358+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.358+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c738c90 2024-05-07T13:56:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.359+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.359+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c738c90 2024-05-07T13:56:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.359+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.359+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e740393c0 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.359+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.359+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c73d410 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.359+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.359+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e7004d850 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.360+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.360+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c738c90 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.360+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.360+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e740393c0 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.360+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.360+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c73d410 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.361+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.361+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e740393c0 2024-05-07T13:56:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.361+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.361+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e7004d850 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.361+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.361+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c73d410 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.361+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.361+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e740393c0 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x562f0c738c90 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f0c73c920 con 0x7f1e7004d850 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c7408e0 con 0x562f0c738c90 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.362+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c740cd0 con 0x562f0c738c90 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c740cd0 con 0x7f1e740393c0 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 20 zone default found 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 4 Realm: () 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 20 zonegroup default 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c7410f0 con 0x7f1e740393c0 2024-05-07T13:56:11.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.363+0000 7f1e7f63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c741510 con 0x562f0c73d410 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7f63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c7437c0 con 0x562f0c73d410 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7f63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7f63f800 20 started sync module instance, tier type = 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7f63f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.364+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c742c60 con 0x7f1e7004d850 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.365+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.365+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94760072392704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c7438d0 con 0x7f1e7004d850 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.365+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c744290 con 0x562f0c738c90 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.366+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94760072392704] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.367+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.367+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94760072396256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c744200 con 0x562f0c738c90 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.367+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c745150 con 0x562f0c73d410 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.367+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94760072396256] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.368+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.368+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94760072398464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c745150 con 0x562f0c73d410 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.368+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c745ba0 con 0x7f1e7004d850 2024-05-07T13:56:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.369+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94760072398464] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.369+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.369+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94760072400032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c7450c0 con 0x7f1e7004d850 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.369+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c746a60 con 0x562f0c738c90 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.370+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94760072400032] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.370+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.370+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94760072404880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c746a60 con 0x562f0c738c90 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.370+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c7474b0 con 0x7f1e740393c0 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.371+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94760072404880] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.371+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.371+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94760072409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c746a60 con 0x7f1e740393c0 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.371+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c747ec0 con 0x7f1e740393c0 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.372+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94760072409024] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.372+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.372+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94760072406448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c7480a0 con 0x7f1e740393c0 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.372+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c7488f0 con 0x7f1e740393c0 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94760072413824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c748cb0 con 0x7f1e740393c0 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7f63f800 20 add_watcher() i=0 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7f63f800 20 add_watcher() i=1 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7f63f800 20 add_watcher() i=2 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7f63f800 20 add_watcher() i=3 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7f63f800 20 add_watcher() i=4 2024-05-07T13:56:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7f63f800 20 add_watcher() i=5 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94760072406448] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.373+0000 7f1e7f63f800 20 add_watcher() i=6 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.374+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94760072413824] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x7f1e740393c0 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.374+0000 7f1e7f63f800 20 add_watcher() i=7 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.374+0000 7f1e7f63f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.374+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c747bf0 con 0x562f0c738c90 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.374+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.374+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94760072415040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c747bf0 con 0x562f0c738c90 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.375+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94760072415040] v27'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1d337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1e7f63f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1e7f63f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:11.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1e7f63f800 5 note: GC not initialized 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1d327e4640 20 reqs_thread_entry: start 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1e7f63f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1e7f63f800 20 Filter name: none 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1ca3fff640 20 reqs_thread_entry: start 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.376+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c77ed20 con 0x562f0c738c90 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.377+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.377+0000 7f1e7f63f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.377+0000 7f1e7f63f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.377+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c77f100 con 0x562f0c738c90 2024-05-07T13:56:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.377+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1e7800a4a0 con 0x562f0c738c90 2024-05-07T13:56:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.377+0000 7f1e7f63f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.377+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f0c77f100 con 0x7f1e7004d850 2024-05-07T13:56:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.377+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.378+0000 7f1d337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.378+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94760072415040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c77f100 con 0x562f0c738c90 2024-05-07T13:56:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.379+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94760072415040] v27'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e7803f040 con 0x562f0c738c90 2024-05-07T13:56:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.379+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94760072392704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c77f0c0 con 0x7f1e7004d850 2024-05-07T13:56:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.380+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94760072392704] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.380+0000 7f1e7f63f800 20 remove_watcher() i=0 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.380+0000 7f1e7f63f800 2 removed watcher, disabling cache 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.380+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94760072396256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c77f0c0 con 0x562f0c738c90 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.381+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94760072396256] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7803f040 con 0x562f0c738c90 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.381+0000 7f1e7f63f800 20 remove_watcher() i=1 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.381+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94760072398464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c743de0 con 0x562f0c73d410 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.382+0000 7f1e7d13e640 1 -- 172.21.15.50:0/23512058 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94760072398464] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e700a7070 con 0x562f0c73d410 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.382+0000 7f1e7f63f800 20 remove_watcher() i=2 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.382+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94760072400032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c744680 con 0x7f1e7004d850 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.383+0000 7f1e7c93d640 1 -- 172.21.15.50:0/23512058 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94760072400032] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e74036040 con 0x7f1e7004d850 2024-05-07T13:56:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.383+0000 7f1e7f63f800 20 remove_watcher() i=3 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.383+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94760072404880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c743de0 con 0x562f0c738c90 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.384+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94760072404880] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7803f040 con 0x562f0c738c90 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.384+0000 7f1e7f63f800 20 remove_watcher() i=4 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.384+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94760072409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c744ca0 con 0x7f1e740393c0 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.385+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94760072409024] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7803f040 con 0x7f1e740393c0 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.385+0000 7f1e7f63f800 20 remove_watcher() i=5 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.385+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94760072406448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c743de0 con 0x7f1e740393c0 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.386+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94760072406448] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7803f040 con 0x7f1e740393c0 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.386+0000 7f1e7f63f800 20 remove_watcher() i=6 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.386+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94760072413824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f0c746fc0 con 0x7f1e740393c0 2024-05-07T13:56:11.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94760072413824] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e7803f040 con 0x7f1e740393c0 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 20 remove_watcher() i=7 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e740393c0 msgr2=0x7f1e740397e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e740393c0 0x7f1e740397e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c738c90 msgr2=0x562f0c73b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c738c90 0x562f0c73b150 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e7004d850 msgr2=0x7f1e700ae980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e7004d850 0x7f1e700ae980 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c73d410 msgr2=0x562f0c73f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c73d410 0x562f0c73f800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d48036950 msgr2=0x7f1d48038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.387+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d48036950 0x7f1d48038e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x562f0c70b1a0 tx=0x7f1e74011000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 msgr2=0x562f0c72d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7d93f640 1 -- 172.21.15.50:0/23512058 reap_dead start 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c72d700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1e70097f00 tx=0x7f1e70078eb0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 shutdown_connections 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/23512058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c7262f0 0x562f0c72d700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 >> 172.21.15.50:0/23512058 conn(0x562f0c722650 msgr2=0x562f0c71fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 shutdown_connections 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/23512058 wait complete. 2024-05-07T13:56:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/4009469638 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d54036900 msgr2=0x7f1d54038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/4009469638 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d54036900 0x7f1d54038dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x562f0c6ff030 tx=0x7f1e74006000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/4009469638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c719200 msgr2=0x562f0c719620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/4009469638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c719200 0x562f0c719620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e7008bbc0 tx=0x7f1e70002c50 comp rx=0 tx=0).stop 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/4009469638 shutdown_connections 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/4009469638 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d54036900 0x7f1d54038dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/4009469638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c719200 0x562f0c719620 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/4009469638 >> 172.21.15.50:0/4009469638 conn(0x562f0c70d2a0 msgr2=0x562f0c70d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/4009469638 shutdown_connections 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/4009469638 wait complete. 2024-05-07T13:56:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562f0c7081a0 msgr2=0x562f0c70a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562f0c7081a0 0x562f0c70a610 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c5fef00 msgr2=0x562f0c701900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562f0c5fef00 0x562f0c701900 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c7040c0 msgr2=0x562f0c706560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.388+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562f0c7040c0 0x562f0c706560 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.389+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d64036950 msgr2=0x7f1d64038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.389+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d64036950 0x7f1d64038e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e74001e10 tx=0x7f1e74001390 comp rx=0 tx=0).stop 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.389+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 msgr2=0x562f0c6fa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.389+0000 7f1e7f63f800 1 --2- 172.21.15.50:0/2948055042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f0c5fe5a0 0x562f0c6fa6c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e70005930 tx=0x7f1e70002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.389+0000 7f1e7d93f640 1 -- 172.21.15.50:0/2948055042 reap_dead start 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.389+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 shutdown_connections 2024-05-07T13:56:11.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.389+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 >> 172.21.15.50:0/2948055042 conn(0x562f0c5f8d30 msgr2=0x562f0c6e88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.389+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 shutdown_connections 2024-05-07T13:56:11.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.389+0000 7f1e7f63f800 1 -- 172.21.15.50:0/2948055042 wait complete. 2024-05-07T13:56:11.400 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-05-07T13:56:11.400 DEBUG:tasks.util.rgw: json result: [] 2024-05-07T13:56:11.400 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-07T13:56:11.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-07T13:56:11.400 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-07T13:56:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:11.446 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.458+0000 7fea35698800 1 Processor -- start 2024-05-07T13:56:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.458+0000 7fea35698800 1 -- start start 2024-05-07T13:56:11.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.458+0000 7fea35698800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d70f269570 0x55d70f272070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.458+0000 7fea35698800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d70f1dc050 con 0x55d70f267a30 2024-05-07T13:56:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.458+0000 7fea35698800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55d70f0fa050 con 0x55d70f269570 2024-05-07T13:56:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.458+0000 7fea32996640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d70f269570 0x55d70f272070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.458+0000 7fea33197640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55d70f267a30 0x55d70f267e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39696/0 (socket says 172.21.15.50:39696) 2024-05-07T13:56:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.458+0000 7fea32996640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d70f269570 0x55d70f272070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45664/0 (socket says 172.21.15.50:45664) 2024-05-07T13:56:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.458+0000 7fea33197640 1 -- 172.21.15.50:0/1462233137 learned_addr learned my addr 172.21.15.50:0/1462233137 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.459+0000 7fea32996640 1 -- 172.21.15.50:0/1462233137 >> v1:172.21.15.22:6789/0 conn(0x55d70f267a30 legacy=0x55d70f267e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.459+0000 7fea32996640 1 -- 172.21.15.50:0/1462233137 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70f1dc220 con 0x55d70f269570 2024-05-07T13:56:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea32996640 1 --2- 172.21.15.50:0/1462233137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f269570 0x55d70f272070 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea2800a470 tx=0x7fea2801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ba9a7ddcffd8bb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea32195640 1 -- 172.21.15.50:0/1462233137 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea28057070 con 0x55d70f269570 2024-05-07T13:56:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea32195640 1 -- 172.21.15.50:0/1462233137 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea28052570 con 0x55d70f269570 2024-05-07T13:56:11.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea32195640 1 -- 172.21.15.50:0/1462233137 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea28052870 con 0x55d70f269570 2024-05-07T13:56:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea35698800 1 -- 172.21.15.50:0/1462233137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f269570 msgr2=0x55d70f272070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea35698800 1 --2- 172.21.15.50:0/1462233137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f269570 0x55d70f272070 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea2800a470 tx=0x7fea2801ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea35698800 1 -- 172.21.15.50:0/1462233137 shutdown_connections 2024-05-07T13:56:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea35698800 1 --2- 172.21.15.50:0/1462233137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f269570 0x55d70f272070 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea35698800 1 -- 172.21.15.50:0/1462233137 >> 172.21.15.50:0/1462233137 conn(0x55d70f2635b0 msgr2=0x55d70f2659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea35698800 1 -- 172.21.15.50:0/1462233137 shutdown_connections 2024-05-07T13:56:11.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.461+0000 7fea35698800 1 -- 172.21.15.50:0/1462233137 wait complete. 2024-05-07T13:56:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.476+0000 7fea35698800 1 Processor -- start 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.476+0000 7fea35698800 1 -- start start 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.476+0000 7fea35698800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f35c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.476+0000 7fea35698800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d70f1b41d0 con 0x55d70f267a30 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.477+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f35c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.477+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f35c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45674/0 (socket says 172.21.15.50:45674) 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.477+0000 7fea33197640 1 -- 172.21.15.50:0/2305339232 learned_addr learned my addr 172.21.15.50:0/2305339232 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.477+0000 7fea33197640 1 -- 172.21.15.50:0/2305339232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70f35ceb0 con 0x55d70f267a30 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.477+0000 7fea33197640 1 --2- 172.21.15.50:0/2305339232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f35c8e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fea24001de0 tx=0x7fea2400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa9885807c82c38 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.477+0000 7fe92160a640 1 -- 172.21.15.50:0/2305339232 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea24012020 con 0x55d70f267a30 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.477+0000 7fe92160a640 1 -- 172.21.15.50:0/2305339232 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea2400e5a0 con 0x55d70f267a30 2024-05-07T13:56:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.477+0000 7fe92160a640 1 -- 172.21.15.50:0/2305339232 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea2400e8c0 con 0x55d70f267a30 2024-05-07T13:56:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 -- 172.21.15.50:0/2305339232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 msgr2=0x55d70f35c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 --2- 172.21.15.50:0/2305339232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f35c8e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fea24001de0 tx=0x7fea2400b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 -- 172.21.15.50:0/2305339232 shutdown_connections 2024-05-07T13:56:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 --2- 172.21.15.50:0/2305339232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f35c8e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 -- 172.21.15.50:0/2305339232 >> 172.21.15.50:0/2305339232 conn(0x55d70f2635b0 msgr2=0x55d70f358200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 -- 172.21.15.50:0/2305339232 shutdown_connections 2024-05-07T13:56:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 -- 172.21.15.50:0/2305339232 wait complete. 2024-05-07T13:56:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 Processor -- start 2024-05-07T13:56:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 -- start start 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f364420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.478+0000 7fea35698800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d70f272880 con 0x55d70f267a30 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f364420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f364420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45690/0 (socket says 172.21.15.50:45690) 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fea33197640 1 -- 172.21.15.50:0/1013162473 learned_addr learned my addr 172.21.15.50:0/1013162473 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fea33197640 1 -- 172.21.15.50:0/1013162473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70f364960 con 0x55d70f267a30 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fea33197640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f364420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fea2400c010 tx=0x7fea24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fe91fe07640 1 -- 172.21.15.50:0/1013162473 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea24012070 con 0x55d70f267a30 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fe91fe07640 1 -- 172.21.15.50:0/1013162473 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea2401a7a0 con 0x55d70f267a30 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d70f364bf0 con 0x55d70f267a30 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fe91fe07640 1 -- 172.21.15.50:0/1013162473 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea2401aa80 con 0x55d70f267a30 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.479+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d70f3678a0 con 0x55d70f267a30 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.480+0000 7fe91fe07640 1 -- 172.21.15.50:0/1013162473 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fea24015020 con 0x55d70f267a30 2024-05-07T13:56:11.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.480+0000 7fe91fe07640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe918036950 0x7fe918038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.480+0000 7fe91fe07640 1 -- 172.21.15.50:0/1013162473 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fea24020070 con 0x55d70f267a30 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.480+0000 7fea32996640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe918036950 0x7fe918038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.481+0000 7fea35698800 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f269570 0x55d70f36b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.481+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f36bba0 con 0x55d70f269570 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.481+0000 7fea33998640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f269570 0x55d70f36b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.481+0000 7fea32996640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe918036950 0x7fe918038e10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fea28054000 tx=0x7fea2804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.481+0000 7fea33998640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f269570 0x55d70f36b660 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.481+0000 7fea33998640 1 -- 172.21.15.50:0/1013162473 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f269570 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.481+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f368c30 con 0x55d70f269570 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.482+0000 7fea33998640 1 -- 172.21.15.50:0/1013162473 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f269570 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.482+0000 7fea35698800 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f36def0 0x55d70f3702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.482+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3709d0 con 0x55d70f36def0 2024-05-07T13:56:11.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.482+0000 7fea33197640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f36def0 0x55d70f3702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.482+0000 7fea33197640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f36def0 0x55d70f3702e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.482+0000 7fea33197640 1 -- 172.21.15.50:0/1013162473 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fea2402b070 con 0x55d70f36def0 2024-05-07T13:56:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.482+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f36cea0 con 0x55d70f269570 2024-05-07T13:56:11.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.483+0000 7fea33998640 1 -- 172.21.15.50:0/1013162473 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f269570 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.483+0000 7fea35698800 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d70f371e80 0x55d70f3742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.483+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f374a30 con 0x55d70f371e80 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.483+0000 7fea32996640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d70f371e80 0x55d70f3742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.483+0000 7fea32996640 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d70f371e80 0x55d70f3742d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.484+0000 7fea32996640 1 -- 172.21.15.50:0/1013162473 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fea2805a040 con 0x55d70f371e80 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.484+0000 7fea35698800 1 Processor -- start 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.484+0000 7fea35698800 1 -- start start 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.484+0000 7fea35698800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f382e90 0x55d70f3832b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.484+0000 7fea35698800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d70f15acf0 con 0x55d70f382e90 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.484+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f382e90 0x55d70f3832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.484+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f382e90 0x55d70f3832b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45696/0 (socket says 172.21.15.50:45696) 2024-05-07T13:56:11.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.484+0000 7fea33197640 1 -- 172.21.15.50:0/1714514290 learned_addr learned my addr 172.21.15.50:0/1714514290 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.485+0000 7fea33197640 1 -- 172.21.15.50:0/1714514290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70f3837f0 con 0x55d70f382e90 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.485+0000 7fea33197640 1 --2- 172.21.15.50:0/1714514290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f382e90 0x55d70f3832b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fea2404aa00 tx=0x7fea2400df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.485+0000 7fe91d602640 1 -- 172.21.15.50:0/1714514290 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea240490e0 con 0x55d70f382e90 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.485+0000 7fe91d602640 1 -- 172.21.15.50:0/1714514290 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea24049280 con 0x55d70f382e90 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.485+0000 7fea35698800 1 -- 172.21.15.50:0/1714514290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d70f384260 con 0x55d70f382e90 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.485+0000 7fe91d602640 1 -- 172.21.15.50:0/1714514290 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea24049580 con 0x55d70f382e90 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.485+0000 7fea35698800 1 -- 172.21.15.50:0/1714514290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d70f384760 con 0x55d70f382e90 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.486+0000 7fe91d602640 1 -- 172.21.15.50:0/1714514290 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fea24044060 con 0x55d70f382e90 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.486+0000 7fe91d602640 1 --2- 172.21.15.50:0/1714514290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe90c036900 0x7fe90c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.486+0000 7fe91d602640 1 -- 172.21.15.50:0/1714514290 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fea24039c90 con 0x55d70f382e90 2024-05-07T13:56:11.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.486+0000 7fea32996640 1 --2- 172.21.15.50:0/1714514290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe90c036900 0x7fe90c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.486+0000 7fea35698800 1 Processor -- start 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.486+0000 7fea35698800 1 -- start start 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.486+0000 7fea32996640 1 --2- 172.21.15.50:0/1714514290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe90c036900 0x7fe90c038dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55d70f36c4a0 tx=0x7fea28005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fea35698800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f390460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fea35698800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d70f35d230 con 0x55d70f390040 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f390460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f390460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45708/0 (socket says 172.21.15.50:45708) 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fea33197640 1 -- 172.21.15.50:0/1989744840 learned_addr learned my addr 172.21.15.50:0/1989744840 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fea33197640 1 -- 172.21.15.50:0/1989744840 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70f390a30 con 0x55d70f390040 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fea33197640 1 --2- 172.21.15.50:0/1989744840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f390460 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fea2401efd0 tx=0x7fea2402eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5a0e7f8575cdf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fe916ffd640 1 -- 172.21.15.50:0/1989744840 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea2405d070 con 0x55d70f390040 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fe916ffd640 1 -- 172.21.15.50:0/1989744840 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea24044e30 con 0x55d70f390040 2024-05-07T13:56:11.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.487+0000 7fe916ffd640 1 -- 172.21.15.50:0/1989744840 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea24052040 con 0x55d70f390040 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 -- 172.21.15.50:0/1989744840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 msgr2=0x55d70f390460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 --2- 172.21.15.50:0/1989744840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f390460 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fea2401efd0 tx=0x7fea2402eae0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 -- 172.21.15.50:0/1989744840 shutdown_connections 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 --2- 172.21.15.50:0/1989744840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f390460 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 -- 172.21.15.50:0/1989744840 >> 172.21.15.50:0/1989744840 conn(0x55d70f38c310 msgr2=0x55d70f38a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 -- 172.21.15.50:0/1989744840 shutdown_connections 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 -- 172.21.15.50:0/1989744840 wait complete. 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 Processor -- start 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 -- start start 2024-05-07T13:56:11.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f397390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.488+0000 7fea35698800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d70f391090 con 0x55d70f390040 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f397390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fea33197640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f397390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45714/0 (socket says 172.21.15.50:45714) 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 learned_addr learned my addr 172.21.15.50:0/1224946374 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70f3978d0 con 0x55d70f390040 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fea33197640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f397390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fea2402efd0 tx=0x7fea24025b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fe9157fa640 1 -- 172.21.15.50:0/1224946374 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea2405d030 con 0x55d70f390040 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fe9157fa640 1 -- 172.21.15.50:0/1224946374 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea24027ca0 con 0x55d70f390040 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d70f3978d0 con 0x55d70f390040 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fe9157fa640 1 -- 172.21.15.50:0/1224946374 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea240163b0 con 0x55d70f390040 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.489+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d70f3978d0 con 0x55d70f390040 2024-05-07T13:56:11.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.490+0000 7fe9157fa640 1 -- 172.21.15.50:0/1224946374 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fea2406b020 con 0x55d70f390040 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.490+0000 7fe9157fa640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe8fc036900 0x7fe8fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.490+0000 7fe9157fa640 1 -- 172.21.15.50:0/1224946374 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fea24069020 con 0x55d70f390040 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.490+0000 7fea32996640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe8fc036900 0x7fe8fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea35698800 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f3a2af0 0x55d70f3a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a5700 con 0x55d70f3a2af0 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea33998640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f3a2af0 0x55d70f3a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea32996640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe8fc036900 0x7fe8fc038dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55d70f374e30 tx=0x7fea2804f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea33998640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f3a2af0 0x55d70f3a4fb0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea35698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea35698800 20 realm 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.491+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a5b10 con 0x55d70f3a2af0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a63e0 con 0x55d70f3a2af0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x55d70f3a2af0 2024-05-07T13:56:11.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f3a7270 0x55d70f3a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a9dc0 con 0x55d70f3a7270 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea33197640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f3a7270 0x55d70f3a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.492+0000 7fea33197640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f3a7270 0x55d70f3a9660 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.493+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.493+0000 7fea35698800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.493+0000 7fea35698800 20 searching for the correct realm 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.493+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ab7a0 con 0x55d70f3a7270 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.493+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.493+0000 7fea33197640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fea24017050 0x7fea24021a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.493+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ab7a0 con 0x7fea24017050 2024-05-07T13:56:11.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.493+0000 7fea32996640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fea24017050 0x7fea24021a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.494+0000 7fea32996640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fea24017050 0x7fea24021a80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.494+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.494+0000 7fea32996640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fea28074040 0x7fea28081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.494+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ab7a0 con 0x7fea28074040 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.494+0000 7fea33998640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fea28074040 0x7fea28081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.495+0000 7fea33998640 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fea28074040 0x7fea28081410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.495+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.495+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x55d70f3a2af0 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.495+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.495+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x55d70f3a2af0 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.495+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.495+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x7fea28074040 2024-05-07T13:56:11.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.496+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.496+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x7fea28074040 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.496+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.496+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x7fea24017050 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.496+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.496+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x55d70f3a7270 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.496+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.496+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x55d70f3a2af0 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.497+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.497+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x7fea28074040 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.497+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.497+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x55d70f3a2af0 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.497+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.497+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3a6780 con 0x7fea24017050 2024-05-07T13:56:11.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.497+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.497+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a7270 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.498+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.498+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a7270 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.498+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.498+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x7fea28074040 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.498+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.498+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a7270 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.499+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.499+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a7270 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.499+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.499+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a2af0 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.499+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.499+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a2af0 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.499+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.499+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x7fea28074040 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.500+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.500+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a7270 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.500+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.500+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x7fea24017050 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.500+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.500+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a2af0 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.500+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.500+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x7fea28074040 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.501+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.501+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a7270 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.501+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.501+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x7fea28074040 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.501+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.501+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x7fea24017050 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.501+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.501+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a7270 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x7fea28074040 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x55d70f3a2af0 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fea2808e060 con 0x7fea24017050 2024-05-07T13:56:11.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea35698800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea35698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea35698800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea35698800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea35698800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea35698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.502+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3aa770 con 0x55d70f3a2af0 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.503+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.503+0000 7fea35698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.503+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.503+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3aab60 con 0x55d70f3a2af0 2024-05-07T13:56:11.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.503+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.503+0000 7fea35698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.503+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.503+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3aab60 con 0x7fea28074040 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 zone default found 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 4 Realm: () 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 zonegroup default 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3aaf80 con 0x7fea28074040 2024-05-07T13:56:11.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ab3a0 con 0x55d70f3a7270 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ad650 con 0x55d70f3a7270 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.504+0000 7fea35698800 20 started sync module instance, tier type = 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.505+0000 7fea35698800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.505+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3acaf0 con 0x7fea24017050 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.505+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.505+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94382161841808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ad760 con 0x7fea24017050 2024-05-07T13:56:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.506+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ae120 con 0x55d70f3a2af0 2024-05-07T13:56:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.506+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94382161841808] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.507+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.507+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94382161845360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ae540 con 0x55d70f3a2af0 2024-05-07T13:56:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.507+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3aef00 con 0x55d70f3a7270 2024-05-07T13:56:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.508+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94382161845360] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.508+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.508+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94382161849392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ae540 con 0x55d70f3a7270 2024-05-07T13:56:11.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.508+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3af950 con 0x7fea24017050 2024-05-07T13:56:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.509+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94382161849392] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.509+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.509+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94382161846416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ae4b0 con 0x7fea24017050 2024-05-07T13:56:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.509+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b0810 con 0x55d70f3a2af0 2024-05-07T13:56:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.510+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.510+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94382161855808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b0f90 con 0x55d70f3a2af0 2024-05-07T13:56:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.510+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b1ab0 con 0x7fea28074040 2024-05-07T13:56:11.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.510+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94382161846416] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.511+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.511+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94382161855808] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.511+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94382161859968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b1a70 con 0x7fea28074040 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.511+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b0a20 con 0x7fea28074040 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.512+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.512+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94382161856992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b24c0 con 0x7fea28074040 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.512+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b2ec0 con 0x7fea28074040 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.512+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94382161859968] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94382161853760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b2e80 con 0x7fea28074040 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea35698800 20 add_watcher() i=0 2024-05-07T13:56:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea35698800 20 add_watcher() i=1 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea35698800 20 add_watcher() i=2 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea35698800 20 add_watcher() i=3 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea35698800 20 add_watcher() i=4 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea35698800 20 add_watcher() i=5 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94382161856992] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.513+0000 7fea35698800 20 add_watcher() i=6 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.514+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94382161853760] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.514+0000 7fea35698800 20 add_watcher() i=7 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.514+0000 7fea35698800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.514+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b2e80 con 0x55d70f3a2af0 2024-05-07T13:56:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.514+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.514+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94382161865168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b2df0 con 0x55d70f3a2af0 2024-05-07T13:56:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.515+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94382161865168] v27'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.515+0000 7fe8e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.515+0000 7fea35698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.515+0000 7fea35698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.515+0000 7fea35698800 5 note: GC not initialized 2024-05-07T13:56:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.515+0000 7fe8e8fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea35698800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea35698800 20 Filter name: none 2024-05-07T13:56:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fe8627fc640 20 reqs_thread_entry: start 2024-05-07T13:56:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3e8da0 con 0x55d70f3a2af0 2024-05-07T13:56:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea35698800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea35698800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3e9180 con 0x55d70f3a2af0 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.516+0000 7fea35698800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.517+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3ea190 con 0x7fea24017050 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.517+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.518+0000 7fe8e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.518+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94382161865168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b32e0 con 0x55d70f3a2af0 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.519+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94382161865168] v27'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.519+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94382161841808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b29d0 con 0x7fea24017050 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.519+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94382161841808] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.520+0000 7fea35698800 20 remove_watcher() i=0 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.520+0000 7fea35698800 2 removed watcher, disabling cache 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.520+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94382161845360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b29d0 con 0x55d70f3a2af0 2024-05-07T13:56:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.521+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94382161845360] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.521+0000 7fea35698800 20 remove_watcher() i=1 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.521+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94382161849392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3adc70 con 0x55d70f3a7270 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.521+0000 7fea33197640 1 -- 172.21.15.50:0/1224946374 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94382161849392] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea24055040 con 0x55d70f3a7270 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.522+0000 7fea35698800 20 remove_watcher() i=2 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.522+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94382161846416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b29d0 con 0x7fea24017050 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.522+0000 7fea32996640 1 -- 172.21.15.50:0/1224946374 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94382161846416] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2807f070 con 0x7fea24017050 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.522+0000 7fea35698800 20 remove_watcher() i=3 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.522+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94382161855808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b29d0 con 0x55d70f3a2af0 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.524+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94382161855808] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x55d70f3a2af0 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.524+0000 7fea35698800 20 remove_watcher() i=4 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.524+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94382161859968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b0540 con 0x7fea28074040 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.525+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94382161859968] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.525+0000 7fea35698800 20 remove_watcher() i=5 2024-05-07T13:56:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.525+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94382161856992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b29d0 con 0x7fea28074040 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.526+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94382161856992] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.526+0000 7fea35698800 20 remove_watcher() i=6 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.526+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94382161853760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d70f3b29d0 con 0x7fea28074040 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.526+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94382161853760] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea2c00a4a0 con 0x7fea28074040 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 20 remove_watcher() i=7 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fea28074040 msgr2=0x7fea28081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fea28074040 0x7fea28081410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f3a2af0 msgr2=0x55d70f3a4fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f3a2af0 0x55d70f3a4fb0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fea24017050 msgr2=0x7fea24021a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fea24017050 0x7fea24021a80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f3a7270 msgr2=0x55d70f3a9660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f3a7270 0x55d70f3a9660 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe8fc036900 msgr2=0x7fe8fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe8fc036900 0x7fe8fc038dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55d70f374e30 tx=0x7fea2804f000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 msgr2=0x55d70f397390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1224946374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f390040 0x55d70f397390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fea2402efd0 tx=0x7fea24025b60 comp rx=0 tx=0).stop 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 reap_dead start 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea33998640 1 -- 172.21.15.50:0/1224946374 reap_dead start 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 shutdown_connections 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 >> 172.21.15.50:0/1224946374 conn(0x55d70f38c310 msgr2=0x55d70f389970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 shutdown_connections 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1224946374 wait complete. 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1714514290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe90c036900 msgr2=0x7fe90c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1714514290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe90c036900 0x7fe90c038dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55d70f36c4a0 tx=0x7fea28005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:11.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1714514290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f382e90 msgr2=0x55d70f3832b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1714514290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f382e90 0x55d70f3832b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fea2404aa00 tx=0x7fea2400df30 comp rx=0 tx=0).stop 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1714514290 shutdown_connections 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1714514290 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe90c036900 0x7fe90c038dc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 --2- 172.21.15.50:0/1714514290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f382e90 0x55d70f3832b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1714514290 >> 172.21.15.50:0/1714514290 conn(0x55d70f376f30 msgr2=0x55d70f377330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1714514290 shutdown_connections 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.527+0000 7fea35698800 1 -- 172.21.15.50:0/1714514290 wait complete. 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d70f371e80 msgr2=0x55d70f3742d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d70f371e80 0x55d70f3742d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f269570 msgr2=0x55d70f36b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d70f269570 0x55d70f36b660 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f36def0 msgr2=0x55d70f3702e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d70f36def0 0x55d70f3702e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe918036950 msgr2=0x7fe918038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fe918036950 0x7fe918038e10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fea28054000 tx=0x7fea2804e000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 msgr2=0x55d70f364420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 --2- 172.21.15.50:0/1013162473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d70f267a30 0x55d70f364420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fea2400c010 tx=0x7fea24000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea33998640 1 -- 172.21.15.50:0/1013162473 reap_dead start 2024-05-07T13:56:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 shutdown_connections 2024-05-07T13:56:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 >> 172.21.15.50:0/1013162473 conn(0x55d70f2635b0 msgr2=0x55d70f356a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 shutdown_connections 2024-05-07T13:56:11.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.528+0000 7fea35698800 1 -- 172.21.15.50:0/1013162473 wait complete. 2024-05-07T13:56:11.533 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-05-07T13:56:11.533 DEBUG:tasks.util.rgw: json result: [] 2024-05-07T13:56:11.605 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:11.605 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-07T13:56:11.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-07T13:56:11.605 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-07T13:56:11.652 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:11.652 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950a214800 1 Processor -- start 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950a214800 1 -- start start 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950a214800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55918ef28be0 0x55918ef2afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950a214800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55918ef2f020 con 0x55918ef2b510 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950a214800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55918edb9050 con 0x55918ef28be0 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950587d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55918ef28be0 0x55918ef2afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950507c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55918ef2b510 0x55918ef2d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39704/0 (socket says 172.21.15.50:39704) 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950507c640 1 -- 172.21.15.50:0/3635921894 learned_addr learned my addr 172.21.15.50:0/3635921894 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950587d640 1 --2- 172.21.15.50:0/3635921894 >> v2:172.21.15.22:3300/0 conn(0x55918ef28be0 0x55918ef2afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45722/0 (socket says 172.21.15.50:45722) 2024-05-07T13:56:11.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950587d640 1 -- 172.21.15.50:0/3635921894 >> v1:172.21.15.22:6789/0 conn(0x55918ef2b510 legacy=0x55918ef2d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.665+0000 7f950587d640 1 -- 172.21.15.50:0/3635921894 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55918ef30200 con 0x55918ef28be0 2024-05-07T13:56:11.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.667+0000 7f950587d640 1 --2- 172.21.15.50:0/3635921894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918ef2afd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94f800a470 tx=0x7f94f801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fc4b161d5b9ae8 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.667+0000 7f950487b640 1 -- 172.21.15.50:0/3635921894 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8057070 con 0x55918ef28be0 2024-05-07T13:56:11.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.668+0000 7f950487b640 1 -- 172.21.15.50:0/3635921894 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f8052570 con 0x55918ef28be0 2024-05-07T13:56:11.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.668+0000 7f950487b640 1 -- 172.21.15.50:0/3635921894 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8052870 con 0x55918ef28be0 2024-05-07T13:56:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.668+0000 7f950a214800 1 -- 172.21.15.50:0/3635921894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 msgr2=0x55918ef2afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.668+0000 7f950a214800 1 --2- 172.21.15.50:0/3635921894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918ef2afd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94f800a470 tx=0x7f94f801ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.668+0000 7f950a214800 1 -- 172.21.15.50:0/3635921894 shutdown_connections 2024-05-07T13:56:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.668+0000 7f950a214800 1 --2- 172.21.15.50:0/3635921894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918ef2afd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.668+0000 7f950a214800 1 -- 172.21.15.50:0/3635921894 >> 172.21.15.50:0/3635921894 conn(0x55918ef225b0 msgr2=0x55918ef249d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.668+0000 7f950a214800 1 -- 172.21.15.50:0/3635921894 shutdown_connections 2024-05-07T13:56:11.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.668+0000 7f950a214800 1 -- 172.21.15.50:0/3635921894 wait complete. 2024-05-07T13:56:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.683+0000 7f950a214800 1 Processor -- start 2024-05-07T13:56:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.683+0000 7f950a214800 1 -- start start 2024-05-07T13:56:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.683+0000 7f950a214800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918ef28520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.683+0000 7f950a214800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55918ee731d0 con 0x55918ef28be0 2024-05-07T13:56:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.684+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918ef28520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.684+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918ef28520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45730/0 (socket says 172.21.15.50:45730) 2024-05-07T13:56:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.684+0000 7f950587d640 1 -- 172.21.15.50:0/2511319270 learned_addr learned my addr 172.21.15.50:0/2511319270 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.684+0000 7f950587d640 1 -- 172.21.15.50:0/2511319270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55918ef26ae0 con 0x55918ef28be0 2024-05-07T13:56:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.684+0000 7f950587d640 1 --2- 172.21.15.50:0/2511319270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918ef28520 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94f8055040 tx=0x7f94f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf765a20e88a889 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.684+0000 7f93f3e07640 1 -- 172.21.15.50:0/2511319270 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8057040 con 0x55918ef28be0 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.684+0000 7f93f3e07640 1 -- 172.21.15.50:0/2511319270 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f8052990 con 0x55918ef28be0 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.684+0000 7f93f3e07640 1 -- 172.21.15.50:0/2511319270 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8052c70 con 0x55918ef28be0 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.685+0000 7f950a214800 1 -- 172.21.15.50:0/2511319270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 msgr2=0x55918ef28520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.685+0000 7f950a214800 1 --2- 172.21.15.50:0/2511319270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918ef28520 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94f8055040 tx=0x7f94f804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.685+0000 7f950a214800 1 -- 172.21.15.50:0/2511319270 shutdown_connections 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.685+0000 7f950a214800 1 --2- 172.21.15.50:0/2511319270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918ef28520 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.685+0000 7f950a214800 1 -- 172.21.15.50:0/2511319270 >> 172.21.15.50:0/2511319270 conn(0x55918ef225b0 msgr2=0x55918f015000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.685+0000 7f950a214800 1 -- 172.21.15.50:0/2511319270 shutdown_connections 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.685+0000 7f950a214800 1 -- 172.21.15.50:0/2511319270 wait complete. 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.686+0000 7f950a214800 1 Processor -- start 2024-05-07T13:56:11.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.686+0000 7f950a214800 1 -- start start 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.686+0000 7f950a214800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918f023390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.686+0000 7f950a214800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55918ef2f490 con 0x55918ef28be0 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.686+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918f023390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.686+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918f023390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45742/0 (socket says 172.21.15.50:45742) 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.686+0000 7f950587d640 1 -- 172.21.15.50:0/3407825528 learned_addr learned my addr 172.21.15.50:0/3407825528 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.686+0000 7f950587d640 1 -- 172.21.15.50:0/3407825528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55918f0238d0 con 0x55918ef28be0 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.687+0000 7f950587d640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918f023390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f94f800a470 tx=0x7f94f8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.687+0000 7f93f2604640 1 -- 172.21.15.50:0/3407825528 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8073070 con 0x55918ef28be0 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.687+0000 7f93f2604640 1 -- 172.21.15.50:0/3407825528 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f805d650 con 0x55918ef28be0 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.687+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55918f023b60 con 0x55918ef28be0 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.687+0000 7f93f2604640 1 -- 172.21.15.50:0/3407825528 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8057070 con 0x55918ef28be0 2024-05-07T13:56:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.687+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55918f026810 con 0x55918ef28be0 2024-05-07T13:56:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.688+0000 7f93f2604640 1 -- 172.21.15.50:0/3407825528 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94f8076070 con 0x55918ef28be0 2024-05-07T13:56:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.688+0000 7f93f2604640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93ec036950 0x7f93ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.688+0000 7f93f2604640 1 -- 172.21.15.50:0/3407825528 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f94f808dfc0 con 0x55918ef28be0 2024-05-07T13:56:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.688+0000 7f950507c640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93ec036950 0x7f93ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.688+0000 7f950a214800 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918ef2b510 0x55918f02a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.688+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f02ab50 con 0x55918ef2b510 2024-05-07T13:56:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.688+0000 7f950607e640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918ef2b510 0x55918f02a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.688+0000 7f950507c640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93ec036950 0x7f93ec038e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94f0000f60 tx=0x7f94f00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.688+0000 7f950607e640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918ef2b510 0x55918f02a5d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.689+0000 7f950607e640 1 -- 172.21.15.50:0/3407825528 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918ef2b510 2024-05-07T13:56:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.689+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f027b80 con 0x55918ef2b510 2024-05-07T13:56:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.689+0000 7f950607e640 1 -- 172.21.15.50:0/3407825528 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f950000a4a0 con 0x55918ef2b510 2024-05-07T13:56:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.689+0000 7f950a214800 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f02ce60 0x55918f02f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.689+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f02f940 con 0x55918f02ce60 2024-05-07T13:56:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.689+0000 7f950587d640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f02ce60 0x55918f02f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.689+0000 7f950587d640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f02ce60 0x55918f02f250 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.690+0000 7f950587d640 1 -- 172.21.15.50:0/3407825528 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94f8075030 con 0x55918f02ce60 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.690+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f02be10 con 0x55918ef2b510 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.690+0000 7f950607e640 1 -- 172.21.15.50:0/3407825528 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f950000a4a0 con 0x55918ef2b510 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.690+0000 7f950a214800 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55918f030df0 0x55918f033240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.690+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f0339a0 con 0x55918f030df0 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.690+0000 7f950507c640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55918f030df0 0x55918f033240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.691+0000 7f950507c640 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55918f030df0 0x55918f033240 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.691+0000 7f950507c640 1 -- 172.21.15.50:0/3407825528 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94f0009050 con 0x55918f030df0 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.691+0000 7f950a214800 1 Processor -- start 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.691+0000 7f950a214800 1 -- start start 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.691+0000 7f950a214800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f041e00 0x55918f042220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f950a214800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55918ee19cf0 con 0x55918f041e00 2024-05-07T13:56:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f041e00 0x55918f042220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f041e00 0x55918f042220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45750/0 (socket says 172.21.15.50:45750) 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f950587d640 1 -- 172.21.15.50:0/3821794984 learned_addr learned my addr 172.21.15.50:0/3821794984 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f950587d640 1 -- 172.21.15.50:0/3821794984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55918f042760 con 0x55918f041e00 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f950587d640 1 --2- 172.21.15.50:0/3821794984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f041e00 0x55918f042220 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f94f8006e60 tx=0x7f94f8006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f93eb7fe640 1 -- 172.21.15.50:0/3821794984 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8076db0 con 0x55918f041e00 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f93eb7fe640 1 -- 172.21.15.50:0/3821794984 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f8088070 con 0x55918f041e00 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f93eb7fe640 1 -- 172.21.15.50:0/3821794984 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f805cb90 con 0x55918f041e00 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f950a214800 1 -- 172.21.15.50:0/3821794984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55918f0431d0 con 0x55918f041e00 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.692+0000 7f950a214800 1 -- 172.21.15.50:0/3821794984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55918f0436d0 con 0x55918f041e00 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.693+0000 7f93eb7fe640 1 -- 172.21.15.50:0/3821794984 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94f808a020 con 0x55918f041e00 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.693+0000 7f93eb7fe640 1 --2- 172.21.15.50:0/3821794984 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93e0036900 0x7f93e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.693+0000 7f93eb7fe640 1 -- 172.21.15.50:0/3821794984 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f94f8093ce0 con 0x55918f041e00 2024-05-07T13:56:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.693+0000 7f950507c640 1 --2- 172.21.15.50:0/3821794984 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93e0036900 0x7f93e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.694+0000 7f950a214800 1 Processor -- start 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.694+0000 7f950a214800 1 -- start start 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.694+0000 7f950507c640 1 --2- 172.21.15.50:0/3821794984 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93e0036900 0x7f93e0038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f94f000bf50 tx=0x7f94f000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.694+0000 7f950a214800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f04f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.694+0000 7f950a214800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55918ef26da0 con 0x55918f04efd0 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.694+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f04f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.694+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f04f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45764/0 (socket says 172.21.15.50:45764) 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.694+0000 7f950587d640 1 -- 172.21.15.50:0/485890886 learned_addr learned my addr 172.21.15.50:0/485890886 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f950587d640 1 -- 172.21.15.50:0/485890886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55918f04f9c0 con 0x55918f04efd0 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f950587d640 1 --2- 172.21.15.50:0/485890886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f04f3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f94f808df70 tx=0x7f94f8078440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cd6caab3fd56f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f93e97fa640 1 -- 172.21.15.50:0/485890886 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f805d970 con 0x55918f04efd0 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f93e97fa640 1 -- 172.21.15.50:0/485890886 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f8079990 con 0x55918f04efd0 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f93e97fa640 1 -- 172.21.15.50:0/485890886 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f805db10 con 0x55918f04efd0 2024-05-07T13:56:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f950a214800 1 -- 172.21.15.50:0/485890886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 msgr2=0x55918f04f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f950a214800 1 --2- 172.21.15.50:0/485890886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f04f3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f94f808df70 tx=0x7f94f8078440 comp rx=0 tx=0).stop 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f950a214800 1 -- 172.21.15.50:0/485890886 shutdown_connections 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f950a214800 1 --2- 172.21.15.50:0/485890886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f04f3f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f950a214800 1 -- 172.21.15.50:0/485890886 >> 172.21.15.50:0/485890886 conn(0x55918f04b2a0 msgr2=0x55918f049300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f950a214800 1 -- 172.21.15.50:0/485890886 shutdown_connections 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.695+0000 7f950a214800 1 -- 172.21.15.50:0/485890886 wait complete. 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.696+0000 7f950a214800 1 Processor -- start 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.696+0000 7f950a214800 1 -- start start 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.696+0000 7f950a214800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f056320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.696+0000 7f950a214800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55918f050020 con 0x55918f04efd0 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.696+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f056320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.696+0000 7f950587d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f056320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45776/0 (socket says 172.21.15.50:45776) 2024-05-07T13:56:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.696+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 learned_addr learned my addr 172.21.15.50:0/2434345217 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.696+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55918f056860 con 0x55918f04efd0 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.696+0000 7f950587d640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f056320 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94f8076f70 tx=0x7f94f8066410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.697+0000 7f93d77fe640 1 -- 172.21.15.50:0/2434345217 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8088b50 con 0x55918f04efd0 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.697+0000 7f93d77fe640 1 -- 172.21.15.50:0/2434345217 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f8088cf0 con 0x55918f04efd0 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.697+0000 7f93d77fe640 1 -- 172.21.15.50:0/2434345217 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f808da60 con 0x55918f04efd0 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.697+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55918f056860 con 0x55918f04efd0 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.697+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55918f056dc0 con 0x55918f04efd0 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.697+0000 7f93d77fe640 1 -- 172.21.15.50:0/2434345217 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94f808dc00 con 0x55918f04efd0 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.698+0000 7f93d77fe640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93d0036950 0x7f93d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.698+0000 7f93d77fe640 1 -- 172.21.15.50:0/2434345217 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f94f80a4030 con 0x55918f04efd0 2024-05-07T13:56:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.698+0000 7f950507c640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93d0036950 0x7f93d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.698+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.698+0000 7f950a214800 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918f061ab0 0x55918f063f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.698+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f0646c0 con 0x55918f061ab0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.698+0000 7f950607e640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918f061ab0 0x55918f063f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.698+0000 7f950507c640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93d0036950 0x7f93d0038e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94f0001b60 tx=0x7f94f0010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950607e640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918f061ab0 0x55918f063f70 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 20 realm 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f064ad0 con 0x55918f061ab0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f0653a0 con 0x55918f061ab0 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f061ab0 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.699+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.700+0000 7f950a214800 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f066230 0x55918f068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.700+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f068d80 con 0x55918f066230 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.700+0000 7f950587d640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f066230 0x55918f068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.700+0000 7f950587d640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f066230 0x55918f068620 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.700+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.700+0000 7f950a214800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.700+0000 7f950a214800 20 searching for the correct realm 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.700+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f06a760 con 0x55918f066230 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.701+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.701+0000 7f950587d640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94f8078060 0x7f94f804e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.701+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f06a760 con 0x7f94f8078060 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.701+0000 7f950507c640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94f8078060 0x7f94f804e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.701+0000 7f950507c640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94f8078060 0x7f94f804e200 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.701+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f0009050 con 0x7f94f8078060 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.701+0000 7f950507c640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f94f0038040 0x7f94f001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.701+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f06a760 con 0x7f94f0038040 2024-05-07T13:56:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.702+0000 7f950607e640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f94f0038040 0x7f94f001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.702+0000 7f950607e640 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f94f0038040 0x7f94f001bab0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.702+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.702+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f061ab0 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.702+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.702+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f061ab0 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.703+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.703+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f0038040 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.703+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.703+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f0038040 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.703+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.703+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f8078060 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.703+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f0009050 con 0x7f94f8078060 2024-05-07T13:56:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.703+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f066230 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.704+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.704+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f061ab0 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.704+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.704+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f0038040 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.704+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.704+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f061ab0 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.705+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.705+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f8078060 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.705+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94f0009050 con 0x7f94f8078060 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.705+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f066230 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.705+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.705+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f066230 2024-05-07T13:56:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.705+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.705+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f0038040 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.706+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.706+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f066230 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.706+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.706+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f066230 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.706+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.706+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f061ab0 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.706+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.706+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f061ab0 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.707+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.707+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f0038040 2024-05-07T13:56:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.707+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.707+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f066230 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.707+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.708+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f8078060 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.708+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f0009050 con 0x7f94f8078060 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.708+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f061ab0 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.708+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.708+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f0038040 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.708+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.708+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f066230 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.709+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.709+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f0038040 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.709+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.709+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f8078060 2024-05-07T13:56:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.709+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f0009050 con 0x7f94f8078060 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.709+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f066230 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f0038040 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x55918f061ab0 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55918f065740 con 0x7f94f8078060 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f0045040 con 0x7f94f8078060 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950a214800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950a214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950a214800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950a214800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950a214800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950a214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.710+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f069730 con 0x55918f061ab0 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.711+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.711+0000 7f950a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.711+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.711+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f069b20 con 0x55918f061ab0 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.711+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.711+0000 7f950a214800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.711+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.711+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f069b20 con 0x7f94f0038040 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 zone default found 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 4 Realm: () 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 zonegroup default 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f069f40 con 0x7f94f0038040 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f06a360 con 0x55918f066230 2024-05-07T13:56:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f06c610 con 0x55918f066230 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 started sync module instance, tier type = 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.712+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f069320 con 0x7f94f8078060 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.714+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f0045040 con 0x7f94f8078060 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.714+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94083658201984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06ca50 con 0x7f94f8078060 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.714+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06d550 con 0x55918f061ab0 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.715+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94083658201984] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f0045040 con 0x7f94f8078060 2024-05-07T13:56:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.715+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.715+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94083658207296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06d970 con 0x55918f061ab0 2024-05-07T13:56:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.715+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06e370 con 0x55918f066230 2024-05-07T13:56:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.716+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94083658207296] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.716+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.716+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94083658203376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06e760 con 0x55918f066230 2024-05-07T13:56:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.716+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06f180 con 0x7f94f8078060 2024-05-07T13:56:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.717+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94083658203376] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.717+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f0045040 con 0x7f94f8078060 2024-05-07T13:56:11.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.717+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94083658210944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06fa50 con 0x7f94f8078060 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.717+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f070410 con 0x55918f061ab0 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.718+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.718+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94083658219840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f070bf0 con 0x55918f061ab0 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.718+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f071710 con 0x7f94f0038040 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.718+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94083658210944] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f0045040 con 0x7f94f8078060 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.719+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.719+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94083658219840] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.719+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94083658224096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f0716d0 con 0x7f94f0038040 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.719+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f070680 con 0x7f94f0038040 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.720+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94083658224096] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.721+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.721+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94083658216864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f071c70 con 0x7f94f0038040 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.721+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f072630 con 0x7f94f0038040 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.721+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94083658216864] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94083658221120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f072630 con 0x7f94f0038040 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 20 add_watcher() i=0 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 20 add_watcher() i=1 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 20 add_watcher() i=2 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 20 add_watcher() i=3 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 20 add_watcher() i=4 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 20 add_watcher() i=5 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 20 add_watcher() i=6 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94083658221120] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x7f94f0038040 2024-05-07T13:56:11.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 20 add_watcher() i=7 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.722+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f075960 con 0x55918f061ab0 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.723+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.723+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94083658228464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f072bc0 con 0x55918f061ab0 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.724+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94083658228464] v27'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.724+0000 7f93b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.724+0000 7f950a214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.724+0000 7f950a214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.724+0000 7f950a214800 5 note: GC not initialized 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.724+0000 7f93b67fc640 20 reqs_thread_entry: start 2024-05-07T13:56:11.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.724+0000 7f950a214800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.724+0000 7f950a214800 20 Filter name: none 2024-05-07T13:56:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.724+0000 7f9327fff640 20 reqs_thread_entry: start 2024-05-07T13:56:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.725+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.725+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f0a88c0 con 0x55918f061ab0 2024-05-07T13:56:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.725+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.725+0000 7f950a214800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.725+0000 7f950a214800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.725+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f0a8ca0 con 0x55918f061ab0 2024-05-07T13:56:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.725+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f950000a4a0 con 0x55918f061ab0 2024-05-07T13:56:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.725+0000 7f950a214800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.725+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55918f0a8ca0 con 0x7f94f8078060 2024-05-07T13:56:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.726+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f94f0045040 con 0x7f94f8078060 2024-05-07T13:56:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.726+0000 7f93b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.726+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94083658228464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f07ebf0 con 0x55918f061ab0 2024-05-07T13:56:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.727+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94083658228464] v27'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f950003f040 con 0x55918f061ab0 2024-05-07T13:56:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.727+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94083658201984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f07ebf0 con 0x7f94f8078060 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.728+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94083658201984] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f0045040 con 0x7f94f8078060 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.728+0000 7f950a214800 20 remove_watcher() i=0 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.728+0000 7f950a214800 2 removed watcher, disabling cache 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.728+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94083658207296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06bb80 con 0x55918f061ab0 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.730+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94083658207296] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950003f040 con 0x55918f061ab0 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.730+0000 7f950a214800 20 remove_watcher() i=1 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.730+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94083658203376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06bb80 con 0x55918f066230 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.731+0000 7f950587d640 1 -- 172.21.15.50:0/2434345217 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94083658203376] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f8075030 con 0x55918f066230 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.731+0000 7f950a214800 20 remove_watcher() i=2 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.731+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94083658210944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06d040 con 0x7f94f8078060 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.732+0000 7f950507c640 1 -- 172.21.15.50:0/2434345217 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94083658210944] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f0045040 con 0x7f94f8078060 2024-05-07T13:56:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.732+0000 7f950a214800 20 remove_watcher() i=3 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.732+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94083658219840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06d040 con 0x55918f061ab0 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.733+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94083658219840] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950003f040 con 0x55918f061ab0 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.733+0000 7f950a214800 20 remove_watcher() i=4 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.733+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94083658224096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f070140 con 0x7f94f0038040 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.734+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94083658224096] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950003f040 con 0x7f94f0038040 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.734+0000 7f950a214800 20 remove_watcher() i=5 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.734+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94083658216864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f06d040 con 0x7f94f0038040 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.735+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94083658216864] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950003f040 con 0x7f94f0038040 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.735+0000 7f950a214800 20 remove_watcher() i=6 2024-05-07T13:56:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.735+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94083658221120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55918f070140 con 0x7f94f0038040 2024-05-07T13:56:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.735+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94083658221120] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950003f040 con 0x7f94f0038040 2024-05-07T13:56:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.735+0000 7f950a214800 20 remove_watcher() i=7 2024-05-07T13:56:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f94f0038040 msgr2=0x7f94f001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f94f0038040 0x7f94f001bab0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918f061ab0 msgr2=0x55918f063f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918f061ab0 0x55918f063f70 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94f8078060 msgr2=0x7f94f804e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94f8078060 0x7f94f804e200 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f066230 msgr2=0x55918f068620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f066230 0x55918f068620 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93d0036950 msgr2=0x7f93d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93d0036950 0x7f93d0038e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94f0001b60 tx=0x7f94f0010000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 msgr2=0x55918f056320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950607e640 1 -- 172.21.15.50:0/2434345217 reap_dead start 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f056320 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94f8076f70 tx=0x7f94f8066410 comp rx=0 tx=0).stop 2024-05-07T13:56:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 shutdown_connections 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/2434345217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f04efd0 0x55918f056320 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 >> 172.21.15.50:0/2434345217 conn(0x55918f04b2a0 msgr2=0x55918f048900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 shutdown_connections 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/2434345217 wait complete. 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/3821794984 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93e0036900 msgr2=0x7f93e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/3821794984 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93e0036900 0x7f93e0038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f94f000bf50 tx=0x7f94f000f000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/3821794984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f041e00 msgr2=0x55918f042220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/3821794984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f041e00 0x55918f042220 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f94f8006e60 tx=0x7f94f8006650 comp rx=0 tx=0).stop 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/3821794984 shutdown_connections 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/3821794984 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93e0036900 0x7f93e0038dc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 --2- 172.21.15.50:0/3821794984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918f041e00 0x55918f042220 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/3821794984 >> 172.21.15.50:0/3821794984 conn(0x55918f035ea0 msgr2=0x55918f0362a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/3821794984 shutdown_connections 2024-05-07T13:56:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.736+0000 7f950a214800 1 -- 172.21.15.50:0/3821794984 wait complete. 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55918f030df0 msgr2=0x55918f033240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55918f030df0 0x55918f033240 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918ef2b510 msgr2=0x55918f02a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55918ef2b510 0x55918f02a5d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f02ce60 msgr2=0x55918f02f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55918f02ce60 0x55918f02f250 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93ec036950 msgr2=0x7f93ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f93ec036950 0x7f93ec038e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94f0000f60 tx=0x7f94f00012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 msgr2=0x55918f023390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 --2- 172.21.15.50:0/3407825528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55918ef28be0 0x55918f023390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f94f800a470 tx=0x7f94f8003020 comp rx=0 tx=0).stop 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950607e640 1 -- 172.21.15.50:0/3407825528 reap_dead start 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 shutdown_connections 2024-05-07T13:56:11.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 >> 172.21.15.50:0/3407825528 conn(0x55918ef225b0 msgr2=0x55918ef27300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 shutdown_connections 2024-05-07T13:56:11.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.737+0000 7f950a214800 1 -- 172.21.15.50:0/3407825528 wait complete. 2024-05-07T13:56:11.737 INFO:teuthology.orchestra.run.smithi050.stdout:["myfoo"] 2024-05-07T13:56:11.738 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-07T13:56:11.795 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:11.795 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-07T13:56:11.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-07T13:56:11.796 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-07T13:56:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:11.841 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.853+0000 7fcdd97dc800 1 Processor -- start 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.853+0000 7fcdd97dc800 1 -- start start 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.853+0000 7fcdd97dc800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56443fc06940 0x56443fc06d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.853+0000 7fcdd97dc800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56443fc07e60 con 0x56443fc072a0 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.853+0000 7fcdd97dc800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x56443fa99050 con 0x56443fc06940 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.853+0000 7fcdd72db640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56443fc06940 0x56443fc06d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.854+0000 7fcdd72db640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56443fc06940 0x56443fc06d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45784/0 (socket says 172.21.15.50:45784) 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.854+0000 7fcdd72db640 1 -- 172.21.15.50:0/184825686 learned_addr learned my addr 172.21.15.50:0/184825686 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.854+0000 7fcdd72db640 1 -- 172.21.15.50:0/184825686 >> v1:172.21.15.22:6789/0 conn(0x56443fc072a0 legacy=0x56443fc07750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.854+0000 7fcdd62d9640 1 -- 172.21.15.50:0/184825686 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996472698 0 0) 0x56443fc07e60 con 0x56443fc072a0 2024-05-07T13:56:11.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.854+0000 7fcdd72db640 1 -- 172.21.15.50:0/184825686 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443fc08030 con 0x56443fc06940 2024-05-07T13:56:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd72db640 1 --2- 172.21.15.50:0/184825686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fc06d60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800a520 tx=0x7fcdc801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61865a2770f9b08d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd62d9640 1 -- 172.21.15.50:0/184825686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8057070 con 0x56443fc06940 2024-05-07T13:56:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd62d9640 1 -- 172.21.15.50:0/184825686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8052570 con 0x56443fc06940 2024-05-07T13:56:11.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd62d9640 1 -- 172.21.15.50:0/184825686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8052870 con 0x56443fc06940 2024-05-07T13:56:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd97dc800 1 -- 172.21.15.50:0/184825686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 msgr2=0x56443fc06d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/184825686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fc06d60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800a520 tx=0x7fcdc801d010 comp rx=0 tx=0).stop 2024-05-07T13:56:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd97dc800 1 -- 172.21.15.50:0/184825686 shutdown_connections 2024-05-07T13:56:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/184825686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fc06d60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd97dc800 1 -- 172.21.15.50:0/184825686 >> 172.21.15.50:0/184825686 conn(0x56443fc025a0 msgr2=0x56443fc049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd97dc800 1 -- 172.21.15.50:0/184825686 shutdown_connections 2024-05-07T13:56:11.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.856+0000 7fcdd97dc800 1 -- 172.21.15.50:0/184825686 wait complete. 2024-05-07T13:56:11.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.871+0000 7fcdd97dc800 1 Processor -- start 2024-05-07T13:56:11.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.871+0000 7fcdd97dc800 1 -- start start 2024-05-07T13:56:11.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.871+0000 7fcdd97dc800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fcfb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.871+0000 7fcdd97dc800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56443fb531c0 con 0x56443fc06940 2024-05-07T13:56:11.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.872+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fcfb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.872+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fcfb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45786/0 (socket says 172.21.15.50:45786) 2024-05-07T13:56:11.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.872+0000 7fcdd72db640 1 -- 172.21.15.50:0/519522319 learned_addr learned my addr 172.21.15.50:0/519522319 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.872+0000 7fcdd72db640 1 -- 172.21.15.50:0/519522319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443fcfbd60 con 0x56443fc06940 2024-05-07T13:56:11.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.872+0000 7fcdd72db640 1 --2- 172.21.15.50:0/519522319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fcfb790 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8055040 tx=0x7fcdc804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16116421c744b01e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.872+0000 7fccc560a640 1 -- 172.21.15.50:0/519522319 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8057040 con 0x56443fc06940 2024-05-07T13:56:11.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.872+0000 7fccc560a640 1 -- 172.21.15.50:0/519522319 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8052850 con 0x56443fc06940 2024-05-07T13:56:11.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.873+0000 7fccc560a640 1 -- 172.21.15.50:0/519522319 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8052b50 con 0x56443fc06940 2024-05-07T13:56:11.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.873+0000 7fcdd97dc800 1 -- 172.21.15.50:0/519522319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 msgr2=0x56443fcfb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.873+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/519522319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fcfb790 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8055040 tx=0x7fcdc804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.873+0000 7fcdd97dc800 1 -- 172.21.15.50:0/519522319 shutdown_connections 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.873+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/519522319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fcfb790 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.873+0000 7fcdd97dc800 1 -- 172.21.15.50:0/519522319 >> 172.21.15.50:0/519522319 conn(0x56443fc025a0 msgr2=0x56443fcf70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.873+0000 7fcdd97dc800 1 -- 172.21.15.50:0/519522319 shutdown_connections 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.873+0000 7fcdd97dc800 1 -- 172.21.15.50:0/519522319 wait complete. 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fcdd97dc800 1 Processor -- start 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fcdd97dc800 1 -- start start 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fcdd97dc800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fd031c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fcdd97dc800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56443fc08500 con 0x56443fc06940 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fd031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fd031c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45798/0 (socket says 172.21.15.50:45798) 2024-05-07T13:56:11.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fcdd72db640 1 -- 172.21.15.50:0/1555412075 learned_addr learned my addr 172.21.15.50:0/1555412075 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fcdd72db640 1 -- 172.21.15.50:0/1555412075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443fd03700 con 0x56443fc06940 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fcdd72db640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fd031c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8052540 tx=0x7fcdc8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.874+0000 7fccc3e07640 1 -- 172.21.15.50:0/1555412075 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8073070 con 0x56443fc06940 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.875+0000 7fccc3e07640 1 -- 172.21.15.50:0/1555412075 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc805d570 con 0x56443fc06940 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.875+0000 7fccc3e07640 1 -- 172.21.15.50:0/1555412075 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8057070 con 0x56443fc06940 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.875+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56443fd03990 con 0x56443fc06940 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.875+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56443fd06640 con 0x56443fc06940 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.875+0000 7fccc3e07640 1 -- 172.21.15.50:0/1555412075 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcdc8076070 con 0x56443fc06940 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.875+0000 7fccc3e07640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccbc036950 0x7fccbc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.876+0000 7fccc3e07640 1 -- 172.21.15.50:0/1555412075 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcdc808ddc0 con 0x56443fc06940 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.876+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccbc036950 0x7fccbc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.876+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fc072a0 0x56443fd0a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.876+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd0a940 con 0x56443fc072a0 2024-05-07T13:56:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.876+0000 7fcdd7adc640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fc072a0 0x56443fd0a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.876+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccbc036950 0x7fccbc038e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc000f60 tx=0x7fcdcc0013f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.876+0000 7fcdd7adc640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fc072a0 0x56443fd0a400 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.877+0000 7fcdd7adc640 1 -- 172.21.15.50:0/1555412075 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fc072a0 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.877+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd07980 con 0x56443fc072a0 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.877+0000 7fcdd7adc640 1 -- 172.21.15.50:0/1555412075 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fc072a0 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.877+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd0cc00 0x56443fd0eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.877+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd0f6e0 con 0x56443fd0cc00 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.877+0000 7fcdd72db640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd0cc00 0x56443fd0eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.877+0000 7fcdd72db640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd0cc00 0x56443fd0eff0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.877+0000 7fcdd72db640 1 -- 172.21.15.50:0/1555412075 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd0cc00 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.878+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd0bbe0 con 0x56443fc072a0 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.878+0000 7fcdd7adc640 1 -- 172.21.15.50:0/1555412075 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fc072a0 2024-05-07T13:56:11.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.878+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56443fd10b40 0x56443fd12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.878+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd13710 con 0x56443fd10b40 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.878+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56443fd10b40 0x56443fd12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.878+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56443fd10b40 0x56443fd12fb0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.879+0000 7fcdd6ada640 1 -- 172.21.15.50:0/1555412075 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcdcc010590 con 0x56443fd10b40 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.879+0000 7fcdd97dc800 1 Processor -- start 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.879+0000 7fcdd97dc800 1 -- start start 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.879+0000 7fcdd97dc800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd21b40 0x56443fd21f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.879+0000 7fcdd97dc800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56443faf9cf0 con 0x56443fd21b40 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.879+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd21b40 0x56443fd21f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.879+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd21b40 0x56443fd21f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45800/0 (socket says 172.21.15.50:45800) 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.879+0000 7fcdd72db640 1 -- 172.21.15.50:0/3886095482 learned_addr learned my addr 172.21.15.50:0/3886095482 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.880+0000 7fcdd72db640 1 -- 172.21.15.50:0/3886095482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443fd224a0 con 0x56443fd21b40 2024-05-07T13:56:11.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.880+0000 7fcdd72db640 1 --2- 172.21.15.50:0/3886095482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd21b40 0x56443fd21f60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8006b30 tx=0x7fcdc8076650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.880+0000 7fccc1602640 1 -- 172.21.15.50:0/3886095482 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8007df0 con 0x56443fd21b40 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.880+0000 7fccc1602640 1 -- 172.21.15.50:0/3886095482 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8007f90 con 0x56443fd21b40 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.880+0000 7fccc1602640 1 -- 172.21.15.50:0/3886095482 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc80773b0 con 0x56443fd21b40 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.880+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3886095482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56443fd22f10 con 0x56443fd21b40 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.880+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3886095482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56443fd23410 con 0x56443fd21b40 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.881+0000 7fccc1602640 1 -- 172.21.15.50:0/3886095482 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcdc8077550 con 0x56443fd21b40 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.881+0000 7fccc1602640 1 --2- 172.21.15.50:0/3886095482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccb0036900 0x7fccb0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.881+0000 7fccc1602640 1 -- 172.21.15.50:0/3886095482 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcdc8091030 con 0x56443fd21b40 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.881+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/3886095482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccb0036900 0x7fccb0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.881+0000 7fcdd97dc800 1 Processor -- start 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.881+0000 7fcdd97dc800 1 -- start start 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/3886095482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccb0036900 0x7fccb0038dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x56443fd07d40 tx=0x7fcdcc006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fcdd97dc800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd2f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fcdd97dc800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56443fcfc020 con 0x56443fd2ec10 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd2f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd2f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45804/0 (socket says 172.21.15.50:45804) 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fcdd72db640 1 -- 172.21.15.50:0/3629266868 learned_addr learned my addr 172.21.15.50:0/3629266868 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fcdd72db640 1 -- 172.21.15.50:0/3629266868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443fd2f600 con 0x56443fd2ec10 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fcdd72db640 1 --2- 172.21.15.50:0/3629266868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd2f030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcdc808c340 tx=0x7fcdc808cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255539aa672552bb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fccbaffd640 1 -- 172.21.15.50:0/3629266868 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc805c880 con 0x56443fd2ec10 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fccbaffd640 1 -- 172.21.15.50:0/3629266868 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc80797a0 con 0x56443fd2ec10 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.882+0000 7fccbaffd640 1 -- 172.21.15.50:0/3629266868 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc804dad0 con 0x56443fd2ec10 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3629266868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 msgr2=0x56443fd2f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/3629266868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd2f030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcdc808c340 tx=0x7fcdc808cf50 comp rx=0 tx=0).stop 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3629266868 shutdown_connections 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/3629266868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd2f030 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3629266868 >> 172.21.15.50:0/3629266868 conn(0x56443fd2af70 msgr2=0x56443fd28fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3629266868 shutdown_connections 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3629266868 wait complete. 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 Processor -- start 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 -- start start 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.883+0000 7fcdd97dc800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd36020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fcdd97dc800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56443fd2fcb0 con 0x56443fd2ec10 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd36020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fcdd72db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd36020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45816/0 (socket says 172.21.15.50:45816) 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 learned_addr learned my addr 172.21.15.50:0/224364456 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443fd36560 con 0x56443fd2ec10 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fcdd72db640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd36020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcdc808af70 tx=0x7fcdc8082e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fccb97fa640 1 -- 172.21.15.50:0/224364456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc808c4d0 con 0x56443fd2ec10 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fccb97fa640 1 -- 172.21.15.50:0/224364456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc808c670 con 0x56443fd2ec10 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56443fd36560 con 0x56443fd2ec10 2024-05-07T13:56:11.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fccb97fa640 1 -- 172.21.15.50:0/224364456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc808c970 con 0x56443fd2ec10 2024-05-07T13:56:11.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.884+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56443fd36560 con 0x56443fd2ec10 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.885+0000 7fccb97fa640 1 -- 172.21.15.50:0/224364456 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcdc80bb030 con 0x56443fd2ec10 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.885+0000 7fccb97fa640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcca0036950 0x7fcca0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.885+0000 7fccb97fa640 1 -- 172.21.15.50:0/224364456 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcdc80b9070 con 0x56443fd2ec10 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.885+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcca0036950 0x7fcca0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fd41720 0x56443fd43be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd44330 con 0x56443fd41720 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd7adc640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fd41720 0x56443fd43be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcca0036950 0x7fcca0038e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x56443fd0fa80 tx=0x7fcdcc022040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd7adc640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fd41720 0x56443fd43be0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd97dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd97dc800 20 realm 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.886+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd44740 con 0x56443fd41720 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd45010 con 0x56443fd41720 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd41720 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd45ea0 0x56443fd48290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd489f0 con 0x56443fd45ea0 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.887+0000 7fcdd72db640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd45ea0 0x56443fd48290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.888+0000 7fcdd72db640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd45ea0 0x56443fd48290 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.888+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.888+0000 7fcdd97dc800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.888+0000 7fcdd97dc800 20 searching for the correct realm 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.888+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4a3d0 con 0x56443fd45ea0 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.888+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.888+0000 7fcdd72db640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcdc80a0040 0x7fcdc808e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.888+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4a3d0 con 0x7fcdc80a0040 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.889+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcdc80a0040 0x7fcdc808e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.889+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcdc80a0040 0x7fcdc808e090 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.889+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.889+0000 7fcdd6ada640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcdcc003a70 0x7fcdcc0393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.889+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4a3d0 con 0x7fcdcc003a70 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.889+0000 7fcdd7adc640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcdcc003a70 0x7fcdcc0393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.890+0000 7fcdd7adc640 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcdcc003a70 0x7fcdcc0393c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.890+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.890+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd41720 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.890+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.890+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd41720 2024-05-07T13:56:11.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.890+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.890+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdcc003a70 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.891+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.891+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdcc003a70 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.891+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.891+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdc80a0040 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.891+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.891+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd45ea0 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.891+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.891+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd41720 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.892+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.892+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdcc003a70 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.892+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.892+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd41720 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.892+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.892+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdc80a0040 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.892+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.892+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd45ea0 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd45ea0 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdcc003a70 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd45ea0 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd45ea0 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.893+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd41720 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.894+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.894+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd41720 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.894+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.894+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdcc003a70 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.894+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.894+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd45ea0 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.895+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.895+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdc80a0040 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.895+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.895+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd41720 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.895+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.895+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdcc003a70 2024-05-07T13:56:11.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.896+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.896+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd45ea0 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.896+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.896+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdcc003a70 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.896+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.896+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdc80a0040 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.896+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.896+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd45ea0 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.897+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.897+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdcc003a70 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x56443fd41720 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd453b0 con 0x7fcdc80a0040 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd97dc800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd97dc800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd97dc800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd97dc800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd97dc800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd97dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.898+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd493a0 con 0x56443fd41720 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd49790 con 0x56443fd41720 2024-05-07T13:56:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd49790 con 0x7fcdcc003a70 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 zone default found 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 4 Realm: () 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 zonegroup default 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd49bb0 con 0x7fcdcc003a70 2024-05-07T13:56:11.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.899+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd49fd0 con 0x56443fd45ea0 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.900+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.900+0000 7fcdd97dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.900+0000 7fcdd97dc800 20 rados->read ofs=0 len=0 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.900+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4c280 con 0x56443fd45ea0 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.900+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.900+0000 7fcdd97dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.900+0000 7fcdd97dc800 20 started sync module instance, tier type = 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.900+0000 7fcdd97dc800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.900+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4b720 con 0x7fcdc80a0040 2024-05-07T13:56:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.901+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.901+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94851128671040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4b380 con 0x7fcdc80a0040 2024-05-07T13:56:11.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.901+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4d0f0 con 0x56443fd41720 2024-05-07T13:56:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.902+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94851128671040] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.902+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.902+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94851128675392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4d510 con 0x56443fd41720 2024-05-07T13:56:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.902+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4ded0 con 0x56443fd45ea0 2024-05-07T13:56:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.903+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94851128675392] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.904+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.904+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94851128676448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4d480 con 0x56443fd45ea0 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.904+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4ed40 con 0x7fcdc80a0040 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.904+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94851128676448] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.905+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.905+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94851128681072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4f5e0 con 0x7fcdc80a0040 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.905+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4ffa0 con 0x56443fd41720 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.906+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.906+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94851128687344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd503c0 con 0x56443fd41720 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.906+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd50ec0 con 0x7fcdcc003a70 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.906+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94851128681072] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.907+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94851128687344] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.907+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.907+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94851128691120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4ff10 con 0x7fcdcc003a70 2024-05-07T13:56:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.907+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd51760 con 0x7fcdcc003a70 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.908+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94851128691120] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.908+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.908+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94851128684848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4ff10 con 0x7fcdcc003a70 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.908+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd51d80 con 0x7fcdcc003a70 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94851128694992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd521a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94851128684848] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd97dc800 20 add_watcher() i=0 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd97dc800 20 add_watcher() i=1 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd97dc800 20 add_watcher() i=2 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd97dc800 20 add_watcher() i=3 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd97dc800 20 add_watcher() i=4 2024-05-07T13:56:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd97dc800 20 add_watcher() i=5 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.909+0000 7fcdd97dc800 20 add_watcher() i=6 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.910+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94851128694992] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.910+0000 7fcdd97dc800 20 add_watcher() i=7 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.910+0000 7fcdd97dc800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.910+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56443fd521a0 con 0x56443fd41720 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.910+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.910+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94851128696048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd52110 con 0x56443fd41720 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.911+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94851128696048] v27'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.911+0000 7fcc8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.912+0000 7fcdd97dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.912+0000 7fcdd97dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.912+0000 7fcdd97dc800 5 note: GC not initialized 2024-05-07T13:56:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.912+0000 7fcc8cfe1640 20 reqs_thread_entry: start 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.912+0000 7fcdd97dc800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.912+0000 7fcdd97dc800 20 Filter name: none 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.912+0000 7fcc067fc640 20 reqs_thread_entry: start 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.912+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd87d60 con 0x56443fd45ea0 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.913+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.913+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd87d60 con 0x56443fd45ea0 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.913+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.913+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd87d60 con 0x56443fd41720 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.913+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(64 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.913+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd493a0 con 0x56443fd41720 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.914+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v27'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.914+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56443fd493a0 con 0x7fcdc80a0040 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.914+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.914+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd45ea0 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.914+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.914+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd41720 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.914+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.914+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd45ea0 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.915+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.915+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdc80a0040 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.915+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.915+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd45ea0 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.915+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.915+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd41720 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.915+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.915+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdcc003a70 2024-05-07T13:56:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.916+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.916+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdcc003a70 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.916+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.916+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd45ea0 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.916+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.916+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdcc003a70 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.916+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.916+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdcc003a70 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.917+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.917+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdcc003a70 2024-05-07T13:56:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.917+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.917+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd45ea0 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.917+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.917+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdc80a0040 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.918+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(80 [pgnls start_epoch 27 out=70b] v27'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.918+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd41720 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.918+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.918+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd41720 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.918+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x56443fd41720 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.918+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd45ea0 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.918+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.918+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdc80a0040 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.919+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.919+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdcc003a70 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.919+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd000a4a0 con 0x7fcdcc003a70 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.919+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd41720 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.920+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd0050040 con 0x56443fd41720 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.920+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdcc003a70 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.920+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd0050040 con 0x7fcdcc003a70 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.920+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd45ea0 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.920+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(88 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.920+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdc80a0040 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.920+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.920+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x7fcdcc003a70 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.921+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd0050040 con 0x7fcdcc003a70 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.921+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdcc048040 con 0x56443fd41720 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.921+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd0050040 con 0x56443fd41720 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.921+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdd0055040 con 0x56443fd45ea0 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.921+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.921+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcdd0055040 con 0x7fcdc80a0040 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.921+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(93 [pgnls start_epoch 27 out=127b] v27'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.921+0000 7fcdd97dc800 20 RGWRados::pool_iterate: got myfoo 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.921+0000 7fcdd97dc800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.922+0000 7fcc8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:11.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.922+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94851128696048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd493a0 con 0x56443fd41720 2024-05-07T13:56:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.923+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94851128696048] v27'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcdd0050040 con 0x56443fd41720 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.923+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94851128671040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd51cf0 con 0x7fcdc80a0040 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.924+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94851128671040] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.924+0000 7fcdd97dc800 20 remove_watcher() i=0 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.924+0000 7fcdd97dc800 2 removed watcher, disabling cache 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.924+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94851128675392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd51cf0 con 0x56443fd41720 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.925+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94851128675392] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd0050040 con 0x56443fd41720 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.925+0000 7fcdd97dc800 20 remove_watcher() i=1 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.925+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94851128676448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4cc40 con 0x56443fd45ea0 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.926+0000 7fcdd72db640 1 -- 172.21.15.50:0/224364456 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94851128676448] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc8075030 con 0x56443fd45ea0 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.926+0000 7fcdd97dc800 20 remove_watcher() i=2 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.926+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94851128681072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd51cf0 con 0x7fcdc80a0040 2024-05-07T13:56:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.927+0000 7fcdd6ada640 1 -- 172.21.15.50:0/224364456 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94851128681072] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdcc036040 con 0x7fcdc80a0040 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.927+0000 7fcdd97dc800 20 remove_watcher() i=3 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.927+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94851128687344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4e270 con 0x56443fd41720 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.929+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94851128687344] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd0050040 con 0x56443fd41720 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.929+0000 7fcdd97dc800 20 remove_watcher() i=4 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.929+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94851128691120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd51cf0 con 0x7fcdcc003a70 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.930+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94851128691120] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd0050040 con 0x7fcdcc003a70 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.930+0000 7fcdd97dc800 20 remove_watcher() i=5 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.930+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94851128684848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd4faf0 con 0x7fcdcc003a70 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.931+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94851128684848] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd0050040 con 0x7fcdcc003a70 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.931+0000 7fcdd97dc800 20 remove_watcher() i=6 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.931+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94851128694992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56443fd51cf0 con 0x7fcdcc003a70 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94851128694992] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd0050040 con 0x7fcdcc003a70 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 20 remove_watcher() i=7 2024-05-07T13:56:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcdcc003a70 msgr2=0x7fcdcc0393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcdcc003a70 0x7fcdcc0393c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fd41720 msgr2=0x56443fd43be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fd41720 0x56443fd43be0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcdc80a0040 msgr2=0x7fcdc808e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcdc80a0040 0x7fcdc808e090 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd45ea0 msgr2=0x56443fd48290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd45ea0 0x56443fd48290 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcca0036950 msgr2=0x7fcca0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcca0036950 0x7fcca0038e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x56443fd0fa80 tx=0x7fcdcc022040 comp rx=0 tx=0).stop 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 msgr2=0x56443fd36020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/224364456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd2ec10 0x56443fd36020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcdc808af70 tx=0x7fcdc8082e80 comp rx=0 tx=0).stop 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 reap_dead start 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd7adc640 1 -- 172.21.15.50:0/224364456 reap_dead start 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 shutdown_connections 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 >> 172.21.15.50:0/224364456 conn(0x56443fd2af70 msgr2=0x56443fd285d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 shutdown_connections 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/224364456 wait complete. 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3886095482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccb0036900 msgr2=0x7fccb0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/3886095482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccb0036900 0x7fccb0038dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x56443fd07d40 tx=0x7fcdcc006000 comp rx=0 tx=0).stop 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3886095482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd21b40 msgr2=0x56443fd21f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/3886095482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd21b40 0x56443fd21f60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8006b30 tx=0x7fcdc8076650 comp rx=0 tx=0).stop 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3886095482 shutdown_connections 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/3886095482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccb0036900 0x7fccb0038dc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/3886095482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fd21b40 0x56443fd21f60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.932+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3886095482 >> 172.21.15.50:0/3886095482 conn(0x56443fd15be0 msgr2=0x56443fd15fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3886095482 shutdown_connections 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/3886095482 wait complete. 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56443fd10b40 msgr2=0x56443fd12fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56443fd10b40 0x56443fd12fb0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fc072a0 msgr2=0x56443fd0a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56443fc072a0 0x56443fd0a400 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd0cc00 msgr2=0x56443fd0eff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56443fd0cc00 0x56443fd0eff0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccbc036950 msgr2=0x7fccbc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fccbc036950 0x7fccbc038e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc000f60 tx=0x7fcdcc0013f0 comp rx=0 tx=0).stop 2024-05-07T13:56:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 msgr2=0x56443fd031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 --2- 172.21.15.50:0/1555412075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56443fc06940 0x56443fd031c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8052540 tx=0x7fcdc8003020 comp rx=0 tx=0).stop 2024-05-07T13:56:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd7adc640 1 -- 172.21.15.50:0/1555412075 reap_dead start 2024-05-07T13:56:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 shutdown_connections 2024-05-07T13:56:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 >> 172.21.15.50:0/1555412075 conn(0x56443fc025a0 msgr2=0x56443fcf58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 shutdown_connections 2024-05-07T13:56:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:11.933+0000 7fcdd97dc800 1 -- 172.21.15.50:0/1555412075 wait complete. 2024-05-07T13:56:11.933 INFO:teuthology.orchestra.run.smithi050.stdout:["myfoo"] 2024-05-07T13:56:11.933 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-07T13:56:11.944 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:11.955 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:11.964 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:12.011 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-05-07T13:56:12.039 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:12.067 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:12.095 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:12.095 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-07T13:56:12.095 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-07T13:56:12.096 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-07T13:56:12.141 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:12.141 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:12.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.153+0000 7fb1a6b2d800 1 Processor -- start 2024-05-07T13:56:12.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.153+0000 7fb1a6b2d800 1 -- start start 2024-05-07T13:56:12.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.153+0000 7fb1a6b2d800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558fe328d480 0x558fe328f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.153+0000 7fb1a6b2d800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558fe328fe40 con 0x558fe32894d0 2024-05-07T13:56:12.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.153+0000 7fb1a6b2d800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x558fe311b050 con 0x558fe328d480 2024-05-07T13:56:12.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.154+0000 7fb1a20c4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558fe328d480 0x558fe328f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.154+0000 7fb1a28c5640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x558fe32894d0 0x558fe32898f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39720/0 (socket says 172.21.15.50:39720) 2024-05-07T13:56:12.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.154+0000 7fb1a28c5640 1 -- 172.21.15.50:0/2623931198 learned_addr learned my addr 172.21.15.50:0/2623931198 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:12.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.154+0000 7fb1a20c4640 1 -- 172.21.15.50:0/2623931198 >> v1:172.21.15.22:6789/0 conn(0x558fe32894d0 legacy=0x558fe32898f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.154+0000 7fb1a20c4640 1 -- 172.21.15.50:0/2623931198 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe3291020 con 0x558fe328d480 2024-05-07T13:56:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.156+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/2623931198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe328d480 0x558fe328f870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00a600 tx=0x7fb18c01ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88247d4586a91dc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.156+0000 7fb1a18c3640 1 -- 172.21.15.50:0/2623931198 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c00a200 con 0x558fe328d480 2024-05-07T13:56:12.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.156+0000 7fb1a18c3640 1 -- 172.21.15.50:0/2623931198 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18c00a3a0 con 0x558fe328d480 2024-05-07T13:56:12.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.156+0000 7fb1a18c3640 1 -- 172.21.15.50:0/2623931198 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c0086e0 con 0x558fe328d480 2024-05-07T13:56:12.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.156+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2623931198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe328d480 msgr2=0x558fe328f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.156+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/2623931198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe328d480 0x558fe328f870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00a600 tx=0x7fb18c01ed70 comp rx=0 tx=0).stop 2024-05-07T13:56:12.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.157+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2623931198 shutdown_connections 2024-05-07T13:56:12.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.157+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/2623931198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe328d480 0x558fe328f870 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.157+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2623931198 >> 172.21.15.50:0/2623931198 conn(0x558fe3283d30 msgr2=0x558fe3286150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.157+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2623931198 shutdown_connections 2024-05-07T13:56:12.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.157+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2623931198 wait complete. 2024-05-07T13:56:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.171+0000 7fb1a6b2d800 1 Processor -- start 2024-05-07T13:56:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.172+0000 7fb1a6b2d800 1 -- start start 2024-05-07T13:56:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.172+0000 7fb1a6b2d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe337d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.172+0000 7fb1a6b2d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558fe31d51d0 con 0x558fe32894d0 2024-05-07T13:56:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.172+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe337d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.172+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe337d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45844/0 (socket says 172.21.15.50:45844) 2024-05-07T13:56:12.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.172+0000 7fb1a28c5640 1 -- 172.21.15.50:0/4280261914 learned_addr learned my addr 172.21.15.50:0/4280261914 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.172+0000 7fb1a28c5640 1 -- 172.21.15.50:0/4280261914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe337ddf0 con 0x558fe32894d0 2024-05-07T13:56:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.172+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/4280261914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe337d820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb1940017a0 tx=0x7fb194001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1428feee4e4e12c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb090e09640 1 -- 172.21.15.50:0/4280261914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194004520 con 0x558fe32894d0 2024-05-07T13:56:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb090e09640 1 -- 172.21.15.50:0/4280261914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1940046c0 con 0x558fe32894d0 2024-05-07T13:56:12.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb090e09640 1 -- 172.21.15.50:0/4280261914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194004a00 con 0x558fe32894d0 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/4280261914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 msgr2=0x558fe337d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/4280261914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe337d820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb1940017a0 tx=0x7fb194001c60 comp rx=0 tx=0).stop 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/4280261914 shutdown_connections 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/4280261914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe337d820 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/4280261914 >> 172.21.15.50:0/4280261914 conn(0x558fe3283d30 msgr2=0x558fe3374d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/4280261914 shutdown_connections 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.173+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/4280261914 wait complete. 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.174+0000 7fb1a6b2d800 1 Processor -- start 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.174+0000 7fb1a6b2d800 1 -- start start 2024-05-07T13:56:12.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.174+0000 7fb1a6b2d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe3385340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.174+0000 7fb1a6b2d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558fe32902b0 con 0x558fe32894d0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.174+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe3385340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.174+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe3385340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45860/0 (socket says 172.21.15.50:45860) 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.174+0000 7fb1a28c5640 1 -- 172.21.15.50:0/129205376 learned_addr learned my addr 172.21.15.50:0/129205376 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.175+0000 7fb1a28c5640 1 -- 172.21.15.50:0/129205376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe3385880 con 0x558fe32894d0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.175+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe3385340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb194000f80 tx=0x7fb194001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.175+0000 7fb08f606640 1 -- 172.21.15.50:0/129205376 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194022020 con 0x558fe32894d0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.175+0000 7fb08f606640 1 -- 172.21.15.50:0/129205376 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194014870 con 0x558fe32894d0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.175+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fe3385b10 con 0x558fe32894d0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.175+0000 7fb08f606640 1 -- 172.21.15.50:0/129205376 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194014bb0 con 0x558fe32894d0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.175+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe33887c0 con 0x558fe32894d0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.176+0000 7fb08f606640 1 -- 172.21.15.50:0/129205376 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb194025020 con 0x558fe32894d0 2024-05-07T13:56:12.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.176+0000 7fb08f606640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb088036950 0x7fb088038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.176+0000 7fb08f606640 1 -- 172.21.15.50:0/129205376 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb194018030 con 0x558fe32894d0 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.176+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb088036950 0x7fb088038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.176+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe328d480 0x558fe338c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.176+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe338cb50 con 0x558fe328d480 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.176+0000 7fb1a30c6640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe328d480 0x558fe338c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.177+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb088036950 0x7fb088038e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb18c055000 tx=0x7fb18c050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.177+0000 7fb1a30c6640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe328d480 0x558fe338c580 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.177+0000 7fb1a30c6640 1 -- 172.21.15.50:0/129205376 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe328d480 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.177+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe3389b10 con 0x558fe328d480 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.177+0000 7fb1a30c6640 1 -- 172.21.15.50:0/129205376 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe328d480 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.177+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe338ee60 0x558fe3391250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.177+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe3391920 con 0x558fe338ee60 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.177+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe338ee60 0x558fe3391250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.178+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe338ee60 0x558fe3391250 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.178+0000 7fb1a28c5640 1 -- 172.21.15.50:0/129205376 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb19401b070 con 0x558fe338ee60 2024-05-07T13:56:12.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.178+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe338de10 con 0x558fe328d480 2024-05-07T13:56:12.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.178+0000 7fb1a30c6640 1 -- 172.21.15.50:0/129205376 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe328d480 2024-05-07T13:56:12.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.178+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558fe3392d80 0x558fe33951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.178+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe3395950 con 0x558fe3392d80 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.178+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558fe3392d80 0x558fe33951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.179+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558fe3392d80 0x558fe33951f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.179+0000 7fb1a20c4640 1 -- 172.21.15.50:0/129205376 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb18c05f6f0 con 0x558fe3392d80 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.179+0000 7fb1a6b2d800 1 Processor -- start 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.179+0000 7fb1a6b2d800 1 -- start start 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb1a6b2d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33a3e00 0x558fe33a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb1a6b2d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558fe317bcf0 con 0x558fe33a3e00 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33a3e00 0x558fe33a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33a3e00 0x558fe33a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45876/0 (socket says 172.21.15.50:45876) 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb1a28c5640 1 -- 172.21.15.50:0/2016360940 learned_addr learned my addr 172.21.15.50:0/2016360940 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb1a28c5640 1 -- 172.21.15.50:0/2016360940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe33a4760 con 0x558fe33a3e00 2024-05-07T13:56:12.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/2016360940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33a3e00 0x558fe33a4220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb19404aca0 tx=0x7fb1940108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb08ce01640 1 -- 172.21.15.50:0/2016360940 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194044c40 con 0x558fe33a3e00 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb08ce01640 1 -- 172.21.15.50:0/2016360940 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194044de0 con 0x558fe33a3e00 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.180+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2016360940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fe33a51d0 con 0x558fe33a3e00 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.181+0000 7fb08ce01640 1 -- 172.21.15.50:0/2016360940 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19401da80 con 0x558fe33a3e00 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.181+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2016360940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe33a56d0 con 0x558fe33a3e00 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.181+0000 7fb08ce01640 1 -- 172.21.15.50:0/2016360940 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb194010070 con 0x558fe33a3e00 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.181+0000 7fb08ce01640 1 --2- 172.21.15.50:0/2016360940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb07c0369a0 0x7fb07c038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.181+0000 7fb08ce01640 1 -- 172.21.15.50:0/2016360940 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb1940280f0 con 0x558fe33a3e00 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.182+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/2016360940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb07c0369a0 0x7fb07c038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.182+0000 7fb1a6b2d800 1 Processor -- start 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.182+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/2016360940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb07c0369a0 0x7fb07c038e60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x558fe338d410 tx=0x7fb18c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.182+0000 7fb1a6b2d800 1 -- start start 2024-05-07T13:56:12.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.182+0000 7fb1a6b2d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.182+0000 7fb1a6b2d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558fe337e170 con 0x558fe33b0ef0 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.182+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.182+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45878/0 (socket says 172.21.15.50:45878) 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.182+0000 7fb1a28c5640 1 -- 172.21.15.50:0/2473268838 learned_addr learned my addr 172.21.15.50:0/2473268838 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb1a28c5640 1 -- 172.21.15.50:0/2473268838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe33b18e0 con 0x558fe33b0ef0 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/2473268838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b1310 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb194044fb0 tx=0x7fb19401dec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cdf12ce3f26a23 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb0867fc640 1 -- 172.21.15.50:0/2473268838 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194012ab0 con 0x558fe33b0ef0 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb0867fc640 1 -- 172.21.15.50:0/2473268838 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19405c070 con 0x558fe33b0ef0 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb0867fc640 1 -- 172.21.15.50:0/2473268838 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19400fed0 con 0x558fe33b0ef0 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2473268838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 msgr2=0x558fe33b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/2473268838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b1310 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb194044fb0 tx=0x7fb19401dec0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2473268838 shutdown_connections 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/2473268838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b1310 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2473268838 >> 172.21.15.50:0/2473268838 conn(0x558fe33ad250 msgr2=0x558fe33ab2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2473268838 shutdown_connections 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.183+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2473268838 wait complete. 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.184+0000 7fb1a6b2d800 1 Processor -- start 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.184+0000 7fb1a6b2d800 1 -- start start 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.184+0000 7fb1a6b2d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.184+0000 7fb1a6b2d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558fe33b1f90 con 0x558fe33b0ef0 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.184+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.184+0000 7fb1a28c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45882/0 (socket says 172.21.15.50:45882) 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.184+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 learned_addr learned my addr 172.21.15.50:0/3652257221 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.184+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe33b8880 con 0x558fe33b0ef0 2024-05-07T13:56:12.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.185+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b8340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb194044fb0 tx=0x7fb194004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.185+0000 7fb084ff9640 1 -- 172.21.15.50:0/3652257221 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1940128d0 con 0x558fe33b0ef0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.185+0000 7fb084ff9640 1 -- 172.21.15.50:0/3652257221 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19404c070 con 0x558fe33b0ef0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.185+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fe33b8880 con 0x558fe33b0ef0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.185+0000 7fb084ff9640 1 -- 172.21.15.50:0/3652257221 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194012ab0 con 0x558fe33b0ef0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.185+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe33b8880 con 0x558fe33b0ef0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.185+0000 7fb084ff9640 1 -- 172.21.15.50:0/3652257221 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb1940490d0 con 0x558fe33b0ef0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.186+0000 7fb084ff9640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb06c036950 0x7fb06c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.186+0000 7fb084ff9640 1 -- 172.21.15.50:0/3652257221 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb194069070 con 0x558fe33b0ef0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.186+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb06c036950 0x7fb06c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.186+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.186+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe33c3890 0x558fe33c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.186+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c64a0 con 0x558fe33c3890 2024-05-07T13:56:12.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.186+0000 7fb1a30c6640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe33c3890 0x558fe33c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.186+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb06c036950 0x7fb06c038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb18c000c00 tx=0x7fb18c061040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a30c6640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe33c3890 0x558fe33c5d50 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 20 realm 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c68d0 con 0x558fe33c3890 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c3890 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.187+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c7540 con 0x558fe33c3890 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a6b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe33c7f00 0x558fe33ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33ca830 con 0x558fe33c7f00 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe33c7f00 0x558fe33ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe33c7f00 0x558fe33ca2f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a6b2d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:12.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a6b2d800 20 searching for the correct realm 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.188+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cc1c0 con 0x558fe33c7f00 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.189+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.189+0000 7fb1a28c5640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb194032040 0x7fb19402f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.189+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cc1c0 con 0x7fb194032040 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.189+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb194032040 0x7fb19402f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.189+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb194032040 0x7fb19402f6d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.190+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.190+0000 7fb1a20c4640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb18c084040 0x7fb18c05d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.190+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cc1c0 con 0x7fb18c084040 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.190+0000 7fb1a30c6640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb18c084040 0x7fb18c05d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.190+0000 7fb1a30c6640 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb18c084040 0x7fb18c05d950 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.190+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.190+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c3890 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.191+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.191+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c3890 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.191+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.191+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb18c084040 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.191+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.191+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb18c084040 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.191+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.191+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb194032040 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.192+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.192+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c7f00 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.192+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.192+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c3890 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.192+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.192+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb18c084040 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.193+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.193+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c3890 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.193+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.193+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb194032040 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.193+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.193+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c7f00 2024-05-07T13:56:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.193+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.193+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c7f00 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.193+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.194+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb18c084040 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.194+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.194+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c7f00 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.194+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.194+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c7f00 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.194+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.194+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c3890 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.194+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.194+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c3890 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.195+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.195+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb18c084040 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.195+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.195+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c7f00 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.195+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.195+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb194032040 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.196+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.196+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c3890 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.196+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.196+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb18c084040 2024-05-07T13:56:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.196+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.196+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c7f00 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.196+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.196+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb18c084040 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.197+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.197+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x7fb194032040 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.197+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.197+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558fe33c71a0 con 0x558fe33c7f00 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.197+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.197+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fb19408c040 con 0x7fb18c084040 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fb19408c040 con 0x558fe33c3890 2024-05-07T13:56:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fb19408c040 con 0x7fb194032040 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a6b2d800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a6b2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a6b2d800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a6b2d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a6b2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a6b2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.198+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cb190 con 0x558fe33c3890 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.199+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.199+0000 7fb1a6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.199+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.199+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cb580 con 0x558fe33c3890 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.199+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.199+0000 7fb1a6b2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.199+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.199+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cb580 con 0x7fb18c084040 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 zone default found 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 4 Realm: () 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 zonegroup default 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cb9a0 con 0x7fb18c084040 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cb9a0 con 0x558fe33c7f00 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33ce070 con 0x558fe33c7f00 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 started sync module instance, tier type = 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.200+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cd510 con 0x7fb194032040 2024-05-07T13:56:12.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.201+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.201+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94076481099952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33ce180 con 0x7fb194032040 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.201+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33ceb40 con 0x558fe33c3890 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.203+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94076481099952] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.203+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.203+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94076481103504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cef60 con 0x558fe33c3890 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.203+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cf920 con 0x558fe33c7f00 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.204+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94076481103504] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.204+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.204+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94076481107536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33cef60 con 0x558fe33c7f00 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.204+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d0390 con 0x7fb194032040 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.205+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94076481107536] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.205+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.205+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94076481104560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33ceed0 con 0x7fb194032040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.205+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d1250 con 0x558fe33c3890 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.206+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.206+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94076481113984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d1a10 con 0x558fe33c3890 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.206+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d2530 con 0x7fb18c084040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.206+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94076481104560] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.207+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94076481113984] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.207+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.207+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94076481118208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d24f0 con 0x7fb18c084040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.207+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d2dd0 con 0x7fb18c084040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.208+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.208+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94076481120464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d24f0 con 0x7fb18c084040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.208+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d38e0 con 0x7fb18c084040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.208+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94076481118208] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94076481120464] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94076481121520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d33f0 con 0x7fb18c084040 2024-05-07T13:56:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a6b2d800 20 add_watcher() i=0 2024-05-07T13:56:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a6b2d800 20 add_watcher() i=1 2024-05-07T13:56:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a6b2d800 20 add_watcher() i=2 2024-05-07T13:56:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a6b2d800 20 add_watcher() i=3 2024-05-07T13:56:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a6b2d800 20 add_watcher() i=4 2024-05-07T13:56:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a6b2d800 20 add_watcher() i=5 2024-05-07T13:56:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.209+0000 7fb1a6b2d800 20 add_watcher() i=6 2024-05-07T13:56:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.210+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94076481121520] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.210+0000 7fb1a6b2d800 20 add_watcher() i=7 2024-05-07T13:56:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.210+0000 7fb1a6b2d800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.210+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d68d0 con 0x558fe33c3890 2024-05-07T13:56:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.210+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.210+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94076481123312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33d3cc0 con 0x558fe33c3890 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.211+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94076481123312] v27'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.211+0000 7fb0597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.211+0000 7fb1a6b2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.211+0000 7fb1a6b2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.212+0000 7fb1a6b2d800 5 note: GC not initialized 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.212+0000 7fafd3fff640 20 reqs_thread_entry: start 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.212+0000 7fb1a6b2d800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.212+0000 7fb1a6b2d800 20 Filter name: none 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.212+0000 7fafd1ffb640 20 reqs_thread_entry: start 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.212+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.212+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe3409d30 con 0x7fb194032040 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.212+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe340a900 con 0x7fb194032040 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(63 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe340a8b0 con 0x7fb194032040 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.213+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe340bfd0 con 0x7fb194032040 2024-05-07T13:56:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(65 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-07T13:56:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 4.14 4:293cf68a:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe340ba00 con 0x558fe33c7f00 2024-05-07T13:56:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:67 4.26 4:6704b11e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe34108f0 con 0x7fb18c084040 2024-05-07T13:56:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 4.9 4:909e4f72:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe3413260 con 0x558fe33c3890 2024-05-07T13:56:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 4.1f 4:f81bf5a8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe3415c20 con 0x558fe33c7f00 2024-05-07T13:56:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 4.30 4:0e03b4bd:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe3418970 con 0x558fe33c7f00 2024-05-07T13:56:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 4.1d 4:bb05b52e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe341b4d0 con 0x558fe33c7f00 2024-05-07T13:56:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 4.a 4:50fb99c4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe341e050 con 0x7fb194032040 2024-05-07T13:56:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 4.35 4:ad982cc1:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe341b4d0 con 0x558fe33c3890 2024-05-07T13:56:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:74 4.5 4:a1423e85:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe3422fb0 con 0x558fe33c7f00 2024-05-07T13:56:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(72 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 4.8 4:10d422e9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe3425820 con 0x558fe33c7f00 2024-05-07T13:56:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:76 4.30 4:0cdb3134:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558fe341b4d0 con 0x558fe33c7f00 2024-05-07T13:56:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(70 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(67 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(74 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(68 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(69 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.214+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(73 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.215+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(75 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb19401b070 con 0x558fe33c7f00 2024-05-07T13:56:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.215+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(76 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb194093060 con 0x558fe33c7f00 2024-05-07T13:56:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.216+0000 7fb0597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.216+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94076481123312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33f22b0 con 0x558fe33c3890 2024-05-07T13:56:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.217+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94076481123312] v27'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.217+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94076481099952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33f22b0 con 0x7fb194032040 2024-05-07T13:56:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.218+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94076481099952] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.218+0000 7fb1a6b2d800 20 remove_watcher() i=0 2024-05-07T13:56:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.218+0000 7fb1a6b2d800 2 removed watcher, disabling cache 2024-05-07T13:56:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.218+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94076481103504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33f22b0 con 0x558fe33c3890 2024-05-07T13:56:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.219+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94076481103504] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.219+0000 7fb1a6b2d800 20 remove_watcher() i=1 2024-05-07T13:56:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.219+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94076481107536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33f22b0 con 0x558fe33c7f00 2024-05-07T13:56:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.220+0000 7fb1a28c5640 1 -- 172.21.15.50:0/3652257221 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94076481107536] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194093060 con 0x558fe33c7f00 2024-05-07T13:56:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.220+0000 7fb1a6b2d800 20 remove_watcher() i=2 2024-05-07T13:56:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.220+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94076481104560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33f22b0 con 0x7fb194032040 2024-05-07T13:56:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.221+0000 7fb1a20c4640 1 -- 172.21.15.50:0/3652257221 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94076481104560] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c072070 con 0x7fb194032040 2024-05-07T13:56:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.221+0000 7fb1a6b2d800 20 remove_watcher() i=3 2024-05-07T13:56:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.221+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94076481113984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33f22b0 con 0x558fe33c3890 2024-05-07T13:56:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.222+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94076481113984] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x558fe33c3890 2024-05-07T13:56:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.222+0000 7fb1a6b2d800 20 remove_watcher() i=4 2024-05-07T13:56:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.222+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94076481118208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33f22b0 con 0x7fb18c084040 2024-05-07T13:56:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.223+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94076481118208] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.223+0000 7fb1a6b2d800 20 remove_watcher() i=5 2024-05-07T13:56:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.223+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94076481120464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33f22b0 con 0x7fb18c084040 2024-05-07T13:56:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.224+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94076481120464] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.224+0000 7fb1a6b2d800 20 remove_watcher() i=6 2024-05-07T13:56:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.224+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94076481121520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558fe33f22b0 con 0x7fb18c084040 2024-05-07T13:56:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94076481121520] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0083e0 con 0x7fb18c084040 2024-05-07T13:56:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 20 remove_watcher() i=7 2024-05-07T13:56:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb18c084040 msgr2=0x7fb18c05d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb18c084040 0x7fb18c05d950 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe33c3890 msgr2=0x558fe33c5d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe33c3890 0x558fe33c5d50 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb194032040 msgr2=0x7fb19402f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb194032040 0x7fb19402f6d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe33c7f00 msgr2=0x558fe33ca2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe33c7f00 0x558fe33ca2f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb06c036950 msgr2=0x7fb06c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb06c036950 0x7fb06c038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb18c000c00 tx=0x7fb18c061040 comp rx=0 tx=0).stop 2024-05-07T13:56:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 msgr2=0x558fe33b8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/3652257221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33b0ef0 0x558fe33b8340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb194044fb0 tx=0x7fb194004180 comp rx=0 tx=0).stop 2024-05-07T13:56:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 reap_dead start 2024-05-07T13:56:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a30c6640 1 -- 172.21.15.50:0/3652257221 reap_dead start 2024-05-07T13:56:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 shutdown_connections 2024-05-07T13:56:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 >> 172.21.15.50:0/3652257221 conn(0x558fe33ad250 msgr2=0x558fe33aa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 shutdown_connections 2024-05-07T13:56:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/3652257221 wait complete. 2024-05-07T13:56:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2016360940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb07c0369a0 msgr2=0x7fb07c038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/2016360940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb07c0369a0 0x7fb07c038e60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x558fe338d410 tx=0x7fb18c005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2016360940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33a3e00 msgr2=0x558fe33a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.225+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/2016360940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33a3e00 0x558fe33a4220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb19404aca0 tx=0x7fb1940108f0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2016360940 shutdown_connections 2024-05-07T13:56:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/2016360940 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb07c0369a0 0x7fb07c038e60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/2016360940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe33a3e00 0x558fe33a4220 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2016360940 >> 172.21.15.50:0/2016360940 conn(0x558fe3397ea0 msgr2=0x558fe33982a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2016360940 shutdown_connections 2024-05-07T13:56:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/2016360940 wait complete. 2024-05-07T13:56:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558fe3392d80 msgr2=0x558fe33951f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558fe3392d80 0x558fe33951f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe328d480 msgr2=0x558fe338c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558fe328d480 0x558fe338c580 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe338ee60 msgr2=0x558fe3391250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558fe338ee60 0x558fe3391250 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb088036950 msgr2=0x7fb088038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb088036950 0x7fb088038e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb18c055000 tx=0x7fb18c050000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 msgr2=0x558fe3385340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 --2- 172.21.15.50:0/129205376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe32894d0 0x558fe3385340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb194000f80 tx=0x7fb194001250 comp rx=0 tx=0).stop 2024-05-07T13:56:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a30c6640 1 -- 172.21.15.50:0/129205376 reap_dead start 2024-05-07T13:56:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 shutdown_connections 2024-05-07T13:56:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 >> 172.21.15.50:0/129205376 conn(0x558fe3283d30 msgr2=0x558fe3373530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 shutdown_connections 2024-05-07T13:56:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.226+0000 7fb1a6b2d800 1 -- 172.21.15.50:0/129205376 wait complete. 2024-05-07T13:56:12.235 INFO:teuthology.orchestra.run.smithi050.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"02b45de7-8fca-4685-ae50-761ba20a02e2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","marker":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-07T13:56:11.612676Z","creation_time":"2024-05-07T13:56:11.609586Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-07T13:56:12.235 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '02b45de7-8fca-4685-ae50-761ba20a02e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-07T13:56:11.612676Z', 'creation_time': '2024-05-07T13:56:11.609586Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-07T13:56:12.236 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-07T13:56:12.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-07T13:56:12.236 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-07T13:56:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:12.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.294+0000 7f5672f38800 1 Processor -- start 2024-05-07T13:56:12.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.294+0000 7f5672f38800 1 -- start start 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.294+0000 7f5672f38800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b8f1357140 0x55b8f1357560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.294+0000 7f5672f38800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b8f1357be0 con 0x55b8f1358350 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.294+0000 7f5672f38800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55b8f11e8050 con 0x55b8f1357140 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.295+0000 7f566ec96640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b8f1357140 0x55b8f1357560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.295+0000 7f566e495640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55b8f1358350 0x55b8f13587d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39730/0 (socket says 172.21.15.50:39730) 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.295+0000 7f566ec96640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b8f1357140 0x55b8f1357560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45890/0 (socket says 172.21.15.50:45890) 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.295+0000 7f566e495640 1 -- 172.21.15.50:0/3610772837 learned_addr learned my addr 172.21.15.50:0/3610772837 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.295+0000 7f566ec96640 1 -- 172.21.15.50:0/3610772837 >> v1:172.21.15.22:6789/0 conn(0x55b8f1358350 legacy=0x55b8f13587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.295+0000 7f566ec96640 1 -- 172.21.15.50:0/3610772837 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f1358f10 con 0x55b8f1357140 2024-05-07T13:56:12.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.297+0000 7f566ec96640 1 --2- 172.21.15.50:0/3610772837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f1357560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f566000a470 tx=0x7f566001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ec261955c4794d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.297+0000 7f566dc94640 1 -- 172.21.15.50:0/3610772837 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660057070 con 0x55b8f1357140 2024-05-07T13:56:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.297+0000 7f566dc94640 1 -- 172.21.15.50:0/3610772837 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566004adc0 con 0x55b8f1357140 2024-05-07T13:56:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.297+0000 7f566dc94640 1 -- 172.21.15.50:0/3610772837 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660052590 con 0x55b8f1357140 2024-05-07T13:56:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.298+0000 7f5672f38800 1 -- 172.21.15.50:0/3610772837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 msgr2=0x55b8f1357560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.298+0000 7f5672f38800 1 --2- 172.21.15.50:0/3610772837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f1357560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f566000a470 tx=0x7f566001ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.298+0000 7f5672f38800 1 -- 172.21.15.50:0/3610772837 shutdown_connections 2024-05-07T13:56:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.298+0000 7f5672f38800 1 --2- 172.21.15.50:0/3610772837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f1357560 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.298+0000 7f5672f38800 1 -- 172.21.15.50:0/3610772837 >> 172.21.15.50:0/3610772837 conn(0x55b8f1352780 msgr2=0x55b8f1354ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.298+0000 7f5672f38800 1 -- 172.21.15.50:0/3610772837 shutdown_connections 2024-05-07T13:56:12.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.298+0000 7f5672f38800 1 -- 172.21.15.50:0/3610772837 wait complete. 2024-05-07T13:56:12.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.313+0000 7f5672f38800 1 Processor -- start 2024-05-07T13:56:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.313+0000 7f5672f38800 1 -- start start 2024-05-07T13:56:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.313+0000 7f5672f38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f14487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.313+0000 7f5672f38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b8f12a21d0 con 0x55b8f1357140 2024-05-07T13:56:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.313+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f14487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.314+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f14487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45906/0 (socket says 172.21.15.50:45906) 2024-05-07T13:56:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.314+0000 7f566ec96640 1 -- 172.21.15.50:0/2351037982 learned_addr learned my addr 172.21.15.50:0/2351037982 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.314+0000 7f566ec96640 1 -- 172.21.15.50:0/2351037982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f1448da0 con 0x55b8f1357140 2024-05-07T13:56:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.314+0000 7f566ec96640 1 --2- 172.21.15.50:0/2351037982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f14487d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5660055040 tx=0x7f566004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b545f26731481e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.314+0000 7f555ce09640 1 -- 172.21.15.50:0/2351037982 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660057040 con 0x55b8f1357140 2024-05-07T13:56:12.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.314+0000 7f555ce09640 1 -- 172.21.15.50:0/2351037982 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5660063070 con 0x55b8f1357140 2024-05-07T13:56:12.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.314+0000 7f555ce09640 1 -- 172.21.15.50:0/2351037982 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566005d790 con 0x55b8f1357140 2024-05-07T13:56:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 -- 172.21.15.50:0/2351037982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 msgr2=0x55b8f14487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 --2- 172.21.15.50:0/2351037982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f14487d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5660055040 tx=0x7f566004c000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 -- 172.21.15.50:0/2351037982 shutdown_connections 2024-05-07T13:56:12.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 --2- 172.21.15.50:0/2351037982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f14487d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 -- 172.21.15.50:0/2351037982 >> 172.21.15.50:0/2351037982 conn(0x55b8f1352780 msgr2=0x55b8f14440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 -- 172.21.15.50:0/2351037982 shutdown_connections 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 -- 172.21.15.50:0/2351037982 wait complete. 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 Processor -- start 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 -- start start 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f1450260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.315+0000 7f5672f38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b8f1360820 con 0x55b8f1357140 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.316+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f1450260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.316+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f1450260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45920/0 (socket says 172.21.15.50:45920) 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.316+0000 7f566ec96640 1 -- 172.21.15.50:0/1272670702 learned_addr learned my addr 172.21.15.50:0/1272670702 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.316+0000 7f566ec96640 1 -- 172.21.15.50:0/1272670702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f14507a0 con 0x55b8f1357140 2024-05-07T13:56:12.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.316+0000 7f566ec96640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f1450260 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f566000a470 tx=0x7f5660002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.316+0000 7f555b606640 1 -- 172.21.15.50:0/1272670702 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660057050 con 0x55b8f1357140 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.316+0000 7f555b606640 1 -- 172.21.15.50:0/1272670702 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566005dc90 con 0x55b8f1357140 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.316+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8f1450a30 con 0x55b8f1357140 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.316+0000 7f555b606640 1 -- 172.21.15.50:0/1272670702 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660052440 con 0x55b8f1357140 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.317+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f14536e0 con 0x55b8f1357140 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.317+0000 7f555b606640 1 -- 172.21.15.50:0/1272670702 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f56600525e0 con 0x55b8f1357140 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.317+0000 7f555b606640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5554036950 0x7f5554038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.317+0000 7f555b606640 1 -- 172.21.15.50:0/1272670702 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f566008dc60 con 0x55b8f1357140 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.318+0000 7f566e495640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5554036950 0x7f5554038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.318+0000 7f5672f38800 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1358350 0x55b8f14574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.318+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1457a20 con 0x55b8f1358350 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.318+0000 7f566f497640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1358350 0x55b8f14574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.318+0000 7f566e495640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5554036950 0x7f5554038e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5664000f60 tx=0x7f56640012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.318+0000 7f566f497640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1358350 0x55b8f14574a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.318+0000 7f566f497640 1 -- 172.21.15.50:0/1272670702 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1358350 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.318+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1454a50 con 0x55b8f1358350 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.319+0000 7f566f497640 1 -- 172.21.15.50:0/1272670702 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1358350 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.319+0000 7f5672f38800 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1459d80 0x55b8f145c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.319+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f145c810 con 0x55b8f1459d80 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.319+0000 7f566ec96640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1459d80 0x55b8f145c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.319+0000 7f566ec96640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1459d80 0x55b8f145c170 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.319+0000 7f566ec96640 1 -- 172.21.15.50:0/1272670702 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1459d80 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.319+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1458d30 con 0x55b8f1358350 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.320+0000 7f566f497640 1 -- 172.21.15.50:0/1272670702 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1358350 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.320+0000 7f5672f38800 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b8f145dcc0 0x55b8f1460110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.320+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1460870 con 0x55b8f145dcc0 2024-05-07T13:56:12.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.320+0000 7f566e495640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b8f145dcc0 0x55b8f1460110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.320+0000 7f566e495640 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b8f145dcc0 0x55b8f1460110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.320+0000 7f566e495640 1 -- 172.21.15.50:0/1272670702 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5664009050 con 0x55b8f145dcc0 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.321+0000 7f5672f38800 1 Processor -- start 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.321+0000 7f5672f38800 1 -- start start 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.321+0000 7f5672f38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f146ecd0 0x55b8f146f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.321+0000 7f5672f38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b8f1248cf0 con 0x55b8f146ecd0 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.321+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f146ecd0 0x55b8f146f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.321+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f146ecd0 0x55b8f146f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45930/0 (socket says 172.21.15.50:45930) 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.321+0000 7f566ec96640 1 -- 172.21.15.50:0/69666987 learned_addr learned my addr 172.21.15.50:0/69666987 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.322+0000 7f566ec96640 1 -- 172.21.15.50:0/69666987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f146f630 con 0x55b8f146ecd0 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.322+0000 7f566ec96640 1 --2- 172.21.15.50:0/69666987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f146ecd0 0x55b8f146f0f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f566005cb40 tx=0x7f566005b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.322+0000 7f5558e01640 1 -- 172.21.15.50:0/69666987 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660076040 con 0x55b8f146ecd0 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.322+0000 7f5558e01640 1 -- 172.21.15.50:0/69666987 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566005ba40 con 0x55b8f146ecd0 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.322+0000 7f5672f38800 1 -- 172.21.15.50:0/69666987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8f14700a0 con 0x55b8f146ecd0 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.322+0000 7f5558e01640 1 -- 172.21.15.50:0/69666987 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660007fa0 con 0x55b8f146ecd0 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.322+0000 7f5672f38800 1 -- 172.21.15.50:0/69666987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f14704e0 con 0x55b8f146ecd0 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.323+0000 7f5558e01640 1 -- 172.21.15.50:0/69666987 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5660066a20 con 0x55b8f146ecd0 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.323+0000 7f5558e01640 1 --2- 172.21.15.50:0/69666987 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f554803ad60 0x7f554803d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.323+0000 7f5558e01640 1 -- 172.21.15.50:0/69666987 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5660002000 con 0x55b8f146ecd0 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.323+0000 7f566e495640 1 --2- 172.21.15.50:0/69666987 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f554803ad60 0x7f554803d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.324+0000 7f5672f38800 1 Processor -- start 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.324+0000 7f5672f38800 1 -- start start 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.324+0000 7f566e495640 1 --2- 172.21.15.50:0/69666987 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f554803ad60 0x7f554803d220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f566400bf50 tx=0x7f566400f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.324+0000 7f5672f38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.324+0000 7f5672f38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b8f1449060 con 0x55b8f1482380 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.324+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.324+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14827a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45932/0 (socket says 172.21.15.50:45932) 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.324+0000 7f566ec96640 1 -- 172.21.15.50:0/3012676620 learned_addr learned my addr 172.21.15.50:0/3012676620 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.324+0000 7f566ec96640 1 -- 172.21.15.50:0/3012676620 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f1482d70 con 0x55b8f1482380 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.325+0000 7f566ec96640 1 --2- 172.21.15.50:0/3012676620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14827a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f566005d820 tx=0x7f566007b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebaa30883633a60 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.325+0000 7f55527fc640 1 -- 172.21.15.50:0/3012676620 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566009f070 con 0x55b8f1482380 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.325+0000 7f55527fc640 1 -- 172.21.15.50:0/3012676620 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5660008140 con 0x55b8f1482380 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.325+0000 7f55527fc640 1 -- 172.21.15.50:0/3012676620 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566008a5e0 con 0x55b8f1482380 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.325+0000 7f5672f38800 1 -- 172.21.15.50:0/3012676620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 msgr2=0x55b8f14827a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.325+0000 7f5672f38800 1 --2- 172.21.15.50:0/3012676620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14827a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f566005d820 tx=0x7f566007b5d0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.325+0000 7f5672f38800 1 -- 172.21.15.50:0/3012676620 shutdown_connections 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.325+0000 7f5672f38800 1 --2- 172.21.15.50:0/3012676620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14827a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f5672f38800 1 -- 172.21.15.50:0/3012676620 >> 172.21.15.50:0/3012676620 conn(0x55b8f1475ed0 msgr2=0x55b8f1473f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f5672f38800 1 -- 172.21.15.50:0/3012676620 shutdown_connections 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f5672f38800 1 -- 172.21.15.50:0/3012676620 wait complete. 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f5672f38800 1 Processor -- start 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f5672f38800 1 -- start start 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f5672f38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14897d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f5672f38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b8f1483420 con 0x55b8f1482380 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f566ec96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14897d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45948/0 (socket says 172.21.15.50:45948) 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.326+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 learned_addr learned my addr 172.21.15.50:0/3368307619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.327+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f1489d10 con 0x55b8f1482380 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.327+0000 7f566ec96640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14897d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5660067780 tx=0x7f5660079e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.327+0000 7f5550ff9640 1 -- 172.21.15.50:0/3368307619 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566009f040 con 0x55b8f1482380 2024-05-07T13:56:12.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.327+0000 7f5550ff9640 1 -- 172.21.15.50:0/3368307619 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566008a6b0 con 0x55b8f1482380 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.327+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8f1489d10 con 0x55b8f1482380 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.327+0000 7f5550ff9640 1 -- 172.21.15.50:0/3368307619 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56600664f0 con 0x55b8f1482380 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.327+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f1489d10 con 0x55b8f1482380 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.328+0000 7f5550ff9640 1 -- 172.21.15.50:0/3368307619 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f56600b4020 con 0x55b8f1482380 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.328+0000 7f5550ff9640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55380369a0 0x7f5538038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.328+0000 7f5550ff9640 1 -- 172.21.15.50:0/3368307619 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f56600b2020 con 0x55b8f1482380 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.328+0000 7f566e495640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55380369a0 0x7f5538038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.329+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.329+0000 7f5672f38800 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1494f00 0x55b8f14973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.329+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1497b10 con 0x55b8f1494f00 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.329+0000 7f566e495640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55380369a0 0x7f5538038e60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5664001b60 tx=0x7f5664010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.329+0000 7f566f497640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1494f00 0x55b8f14973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.329+0000 7f566f497640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1494f00 0x55b8f14973c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 20 realm 2024-05-07T13:56:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1497f20 con 0x55b8f1494f00 2024-05-07T13:56:12.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14987f0 con 0x55b8f1494f00 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.330+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1494f00 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f5672f38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f5672f38800 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1499680 0x55b8f149ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149c1d0 con 0x55b8f1499680 2024-05-07T13:56:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f566ec96640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1499680 0x55b8f149ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f566ec96640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1499680 0x55b8f149ba70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f5672f38800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f5672f38800 20 searching for the correct realm 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.331+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149dbb0 con 0x55b8f1499680 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.332+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.332+0000 7f566ec96640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f566008a8a0 0x7f56600797b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.332+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149dbb0 con 0x7f566008a8a0 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.332+0000 7f566e495640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f566008a8a0 0x7f56600797b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.332+0000 7f566e495640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f566008a8a0 0x7f56600797b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.333+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.333+0000 7f566e495640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5664037040 0x7f5664036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.333+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149dbb0 con 0x7f5664037040 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.333+0000 7f566f497640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5664037040 0x7f5664036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.333+0000 7f566f497640 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5664037040 0x7f5664036410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.333+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.333+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1494f00 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.334+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.334+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1494f00 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.334+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.334+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f5664037040 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.334+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.335+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f5664037040 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.335+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.335+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f566008a8a0 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.335+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.335+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1499680 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.335+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.335+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1494f00 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.336+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.336+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f5664037040 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.336+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.336+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1494f00 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.337+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.337+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f566008a8a0 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.338+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.338+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1499680 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.338+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.338+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1499680 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.338+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.338+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f5664037040 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.339+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.339+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1499680 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.339+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.339+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1499680 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.340+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.340+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1494f00 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.340+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.340+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1494f00 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.340+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.340+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f5664037040 2024-05-07T13:56:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.341+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.341+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1499680 2024-05-07T13:56:12.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.341+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.341+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f566008a8a0 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.342+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.342+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1494f00 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.342+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.342+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f5664037040 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.342+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.342+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1499680 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.342+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.342+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f5664037040 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.343+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.343+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f566008a8a0 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.343+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.343+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1499680 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.343+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.343+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f5664037040 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x55b8f1494f00 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b8f1498b90 con 0x7f566008a8a0 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f5672f38800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f5672f38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f5672f38800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f5672f38800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f5672f38800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:12.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f5672f38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.344+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149cb80 con 0x55b8f1494f00 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.345+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.345+0000 7f5672f38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.345+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.345+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149cf70 con 0x55b8f1494f00 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.345+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.345+0000 7f5672f38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.345+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.345+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149cf70 con 0x7f5664037040 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:12.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 20 zone default found 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 4 Realm: () 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 20 zonegroup default 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149d390 con 0x7f5664037040 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.346+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149d7b0 con 0x55b8f1499680 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.347+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.347+0000 7f5672f38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.347+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.347+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149fa60 con 0x55b8f1499680 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.347+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.347+0000 7f5672f38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.347+0000 7f5672f38800 20 started sync module instance, tier type = 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.347+0000 7f5672f38800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.347+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149c770 con 0x7f566008a8a0 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.349+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.349+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94252810497968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f149fad0 con 0x7f566008a8a0 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.349+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a05c0 con 0x55b8f1494f00 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.351+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.351+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94252810502288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a0e90 con 0x55b8f1494f00 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.351+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a1730 con 0x55b8f1499680 2024-05-07T13:56:12.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.351+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94252810497968] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.352+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94252810502288] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.352+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.352+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94252810499360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a1730 con 0x55b8f1499680 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.352+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a1f80 con 0x7f566008a8a0 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.353+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94252810499360] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.353+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.353+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94252810507360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a2320 con 0x7f566008a8a0 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.353+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a2ce0 con 0x55b8f1494f00 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.354+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94252810507360] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.354+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.354+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94252810512432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a2c50 con 0x55b8f1494f00 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.354+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a3ba0 con 0x7f5664037040 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.355+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94252810512432] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.355+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.355+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94252810514496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a3ba0 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.355+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a4560 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.356+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94252810514496] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.356+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.356+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94252810516688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a4560 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.356+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a4f20 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94252810516688] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94252810519184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a4f20 con 0x7f5664037040 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f5672f38800 20 add_watcher() i=0 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f5672f38800 20 add_watcher() i=1 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f5672f38800 20 add_watcher() i=2 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f5672f38800 20 add_watcher() i=3 2024-05-07T13:56:12.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f5672f38800 20 add_watcher() i=4 2024-05-07T13:56:12.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f5672f38800 20 add_watcher() i=5 2024-05-07T13:56:12.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.357+0000 7f5672f38800 20 add_watcher() i=6 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.358+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94252810519184] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.358+0000 7f5672f38800 20 add_watcher() i=7 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.358+0000 7f5672f38800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.358+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a8280 con 0x55b8f1494f00 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.358+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.358+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94252810521568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14a54b0 con 0x55b8f1494f00 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.359+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94252810521568] v27'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.359+0000 7f55257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 5 note: GC not initialized 2024-05-07T13:56:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f549ffff640 20 reqs_thread_entry: start 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 20 Filter name: none 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f549dffb640 20 reqs_thread_entry: start 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14db350 con 0x55b8f1494f00 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.360+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14db730 con 0x55b8f1494f00 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f5672f38800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14db730 con 0x7f566008a8a0 2024-05-07T13:56:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14da170 con 0x7f566008a8a0 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f5672f38800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f5672f38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.361+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14dcb30 con 0x7f566008a8a0 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 4.14 4:293cf68a:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14dc5d0 con 0x55b8f1499680 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:68 4.26 4:6704b11e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14e1640 con 0x7f5664037040 2024-05-07T13:56:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 4.9 4:909e4f72:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14e3ef0 con 0x55b8f1494f00 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 4.1f 4:f81bf5a8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14e6820 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 4.30 4:0e03b4bd:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14e96b0 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:72 4.1d 4:bb05b52e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14ec020 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:73 4.a 4:50fb99c4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14eeb40 con 0x7f566008a8a0 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:74 4.35 4:ad982cc1:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14f1430 con 0x55b8f1494f00 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 4.5 4:a1423e85:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14f3e70 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:76 4.8 4:10d422e9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14f66e0 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 4.30 4:0cdb3134:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14f8f50 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(67 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(70 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(72 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(73 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.362+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(68 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.363+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(69 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.363+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(74 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.363+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(75 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.363+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(76 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.363+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(77 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.364+0000 7f55257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.364+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94252810521568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14c3e70 con 0x55b8f1494f00 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.365+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94252810521568] v27'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.365+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94252810497968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14c3e70 con 0x7f566008a8a0 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.366+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94252810497968] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.366+0000 7f5672f38800 20 remove_watcher() i=0 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.366+0000 7f5672f38800 2 removed watcher, disabling cache 2024-05-07T13:56:12.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.366+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94252810502288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14c3e70 con 0x55b8f1494f00 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.367+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94252810502288] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.367+0000 7f5672f38800 20 remove_watcher() i=1 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.367+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94252810499360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14c3e70 con 0x55b8f1499680 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.368+0000 7f566ec96640 1 -- 172.21.15.50:0/3368307619 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94252810499360] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5660078070 con 0x55b8f1499680 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.368+0000 7f5672f38800 20 remove_watcher() i=2 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.368+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94252810507360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14c3e70 con 0x7f566008a8a0 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.369+0000 7f566e495640 1 -- 172.21.15.50:0/3368307619 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94252810507360] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5664009050 con 0x7f566008a8a0 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.369+0000 7f5672f38800 20 remove_watcher() i=3 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.369+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94252810512432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14c3e70 con 0x55b8f1494f00 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.370+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94252810512432] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x55b8f1494f00 2024-05-07T13:56:12.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.370+0000 7f5672f38800 20 remove_watcher() i=4 2024-05-07T13:56:12.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.370+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94252810514496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14c3e70 con 0x7f5664037040 2024-05-07T13:56:12.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.371+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94252810514496] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.371+0000 7f5672f38800 20 remove_watcher() i=5 2024-05-07T13:56:12.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.371+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94252810516688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14c3e70 con 0x7f5664037040 2024-05-07T13:56:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.372+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94252810516688] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.372+0000 7f5672f38800 20 remove_watcher() i=6 2024-05-07T13:56:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.372+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94252810519184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b8f14c3e70 con 0x7f5664037040 2024-05-07T13:56:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94252810519184] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566800a4a0 con 0x7f5664037040 2024-05-07T13:56:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 20 remove_watcher() i=7 2024-05-07T13:56:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5664037040 msgr2=0x7f5664036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5664037040 0x7f5664036410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1494f00 msgr2=0x55b8f14973c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1494f00 0x55b8f14973c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f566008a8a0 msgr2=0x7f56600797b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f566008a8a0 0x7f56600797b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1499680 msgr2=0x55b8f149ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1499680 0x55b8f149ba70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55380369a0 msgr2=0x7f5538038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55380369a0 0x7f5538038e60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5664001b60 tx=0x7f5664010000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 msgr2=0x55b8f14897d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f566f497640 1 -- 172.21.15.50:0/3368307619 reap_dead start 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14897d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5660067780 tx=0x7f5660079e70 comp rx=0 tx=0).stop 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 shutdown_connections 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 --2- 172.21.15.50:0/3368307619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1482380 0x55b8f14897d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 >> 172.21.15.50:0/3368307619 conn(0x55b8f1475ed0 msgr2=0x55b8f1483b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 shutdown_connections 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.373+0000 7f5672f38800 1 -- 172.21.15.50:0/3368307619 wait complete. 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 -- 172.21.15.50:0/69666987 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f554803ad60 msgr2=0x7f554803d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 --2- 172.21.15.50:0/69666987 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f554803ad60 0x7f554803d220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f566400bf50 tx=0x7f566400f000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 -- 172.21.15.50:0/69666987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f146ecd0 msgr2=0x55b8f146f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 --2- 172.21.15.50:0/69666987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f146ecd0 0x55b8f146f0f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f566005cb40 tx=0x7f566005b660 comp rx=0 tx=0).stop 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 -- 172.21.15.50:0/69666987 shutdown_connections 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 --2- 172.21.15.50:0/69666987 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f554803ad60 0x7f554803d220 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 --2- 172.21.15.50:0/69666987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f146ecd0 0x55b8f146f0f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 -- 172.21.15.50:0/69666987 >> 172.21.15.50:0/69666987 conn(0x55b8f1462d70 msgr2=0x55b8f1463170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 -- 172.21.15.50:0/69666987 shutdown_connections 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.374+0000 7f5672f38800 1 -- 172.21.15.50:0/69666987 wait complete. 2024-05-07T13:56:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b8f145dcc0 msgr2=0x55b8f1460110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b8f145dcc0 0x55b8f1460110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1358350 msgr2=0x55b8f14574a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b8f1358350 0x55b8f14574a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1459d80 msgr2=0x55b8f145c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b8f1459d80 0x55b8f145c170 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5554036950 msgr2=0x7f5554038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5554036950 0x7f5554038e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5664000f60 tx=0x7f56640012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 msgr2=0x55b8f1450260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 --2- 172.21.15.50:0/1272670702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8f1357140 0x55b8f1450260 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f566000a470 tx=0x7f5660002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f566f497640 1 -- 172.21.15.50:0/1272670702 reap_dead start 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 shutdown_connections 2024-05-07T13:56:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 >> 172.21.15.50:0/1272670702 conn(0x55b8f1352780 msgr2=0x55b8f14428f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 shutdown_connections 2024-05-07T13:56:12.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.375+0000 7f5672f38800 1 -- 172.21.15.50:0/1272670702 wait complete. 2024-05-07T13:56:12.374 INFO:teuthology.orchestra.run.smithi050.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"02b45de7-8fca-4685-ae50-761ba20a02e2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","marker":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-07T13:56:11.612676Z","creation_time":"2024-05-07T13:56:11.609586Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-05-07T13:56:12.374 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '02b45de7-8fca-4685-ae50-761ba20a02e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-07T13:56:11.612676Z', 'creation_time': '2024-05-07T13:56:11.609586Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-07T13:56:12.380 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-07T13:56:12.381 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-07T13:56:12.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-07T13:56:12.381 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-07T13:56:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.439+0000 7fd80bf1f800 1 Processor -- start 2024-05-07T13:56:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.439+0000 7fd80bf1f800 1 -- start start 2024-05-07T13:56:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.439+0000 7fd80bf1f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d512d3b550 0x55d512d44050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.439+0000 7fd80bf1f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d512cae070 con 0x55d512d39a10 2024-05-07T13:56:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.439+0000 7fd80bf1f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55d512bcc050 con 0x55d512d3b550 2024-05-07T13:56:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.440+0000 7fd8073c9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d512d3b550 0x55d512d44050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.440+0000 7fd807bca640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55d512d39a10 0x55d512d39e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39738/0 (socket says 172.21.15.50:39738) 2024-05-07T13:56:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.440+0000 7fd807bca640 1 -- 172.21.15.50:0/2109582444 learned_addr learned my addr 172.21.15.50:0/2109582444 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.440+0000 7fd8073c9640 1 -- 172.21.15.50:0/2109582444 >> v1:172.21.15.22:6789/0 conn(0x55d512d39a10 legacy=0x55d512d39e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.440+0000 7fd806bc8640 1 -- 172.21.15.50:0/2109582444 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880421459 0 0) 0x55d512cae070 con 0x55d512d39a10 2024-05-07T13:56:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.440+0000 7fd8073c9640 1 -- 172.21.15.50:0/2109582444 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d512cae240 con 0x55d512d3b550 2024-05-07T13:56:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd8073c9640 1 --2- 172.21.15.50:0/2109582444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d3b550 0x55d512d44050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00a470 tx=0x7fd7fc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14f5b44bca8288c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd806bc8640 1 -- 172.21.15.50:0/2109582444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc057070 con 0x55d512d3b550 2024-05-07T13:56:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd806bc8640 1 -- 172.21.15.50:0/2109582444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc052570 con 0x55d512d3b550 2024-05-07T13:56:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd806bc8640 1 -- 172.21.15.50:0/2109582444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc052870 con 0x55d512d3b550 2024-05-07T13:56:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2109582444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d3b550 msgr2=0x55d512d44050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2109582444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d3b550 0x55d512d44050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00a470 tx=0x7fd7fc01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2109582444 shutdown_connections 2024-05-07T13:56:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2109582444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d3b550 0x55d512d44050 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2109582444 >> 172.21.15.50:0/2109582444 conn(0x55d512d355b0 msgr2=0x55d512d379d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2109582444 shutdown_connections 2024-05-07T13:56:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.442+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2109582444 wait complete. 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.458+0000 7fd80bf1f800 1 Processor -- start 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.458+0000 7fd80bf1f800 1 -- start start 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.458+0000 7fd80bf1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e2e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.458+0000 7fd80bf1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d512c861d0 con 0x55d512d39a10 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.458+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e2e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.458+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e2e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45954/0 (socket says 172.21.15.50:45954) 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.458+0000 7fd807bca640 1 -- 172.21.15.50:0/3831959081 learned_addr learned my addr 172.21.15.50:0/3831959081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.458+0000 7fd807bca640 1 -- 172.21.15.50:0/3831959081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d512e2ec40 con 0x55d512d39a10 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.459+0000 7fd807bca640 1 --2- 172.21.15.50:0/3831959081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e2e670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800b210 tx=0x7fd7f800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa2b7e4572468b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.459+0000 7fd6f5e0b640 1 -- 172.21.15.50:0/3831959081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f8008070 con 0x55d512d39a10 2024-05-07T13:56:12.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.459+0000 7fd6f5e0b640 1 -- 172.21.15.50:0/3831959081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f800d500 con 0x55d512d39a10 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.459+0000 7fd6f5e0b640 1 -- 172.21.15.50:0/3831959081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f800d840 con 0x55d512d39a10 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.459+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3831959081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 msgr2=0x55d512e2e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.459+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3831959081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e2e670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800b210 tx=0x7fd7f800b6d0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.459+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3831959081 shutdown_connections 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.459+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3831959081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e2e670 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.459+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3831959081 >> 172.21.15.50:0/3831959081 conn(0x55d512d355b0 msgr2=0x55d512e29f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.460+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3831959081 shutdown_connections 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.460+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3831959081 wait complete. 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.460+0000 7fd80bf1f800 1 Processor -- start 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.460+0000 7fd80bf1f800 1 -- start start 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.460+0000 7fd80bf1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e36240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.460+0000 7fd80bf1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d512d44860 con 0x55d512d39a10 2024-05-07T13:56:12.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.460+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e36240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.460+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e36240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45958/0 (socket says 172.21.15.50:45958) 2024-05-07T13:56:12.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.460+0000 7fd807bca640 1 -- 172.21.15.50:0/2131046492 learned_addr learned my addr 172.21.15.50:0/2131046492 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.461+0000 7fd807bca640 1 -- 172.21.15.50:0/2131046492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d512e36780 con 0x55d512d39a10 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.461+0000 7fd807bca640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e36240 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800b210 tx=0x7fd7f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.461+0000 7fd6effff640 1 -- 172.21.15.50:0/2131046492 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f800f950 con 0x55d512d39a10 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.461+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d512e36a10 con 0x55d512d39a10 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.461+0000 7fd6effff640 1 -- 172.21.15.50:0/2131046492 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f800faf0 con 0x55d512d39a10 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.461+0000 7fd6effff640 1 -- 172.21.15.50:0/2131046492 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f800fdd0 con 0x55d512d39a10 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.461+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d512e396c0 con 0x55d512d39a10 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.462+0000 7fd6effff640 1 -- 172.21.15.50:0/2131046492 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd7f8017040 con 0x55d512d39a10 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.462+0000 7fd6effff640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6f00368b0 0x7fd6f0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.462+0000 7fd6effff640 1 -- 172.21.15.50:0/2131046492 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd7f8015020 con 0x55d512d39a10 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.462+0000 7fd8073c9640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6f00368b0 0x7fd6f0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.462+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512d3b550 0x55d512e3d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.462+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e3da00 con 0x55d512d3b550 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.463+0000 7fd8083cb640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512d3b550 0x55d512e3d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.463+0000 7fd8073c9640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6f00368b0 0x7fd6f0038d70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc054000 tx=0x7fd7fc04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.463+0000 7fd8083cb640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512d3b550 0x55d512e3d480 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.463+0000 7fd8083cb640 1 -- 172.21.15.50:0/2131046492 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512d3b550 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.463+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e3aa50 con 0x55d512d3b550 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.463+0000 7fd8083cb640 1 -- 172.21.15.50:0/2131046492 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512d3b550 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.464+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e3fd30 0x55d512e42120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.464+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e42810 con 0x55d512e3fd30 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.464+0000 7fd807bca640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e3fd30 0x55d512e42120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.464+0000 7fd807bca640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e3fd30 0x55d512e42120 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.464+0000 7fd807bca640 1 -- 172.21.15.50:0/2131046492 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd7f802d070 con 0x55d512e3fd30 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.464+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e3ece0 con 0x55d512d3b550 2024-05-07T13:56:12.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.464+0000 7fd8083cb640 1 -- 172.21.15.50:0/2131046492 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512d3b550 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.465+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d512e43cc0 0x55d512e46110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.465+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e46870 con 0x55d512e43cc0 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.465+0000 7fd8073c9640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d512e43cc0 0x55d512e46110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.465+0000 7fd8073c9640 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d512e43cc0 0x55d512e46110 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.465+0000 7fd8073c9640 1 -- 172.21.15.50:0/2131046492 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd7fc05a040 con 0x55d512e43cc0 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.466+0000 7fd80bf1f800 1 Processor -- start 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.466+0000 7fd80bf1f800 1 -- start start 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.466+0000 7fd80bf1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e54cd0 0x55d512e550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.466+0000 7fd80bf1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d512c2ccf0 con 0x55d512e54cd0 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.466+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e54cd0 0x55d512e550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.466+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e54cd0 0x55d512e550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45974/0 (socket says 172.21.15.50:45974) 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.466+0000 7fd807bca640 1 -- 172.21.15.50:0/3579046426 learned_addr learned my addr 172.21.15.50:0/3579046426 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.466+0000 7fd807bca640 1 -- 172.21.15.50:0/3579046426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d512e55630 con 0x55d512e54cd0 2024-05-07T13:56:12.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.467+0000 7fd807bca640 1 --2- 172.21.15.50:0/3579046426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e54cd0 0x55d512e550f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800b710 tx=0x7fd7f8041d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.467+0000 7fd6ed7fa640 1 -- 172.21.15.50:0/3579046426 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f8019470 con 0x55d512e54cd0 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.467+0000 7fd6ed7fa640 1 -- 172.21.15.50:0/3579046426 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f8019610 con 0x55d512e54cd0 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.467+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3579046426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d512e560a0 con 0x55d512e54cd0 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.467+0000 7fd6ed7fa640 1 -- 172.21.15.50:0/3579046426 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f80198f0 con 0x55d512e54cd0 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.467+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3579046426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d512e565a0 con 0x55d512e54cd0 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.467+0000 7fd6ed7fa640 1 -- 172.21.15.50:0/3579046426 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd7f803f250 con 0x55d512e54cd0 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd6ed7fa640 1 --2- 172.21.15.50:0/3579046426 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6e00368b0 0x7fd6e0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd6ed7fa640 1 -- 172.21.15.50:0/3579046426 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd7f803ace0 con 0x55d512e54cd0 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd8073c9640 1 --2- 172.21.15.50:0/3579046426 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6e00368b0 0x7fd6e0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd80bf1f800 1 Processor -- start 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd80bf1f800 1 -- start start 2024-05-07T13:56:12.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd8073c9640 1 --2- 172.21.15.50:0/3579046426 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6e00368b0 0x7fd6e0038d70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55d512e3e2e0 tx=0x7fd7fc005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd80bf1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e62530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd80bf1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d512e2efc0 con 0x55d512e62110 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e62530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e62530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45982/0 (socket says 172.21.15.50:45982) 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.468+0000 7fd807bca640 1 -- 172.21.15.50:0/1292562218 learned_addr learned my addr 172.21.15.50:0/1292562218 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd807bca640 1 -- 172.21.15.50:0/1292562218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d512e62b00 con 0x55d512e62110 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd807bca640 1 --2- 172.21.15.50:0/1292562218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e62530 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd7f803dfd0 tx=0x7fd7f8026d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6740db8309152f06 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd6e6ffd640 1 -- 172.21.15.50:0/1292562218 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f8026430 con 0x55d512e62110 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd6e6ffd640 1 -- 172.21.15.50:0/1292562218 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f801cc80 con 0x55d512e62110 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd6e6ffd640 1 -- 172.21.15.50:0/1292562218 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f8030c80 con 0x55d512e62110 2024-05-07T13:56:12.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd80bf1f800 1 -- 172.21.15.50:0/1292562218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 msgr2=0x55d512e62530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/1292562218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e62530 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd7f803dfd0 tx=0x7fd7f8026d00 comp rx=0 tx=0).stop 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd80bf1f800 1 -- 172.21.15.50:0/1292562218 shutdown_connections 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/1292562218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e62530 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.469+0000 7fd80bf1f800 1 -- 172.21.15.50:0/1292562218 >> 172.21.15.50:0/1292562218 conn(0x55d512e5e390 msgr2=0x55d512e5c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd80bf1f800 1 -- 172.21.15.50:0/1292562218 shutdown_connections 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd80bf1f800 1 -- 172.21.15.50:0/1292562218 wait complete. 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd80bf1f800 1 Processor -- start 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd80bf1f800 1 -- start start 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd80bf1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd80bf1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d512e63170 con 0x55d512e62110 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd807bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45992/0 (socket says 172.21.15.50:45992) 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 learned_addr learned my addr 172.21.15.50:0/3454151652 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.470+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d512e69a10 con 0x55d512e62110 2024-05-07T13:56:12.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.471+0000 7fd807bca640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e694d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800efd0 tx=0x7fd7f801ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.471+0000 7fd6e57fa640 1 -- 172.21.15.50:0/3454151652 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f806d070 con 0x55d512e62110 2024-05-07T13:56:12.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.471+0000 7fd6e57fa640 1 -- 172.21.15.50:0/3454151652 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f8026910 con 0x55d512e62110 2024-05-07T13:56:12.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.471+0000 7fd6e57fa640 1 -- 172.21.15.50:0/3454151652 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7f8030570 con 0x55d512e62110 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.471+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d512e69a10 con 0x55d512e62110 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.471+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d512e69a10 con 0x55d512e62110 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.472+0000 7fd6e57fa640 1 -- 172.21.15.50:0/3454151652 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd7f8070070 con 0x55d512e62110 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.472+0000 7fd6e57fa640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6d0036900 0x7fd6d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.472+0000 7fd6e57fa640 1 -- 172.21.15.50:0/3454151652 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd7f8059070 con 0x55d512e62110 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.472+0000 7fd8073c9640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6d0036900 0x7fd6d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.472+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.472+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512e74990 0x55d512e76e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.472+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e775a0 con 0x55d512e74990 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.472+0000 7fd8083cb640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512e74990 0x55d512e76e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.472+0000 7fd8073c9640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6d0036900 0x7fd6d0038dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc01ced0 tx=0x7fd7fc04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd8083cb640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512e74990 0x55d512e76e50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 20 realm 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e779b0 con 0x55d512e74990 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78280 con 0x55d512e74990 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.473+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e74990 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd80bf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e79110 0x55d512e7b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7bc60 con 0x55d512e79110 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd807bca640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e79110 0x55d512e7b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd807bca640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e79110 0x55d512e7b500 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd80bf1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd80bf1f800 20 searching for the correct realm 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.474+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7d640 con 0x55d512e79110 2024-05-07T13:56:12.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.475+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.475+0000 7fd807bca640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd7f8072060 0x7fd7f800c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.475+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7d640 con 0x7fd7f8072060 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.475+0000 7fd8073c9640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd7f8072060 0x7fd7f800c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.475+0000 7fd8073c9640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd7f8072060 0x7fd7f800c820 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.476+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.476+0000 7fd8073c9640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd7fc083040 0x7fd7fc075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.476+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7d640 con 0x7fd7fc083040 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.476+0000 7fd8083cb640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd7fc083040 0x7fd7fc075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.476+0000 7fd8083cb640 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd7fc083040 0x7fd7fc075430 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.477+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.477+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e74990 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.477+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.477+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e74990 2024-05-07T13:56:12.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.477+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.477+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7fc083040 2024-05-07T13:56:12.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.477+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.477+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7fc083040 2024-05-07T13:56:12.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.478+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.478+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7f8072060 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.478+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.478+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e79110 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.478+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.478+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e74990 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.478+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.478+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7fc083040 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.479+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.479+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e74990 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.479+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.479+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7f8072060 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.479+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.479+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e79110 2024-05-07T13:56:12.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.480+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.480+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e79110 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.480+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.480+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7fc083040 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.480+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.480+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e79110 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.481+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.481+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e79110 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.481+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.481+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e74990 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.481+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.481+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e74990 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.481+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.481+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7fc083040 2024-05-07T13:56:12.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.482+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.482+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e79110 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.482+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.482+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7f8072060 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.482+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.482+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e74990 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.482+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.482+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7fc083040 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.483+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.483+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e79110 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.483+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.483+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7fc083040 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.483+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.483+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7f8072060 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.484+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.484+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e79110 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.484+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.484+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7fc083040 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.484+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.484+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x55d512e74990 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.484+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.484+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d512e78620 con 0x7fd7f8072060 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:12.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7c610 con 0x55d512e74990 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7ca00 con 0x55d512e74990 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.485+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7ca00 con 0x7fd7fc083040 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 20 zone default found 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 4 Realm: () 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 20 zonegroup default 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7ce20 con 0x7fd7fc083040 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7d240 con 0x55d512e79110 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7f4f0 con 0x55d512e79110 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.486+0000 7fd80bf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.487+0000 7fd80bf1f800 20 started sync module instance, tier type = 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.487+0000 7fd80bf1f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.487+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7e990 con 0x7fd7f8072060 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.488+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.488+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94373633584432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e7f150 con 0x7fd7f8072060 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.488+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e80270 con 0x55d512e74990 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.489+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94373633584432] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.489+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.489+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94373633587344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e80660 con 0x55d512e74990 2024-05-07T13:56:12.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.489+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e810c0 con 0x55d512e79110 2024-05-07T13:56:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.490+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94373633587344] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.490+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.490+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94373633592176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e81460 con 0x55d512e79110 2024-05-07T13:56:12.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.490+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e81ea0 con 0x7fd7f8072060 2024-05-07T13:56:12.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.491+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94373633592176] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.491+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.491+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94373633588400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e82740 con 0x7fd7f8072060 2024-05-07T13:56:12.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.491+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e83100 con 0x55d512e74990 2024-05-07T13:56:12.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.492+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94373633588400] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.492+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.492+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94373633600592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e83520 con 0x55d512e74990 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.492+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e83ee0 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.493+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94373633600592] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.494+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.494+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94373633604624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e83520 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.494+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e848f0 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.495+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.495+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94373633606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e84d10 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.495+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e85810 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.495+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94373633604624] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94373633606720] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94373633610496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e84860 con 0x7fd7fc083040 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 20 add_watcher() i=0 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 20 add_watcher() i=1 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 20 add_watcher() i=2 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 20 add_watcher() i=3 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 20 add_watcher() i=4 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 20 add_watcher() i=5 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 20 add_watcher() i=6 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94373633610496] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 20 add_watcher() i=7 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.496+0000 7fd80bf1f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.497+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512e88910 con 0x55d512e74990 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.497+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.497+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94373633601648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512e85d90 con 0x55d512e74990 2024-05-07T13:56:12.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.498+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94373633601648] v27'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.498+0000 7fd6bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.498+0000 7fd80bf1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.498+0000 7fd80bf1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.498+0000 7fd80bf1f800 5 note: GC not initialized 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.498+0000 7fd6bcfe1640 20 reqs_thread_entry: start 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.498+0000 7fd80bf1f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.498+0000 7fd80bf1f800 20 Filter name: none 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd6367fc640 20 reqs_thread_entry: start 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ebbc00 con 0x7fd7f8072060 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd80bf1f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ebc7d0 con 0x7fd7f8072060 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(63 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd80bf1f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd80bf1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.499+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ebc780 con 0x7fd7f8072060 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ebdea0 con 0x7fd7f8072060 2024-05-07T13:56:12.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(65 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 4.14 4:293cf68a:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ebd900 con 0x55d512e79110 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:67 4.26 4:6704b11e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec2750 con 0x7fd7fc083040 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 4.9 4:909e4f72:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec5040 con 0x55d512e74990 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 4.1f 4:f81bf5a8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec7d80 con 0x55d512e79110 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 4.30 4:0e03b4bd:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec7d80 con 0x55d512e79110 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(68 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 4.1d 4:bb05b52e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec2fe0 con 0x55d512e79110 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.500+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 4.a 4:50fb99c4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec48c0 con 0x7fd7f8072060 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(67 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(69 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 4.35 4:ad982cc1:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec7730 con 0x55d512e74990 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:74 4.5 4:a1423e85:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec4900 con 0x55d512e79110 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(70 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 4.8 4:10d422e9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec2140 con 0x55d512e79110 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(71 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:76 4.30 4:0cdb3134:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d512ec2af0 con 0x55d512e79110 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(73 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(76 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(74 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(72 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.501+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(75 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.502+0000 7fd6bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.502+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94373633601648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512ea4160 con 0x55d512e74990 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.503+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94373633601648] v27'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.503+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94373633584432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512ea4160 con 0x7fd7f8072060 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.504+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94373633584432] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.504+0000 7fd80bf1f800 20 remove_watcher() i=0 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.504+0000 7fd80bf1f800 2 removed watcher, disabling cache 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.504+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94373633587344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512ea4160 con 0x55d512e74990 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.505+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94373633587344] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.505+0000 7fd80bf1f800 20 remove_watcher() i=1 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.505+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94373633592176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512ea4160 con 0x55d512e79110 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.506+0000 7fd807bca640 1 -- 172.21.15.50:0/3454151652 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94373633592176] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7f806f030 con 0x55d512e79110 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.506+0000 7fd80bf1f800 20 remove_watcher() i=2 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.506+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94373633588400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512ea4160 con 0x7fd7f8072060 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.507+0000 7fd8073c9640 1 -- 172.21.15.50:0/3454151652 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94373633588400] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7fc070030 con 0x7fd7f8072060 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.507+0000 7fd80bf1f800 20 remove_watcher() i=3 2024-05-07T13:56:12.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.507+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94373633600592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512ea4160 con 0x55d512e74990 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.508+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94373633600592] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x55d512e74990 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.508+0000 7fd80bf1f800 20 remove_watcher() i=4 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.508+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94373633604624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512ea4160 con 0x7fd7fc083040 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.509+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94373633604624] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.509+0000 7fd80bf1f800 20 remove_watcher() i=5 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.509+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94373633606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512ea4160 con 0x7fd7fc083040 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.510+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94373633606720] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.510+0000 7fd80bf1f800 20 remove_watcher() i=6 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.510+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94373633610496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d512ea4160 con 0x7fd7fc083040 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94373633610496] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd80000a4a0 con 0x7fd7fc083040 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 20 remove_watcher() i=7 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd7fc083040 msgr2=0x7fd7fc075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd7fc083040 0x7fd7fc075430 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512e74990 msgr2=0x55d512e76e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512e74990 0x55d512e76e50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd7f8072060 msgr2=0x7fd7f800c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fd7f8072060 0x7fd7f800c820 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e79110 msgr2=0x55d512e7b500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e79110 0x55d512e7b500 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6d0036900 msgr2=0x7fd6d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6d0036900 0x7fd6d0038dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc01ced0 tx=0x7fd7fc04f000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 msgr2=0x55d512e694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd8083cb640 1 -- 172.21.15.50:0/3454151652 reap_dead start 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e694d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800efd0 tx=0x7fd7f801ef40 comp rx=0 tx=0).stop 2024-05-07T13:56:12.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 shutdown_connections 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3454151652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e62110 0x55d512e694d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 >> 172.21.15.50:0/3454151652 conn(0x55d512e5e390 msgr2=0x55d512e5b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.511+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 shutdown_connections 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3454151652 wait complete. 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3579046426 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6e00368b0 msgr2=0x7fd6e0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3579046426 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6e00368b0 0x7fd6e0038d70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55d512e3e2e0 tx=0x7fd7fc005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3579046426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e54cd0 msgr2=0x55d512e550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3579046426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e54cd0 0x55d512e550f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800b710 tx=0x7fd7f8041d50 comp rx=0 tx=0).stop 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3579046426 shutdown_connections 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3579046426 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6e00368b0 0x7fd6e0038d70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/3579046426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512e54cd0 0x55d512e550f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3579046426 >> 172.21.15.50:0/3579046426 conn(0x55d512e48d70 msgr2=0x55d512e49170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3579046426 shutdown_connections 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/3579046426 wait complete. 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d512e43cc0 msgr2=0x55d512e46110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d512e43cc0 0x55d512e46110 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512d3b550 msgr2=0x55d512e3d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d512d3b550 0x55d512e3d480 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e3fd30 msgr2=0x55d512e42120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d512e3fd30 0x55d512e42120 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6f00368b0 msgr2=0x7fd6f0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd6f00368b0 0x7fd6f0038d70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc054000 tx=0x7fd7fc04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 msgr2=0x55d512e36240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 --2- 172.21.15.50:0/2131046492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d512d39a10 0x55d512e36240 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800b210 tx=0x7fd7f8000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd8083cb640 1 -- 172.21.15.50:0/2131046492 reap_dead start 2024-05-07T13:56:12.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 shutdown_connections 2024-05-07T13:56:12.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.512+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 >> 172.21.15.50:0/2131046492 conn(0x55d512d355b0 msgr2=0x55d512e287b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.513+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 shutdown_connections 2024-05-07T13:56:12.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.513+0000 7fd80bf1f800 1 -- 172.21.15.50:0/2131046492 wait complete. 2024-05-07T13:56:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"02b45de7-8fca-4685-ae50-761ba20a02e2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","marker":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-07T13:56:11.612676Z","creation_time":"2024-05-07T13:56:11.609586Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-07T13:56:12.523 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '02b45de7-8fca-4685-ae50-761ba20a02e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-07T13:56:11.612676Z', 'creation_time': '2024-05-07T13:56:11.609586Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-07T13:56:12.523 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-07T13:56:12.523 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-07T13:56:12.523 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-05-07T13:56:12.570 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:12.570 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:12.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.582+0000 7f4375c16800 1 Processor -- start 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.582+0000 7f4375c16800 1 -- start start 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.582+0000 7f4375c16800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55df7dbf5590 0x55df7dbf7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.582+0000 7f4375c16800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df7dbf7f50 con 0x55df7dbf1150 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.582+0000 7f4375c16800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55df7da82050 con 0x55df7dbf5590 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.583+0000 7f4370a83640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55df7dbf5590 0x55df7dbf7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.583+0000 7f4370a83640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55df7dbf5590 0x55df7dbf7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46002/0 (socket says 172.21.15.50:46002) 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.583+0000 7f4370a83640 1 -- 172.21.15.50:0/2510277007 learned_addr learned my addr 172.21.15.50:0/2510277007 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.583+0000 7f4371284640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55df7dbf1150 0x55df7dbf1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39746/0 (socket says 172.21.15.50:39746) 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.583+0000 7f4370a83640 1 -- 172.21.15.50:0/2510277007 >> v1:172.21.15.22:6789/0 conn(0x55df7dbf1150 legacy=0x55df7dbf1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.583+0000 7f4370a83640 1 -- 172.21.15.50:0/2510277007 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7dbf9180 con 0x55df7dbf5590 2024-05-07T13:56:12.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.585+0000 7f4370a83640 1 --2- 172.21.15.50:0/2510277007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf5590 0x55df7dbf7980 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f435c00a520 tx=0x7f435c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe073a86a10dd6bb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.585+0000 7f436bfff640 1 -- 172.21.15.50:0/2510277007 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f435c057070 con 0x55df7dbf5590 2024-05-07T13:56:12.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.585+0000 7f436bfff640 1 -- 172.21.15.50:0/2510277007 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435c052570 con 0x55df7dbf5590 2024-05-07T13:56:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.585+0000 7f436bfff640 1 -- 172.21.15.50:0/2510277007 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f435c04ae60 con 0x55df7dbf5590 2024-05-07T13:56:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.585+0000 7f4375c16800 1 -- 172.21.15.50:0/2510277007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf5590 msgr2=0x55df7dbf7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.585+0000 7f4375c16800 1 --2- 172.21.15.50:0/2510277007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf5590 0x55df7dbf7980 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f435c00a520 tx=0x7f435c01d010 comp rx=0 tx=0).stop 2024-05-07T13:56:12.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.585+0000 7f4375c16800 1 -- 172.21.15.50:0/2510277007 shutdown_connections 2024-05-07T13:56:12.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.585+0000 7f4375c16800 1 --2- 172.21.15.50:0/2510277007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf5590 0x55df7dbf7980 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.585+0000 7f4375c16800 1 -- 172.21.15.50:0/2510277007 >> 172.21.15.50:0/2510277007 conn(0x55df7dbec790 msgr2=0x55df7dbeebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.586+0000 7f4375c16800 1 -- 172.21.15.50:0/2510277007 shutdown_connections 2024-05-07T13:56:12.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.586+0000 7f4375c16800 1 -- 172.21.15.50:0/2510277007 wait complete. 2024-05-07T13:56:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.600+0000 7f4375c16800 1 Processor -- start 2024-05-07T13:56:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.600+0000 7f4375c16800 1 -- start start 2024-05-07T13:56:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.601+0000 7f4375c16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dce2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.601+0000 7f4375c16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55df7db3c1c0 con 0x55df7dbf1150 2024-05-07T13:56:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.601+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dce2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.601+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dce2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46012/0 (socket says 172.21.15.50:46012) 2024-05-07T13:56:12.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.601+0000 7f4371284640 1 -- 172.21.15.50:0/203032059 learned_addr learned my addr 172.21.15.50:0/203032059 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.601+0000 7f4371284640 1 -- 172.21.15.50:0/203032059 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7dce2c60 con 0x55df7dbf1150 2024-05-07T13:56:12.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.601+0000 7f4371284640 1 --2- 172.21.15.50:0/203032059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dce2690 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f436400b230 tx=0x7f436400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7a991babcd1b34 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.601+0000 7f425f606640 1 -- 172.21.15.50:0/203032059 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436400e5c0 con 0x55df7dbf1150 2024-05-07T13:56:12.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.602+0000 7f425f606640 1 -- 172.21.15.50:0/203032059 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364006070 con 0x55df7dbf1150 2024-05-07T13:56:12.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.602+0000 7f425f606640 1 -- 172.21.15.50:0/203032059 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436400e890 con 0x55df7dbf1150 2024-05-07T13:56:12.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.602+0000 7f4375c16800 1 -- 172.21.15.50:0/203032059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 msgr2=0x55df7dce2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.602+0000 7f4375c16800 1 --2- 172.21.15.50:0/203032059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dce2690 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f436400b230 tx=0x7f436400b6f0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.602+0000 7f4375c16800 1 -- 172.21.15.50:0/203032059 shutdown_connections 2024-05-07T13:56:12.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.602+0000 7f4375c16800 1 --2- 172.21.15.50:0/203032059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dce2690 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.602+0000 7f4375c16800 1 -- 172.21.15.50:0/203032059 >> 172.21.15.50:0/203032059 conn(0x55df7dbec790 msgr2=0x55df7dcddfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.602+0000 7f4375c16800 1 -- 172.21.15.50:0/203032059 shutdown_connections 2024-05-07T13:56:12.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.602+0000 7f4375c16800 1 -- 172.21.15.50:0/203032059 wait complete. 2024-05-07T13:56:12.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.603+0000 7f4375c16800 1 Processor -- start 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.603+0000 7f4375c16800 1 -- start start 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.603+0000 7f4375c16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dcea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.603+0000 7f4375c16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55df7dbf8420 con 0x55df7dbf1150 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.603+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dcea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.603+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dcea210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46028/0 (socket says 172.21.15.50:46028) 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.603+0000 7f4371284640 1 -- 172.21.15.50:0/1815494178 learned_addr learned my addr 172.21.15.50:0/1815494178 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.603+0000 7f4371284640 1 -- 172.21.15.50:0/1815494178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7dcea750 con 0x55df7dbf1150 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.603+0000 7f4371284640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dcea210 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4364000fd0 tx=0x7f4364000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.604+0000 7f425de03640 1 -- 172.21.15.50:0/1815494178 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436400f8d0 con 0x55df7dbf1150 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.604+0000 7f425de03640 1 -- 172.21.15.50:0/1815494178 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f436400fa90 con 0x55df7dbf1150 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.604+0000 7f425de03640 1 -- 172.21.15.50:0/1815494178 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436400fdb0 con 0x55df7dbf1150 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.604+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df7dcea9e0 con 0x55df7dbf1150 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.604+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df7dced690 con 0x55df7dbf1150 2024-05-07T13:56:12.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.604+0000 7f425de03640 1 -- 172.21.15.50:0/1815494178 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4364017070 con 0x55df7dbf1150 2024-05-07T13:56:12.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.605+0000 7f425de03640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4258036950 0x7f4258038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.605+0000 7f425de03640 1 -- 172.21.15.50:0/1815494178 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4364015020 con 0x55df7dbf1150 2024-05-07T13:56:12.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.605+0000 7f4370a83640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4258036950 0x7f4258038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.605+0000 7f4375c16800 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dbf5590 0x55df7dcf1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.605+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dcf1990 con 0x55df7dbf5590 2024-05-07T13:56:12.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.605+0000 7f4371a85640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dbf5590 0x55df7dcf1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.605+0000 7f4370a83640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4258036950 0x7f4258038e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f435c054000 tx=0x7f435c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.605+0000 7f4371a85640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dbf5590 0x55df7dcf1450 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.606+0000 7f4371a85640 1 -- 172.21.15.50:0/1815494178 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dbf5590 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.606+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dceea20 con 0x55df7dbf5590 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.606+0000 7f4371a85640 1 -- 172.21.15.50:0/1815494178 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dbf5590 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.606+0000 7f4375c16800 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dcf3ca0 0x55df7dcf6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.606+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dcf6780 con 0x55df7dcf3ca0 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.606+0000 7f4371284640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dcf3ca0 0x55df7dcf6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.606+0000 7f4371284640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dcf3ca0 0x55df7dcf6090 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.607+0000 7f4371284640 1 -- 172.21.15.50:0/1815494178 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f436402e070 con 0x55df7dcf3ca0 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.607+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dcf2c20 con 0x55df7dbf5590 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.607+0000 7f4371a85640 1 -- 172.21.15.50:0/1815494178 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dbf5590 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.607+0000 7f4375c16800 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55df7dcf7be0 0x55df7dcfa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.607+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dcfa7b0 con 0x55df7dcf7be0 2024-05-07T13:56:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.607+0000 7f4370a83640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55df7dcf7be0 0x55df7dcfa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.608+0000 7f4370a83640 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55df7dcf7be0 0x55df7dcfa050 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.608+0000 7f4370a83640 1 -- 172.21.15.50:0/1815494178 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f435c05a040 con 0x55df7dcf7be0 2024-05-07T13:56:12.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.608+0000 7f4375c16800 1 Processor -- start 2024-05-07T13:56:12.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.608+0000 7f4375c16800 1 -- start start 2024-05-07T13:56:12.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.608+0000 7f4375c16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7db66a60 0x55df7db64ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.608+0000 7f4375c16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55df7dae2cf0 con 0x55df7db66a60 2024-05-07T13:56:12.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7db66a60 0x55df7db64ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7db66a60 0x55df7db64ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46044/0 (socket says 172.21.15.50:46044) 2024-05-07T13:56:12.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4371284640 1 -- 172.21.15.50:0/4293331908 learned_addr learned my addr 172.21.15.50:0/4293331908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4371284640 1 -- 172.21.15.50:0/4293331908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7db65410 con 0x55df7db66a60 2024-05-07T13:56:12.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4371284640 1 --2- 172.21.15.50:0/4293331908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7db66a60 0x55df7db64ed0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f436401d5c0 tx=0x7f4364017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4256ffd640 1 -- 172.21.15.50:0/4293331908 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4364044c60 con 0x55df7db66a60 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4256ffd640 1 -- 172.21.15.50:0/4293331908 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364044e00 con 0x55df7db66a60 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4256ffd640 1 -- 172.21.15.50:0/4293331908 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43640408d0 con 0x55df7db66a60 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4375c16800 1 -- 172.21.15.50:0/4293331908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df7db656a0 con 0x55df7db66a60 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.609+0000 7f4375c16800 1 -- 172.21.15.50:0/4293331908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df7db65ba0 con 0x55df7db66a60 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.610+0000 7f4256ffd640 1 -- 172.21.15.50:0/4293331908 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4364051020 con 0x55df7db66a60 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.610+0000 7f4256ffd640 1 --2- 172.21.15.50:0/4293331908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f424c036950 0x7f424c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.610+0000 7f4256ffd640 1 -- 172.21.15.50:0/4293331908 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f436403dc50 con 0x55df7db66a60 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.610+0000 7f4370a83640 1 --2- 172.21.15.50:0/4293331908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f424c036950 0x7f424c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.610+0000 7f4375c16800 1 Processor -- start 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4375c16800 1 -- start start 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4370a83640 1 --2- 172.21.15.50:0/4293331908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f424c036950 0x7f424c038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55df7dcf2250 tx=0x7f435c005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4375c16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4375c16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55df7dce2fe0 con 0x55df7dd17fa0 2024-05-07T13:56:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd183c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46052/0 (socket says 172.21.15.50:46052) 2024-05-07T13:56:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4371284640 1 -- 172.21.15.50:0/1266401558 learned_addr learned my addr 172.21.15.50:0/1266401558 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4371284640 1 -- 172.21.15.50:0/1266401558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7dd189b0 con 0x55df7dd17fa0 2024-05-07T13:56:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4371284640 1 --2- 172.21.15.50:0/1266401558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd183c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4364045140 tx=0x7f4364026750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755786c4b545848e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4254ff9640 1 -- 172.21.15.50:0/1266401558 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4364058030 con 0x55df7dd17fa0 2024-05-07T13:56:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.611+0000 7f4254ff9640 1 -- 172.21.15.50:0/1266401558 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f436401a950 con 0x55df7dd17fa0 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4254ff9640 1 -- 172.21.15.50:0/1266401558 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436401c7e0 con 0x55df7dd17fa0 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4375c16800 1 -- 172.21.15.50:0/1266401558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 msgr2=0x55df7dd183c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4375c16800 1 --2- 172.21.15.50:0/1266401558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd183c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4364045140 tx=0x7f4364026750 comp rx=0 tx=0).stop 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4375c16800 1 -- 172.21.15.50:0/1266401558 shutdown_connections 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4375c16800 1 --2- 172.21.15.50:0/1266401558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd183c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4375c16800 1 -- 172.21.15.50:0/1266401558 >> 172.21.15.50:0/1266401558 conn(0x55df7dd142e0 msgr2=0x55df7dd12340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4375c16800 1 -- 172.21.15.50:0/1266401558 shutdown_connections 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4375c16800 1 -- 172.21.15.50:0/1266401558 wait complete. 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4375c16800 1 Processor -- start 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.612+0000 7f4375c16800 1 -- start start 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4375c16800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd1f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4375c16800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55df7dd190d0 con 0x55df7dd17fa0 2024-05-07T13:56:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd1f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4371284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd1f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46058/0 (socket says 172.21.15.50:46058) 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 learned_addr learned my addr 172.21.15.50:0/3136258490 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7dd1f8d0 con 0x55df7dd17fa0 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4371284640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd1f390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4364005d50 tx=0x7f4364028260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4242ffd640 1 -- 172.21.15.50:0/3136258490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436404bde0 con 0x55df7dd17fa0 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4242ffd640 1 -- 172.21.15.50:0/3136258490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364031450 con 0x55df7dd17fa0 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df7dd1f8d0 con 0x55df7dd17fa0 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4242ffd640 1 -- 172.21.15.50:0/3136258490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436403f4a0 con 0x55df7dd17fa0 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.613+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df7dd1f8d0 con 0x55df7dd17fa0 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.614+0000 7f4242ffd640 1 -- 172.21.15.50:0/3136258490 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f436406b070 con 0x55df7dd17fa0 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.615+0000 7f4242ffd640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f423c036950 0x7f423c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.615+0000 7f4242ffd640 1 -- 172.21.15.50:0/3136258490 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f436405c070 con 0x55df7dd17fa0 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.615+0000 7f4370a83640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f423c036950 0x7f423c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.615+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.615+0000 7f4375c16800 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dd2aab0 0x55df7dd2cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.615+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2d6c0 con 0x55df7dd2aab0 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.615+0000 7f4371a85640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dd2aab0 0x55df7dd2cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.615+0000 7f4370a83640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f423c036950 0x7f423c038e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f435c052fd0 tx=0x7f435c04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.615+0000 7f4371a85640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dd2aab0 0x55df7dd2cf70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 20 realm 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2dad0 con 0x55df7dd2aab0 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e3a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x55df7dd2aab0 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dd2f230 0x55df7dd31620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.616+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd31d80 con 0x55df7dd2f230 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.617+0000 7f4371284640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dd2f230 0x55df7dd31620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.617+0000 7f4371284640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dd2f230 0x55df7dd31620 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.617+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.617+0000 7f4375c16800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.617+0000 7f4375c16800 20 searching for the correct realm 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.617+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd33760 con 0x55df7dd2f230 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.618+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.618+0000 7f4371284640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4364054040 0x7f43640441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.618+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd33760 con 0x7f4364054040 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.618+0000 7f4370a83640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4364054040 0x7f43640441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.618+0000 7f4370a83640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4364054040 0x7f43640441b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.618+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.618+0000 7f4370a83640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f435c074040 0x7f435c081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.618+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd33760 con 0x7f435c074040 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.619+0000 7f4371a85640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f435c074040 0x7f435c081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.619+0000 7f4371a85640 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f435c074040 0x7f435c081410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.619+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.619+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x55df7dd2aab0 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.619+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.619+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x55df7dd2aab0 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.620+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.620+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x7f435c074040 2024-05-07T13:56:12.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.620+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.620+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x7f435c074040 2024-05-07T13:56:12.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.620+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.620+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x7f4364054040 2024-05-07T13:56:12.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.620+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.620+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x55df7dd2f230 2024-05-07T13:56:12.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.621+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.621+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x55df7dd2aab0 2024-05-07T13:56:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.621+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.621+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x7f435c074040 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.621+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.621+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x55df7dd2aab0 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.621+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.621+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd2e740 con 0x7f4364054040 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.622+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.622+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2f230 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.622+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.622+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2f230 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.622+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.622+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x7f435c074040 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2f230 2024-05-07T13:56:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2f230 2024-05-07T13:56:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2aab0 2024-05-07T13:56:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2aab0 2024-05-07T13:56:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.623+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x7f435c074040 2024-05-07T13:56:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.624+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.624+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2f230 2024-05-07T13:56:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.624+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.624+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x7f4364054040 2024-05-07T13:56:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.624+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.624+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2aab0 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.624+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.625+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x7f435c074040 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.625+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.625+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2f230 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.625+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.625+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x7f435c074040 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.625+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.625+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x7f4364054040 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.626+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.626+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2f230 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.626+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.626+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x7f435c074040 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.626+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.626+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x55df7dd2aab0 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f435c08e060 con 0x7f4364054040 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd32730 con 0x55df7dd2aab0 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd32b20 con 0x55df7dd2aab0 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.627+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd32b20 con 0x7f435c074040 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 20 zone default found 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 4 Realm: () 2024-05-07T13:56:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 20 zonegroup default 2024-05-07T13:56:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd32f40 con 0x7f435c074040 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd33360 con 0x55df7dd2f230 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd35610 con 0x55df7dd2f230 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.628+0000 7f4375c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.629+0000 7f4375c16800 20 started sync module instance, tier type = 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.629+0000 7f4375c16800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:12.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.629+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd34ab0 con 0x7f4364054040 2024-05-07T13:56:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.630+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.630+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94418377068240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd35e60 con 0x7f4364054040 2024-05-07T13:56:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.630+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd366b0 con 0x55df7dd2aab0 2024-05-07T13:56:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.631+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94418377068240] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.631+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.631+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94418377071024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd366b0 con 0x55df7dd2aab0 2024-05-07T13:56:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.631+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd371d0 con 0x55df7dd2f230 2024-05-07T13:56:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.632+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.632+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94418377075872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd37a70 con 0x55df7dd2f230 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.632+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd38540 con 0x7f4364054040 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.632+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94418377071024] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.633+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94418377075872] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.633+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.633+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94418377073152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd37a70 con 0x7f4364054040 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.633+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd38e10 con 0x55df7dd2aab0 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.634+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.634+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94418377083744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd396b0 con 0x55df7dd2aab0 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.634+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3a180 con 0x7f435c074040 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.634+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94418377073152] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.635+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94418377083744] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.635+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.635+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94418377088112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd391b0 con 0x7f435c074040 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.635+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3aa20 con 0x7f435c074040 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.636+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94418377088112] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.636+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.636+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94418377078208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd391b0 con 0x7f435c074040 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.636+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3b040 con 0x7f435c074040 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94418377078208] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94418377090336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3b040 con 0x7f435c074040 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4375c16800 20 add_watcher() i=0 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4375c16800 20 add_watcher() i=1 2024-05-07T13:56:12.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4375c16800 20 add_watcher() i=2 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4375c16800 20 add_watcher() i=3 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4375c16800 20 add_watcher() i=4 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4375c16800 20 add_watcher() i=5 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.637+0000 7f4375c16800 20 add_watcher() i=6 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.638+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94418377090336] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.638+0000 7f4375c16800 20 add_watcher() i=7 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.638+0000 7f4375c16800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.638+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3e360 con 0x55df7dd2aab0 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.638+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.638+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94418377092352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3b5d0 con 0x55df7dd2aab0 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.639+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94418377092352] v27'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.639+0000 7f42277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.639+0000 7f4375c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.639+0000 7f4375c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.639+0000 7f4375c16800 5 note: GC not initialized 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.640+0000 7f42267e4640 20 reqs_thread_entry: start 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.640+0000 7f4375c16800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.640+0000 7f4375c16800 20 Filter name: none 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.640+0000 7f4197fff640 20 reqs_thread_entry: start 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.640+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.640+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd71420 con 0x55df7dd2aab0 2024-05-07T13:56:12.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.640+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.640+0000 7f4375c16800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.640+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd72810 con 0x7f4364054040 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd72810 con 0x7f4364054040 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(64 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:65 4.14 4:293cf68a:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd74230 con 0x55df7dd2f230 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:66 4.26 4:6704b11e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd76ee0 con 0x7f435c074040 2024-05-07T13:56:12.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 4.9 4:909e4f72:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd79c10 con 0x55df7dd2aab0 2024-05-07T13:56:12.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 4.1f 4:f81bf5a8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd7c550 con 0x55df7dd2f230 2024-05-07T13:56:12.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 4.30 4:0e03b4bd:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd79c10 con 0x55df7dd2f230 2024-05-07T13:56:12.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 4.1d 4:bb05b52e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd814c0 con 0x55df7dd2f230 2024-05-07T13:56:12.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 4.a 4:50fb99c4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd83d30 con 0x7f4364054040 2024-05-07T13:56:12.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 4.35 4:ad982cc1:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd865a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 4.5 4:a1423e85:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd89010 con 0x55df7dd2f230 2024-05-07T13:56:12.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:74 4.8 4:10d422e9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd8b880 con 0x55df7dd2f230 2024-05-07T13:56:12.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 4.30 4:0cdb3134:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd8b880 con 0x55df7dd2f230 2024-05-07T13:56:12.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.641+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(66 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f436c00a4a0 con 0x7f435c074040 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(67 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(65 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(68 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(69 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(72 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(71 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(70 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(73 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(74 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(75 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.642+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd76850 con 0x7f4364054040 2024-05-07T13:56:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.643+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(76 foo.buckets [call] v27'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.643+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd76850 con 0x7f4364054040 2024-05-07T13:56:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.644+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(77 foo.buckets [call] v27'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.644+0000 7f4375c16800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.644+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd76850 con 0x55df7dd2aab0 2024-05-07T13:56:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.644+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.644+0000 7f4375c16800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:12.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.644+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd76850 con 0x7f4364054040 2024-05-07T13:56:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.645+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.646+0000 7f42277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.646+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94418377092352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd28170 con 0x55df7dd2aab0 2024-05-07T13:56:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.647+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94418377092352] v27'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.647+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94418377068240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3ad00 con 0x7f4364054040 2024-05-07T13:56:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.648+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94418377068240] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.648+0000 7f4375c16800 20 remove_watcher() i=0 2024-05-07T13:56:12.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.648+0000 7f4375c16800 2 removed watcher, disabling cache 2024-05-07T13:56:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.648+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94418377071024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3ad00 con 0x55df7dd2aab0 2024-05-07T13:56:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.649+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94418377071024] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c00a4a0 con 0x55df7dd2aab0 2024-05-07T13:56:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.649+0000 7f4375c16800 20 remove_watcher() i=1 2024-05-07T13:56:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.649+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94418377075872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3ad00 con 0x55df7dd2f230 2024-05-07T13:56:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.650+0000 7f4371284640 1 -- 172.21.15.50:0/3136258490 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94418377075872] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4364080040 con 0x55df7dd2f230 2024-05-07T13:56:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.650+0000 7f4375c16800 20 remove_watcher() i=2 2024-05-07T13:56:12.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.650+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94418377073152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd36ca0 con 0x7f4364054040 2024-05-07T13:56:12.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.651+0000 7f4370a83640 1 -- 172.21.15.50:0/3136258490 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94418377073152] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c07f070 con 0x7f4364054040 2024-05-07T13:56:12.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.651+0000 7f4375c16800 20 remove_watcher() i=3 2024-05-07T13:56:12.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.651+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94418377083744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3ad00 con 0x55df7dd2aab0 2024-05-07T13:56:12.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.652+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94418377083744] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c04a040 con 0x55df7dd2aab0 2024-05-07T13:56:12.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.652+0000 7f4375c16800 20 remove_watcher() i=4 2024-05-07T13:56:12.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.652+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94418377088112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd36200 con 0x7f435c074040 2024-05-07T13:56:12.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.653+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94418377088112] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c04a040 con 0x7f435c074040 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.653+0000 7f4375c16800 20 remove_watcher() i=5 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.653+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94418377078208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd36ca0 con 0x7f435c074040 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.654+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94418377078208] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c04a040 con 0x7f435c074040 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.654+0000 7f4375c16800 20 remove_watcher() i=6 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.654+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94418377090336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df7dd3ad00 con 0x7f435c074040 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94418377090336] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436c04a040 con 0x7f435c074040 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 20 remove_watcher() i=7 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f435c074040 msgr2=0x7f435c081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f435c074040 0x7f435c081410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dd2aab0 msgr2=0x55df7dd2cf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dd2aab0 0x55df7dd2cf70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4364054040 msgr2=0x7f43640441b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4364054040 0x7f43640441b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dd2f230 msgr2=0x55df7dd31620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dd2f230 0x55df7dd31620 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f423c036950 msgr2=0x7f423c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f423c036950 0x7f423c038e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f435c052fd0 tx=0x7f435c04f000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 msgr2=0x55df7dd1f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd1f390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4364005d50 tx=0x7f4364028260 comp rx=0 tx=0).stop 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4371a85640 1 -- 172.21.15.50:0/3136258490 reap_dead start 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 shutdown_connections 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 --2- 172.21.15.50:0/3136258490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dd17fa0 0x55df7dd1f390 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 >> 172.21.15.50:0/3136258490 conn(0x55df7dd142e0 msgr2=0x55df7dd11940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 shutdown_connections 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.655+0000 7f4375c16800 1 -- 172.21.15.50:0/3136258490 wait complete. 2024-05-07T13:56:12.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/4293331908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f424c036950 msgr2=0x7f424c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 --2- 172.21.15.50:0/4293331908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f424c036950 0x7f424c038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55df7dcf2250 tx=0x7f435c005ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/4293331908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7db66a60 msgr2=0x55df7db64ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 --2- 172.21.15.50:0/4293331908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7db66a60 0x55df7db64ed0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f436401d5c0 tx=0x7f4364017d70 comp rx=0 tx=0).stop 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/4293331908 shutdown_connections 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 --2- 172.21.15.50:0/4293331908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f424c036950 0x7f424c038e10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 --2- 172.21.15.50:0/4293331908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7db66a60 0x55df7db64ed0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/4293331908 >> 172.21.15.50:0/4293331908 conn(0x55df7dcfccb0 msgr2=0x55df7dcfd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/4293331908 shutdown_connections 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/4293331908 wait complete. 2024-05-07T13:56:12.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55df7dcf7be0 msgr2=0x55df7dcfa050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55df7dcf7be0 0x55df7dcfa050 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dbf5590 msgr2=0x55df7dcf1450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55df7dbf5590 0x55df7dcf1450 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dcf3ca0 msgr2=0x55df7dcf6090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55df7dcf3ca0 0x55df7dcf6090 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4258036950 msgr2=0x7f4258038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4258036950 0x7f4258038e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f435c054000 tx=0x7f435c04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 msgr2=0x55df7dcea210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 --2- 172.21.15.50:0/1815494178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55df7dbf1150 0x55df7dcea210 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4364000fd0 tx=0x7f4364000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4371a85640 1 -- 172.21.15.50:0/1815494178 reap_dead start 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 shutdown_connections 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 >> 172.21.15.50:0/1815494178 conn(0x55df7dbec790 msgr2=0x55df7dcdc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 shutdown_connections 2024-05-07T13:56:12.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.656+0000 7f4375c16800 1 -- 172.21.15.50:0/1815494178 wait complete. 2024-05-07T13:56:12.666 INFO:teuthology.orchestra.run.smithi050.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-05-07T13:56:12.644912Z","last_stats_update":"2024-05-07T13:56:12.643860Z"} 2024-05-07T13:56:12.667 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-05-07T13:56:12.644912Z', 'last_stats_update': '2024-05-07T13:56:12.643860Z'} 2024-05-07T13:56:12.672 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:12.672 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-07T13:56:12.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-07T13:56:12.672 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-05-07T13:56:12.720 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:12.720 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.732+0000 7f1affb23800 1 Processor -- start 2024-05-07T13:56:12.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.732+0000 7f1affb23800 1 -- start start 2024-05-07T13:56:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.732+0000 7f1affb23800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56263544f9f0 0x56263544fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.732+0000 7f1affb23800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626353c4a70 con 0x562635450350 2024-05-07T13:56:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.732+0000 7f1affb23800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5626352e2050 con 0x56263544f9f0 2024-05-07T13:56:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.733+0000 7f1afb859640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56263544f9f0 0x56263544fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.733+0000 7f1afb859640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56263544f9f0 0x56263544fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46062/0 (socket says 172.21.15.50:46062) 2024-05-07T13:56:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.733+0000 7f1afb859640 1 -- 172.21.15.50:0/4210427522 learned_addr learned my addr 172.21.15.50:0/4210427522 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.733+0000 7f1afb058640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x562635450350 0x562635450800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39756/0 (socket says 172.21.15.50:39756) 2024-05-07T13:56:12.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.733+0000 7f1afb859640 1 -- 172.21.15.50:0/4210427522 >> v1:172.21.15.22:6789/0 conn(0x562635450350 legacy=0x562635450800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.733+0000 7f1afb859640 1 -- 172.21.15.50:0/4210427522 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562635450f10 con 0x56263544f9f0 2024-05-07T13:56:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.735+0000 7f1afb859640 1 --2- 172.21.15.50:0/4210427522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x56263544fe10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00a520 tx=0x7f1aec01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816f1b6c45288187 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.735+0000 7f1afa857640 1 -- 172.21.15.50:0/4210427522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec057070 con 0x56263544f9f0 2024-05-07T13:56:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.735+0000 7f1afa857640 1 -- 172.21.15.50:0/4210427522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec052570 con 0x56263544f9f0 2024-05-07T13:56:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.735+0000 7f1afa857640 1 -- 172.21.15.50:0/4210427522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec04ae60 con 0x56263544f9f0 2024-05-07T13:56:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.735+0000 7f1affb23800 1 -- 172.21.15.50:0/4210427522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 msgr2=0x56263544fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.735+0000 7f1affb23800 1 --2- 172.21.15.50:0/4210427522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x56263544fe10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00a520 tx=0x7f1aec01d010 comp rx=0 tx=0).stop 2024-05-07T13:56:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.735+0000 7f1affb23800 1 -- 172.21.15.50:0/4210427522 shutdown_connections 2024-05-07T13:56:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.735+0000 7f1affb23800 1 --2- 172.21.15.50:0/4210427522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x56263544fe10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.735+0000 7f1affb23800 1 -- 172.21.15.50:0/4210427522 >> 172.21.15.50:0/4210427522 conn(0x56263544b5b0 msgr2=0x56263544d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.736+0000 7f1affb23800 1 -- 172.21.15.50:0/4210427522 shutdown_connections 2024-05-07T13:56:12.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.736+0000 7f1affb23800 1 -- 172.21.15.50:0/4210427522 wait complete. 2024-05-07T13:56:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.751+0000 7f1affb23800 1 Processor -- start 2024-05-07T13:56:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.751+0000 7f1affb23800 1 -- start start 2024-05-07T13:56:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.751+0000 7f1affb23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x562635544b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.751+0000 7f1affb23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56263539c1c0 con 0x56263544f9f0 2024-05-07T13:56:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.751+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x562635544b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.751+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x562635544b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46072/0 (socket says 172.21.15.50:46072) 2024-05-07T13:56:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.751+0000 7f1afb859640 1 -- 172.21.15.50:0/2732418434 learned_addr learned my addr 172.21.15.50:0/2732418434 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.751+0000 7f1afb859640 1 -- 172.21.15.50:0/2732418434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626355450e0 con 0x56263544f9f0 2024-05-07T13:56:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.751+0000 7f1afb859640 1 --2- 172.21.15.50:0/2732418434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x562635544b10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1aec055040 tx=0x7f1aec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcfe5710c81d5e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f19e9e0b640 1 -- 172.21.15.50:0/2732418434 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec057040 con 0x56263544f9f0 2024-05-07T13:56:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f19e9e0b640 1 -- 172.21.15.50:0/2732418434 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec052720 con 0x56263544f9f0 2024-05-07T13:56:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f19e9e0b640 1 -- 172.21.15.50:0/2732418434 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec052a20 con 0x56263544f9f0 2024-05-07T13:56:12.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f1affb23800 1 -- 172.21.15.50:0/2732418434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 msgr2=0x562635544b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f1affb23800 1 --2- 172.21.15.50:0/2732418434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x562635544b10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1aec055040 tx=0x7f1aec04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f1affb23800 1 -- 172.21.15.50:0/2732418434 shutdown_connections 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f1affb23800 1 --2- 172.21.15.50:0/2732418434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x562635544b10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f1affb23800 1 -- 172.21.15.50:0/2732418434 >> 172.21.15.50:0/2732418434 conn(0x56263544b5b0 msgr2=0x562635540430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f1affb23800 1 -- 172.21.15.50:0/2732418434 shutdown_connections 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.752+0000 7f1affb23800 1 -- 172.21.15.50:0/2732418434 wait complete. 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.753+0000 7f1affb23800 1 Processor -- start 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.753+0000 7f1affb23800 1 -- start start 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.753+0000 7f1affb23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x56263554c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.753+0000 7f1affb23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562635451440 con 0x56263544f9f0 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.753+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x56263554c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.753+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x56263554c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46074/0 (socket says 172.21.15.50:46074) 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.753+0000 7f1afb859640 1 -- 172.21.15.50:0/3614231074 learned_addr learned my addr 172.21.15.50:0/3614231074 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.753+0000 7f1afb859640 1 -- 172.21.15.50:0/3614231074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56263554cb60 con 0x56263544f9f0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.754+0000 7f1afb859640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x56263554c620 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1aec052540 tx=0x7f1aec003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.754+0000 7f19e3fff640 1 -- 172.21.15.50:0/3614231074 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec073070 con 0x56263544f9f0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.754+0000 7f19e3fff640 1 -- 172.21.15.50:0/3614231074 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec05d440 con 0x56263544f9f0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.754+0000 7f19e3fff640 1 -- 172.21.15.50:0/3614231074 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec057070 con 0x56263544f9f0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.754+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56263554cdf0 con 0x56263544f9f0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.754+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56263554fa00 con 0x56263544f9f0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.755+0000 7f19e3fff640 1 -- 172.21.15.50:0/3614231074 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1aec076070 con 0x56263544f9f0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.755+0000 7f19e3fff640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19e4036900 0x7f19e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.755+0000 7f19e3fff640 1 -- 172.21.15.50:0/3614231074 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1aec08dc90 con 0x56263544f9f0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.755+0000 7f1afb058640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19e4036900 0x7f19e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.755+0000 7f1affb23800 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562635450350 0x5626355537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.755+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635553d40 con 0x562635450350 2024-05-07T13:56:12.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.755+0000 7f1afc05a640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562635450350 0x5626355537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.755+0000 7f1afb058640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19e4036900 0x7f19e4038dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1af0000f60 tx=0x7f1af0001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.755+0000 7f1afc05a640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562635450350 0x5626355537c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.756+0000 7f1afc05a640 1 -- 172.21.15.50:0/3614231074 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1af400a4a0 con 0x562635450350 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.756+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635550d90 con 0x562635450350 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.756+0000 7f1afc05a640 1 -- 172.21.15.50:0/3614231074 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1af400a4a0 con 0x562635450350 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.756+0000 7f1affb23800 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5626355560a0 0x562635558490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.756+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635558b30 con 0x5626355560a0 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.756+0000 7f1afb859640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5626355560a0 0x562635558490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.757+0000 7f1afb859640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5626355560a0 0x562635558490 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.757+0000 7f1afb859640 1 -- 172.21.15.50:0/3614231074 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1aec075030 con 0x5626355560a0 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.757+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635555050 con 0x562635450350 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.757+0000 7f1afc05a640 1 -- 172.21.15.50:0/3614231074 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1af400a4a0 con 0x562635450350 2024-05-07T13:56:12.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.757+0000 7f1affb23800 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562635559fe0 0x56263555c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.757+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56263555cb90 con 0x562635559fe0 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.758+0000 7f1afb058640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562635559fe0 0x56263555c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.758+0000 7f1afb058640 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562635559fe0 0x56263555c430 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.758+0000 7f1afb058640 1 -- 172.21.15.50:0/3614231074 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1af000f690 con 0x562635559fe0 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.758+0000 7f1affb23800 1 Processor -- start 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.759+0000 7f1affb23800 1 -- start start 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.759+0000 7f1affb23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263556aff0 0x56263556b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.759+0000 7f1affb23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562635342cf0 con 0x56263556aff0 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.759+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263556aff0 0x56263556b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.759+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263556aff0 0x56263556b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46084/0 (socket says 172.21.15.50:46084) 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.759+0000 7f1afb859640 1 -- 172.21.15.50:0/275254538 learned_addr learned my addr 172.21.15.50:0/275254538 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.759+0000 7f1afb859640 1 -- 172.21.15.50:0/275254538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56263556b950 con 0x56263556aff0 2024-05-07T13:56:12.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.759+0000 7f1afb859640 1 --2- 172.21.15.50:0/275254538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263556aff0 0x56263556b410 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0068b0 tx=0x7f1aec076630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.760+0000 7f19e17fa640 1 -- 172.21.15.50:0/275254538 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec0774e0 con 0x56263556aff0 2024-05-07T13:56:12.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.760+0000 7f19e17fa640 1 -- 172.21.15.50:0/275254538 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec077680 con 0x56263556aff0 2024-05-07T13:56:12.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.760+0000 7f1affb23800 1 -- 172.21.15.50:0/275254538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56263556c3c0 con 0x56263556aff0 2024-05-07T13:56:12.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.760+0000 7f19e17fa640 1 -- 172.21.15.50:0/275254538 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec05d720 con 0x56263556aff0 2024-05-07T13:56:12.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.760+0000 7f1affb23800 1 -- 172.21.15.50:0/275254538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56263556c8c0 con 0x56263556aff0 2024-05-07T13:56:12.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.760+0000 7f19e17fa640 1 -- 172.21.15.50:0/275254538 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1aec05d8c0 con 0x56263556aff0 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f19e17fa640 1 --2- 172.21.15.50:0/275254538 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19d4036950 0x7f19d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f19e17fa640 1 -- 172.21.15.50:0/275254538 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1aec0980b0 con 0x56263556aff0 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f1afb058640 1 --2- 172.21.15.50:0/275254538 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19d4036950 0x7f19d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f1affb23800 1 Processor -- start 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f1affb23800 1 -- start start 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f1afb058640 1 --2- 172.21.15.50:0/275254538 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19d4036950 0x7f19d4038e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x562635550cb0 tx=0x7f1af000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f1affb23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x562635578550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f1affb23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5626355453a0 con 0x562635578130 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x562635578550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x562635578550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46098/0 (socket says 172.21.15.50:46098) 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.761+0000 7f1afb859640 1 -- 172.21.15.50:0/2299283089 learned_addr learned my addr 172.21.15.50:0/2299283089 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f1afb859640 1 -- 172.21.15.50:0/2299283089 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562635578b20 con 0x562635578130 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f1afb859640 1 --2- 172.21.15.50:0/2299283089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x562635578550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1aec07b040 tx=0x7f1aec078440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c79f327e2c8ab1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f19daffd640 1 -- 172.21.15.50:0/2299283089 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec08f0c0 con 0x562635578130 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f19daffd640 1 -- 172.21.15.50:0/2299283089 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec078800 con 0x562635578130 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f19daffd640 1 -- 172.21.15.50:0/2299283089 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec05dbb0 con 0x562635578130 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f1affb23800 1 -- 172.21.15.50:0/2299283089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 msgr2=0x562635578550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f1affb23800 1 --2- 172.21.15.50:0/2299283089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x562635578550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1aec07b040 tx=0x7f1aec078440 comp rx=0 tx=0).stop 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f1affb23800 1 -- 172.21.15.50:0/2299283089 shutdown_connections 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f1affb23800 1 --2- 172.21.15.50:0/2299283089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x562635578550 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f1affb23800 1 -- 172.21.15.50:0/2299283089 >> 172.21.15.50:0/2299283089 conn(0x562635574440 msgr2=0x5626355724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f1affb23800 1 -- 172.21.15.50:0/2299283089 shutdown_connections 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.762+0000 7f1affb23800 1 -- 172.21.15.50:0/2299283089 wait complete. 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.763+0000 7f1affb23800 1 Processor -- start 2024-05-07T13:56:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.763+0000 7f1affb23800 1 -- start start 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.763+0000 7f1affb23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x56263557f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.763+0000 7f1affb23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5626355791b0 con 0x562635578130 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.763+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x56263557f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.763+0000 7f1afb859640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x56263557f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46100/0 (socket says 172.21.15.50:46100) 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.763+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 learned_addr learned my addr 172.21.15.50:0/1509598873 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.763+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56263557f9e0 con 0x562635578130 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.764+0000 7f1afb859640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x56263557f4a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1aec09b020 tx=0x7f1aec063f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.764+0000 7f19d97fa640 1 -- 172.21.15.50:0/1509598873 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec05dbb0 con 0x562635578130 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.764+0000 7f19d97fa640 1 -- 172.21.15.50:0/1509598873 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec0b0040 con 0x562635578130 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.764+0000 7f19d97fa640 1 -- 172.21.15.50:0/1509598873 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aec08d7b0 con 0x562635578130 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.764+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56263557f9e0 con 0x562635578130 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.764+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56263557f9e0 con 0x562635578130 2024-05-07T13:56:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.764+0000 7f19d97fa640 1 -- 172.21.15.50:0/1509598873 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1aec089480 con 0x562635578130 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.765+0000 7f19d97fa640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19c4036950 0x7f19c4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.765+0000 7f19d97fa640 1 -- 172.21.15.50:0/1509598873 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1aec0811c0 con 0x562635578130 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.765+0000 7f1afb058640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19c4036950 0x7f19c4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.765+0000 7f1afb058640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19c4036950 0x7f19c4038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x56263555cf90 tx=0x7f1af0010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.765+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56263558ac00 0x56263558d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56263558d810 con 0x56263558ac00 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1afc05a640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56263558ac00 0x56263558d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1afc05a640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56263558ac00 0x56263558d0c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1af400a4a0 con 0x56263558ac00 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 20 realm 2024-05-07T13:56:12.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56263558dc20 con 0x56263558ac00 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1af400a4a0 con 0x56263558ac00 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.766+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56263558e4f0 con 0x56263558ac00 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1af400a4a0 con 0x56263558ac00 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1affb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558ac00 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1af400a4a0 con 0x56263558ac00 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1affb23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1affb23800 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56263558f5f0 0x5626355919e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635591ff0 con 0x56263558f5f0 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1afb859640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56263558f5f0 0x5626355919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1afb859640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56263558f5f0 0x5626355919e0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.767+0000 7f1affb23800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.768+0000 7f1affb23800 20 searching for the correct realm 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.768+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562635593900 con 0x56263558f5f0 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.768+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.768+0000 7f1afb859640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1aec078c20 0x7f1aec0794b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.768+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562635593900 con 0x7f1aec078c20 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.768+0000 7f1afb058640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1aec078c20 0x7f1aec0794b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.768+0000 7f1afb058640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1aec078c20 0x7f1aec0794b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.769+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.769+0000 7f1afb058640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1af000f070 0x7f1af002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.769+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562635593900 con 0x7f1af000f070 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.769+0000 7f1afc05a640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1af000f070 0x7f1af002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.769+0000 7f1afc05a640 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1af000f070 0x7f1af002e910 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.770+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af400a4a0 con 0x7f1af000f070 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.770+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558ac00 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.770+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af400a4a0 con 0x56263558ac00 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.770+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558ac00 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.770+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af400a4a0 con 0x56263558ac00 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.770+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1af000f070 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.770+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af400a4a0 con 0x7f1af000f070 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.770+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1af000f070 2024-05-07T13:56:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.771+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1af400a4a0 con 0x7f1af000f070 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.771+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1aec078c20 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.771+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.771+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558f5f0 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.771+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.771+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558ac00 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.771+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af400a4a0 con 0x56263558ac00 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.771+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1af000f070 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.772+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af400a4a0 con 0x7f1af000f070 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.772+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558ac00 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.772+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af400a4a0 con 0x56263558ac00 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.772+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1aec078c20 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.772+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.772+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558f5f0 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.772+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.772+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558f5f0 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.773+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.773+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1af000f070 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.773+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af400a4a0 con 0x7f1af000f070 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.773+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558f5f0 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.773+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.773+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558f5f0 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.774+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.774+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558ac00 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.774+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af400a4a0 con 0x56263558ac00 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.774+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558ac00 2024-05-07T13:56:12.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.774+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.774+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1af000f070 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.774+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.774+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558f5f0 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.775+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.775+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1aec078c20 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.775+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.775+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558ac00 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.775+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.775+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1af000f070 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.775+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.775+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558f5f0 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.776+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.776+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1af000f070 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.776+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.776+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1aec078c20 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.776+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.776+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558f5f0 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.776+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1af000f070 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x56263558ac00 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56263558e890 con 0x7f1aec078c20 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1affb23800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1affb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1affb23800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1affb23800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1affb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1affb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.777+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5626355928b0 con 0x56263558ac00 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635592ca0 con 0x56263558ac00 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635592ca0 con 0x7f1af000f070 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 zone default found 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 4 Realm: () 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 zonegroup default 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635593d80 con 0x7f1af000f070 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.778+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635595760 con 0x56263558f5f0 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1affb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562635595b00 con 0x56263558f5f0 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1affb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1affb23800 20 started sync module instance, tier type = 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1affb23800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.779+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635594c00 con 0x7f1aec078c20 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.780+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.780+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94722103789392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635595ea0 con 0x7f1aec078c20 2024-05-07T13:56:12.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.780+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635596770 con 0x56263558ac00 2024-05-07T13:56:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.781+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.781+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94722103796288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635597040 con 0x56263558ac00 2024-05-07T13:56:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.781+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635597b10 con 0x56263558f5f0 2024-05-07T13:56:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.781+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94722103789392] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.782+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94722103796288] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.782+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.782+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94722103791648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635597040 con 0x56263558f5f0 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.782+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5626355983f0 con 0x7f1aec078c20 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.783+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94722103791648] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.784+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.784+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94722103798672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635598c90 con 0x7f1aec078c20 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.784+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635599650 con 0x56263558ac00 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.785+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.785+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94722103798672] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.785+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94722103808416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635599a70 con 0x56263558ac00 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.785+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559a430 con 0x7f1af000f070 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.786+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94722103808416] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.786+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.786+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94722103809952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559a430 con 0x7f1af000f070 2024-05-07T13:56:12.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.786+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559adf0 con 0x7f1af000f070 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.787+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94722103809952] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.787+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.787+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94722103814944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559a430 con 0x7f1af000f070 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.787+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559b800 con 0x7f1af000f070 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94722103814944] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94722103817040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559bc20 con 0x7f1af000f070 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1affb23800 20 add_watcher() i=0 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1affb23800 20 add_watcher() i=1 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1affb23800 20 add_watcher() i=2 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1affb23800 20 add_watcher() i=3 2024-05-07T13:56:12.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1affb23800 20 add_watcher() i=4 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1affb23800 20 add_watcher() i=5 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.788+0000 7f1affb23800 20 add_watcher() i=6 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.789+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94722103817040] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.789+0000 7f1affb23800 20 add_watcher() i=7 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.789+0000 7f1affb23800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.789+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56263559bc20 con 0x56263558ac00 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.789+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.789+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94722103818096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559bb90 con 0x56263558ac00 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.790+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94722103818096] v27'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.790+0000 7f19b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.790+0000 7f1affb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.790+0000 7f1affb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.790+0000 7f1affb23800 5 note: GC not initialized 2024-05-07T13:56:12.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f19b0fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 20 Filter name: none 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f192a7fc640 20 reqs_thread_entry: start 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5626355d2150 con 0x56263558ac00 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.791+0000 7f1affb23800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5626355d1c90 con 0x7f1aec078c20 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 : miss 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5626355d57d0 con 0x7f1aec078c20 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(64 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:12.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.792+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5626355d6f50 con 0x7f1aec078c20 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 foo.buckets [call] v27'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1affb23800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1affb23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5626355d6aa0 con 0x7f1aec078c20 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1affb23800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1affb23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1affb23800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1affb23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:12.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.794+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5626355dcf80 con 0x7f1aec078c20 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.795+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.795+0000 7f1affb23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.795+0000 7f1affb23800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.795+0000 7f1affb23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.795+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94722104068752 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5626355da4b0 con 0x7f1af000f070 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.796+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== watch-notify(notify (1) cookie 94722103814944 notify 115964116993 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f1af401e040 con 0x7f1af000f070 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.796+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(68 notify.6 [notify cookie 94722104068752 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.796+0000 7f19daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94722103814944 notifier 4474 bl.length()=338 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.796+0000 7f19daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.796+0000 7f19daffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.796+0000 7f19daffd640 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f19c0003ea0 con 0x7f1af000f070 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.796+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== watch-notify(notify_complete (2) cookie 94722104068752 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1af4027c70 con 0x7f1af000f070 2024-05-07T13:56:12.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.796+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.797+0000 7f19b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.797+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94722103818096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5626355d25b0 con 0x56263558ac00 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.798+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94722103818096] v27'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.798+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94722103789392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559b770 con 0x7f1aec078c20 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.799+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94722103789392] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.799+0000 7f1affb23800 20 remove_watcher() i=0 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.799+0000 7f1affb23800 2 removed watcher, disabling cache 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.799+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94722103796288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559b770 con 0x56263558ac00 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.800+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94722103796288] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.800+0000 7f1affb23800 20 remove_watcher() i=1 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.800+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94722103791648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559b770 con 0x56263558f5f0 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.801+0000 7f1afb859640 1 -- 172.21.15.50:0/1509598873 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94722103791648] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1aec083030 con 0x56263558f5f0 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.801+0000 7f1affb23800 20 remove_watcher() i=2 2024-05-07T13:56:12.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.801+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94722103798672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635595020 con 0x7f1aec078c20 2024-05-07T13:56:12.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.802+0000 7f1afb058640 1 -- 172.21.15.50:0/1509598873 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94722103798672] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af0037040 con 0x7f1aec078c20 2024-05-07T13:56:12.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.802+0000 7f1affb23800 20 remove_watcher() i=3 2024-05-07T13:56:12.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.802+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94722103808416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559b770 con 0x56263558ac00 2024-05-07T13:56:12.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.803+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94722103808416] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x56263558ac00 2024-05-07T13:56:12.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.803+0000 7f1affb23800 20 remove_watcher() i=4 2024-05-07T13:56:12.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.803+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94722103809952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562635596b90 con 0x7f1af000f070 2024-05-07T13:56:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.804+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94722103809952] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.804+0000 7f1affb23800 20 remove_watcher() i=5 2024-05-07T13:56:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.804+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94722103814944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5626355991a0 con 0x7f1af000f070 2024-05-07T13:56:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.805+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94722103814944] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.805+0000 7f1affb23800 20 remove_watcher() i=6 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.805+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94722103817040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56263559b770 con 0x7f1af000f070 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.806+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94722103817040] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1af402f060 con 0x7f1af000f070 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.806+0000 7f1affb23800 20 remove_watcher() i=7 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1af000f070 msgr2=0x7f1af002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1af000f070 0x7f1af002e910 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56263558ac00 msgr2=0x56263558d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56263558ac00 0x56263558d0c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1aec078c20 msgr2=0x7f1aec0794b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1aec078c20 0x7f1aec0794b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56263558f5f0 msgr2=0x5626355919e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56263558f5f0 0x5626355919e0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19c4036950 msgr2=0x7f19c4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19c4036950 0x7f19c4038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x56263555cf90 tx=0x7f1af0010000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 msgr2=0x56263557f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1afc05a640 1 -- 172.21.15.50:0/1509598873 reap_dead start 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x56263557f4a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1aec09b020 tx=0x7f1aec063f40 comp rx=0 tx=0).stop 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 shutdown_connections 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/1509598873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562635578130 0x56263557f4a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 >> 172.21.15.50:0/1509598873 conn(0x562635574440 msgr2=0x562635571aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 shutdown_connections 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/1509598873 wait complete. 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/275254538 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19d4036950 msgr2=0x7f19d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/275254538 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19d4036950 0x7f19d4038e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x562635550cb0 tx=0x7f1af000f000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/275254538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263556aff0 msgr2=0x56263556b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/275254538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263556aff0 0x56263556b410 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0068b0 tx=0x7f1aec076630 comp rx=0 tx=0).stop 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/275254538 shutdown_connections 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/275254538 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19d4036950 0x7f19d4038e10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 --2- 172.21.15.50:0/275254538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263556aff0 0x56263556b410 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/275254538 >> 172.21.15.50:0/275254538 conn(0x56263555f090 msgr2=0x56263555f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/275254538 shutdown_connections 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.807+0000 7f1affb23800 1 -- 172.21.15.50:0/275254538 wait complete. 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562635559fe0 msgr2=0x56263555c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562635559fe0 0x56263555c430 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562635450350 msgr2=0x5626355537c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562635450350 0x5626355537c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5626355560a0 msgr2=0x562635558490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5626355560a0 0x562635558490 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19e4036900 msgr2=0x7f19e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f19e4036900 0x7f19e4038dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1af0000f60 tx=0x7f1af0001370 comp rx=0 tx=0).stop 2024-05-07T13:56:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 msgr2=0x56263554c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 --2- 172.21.15.50:0/3614231074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56263544f9f0 0x56263554c620 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1aec052540 tx=0x7f1aec003020 comp rx=0 tx=0).stop 2024-05-07T13:56:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1afc05a640 1 -- 172.21.15.50:0/3614231074 reap_dead start 2024-05-07T13:56:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 shutdown_connections 2024-05-07T13:56:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 >> 172.21.15.50:0/3614231074 conn(0x56263544b5b0 msgr2=0x56263553ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 shutdown_connections 2024-05-07T13:56:12.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.808+0000 7f1affb23800 1 -- 172.21.15.50:0/3614231074 wait complete. 2024-05-07T13:56:12.809 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-07T13:56:12.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-07T13:56:12.810 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-07T13:56:12.863 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:12.863 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.875+0000 7fa31d975800 1 Processor -- start 2024-05-07T13:56:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31d975800 1 -- start start 2024-05-07T13:56:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31d975800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d129343070 0x55d1293d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31d975800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d1293d6f50 con 0x55d1293d3250 2024-05-07T13:56:12.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31d975800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55d129261050 con 0x55d129343070 2024-05-07T13:56:12.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31b474640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d129343070 0x55d1293d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31b474640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d129343070 0x55d1293d2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46112/0 (socket says 172.21.15.50:46112) 2024-05-07T13:56:12.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31ac73640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55d1293d3250 0x55d1293d56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39768/0 (socket says 172.21.15.50:39768) 2024-05-07T13:56:12.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31b474640 1 -- 172.21.15.50:0/572380950 learned_addr learned my addr 172.21.15.50:0/572380950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31b474640 1 -- 172.21.15.50:0/572380950 >> v1:172.21.15.22:6789/0 conn(0x55d1293d3250 legacy=0x55d1293d56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.876+0000 7fa31b474640 1 -- 172.21.15.50:0/572380950 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1293d8180 con 0x55d129343070 2024-05-07T13:56:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.878+0000 7fa31b474640 1 --2- 172.21.15.50:0/572380950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1293d2cb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00a520 tx=0x7fa30c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57f4c731aeec032 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.878+0000 7fa31a472640 1 -- 172.21.15.50:0/572380950 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c057070 con 0x55d129343070 2024-05-07T13:56:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.878+0000 7fa31a472640 1 -- 172.21.15.50:0/572380950 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c052570 con 0x55d129343070 2024-05-07T13:56:12.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.878+0000 7fa31a472640 1 -- 172.21.15.50:0/572380950 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c04ae60 con 0x55d129343070 2024-05-07T13:56:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.879+0000 7fa31d975800 1 -- 172.21.15.50:0/572380950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 msgr2=0x55d1293d2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.879+0000 7fa31d975800 1 --2- 172.21.15.50:0/572380950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1293d2cb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00a520 tx=0x7fa30c01d010 comp rx=0 tx=0).stop 2024-05-07T13:56:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.879+0000 7fa31d975800 1 -- 172.21.15.50:0/572380950 shutdown_connections 2024-05-07T13:56:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.879+0000 7fa31d975800 1 --2- 172.21.15.50:0/572380950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1293d2cb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.879+0000 7fa31d975800 1 -- 172.21.15.50:0/572380950 >> 172.21.15.50:0/572380950 conn(0x55d1293ca5f0 msgr2=0x55d1293cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.879+0000 7fa31d975800 1 -- 172.21.15.50:0/572380950 shutdown_connections 2024-05-07T13:56:12.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.879+0000 7fa31d975800 1 -- 172.21.15.50:0/572380950 wait complete. 2024-05-07T13:56:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.894+0000 7fa31d975800 1 Processor -- start 2024-05-07T13:56:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.895+0000 7fa31d975800 1 -- start start 2024-05-07T13:56:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.895+0000 7fa31d975800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.895+0000 7fa31d975800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d12931b1f0 con 0x55d129343070 2024-05-07T13:56:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.895+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.895+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46122/0 (socket says 172.21.15.50:46122) 2024-05-07T13:56:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.895+0000 7fa31b474640 1 -- 172.21.15.50:0/687581354 learned_addr learned my addr 172.21.15.50:0/687581354 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.895+0000 7fa31b474640 1 -- 172.21.15.50:0/687581354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1294c1dd0 con 0x55d129343070 2024-05-07T13:56:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.896+0000 7fa31b474640 1 --2- 172.21.15.50:0/687581354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c1800 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa30c055040 tx=0x7fa30c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6126596fb4db94a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.896+0000 7fa20960a640 1 -- 172.21.15.50:0/687581354 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c057040 con 0x55d129343070 2024-05-07T13:56:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.896+0000 7fa20960a640 1 -- 172.21.15.50:0/687581354 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c052720 con 0x55d129343070 2024-05-07T13:56:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.896+0000 7fa20960a640 1 -- 172.21.15.50:0/687581354 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c052a20 con 0x55d129343070 2024-05-07T13:56:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.896+0000 7fa31d975800 1 -- 172.21.15.50:0/687581354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 msgr2=0x55d1294c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.896+0000 7fa31d975800 1 --2- 172.21.15.50:0/687581354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c1800 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa30c055040 tx=0x7fa30c04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.896+0000 7fa31d975800 1 -- 172.21.15.50:0/687581354 shutdown_connections 2024-05-07T13:56:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.896+0000 7fa31d975800 1 --2- 172.21.15.50:0/687581354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c1800 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.896+0000 7fa31d975800 1 -- 172.21.15.50:0/687581354 >> 172.21.15.50:0/687581354 conn(0x55d1293ca5f0 msgr2=0x55d1294bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.897+0000 7fa31d975800 1 -- 172.21.15.50:0/687581354 shutdown_connections 2024-05-07T13:56:12.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.897+0000 7fa31d975800 1 -- 172.21.15.50:0/687581354 wait complete. 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.897+0000 7fa31d975800 1 Processor -- start 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.897+0000 7fa31d975800 1 -- start start 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.897+0000 7fa31d975800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.897+0000 7fa31d975800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d1293d73c0 con 0x55d129343070 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.897+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.897+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46132/0 (socket says 172.21.15.50:46132) 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.897+0000 7fa31b474640 1 -- 172.21.15.50:0/2652636114 learned_addr learned my addr 172.21.15.50:0/2652636114 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.898+0000 7fa31b474640 1 -- 172.21.15.50:0/2652636114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1294c97c0 con 0x55d129343070 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.898+0000 7fa31b474640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c9280 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa30c052540 tx=0x7fa30c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.898+0000 7fa207e07640 1 -- 172.21.15.50:0/2652636114 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c073070 con 0x55d129343070 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.898+0000 7fa207e07640 1 -- 172.21.15.50:0/2652636114 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c05d440 con 0x55d129343070 2024-05-07T13:56:12.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.898+0000 7fa207e07640 1 -- 172.21.15.50:0/2652636114 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c057070 con 0x55d129343070 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.898+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1294c9a50 con 0x55d129343070 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.898+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1294cc700 con 0x55d129343070 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.899+0000 7fa207e07640 1 -- 172.21.15.50:0/2652636114 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa30c076070 con 0x55d129343070 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.899+0000 7fa207e07640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa200036900 0x7fa200038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.899+0000 7fa207e07640 1 -- 172.21.15.50:0/2652636114 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa30c08dc90 con 0x55d129343070 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.899+0000 7fa31ac73640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa200036900 0x7fa200038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.899+0000 7fa31d975800 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d1293d3250 0x55d1294d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.899+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1294d0a00 con 0x55d1293d3250 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.900+0000 7fa31bc75640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d1293d3250 0x55d1294d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.900+0000 7fa31ac73640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa200036900 0x7fa200038dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa310000f60 tx=0x7fa310001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.900+0000 7fa31bc75640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d1293d3250 0x55d1294d04c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.900+0000 7fa31bc75640 1 -- 172.21.15.50:0/2652636114 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d1293d3250 2024-05-07T13:56:12.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.900+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1294cda90 con 0x55d1293d3250 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.900+0000 7fa31bc75640 1 -- 172.21.15.50:0/2652636114 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d1293d3250 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.901+0000 7fa31d975800 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d1294d2d50 0x55d1294d5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.901+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1294d5830 con 0x55d1294d2d50 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.901+0000 7fa31b474640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d1294d2d50 0x55d1294d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.901+0000 7fa31b474640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d1294d2d50 0x55d1294d5140 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.901+0000 7fa31b474640 1 -- 172.21.15.50:0/2652636114 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa30c075030 con 0x55d1294d2d50 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.901+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1294d1d00 con 0x55d1293d3250 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.901+0000 7fa31bc75640 1 -- 172.21.15.50:0/2652636114 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d1293d3250 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.901+0000 7fa31d975800 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d1294d6ce0 0x55d1294d9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.902+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1294d9890 con 0x55d1294d6ce0 2024-05-07T13:56:12.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.902+0000 7fa31ac73640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d1294d6ce0 0x55d1294d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.902+0000 7fa31ac73640 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d1294d6ce0 0x55d1294d9130 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.902+0000 7fa31ac73640 1 -- 172.21.15.50:0/2652636114 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa31000f690 con 0x55d1294d6ce0 2024-05-07T13:56:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.903+0000 7fa31d975800 1 Processor -- start 2024-05-07T13:56:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.903+0000 7fa31d975800 1 -- start start 2024-05-07T13:56:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.903+0000 7fa31d975800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1293d0820 0x55d1293cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.903+0000 7fa31d975800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d1292c1cf0 con 0x55d1293d0820 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.903+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1293d0820 0x55d1293cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.903+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1293d0820 0x55d1293cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46134/0 (socket says 172.21.15.50:46134) 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.903+0000 7fa31b474640 1 -- 172.21.15.50:0/977303419 learned_addr learned my addr 172.21.15.50:0/977303419 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.904+0000 7fa31b474640 1 -- 172.21.15.50:0/977303419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1293cf1d0 con 0x55d1293d0820 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.904+0000 7fa31b474640 1 --2- 172.21.15.50:0/977303419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1293d0820 0x55d1293cec90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0068b0 tx=0x7fa30c076630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.904+0000 7fa205602640 1 -- 172.21.15.50:0/977303419 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c0774e0 con 0x55d1293d0820 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.904+0000 7fa205602640 1 -- 172.21.15.50:0/977303419 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c077680 con 0x55d1293d0820 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.904+0000 7fa31d975800 1 -- 172.21.15.50:0/977303419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1293cf400 con 0x55d1293d0820 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.904+0000 7fa205602640 1 -- 172.21.15.50:0/977303419 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c05d720 con 0x55d1293d0820 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.904+0000 7fa31d975800 1 -- 172.21.15.50:0/977303419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1293cf900 con 0x55d1293d0820 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.905+0000 7fa205602640 1 -- 172.21.15.50:0/977303419 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa30c05d8c0 con 0x55d1293d0820 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.905+0000 7fa205602640 1 --2- 172.21.15.50:0/977303419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1f4036950 0x7fa1f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.905+0000 7fa205602640 1 -- 172.21.15.50:0/977303419 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa30c0980b0 con 0x55d1293d0820 2024-05-07T13:56:12.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.905+0000 7fa31ac73640 1 --2- 172.21.15.50:0/977303419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1f4036950 0x7fa1f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.905+0000 7fa31d975800 1 Processor -- start 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.905+0000 7fa31d975800 1 -- start start 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.905+0000 7fa31ac73640 1 --2- 172.21.15.50:0/977303419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1f4036950 0x7fa1f4038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55d1294d1300 tx=0x7fa31000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.905+0000 7fa31d975800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294f7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.906+0000 7fa31d975800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d1294c2090 con 0x55d1294f7060 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.906+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.906+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46146/0 (socket says 172.21.15.50:46146) 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.906+0000 7fa31b474640 1 -- 172.21.15.50:0/2185657208 learned_addr learned my addr 172.21.15.50:0/2185657208 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.906+0000 7fa31b474640 1 -- 172.21.15.50:0/2185657208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1294f7a50 con 0x55d1294f7060 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.906+0000 7fa31b474640 1 --2- 172.21.15.50:0/2185657208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294f7480 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa30c07b040 tx=0x7fa30c078750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8607be50b4cb919 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.906+0000 7fa1feffd640 1 -- 172.21.15.50:0/2185657208 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c078800 con 0x55d1294f7060 2024-05-07T13:56:12.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.906+0000 7fa1feffd640 1 -- 172.21.15.50:0/2185657208 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c078a10 con 0x55d1294f7060 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.906+0000 7fa1feffd640 1 -- 172.21.15.50:0/2185657208 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c0791f0 con 0x55d1294f7060 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 -- 172.21.15.50:0/2185657208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 msgr2=0x55d1294f7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 --2- 172.21.15.50:0/2185657208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294f7480 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa30c07b040 tx=0x7fa30c078750 comp rx=0 tx=0).stop 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 -- 172.21.15.50:0/2185657208 shutdown_connections 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 --2- 172.21.15.50:0/2185657208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294f7480 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 -- 172.21.15.50:0/2185657208 >> 172.21.15.50:0/2185657208 conn(0x55d1294f3370 msgr2=0x55d1294f13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 -- 172.21.15.50:0/2185657208 shutdown_connections 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 -- 172.21.15.50:0/2185657208 wait complete. 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 Processor -- start 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 -- start start 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.907+0000 7fa31d975800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d1294f80e0 con 0x55d1294f7060 2024-05-07T13:56:12.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa31b474640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46148/0 (socket says 172.21.15.50:46148) 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 learned_addr learned my addr 172.21.15.50:0/2845640937 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1294fe8c0 con 0x55d1294f7060 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa31b474640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294fe380 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa30c09b020 tx=0x7fa30c071f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa1fd7fa640 1 -- 172.21.15.50:0/2845640937 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c05dbb0 con 0x55d1294f7060 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa1fd7fa640 1 -- 172.21.15.50:0/2845640937 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c08d7b0 con 0x55d1294f7060 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa1fd7fa640 1 -- 172.21.15.50:0/2845640937 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa30c0895b0 con 0x55d1294f7060 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1294fe8c0 con 0x55d1294f7060 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.908+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1294fe8c0 con 0x55d1294f7060 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.909+0000 7fa1fd7fa640 1 -- 172.21.15.50:0/2845640937 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa30c0b7020 con 0x55d1294f7060 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.909+0000 7fa1fd7fa640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1e4036950 0x7fa1e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.909+0000 7fa1fd7fa640 1 -- 172.21.15.50:0/2845640937 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa30c0bac90 con 0x55d1294f7060 2024-05-07T13:56:12.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.909+0000 7fa31ac73640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1e4036950 0x7fa1e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.910+0000 7fa31ac73640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1e4036950 0x7fa1e4038e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55d1294d9c90 tx=0x7fa310010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.910+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.910+0000 7fa31d975800 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d129509ac0 0x55d12950bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.910+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d12950c6d0 con 0x55d129509ac0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.910+0000 7fa31bc75640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d129509ac0 0x55d12950bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31bc75640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d129509ac0 0x55d12950bf80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d129509ac0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 20 realm 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d12950cae0 con 0x55d129509ac0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d129509ac0 2024-05-07T13:56:12.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d3b0 con 0x55d129509ac0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d129509ac0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.911+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d129509ac0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d129509ac0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31d975800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31d975800 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d12950e4b0 0x55d1295108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d129510eb0 con 0x55d12950e4b0 2024-05-07T13:56:12.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31b474640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d12950e4b0 0x55d1295108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31b474640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d12950e4b0 0x55d1295108a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31d975800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31d975800 20 searching for the correct realm 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.912+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1295127e0 con 0x55d12950e4b0 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.913+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.913+0000 7fa31b474640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fa30c078c20 0x7fa30c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.913+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1295127e0 con 0x7fa30c078c20 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.913+0000 7fa31ac73640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fa30c078c20 0x7fa30c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.913+0000 7fa31ac73640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fa30c078c20 0x7fa30c062960 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.914+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.914+0000 7fa31ac73640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fa31000f070 0x7fa31002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.914+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1295127e0 con 0x7fa31000f070 2024-05-07T13:56:12.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.914+0000 7fa31bc75640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fa31000f070 0x7fa31002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.914+0000 7fa31bc75640 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fa31000f070 0x7fa31002e910 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.914+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31400a4a0 con 0x7fa31000f070 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.914+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d129509ac0 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.915+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d129509ac0 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.915+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d129509ac0 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.915+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d129509ac0 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.915+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa31000f070 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.915+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31400a4a0 con 0x7fa31000f070 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.915+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa31000f070 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.916+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa31400a4a0 con 0x7fa31000f070 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.916+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa30c078c20 2024-05-07T13:56:12.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.916+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.916+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d12950e4b0 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.916+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.916+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d129509ac0 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.916+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d129509ac0 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.916+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa31000f070 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.917+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31400a4a0 con 0x7fa31000f070 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.917+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d129509ac0 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.917+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d129509ac0 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.917+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa30c078c20 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.917+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.917+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d12950e4b0 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.917+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.917+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d12950e4b0 2024-05-07T13:56:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.918+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.918+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa31000f070 2024-05-07T13:56:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.918+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31400a4a0 con 0x7fa31000f070 2024-05-07T13:56:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.918+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d12950e4b0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.918+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.918+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d12950e4b0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.919+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.919+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d129509ac0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.919+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31400a4a0 con 0x55d129509ac0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.919+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d129509ac0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.919+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.919+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa31000f070 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.920+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.920+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d12950e4b0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.920+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.920+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa30c078c20 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.920+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.920+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d129509ac0 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.920+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.920+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa31000f070 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.921+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.921+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d12950e4b0 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.921+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.921+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa31000f070 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.922+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.922+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa30c078c20 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.922+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.922+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d12950e4b0 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.922+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.922+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa31000f070 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.922+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.922+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x55d129509ac0 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d12950d750 con 0x7fa30c078c20 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d129511770 con 0x55d129509ac0 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d129511b60 con 0x55d129509ac0 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.923+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d129511b60 con 0x7fa31000f070 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:12.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 20 zone default found 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 4 Realm: () 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 20 zonegroup default 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d129512c60 con 0x7fa31000f070 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.924+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d129514640 con 0x55d12950e4b0 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.925+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.925+0000 7fa31d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.925+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.925+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1295149e0 con 0x55d12950e4b0 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.925+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.925+0000 7fa31d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.925+0000 7fa31d975800 20 started sync module instance, tier type = 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.925+0000 7fa31d975800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.925+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129513ae0 con 0x7fa30c078c20 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.926+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.926+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94356829713968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129514d80 con 0x7fa30c078c20 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.926+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1295155d0 con 0x55d129509ac0 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.927+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94356829713968] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.927+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.927+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94356829720864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129515540 con 0x55d129509ac0 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.927+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129516490 con 0x55d12950e4b0 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.928+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94356829720864] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.928+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.928+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94356829724640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129516880 con 0x55d12950e4b0 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.928+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129517280 con 0x7fa30c078c20 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.929+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94356829724640] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.929+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.929+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94356829723072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129517670 con 0x7fa30c078c20 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.929+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1295180b0 con 0x55d129509ac0 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.930+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94356829723072] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.931+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.931+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94356829731712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1295184a0 con 0x55d129509ac0 2024-05-07T13:56:12.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.931+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129518ea0 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.932+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.932+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94356829735344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129518dd0 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.932+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129519dd0 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.932+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94356829731712] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.933+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94356829735344] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.933+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.933+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94356829737616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1295198e0 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.933+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d12951a2a0 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94356829740528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d12951a6c0 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94356829737616] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31d975800 20 add_watcher() i=0 2024-05-07T13:56:12.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31d975800 20 add_watcher() i=1 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31d975800 20 add_watcher() i=2 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31d975800 20 add_watcher() i=3 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31d975800 20 add_watcher() i=4 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31d975800 20 add_watcher() i=5 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.934+0000 7fa31d975800 20 add_watcher() i=6 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.935+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94356829740528] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.935+0000 7fa31d975800 20 add_watcher() i=7 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.935+0000 7fa31d975800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.935+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d12951a6c0 con 0x55d129509ac0 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.935+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.935+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94356829741584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d12951a630 con 0x55d129509ac0 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.936+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94356829741584] v27'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.936+0000 7fa1d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.936+0000 7fa31d975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.936+0000 7fa31d975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.936+0000 7fa31d975800 5 note: GC not initialized 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa1d0fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 20 Filter name: none 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa14a7fc640 20 reqs_thread_entry: start 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d129550c20 con 0x7fa31000f070 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-07T13:56:12.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 20 rados->read ofs=0 len=0 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.937+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d12954f3c0 con 0x7fa31000f070 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.938+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.938+0000 7fa31d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.938+0000 7fa31d975800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.938+0000 7fa31d975800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.938+0000 7fa31d975800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.938+0000 7fa31d975800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.938+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d12954fcb0 con 0x7fa31000f070 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v27'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31d975800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-07T13:56:12.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31d975800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31d975800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94356829960192 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d129554560 con 0x7fa31000f070 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== watch-notify(notify (1) cookie 94356829735344 notify 115964116994 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55d129550050 con 0x7fa31000f070 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa1feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94356829735344 notifier 4481 bl.length()=556 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(65 notify.5 [notify cookie 94356829960192 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa1feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa1feffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa1feffd640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fa1e0003ea0 con 0x7fa31000f070 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== watch-notify(notify_complete (2) cookie 94356829960192 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d12954f4e0 con 0x7fa31000f070 2024-05-07T13:56:12.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.939+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129552090 con 0x7fa31000f070 2024-05-07T13:56:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa31d975800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-07T13:56:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa31d975800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:56:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa31d975800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-07T13:56:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94356829960112 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d129554560 con 0x55d12950e4b0 2024-05-07T13:56:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== watch-notify(notify (1) cookie 94356829724640 notify 115964116994 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55d1293cf400 con 0x55d12950e4b0 2024-05-07T13:56:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa1feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94356829724640 notifier 4481 bl.length()=177 2024-05-07T13:56:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa1feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-07T13:56:12.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa1feffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:56:12.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa1feffd640 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fa1e0003ea0 con 0x55d12950e4b0 2024-05-07T13:56:12.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(68 notify.2 [notify cookie 94356829960112 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.941+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== watch-notify(notify_complete (2) cookie 94356829960112 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d1293cf1d0 con 0x55d12950e4b0 2024-05-07T13:56:12.943 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-07T13:56:12.939518Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:12.939504Z","tags":[],"group_ids":[]} 2024-05-07T13:56:12.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.942+0000 7fa1d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:12.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.942+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94356829741584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1295034e0 con 0x55d129509ac0 2024-05-07T13:56:12.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.943+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94356829741584] v27'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.943+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94356829713968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d12951a210 con 0x7fa30c078c20 2024-05-07T13:56:12.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.944+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94356829713968] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.944+0000 7fa31d975800 20 remove_watcher() i=0 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.944+0000 7fa31d975800 2 removed watcher, disabling cache 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.944+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94356829720864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d12951a210 con 0x55d129509ac0 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.945+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94356829720864] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.945+0000 7fa31d975800 20 remove_watcher() i=1 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.945+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94356829724640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129515120 con 0x55d12950e4b0 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.947+0000 7fa31b474640 1 -- 172.21.15.50:0/2845640937 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94356829724640] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa30c083030 con 0x55d12950e4b0 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.947+0000 7fa31d975800 20 remove_watcher() i=2 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.947+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94356829723072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d12951a210 con 0x7fa30c078c20 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.948+0000 7fa31ac73640 1 -- 172.21.15.50:0/2845640937 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94356829723072] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa310037040 con 0x7fa30c078c20 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.948+0000 7fa31d975800 20 remove_watcher() i=3 2024-05-07T13:56:12.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.948+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94356829731712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129515120 con 0x55d129509ac0 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.949+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94356829731712] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x55d129509ac0 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.949+0000 7fa31d975800 20 remove_watcher() i=4 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.949+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94356829735344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d12951a210 con 0x7fa31000f070 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.950+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94356829735344] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.950+0000 7fa31d975800 20 remove_watcher() i=5 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.950+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94356829737616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d129515120 con 0x7fa31000f070 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.951+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94356829737616] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.951+0000 7fa31d975800 20 remove_watcher() i=6 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.951+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94356829740528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1295189b0 con 0x7fa31000f070 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94356829740528] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa31402f060 con 0x7fa31000f070 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 20 remove_watcher() i=7 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fa31000f070 msgr2=0x7fa31002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fa31000f070 0x7fa31002e910 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d129509ac0 msgr2=0x55d12950bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d129509ac0 0x55d12950bf80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fa30c078c20 msgr2=0x7fa30c062960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fa30c078c20 0x7fa30c062960 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d12950e4b0 msgr2=0x55d1295108a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d12950e4b0 0x55d1295108a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1e4036950 msgr2=0x7fa1e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1e4036950 0x7fa1e4038e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55d1294d9c90 tx=0x7fa310010000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 msgr2=0x55d1294fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31bc75640 1 -- 172.21.15.50:0/2845640937 reap_dead start 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294fe380 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa30c09b020 tx=0x7fa30c071f90 comp rx=0 tx=0).stop 2024-05-07T13:56:12.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 shutdown_connections 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 --2- 172.21.15.50:0/2845640937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1294f7060 0x55d1294fe380 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 >> 172.21.15.50:0/2845640937 conn(0x55d1294f3370 msgr2=0x55d1294f09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 shutdown_connections 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.952+0000 7fa31d975800 1 -- 172.21.15.50:0/2845640937 wait complete. 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/977303419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1f4036950 msgr2=0x7fa1f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 --2- 172.21.15.50:0/977303419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1f4036950 0x7fa1f4038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55d1294d1300 tx=0x7fa31000f000 comp rx=0 tx=0).stop 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/977303419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1293d0820 msgr2=0x55d1293cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 --2- 172.21.15.50:0/977303419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1293d0820 0x55d1293cec90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0068b0 tx=0x7fa30c076630 comp rx=0 tx=0).stop 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/977303419 shutdown_connections 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 --2- 172.21.15.50:0/977303419 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa1f4036950 0x7fa1f4038e10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 --2- 172.21.15.50:0/977303419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1293d0820 0x55d1293cec90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/977303419 >> 172.21.15.50:0/977303419 conn(0x55d1294dbd90 msgr2=0x55d1294dc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/977303419 shutdown_connections 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/977303419 wait complete. 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d1294d6ce0 msgr2=0x55d1294d9130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d1294d6ce0 0x55d1294d9130 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d1293d3250 msgr2=0x55d1294d04c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d1293d3250 0x55d1294d04c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d1294d2d50 msgr2=0x55d1294d5140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d1294d2d50 0x55d1294d5140 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa200036900 msgr2=0x7fa200038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa200036900 0x7fa200038dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa310000f60 tx=0x7fa310001370 comp rx=0 tx=0).stop 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 msgr2=0x55d1294c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 --2- 172.21.15.50:0/2652636114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d129343070 0x55d1294c9280 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa30c052540 tx=0x7fa30c003020 comp rx=0 tx=0).stop 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31bc75640 1 -- 172.21.15.50:0/2652636114 reap_dead start 2024-05-07T13:56:12.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 shutdown_connections 2024-05-07T13:56:12.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 >> 172.21.15.50:0/2652636114 conn(0x55d1293ca5f0 msgr2=0x55d1294bb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:12.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 shutdown_connections 2024-05-07T13:56:12.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:12.953+0000 7fa31d975800 1 -- 172.21.15.50:0/2652636114 wait complete. 2024-05-07T13:56:12.958 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-07T13:56:12.939518Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:12.939504Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:12.964 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-07T13:56:12.968 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:12.969 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-05-07T13:56:12.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-05-07T13:56:12.969 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-05-07T13:56:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:13.013 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.025+0000 7f7e1c536800 1 Processor -- start 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.025+0000 7f7e1c536800 1 -- start start 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.025+0000 7f7e1c536800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5639f038e8c0 0x5639f041dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.025+0000 7f7e1c536800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5639f0421f00 con 0x5639f041e200 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.025+0000 7f7e1c536800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5639f02ac050 con 0x5639f038e8c0 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.026+0000 7f7e182cc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5639f038e8c0 0x5639f041dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.026+0000 7f7e182cc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5639f038e8c0 0x5639f041dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46154/0 (socket says 172.21.15.50:46154) 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.026+0000 7f7e182cc640 1 -- 172.21.15.50:0/3935975525 learned_addr learned my addr 172.21.15.50:0/3935975525 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.026+0000 7f7e182cc640 1 -- 172.21.15.50:0/3935975525 >> v1:172.21.15.22:6789/0 conn(0x5639f041e200 legacy=0x5639f04206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.026+0000 7f7e182cc640 1 -- 172.21.15.50:0/3935975525 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f0423130 con 0x5639f038e8c0 2024-05-07T13:56:13.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.028+0000 7f7e182cc640 1 --2- 172.21.15.50:0/3935975525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f041dc60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800a520 tx=0x7f7e0801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85f26937c416b72 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.028+0000 7f7e172ca640 1 -- 172.21.15.50:0/3935975525 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08057070 con 0x5639f038e8c0 2024-05-07T13:56:13.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.028+0000 7f7e172ca640 1 -- 172.21.15.50:0/3935975525 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e08052570 con 0x5639f038e8c0 2024-05-07T13:56:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.028+0000 7f7e172ca640 1 -- 172.21.15.50:0/3935975525 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e0804ae60 con 0x5639f038e8c0 2024-05-07T13:56:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.029+0000 7f7e1c536800 1 -- 172.21.15.50:0/3935975525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 msgr2=0x5639f041dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.029+0000 7f7e1c536800 1 --2- 172.21.15.50:0/3935975525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f041dc60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800a520 tx=0x7f7e0801d010 comp rx=0 tx=0).stop 2024-05-07T13:56:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.029+0000 7f7e1c536800 1 -- 172.21.15.50:0/3935975525 shutdown_connections 2024-05-07T13:56:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.029+0000 7f7e1c536800 1 --2- 172.21.15.50:0/3935975525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f041dc60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.029+0000 7f7e1c536800 1 -- 172.21.15.50:0/3935975525 >> 172.21.15.50:0/3935975525 conn(0x5639f0415560 msgr2=0x5639f0417980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.029+0000 7f7e1c536800 1 -- 172.21.15.50:0/3935975525 shutdown_connections 2024-05-07T13:56:13.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.029+0000 7f7e1c536800 1 -- 172.21.15.50:0/3935975525 wait complete. 2024-05-07T13:56:13.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.044+0000 7f7e1c536800 1 Processor -- start 2024-05-07T13:56:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.044+0000 7f7e1c536800 1 -- start start 2024-05-07T13:56:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.044+0000 7f7e1c536800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f050c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.044+0000 7f7e1c536800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5639f03661d0 con 0x5639f038e8c0 2024-05-07T13:56:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.044+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f050c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.044+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f050c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46162/0 (socket says 172.21.15.50:46162) 2024-05-07T13:56:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.044+0000 7f7e182cc640 1 -- 172.21.15.50:0/1352280986 learned_addr learned my addr 172.21.15.50:0/1352280986 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.045+0000 7f7e182cc640 1 -- 172.21.15.50:0/1352280986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f050ccd0 con 0x5639f038e8c0 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.045+0000 7f7e182cc640 1 --2- 172.21.15.50:0/1352280986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f050c700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7e08055040 tx=0x7f7e0804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee72f45840477029 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.045+0000 7f7d0660c640 1 -- 172.21.15.50:0/1352280986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08057040 con 0x5639f038e8c0 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.045+0000 7f7d0660c640 1 -- 172.21.15.50:0/1352280986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e08052720 con 0x5639f038e8c0 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.045+0000 7f7d0660c640 1 -- 172.21.15.50:0/1352280986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08052a20 con 0x5639f038e8c0 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 -- 172.21.15.50:0/1352280986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 msgr2=0x5639f050c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1352280986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f050c700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7e08055040 tx=0x7f7e0804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 -- 172.21.15.50:0/1352280986 shutdown_connections 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1352280986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f050c700 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 -- 172.21.15.50:0/1352280986 >> 172.21.15.50:0/1352280986 conn(0x5639f0415560 msgr2=0x5639f0508020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 -- 172.21.15.50:0/1352280986 shutdown_connections 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 -- 172.21.15.50:0/1352280986 wait complete. 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 Processor -- start 2024-05-07T13:56:13.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 -- start start 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f041b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e1c536800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5639f0422370 con 0x5639f038e8c0 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f041b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f041b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46174/0 (socket says 172.21.15.50:46174) 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.046+0000 7f7e182cc640 1 -- 172.21.15.50:0/1842393345 learned_addr learned my addr 172.21.15.50:0/1842393345 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.047+0000 7f7e182cc640 1 -- 172.21.15.50:0/1842393345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f0419c80 con 0x5639f038e8c0 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.047+0000 7f7e182cc640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f041b590 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7e08052540 tx=0x7f7e08003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.047+0000 7f7d04e09640 1 -- 172.21.15.50:0/1842393345 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08073070 con 0x5639f038e8c0 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.047+0000 7f7d04e09640 1 -- 172.21.15.50:0/1842393345 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0805d440 con 0x5639f038e8c0 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.047+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f0419f10 con 0x5639f038e8c0 2024-05-07T13:56:13.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.047+0000 7f7d04e09640 1 -- 172.21.15.50:0/1842393345 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08057070 con 0x5639f038e8c0 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.047+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f041a430 con 0x5639f038e8c0 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.048+0000 7f7d04e09640 1 -- 172.21.15.50:0/1842393345 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e08076070 con 0x5639f038e8c0 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.048+0000 7f7d04e09640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7d00036950 0x7f7d00038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.048+0000 7f7d04e09640 1 -- 172.21.15.50:0/1842393345 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7e0808dc40 con 0x5639f038e8c0 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.048+0000 7f7e17acb640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7d00036950 0x7f7d00038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.048+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f041e200 0x5639f051d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.048+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f051db00 con 0x5639f041e200 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.049+0000 7f7e18acd640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f041e200 0x5639f051d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.049+0000 7f7e17acb640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7d00036950 0x7f7d00038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c001e10 tx=0x7f7e0c001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.049+0000 7f7e18acd640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f041e200 0x5639f051d580 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.049+0000 7f7e18acd640 1 -- 172.21.15.50:0/1842393345 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f041e200 2024-05-07T13:56:13.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.049+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f051e410 con 0x5639f041e200 2024-05-07T13:56:13.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.049+0000 7f7e18acd640 1 -- 172.21.15.50:0/1842393345 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f041e200 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.050+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f051fed0 0x5639f0522360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.050+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f0522af0 con 0x5639f051fed0 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.050+0000 7f7e182cc640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f051fed0 0x5639f0522360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.050+0000 7f7e182cc640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f051fed0 0x5639f0522360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.050+0000 7f7e182cc640 1 -- 172.21.15.50:0/1842393345 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7e08075030 con 0x5639f051fed0 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.050+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f051ec90 con 0x5639f041e200 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.051+0000 7f7e18acd640 1 -- 172.21.15.50:0/1842393345 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f041e200 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.051+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5639f0523fa0 0x5639f0526410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.051+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f0526b70 con 0x5639f0523fa0 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.051+0000 7f7e17acb640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5639f0523fa0 0x5639f0526410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.051+0000 7f7e17acb640 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5639f0523fa0 0x5639f0526410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.052+0000 7f7e17acb640 1 -- 172.21.15.50:0/1842393345 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7e0c0106a0 con 0x5639f0523fa0 2024-05-07T13:56:13.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.052+0000 7f7e1c536800 1 Processor -- start 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.052+0000 7f7e1c536800 1 -- start start 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.052+0000 7f7e1c536800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0534fd0 0x5639f05353f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.052+0000 7f7e1c536800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5639f041bad0 con 0x5639f0534fd0 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.052+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0534fd0 0x5639f05353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.052+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0534fd0 0x5639f05353f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46184/0 (socket says 172.21.15.50:46184) 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.052+0000 7f7e182cc640 1 -- 172.21.15.50:0/1556131458 learned_addr learned my addr 172.21.15.50:0/1556131458 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.053+0000 7f7e182cc640 1 -- 172.21.15.50:0/1556131458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f0535930 con 0x5639f0534fd0 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.053+0000 7f7e182cc640 1 --2- 172.21.15.50:0/1556131458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0534fd0 0x5639f05353f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7e080066d0 tx=0x7f7e08006ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.053+0000 7f7cfdffb640 1 -- 172.21.15.50:0/1556131458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08077b80 con 0x5639f0534fd0 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.053+0000 7f7cfdffb640 1 -- 172.21.15.50:0/1556131458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e08077d20 con 0x5639f0534fd0 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.053+0000 7f7e1c536800 1 -- 172.21.15.50:0/1556131458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f05363a0 con 0x5639f0534fd0 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.053+0000 7f7cfdffb640 1 -- 172.21.15.50:0/1556131458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e0805d850 con 0x5639f0534fd0 2024-05-07T13:56:13.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.053+0000 7f7e1c536800 1 -- 172.21.15.50:0/1556131458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f05368a0 con 0x5639f0534fd0 2024-05-07T13:56:13.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.054+0000 7f7cfdffb640 1 -- 172.21.15.50:0/1556131458 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e0805d9f0 con 0x5639f0534fd0 2024-05-07T13:56:13.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.054+0000 7f7cfdffb640 1 --2- 172.21.15.50:0/1556131458 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7cf0036950 0x7f7cf0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.054+0000 7f7cfdffb640 1 -- 172.21.15.50:0/1556131458 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7e0809ba00 con 0x5639f0534fd0 2024-05-07T13:56:13.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.054+0000 7f7e17acb640 1 --2- 172.21.15.50:0/1556131458 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7cf0036950 0x7f7cf0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.054+0000 7f7e1c536800 1 Processor -- start 2024-05-07T13:56:13.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.054+0000 7f7e1c536800 1 -- start start 2024-05-07T13:56:13.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7e17acb640 1 --2- 172.21.15.50:0/1556131458 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7cf0036950 0x7f7cf0038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5639f041a970 tx=0x7f7e0c006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7e1c536800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f0542480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7e1c536800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5639f030ccf0 con 0x5639f0542060 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f0542480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f0542480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46188/0 (socket says 172.21.15.50:46188) 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7e182cc640 1 -- 172.21.15.50:0/709806332 learned_addr learned my addr 172.21.15.50:0/709806332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7e182cc640 1 -- 172.21.15.50:0/709806332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f0542a50 con 0x5639f0542060 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7e182cc640 1 --2- 172.21.15.50:0/709806332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f0542480 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7e0805cfd0 tx=0x7f7e08079510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5195c2cb37f989f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7cf77fe640 1 -- 172.21.15.50:0/709806332 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e080aa020 con 0x5639f0542060 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7cf77fe640 1 -- 172.21.15.50:0/709806332 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0808d3f0 con 0x5639f0542060 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.055+0000 7f7cf77fe640 1 -- 172.21.15.50:0/709806332 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08096400 con 0x5639f0542060 2024-05-07T13:56:13.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 -- 172.21.15.50:0/709806332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 msgr2=0x5639f0542480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 --2- 172.21.15.50:0/709806332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f0542480 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7e0805cfd0 tx=0x7f7e08079510 comp rx=0 tx=0).stop 2024-05-07T13:56:13.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 -- 172.21.15.50:0/709806332 shutdown_connections 2024-05-07T13:56:13.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 --2- 172.21.15.50:0/709806332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f0542480 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 -- 172.21.15.50:0/709806332 >> 172.21.15.50:0/709806332 conn(0x5639f053e3c0 msgr2=0x5639f053c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 -- 172.21.15.50:0/709806332 shutdown_connections 2024-05-07T13:56:13.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 -- 172.21.15.50:0/709806332 wait complete. 2024-05-07T13:56:13.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 Processor -- start 2024-05-07T13:56:13.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 -- start start 2024-05-07T13:56:13.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f05492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.056+0000 7f7e1c536800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5639f0542f80 con 0x5639f0542060 2024-05-07T13:56:13.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f05492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7e182cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f05492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46192/0 (socket says 172.21.15.50:46192) 2024-05-07T13:56:13.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 learned_addr learned my addr 172.21.15.50:0/297563257 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f0549810 con 0x5639f0542060 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7e182cc640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f05492d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7e08044990 tx=0x7f7e0805af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7cf5ffb640 1 -- 172.21.15.50:0/297563257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e0808a8d0 con 0x5639f0542060 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7cf5ffb640 1 -- 172.21.15.50:0/297563257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0808aa70 con 0x5639f0542060 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f0549810 con 0x5639f0542060 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7cf5ffb640 1 -- 172.21.15.50:0/297563257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e0808a390 con 0x5639f0542060 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.057+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f0549810 con 0x5639f0542060 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.058+0000 7f7cf5ffb640 1 -- 172.21.15.50:0/297563257 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e080ad020 con 0x5639f0542060 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.058+0000 7f7cf5ffb640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7ce8036950 0x7f7ce8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.058+0000 7f7cf5ffb640 1 -- 172.21.15.50:0/297563257 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7e080b7030 con 0x5639f0542060 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.058+0000 7f7e17acb640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7ce8036950 0x7f7ce8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e1c536800 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f0554800 0x5639f0556cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f0557410 con 0x5639f0554800 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e18acd640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f0554800 0x5639f0556cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e17acb640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7ce8036950 0x7f7ce8038e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5639f0526f70 tx=0x7f7e0c011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e18acd640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f0554800 0x5639f0556cc0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e1c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e1c536800 20 realm 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.059+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f0557820 con 0x5639f0554800 2024-05-07T13:56:13.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f05580f0 con 0x5639f0554800 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0554800 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f0558f80 0x5639f055b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f055bad0 con 0x5639f0558f80 2024-05-07T13:56:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.060+0000 7f7e182cc640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f0558f80 0x5639f055b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.061+0000 7f7e182cc640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f0558f80 0x5639f055b370 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.061+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.061+0000 7f7e1c536800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.061+0000 7f7e1c536800 20 searching for the correct realm 2024-05-07T13:56:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.061+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f055d4b0 con 0x5639f0558f80 2024-05-07T13:56:13.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.061+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.061+0000 7f7e182cc640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7e080af040 0x7f7e0809b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.061+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f055d4b0 con 0x7f7e080af040 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.062+0000 7f7e17acb640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7e080af040 0x7f7e0809b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.062+0000 7f7e17acb640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7e080af040 0x7f7e0809b040 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.062+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.062+0000 7f7e17acb640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7e0c0393c0 0x7f7e0c0397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.062+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f055d4b0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.062+0000 7f7e18acd640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7e0c0393c0 0x7f7e0c0397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.063+0000 7f7e18acd640 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7e0c0393c0 0x7f7e0c0397e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.063+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.063+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0554800 2024-05-07T13:56:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.063+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.063+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0554800 2024-05-07T13:56:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.063+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.063+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e0c0393c0 2024-05-07T13:56:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.064+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.064+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e0c0393c0 2024-05-07T13:56:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.064+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.064+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e080af040 2024-05-07T13:56:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.064+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.064+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0558f80 2024-05-07T13:56:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.064+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.064+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0554800 2024-05-07T13:56:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.065+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.065+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e0c0393c0 2024-05-07T13:56:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.065+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.065+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0554800 2024-05-07T13:56:13.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.065+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.065+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e080af040 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.065+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.065+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0558f80 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.066+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.066+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0558f80 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.066+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.066+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e0c0393c0 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.067+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.067+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0558f80 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.067+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.067+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0558f80 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.067+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.067+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0554800 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.067+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.067+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0554800 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.068+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.068+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e0c0393c0 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.068+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.068+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0558f80 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.068+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.068+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e080af040 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.069+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.069+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0554800 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.069+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.069+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e0c0393c0 2024-05-07T13:56:13.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.069+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.069+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0558f80 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.069+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.069+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e0c0393c0 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.070+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.070+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e080af040 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.070+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.070+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0558f80 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.070+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.070+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e0c0393c0 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x5639f0554800 2024-05-07T13:56:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5639f0558490 con 0x7f7e080af040 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e1c536800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e1c536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e1c536800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e1c536800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e1c536800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e1c536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.071+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f055c480 con 0x5639f0554800 2024-05-07T13:56:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f055c870 con 0x5639f0554800 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f055c870 con 0x7f7e0c0393c0 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 20 zone default found 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 4 Realm: () 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 20 zonegroup default 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.072+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f055cc90 con 0x7f7e0c0393c0 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f055cc90 con 0x5639f0558f80 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f055f360 con 0x5639f0558f80 2024-05-07T13:56:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 20 started sync module instance, tier type = 2024-05-07T13:56:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.073+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f055e800 con 0x7f7e080af040 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.074+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.074+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94806845287408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f055e460 con 0x7f7e080af040 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.074+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05601d0 con 0x5639f0554800 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.075+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94806845287408] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.075+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.075+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94806845291808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05605f0 con 0x5639f0554800 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.075+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0560fb0 con 0x5639f0558f80 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.077+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94806845291808] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.077+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.077+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94806845292864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0560560 con 0x5639f0558f80 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.077+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0561e70 con 0x7f7e080af040 2024-05-07T13:56:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.078+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94806845292864] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.078+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.078+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94806845297568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05626c0 con 0x7f7e080af040 2024-05-07T13:56:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.078+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0562f70 con 0x5639f0554800 2024-05-07T13:56:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.079+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.079+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94806845302464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0562b20 con 0x5639f0554800 2024-05-07T13:56:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.079+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94806845297568] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.079+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0563f60 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.080+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.080+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94806845302464] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.080+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94806845301344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0563f20 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.080+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05633d0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.081+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94806845301344] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.081+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.081+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94806845305808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0564430 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.081+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0564df0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94806845305808] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94806845307408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0564df0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e1c536800 20 add_watcher() i=0 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e1c536800 20 add_watcher() i=1 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e1c536800 20 add_watcher() i=2 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e1c536800 20 add_watcher() i=3 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e1c536800 20 add_watcher() i=4 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e1c536800 20 add_watcher() i=5 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.082+0000 7f7e1c536800 20 add_watcher() i=6 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.083+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94806845307408] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.083+0000 7f7e1c536800 20 add_watcher() i=7 2024-05-07T13:56:13.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.083+0000 7f7e1c536800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.083+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f0568210 con 0x5639f0554800 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.084+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.084+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94806845311760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f0565710 con 0x5639f0554800 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.085+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94806845311760] v27'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.085+0000 7f7cce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.085+0000 7f7e1c536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.085+0000 7f7e1c536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.085+0000 7f7e1c536800 5 note: GC not initialized 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.085+0000 7f7ccd7e2640 20 reqs_thread_entry: start 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.085+0000 7f7e1c536800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.085+0000 7f7e1c536800 20 Filter name: none 2024-05-07T13:56:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.085+0000 7f7c3effd640 20 reqs_thread_entry: start 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.086+0000 7f7e1c536800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.086+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5639f059b160 con 0x7f7e080af040 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.086+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.086+0000 7f7e1c536800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.087+0000 7f7cce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.087+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94806845311760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05990e0 con 0x5639f0554800 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.088+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94806845311760] v27'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.088+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94806845287408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05990e0 con 0x7f7e080af040 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.089+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94806845287408] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.089+0000 7f7e1c536800 20 remove_watcher() i=0 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.089+0000 7f7e1c536800 2 removed watcher, disabling cache 2024-05-07T13:56:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.089+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94806845291808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05990e0 con 0x5639f0554800 2024-05-07T13:56:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.090+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94806845291808] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.090+0000 7f7e1c536800 20 remove_watcher() i=1 2024-05-07T13:56:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.090+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94806845292864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f055fd20 con 0x5639f0558f80 2024-05-07T13:56:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.091+0000 7f7e182cc640 1 -- 172.21.15.50:0/297563257 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94806845292864] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e08093020 con 0x5639f0558f80 2024-05-07T13:56:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.091+0000 7f7e1c536800 20 remove_watcher() i=2 2024-05-07T13:56:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.091+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94806845297568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05990e0 con 0x7f7e080af040 2024-05-07T13:56:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.092+0000 7f7e17acb640 1 -- 172.21.15.50:0/297563257 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94806845297568] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c036040 con 0x7f7e080af040 2024-05-07T13:56:13.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.092+0000 7f7e1c536800 20 remove_watcher() i=3 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.092+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94806845302464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05613a0 con 0x5639f0554800 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.093+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94806845302464] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x5639f0554800 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.093+0000 7f7e1c536800 20 remove_watcher() i=4 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.093+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94806845301344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05990e0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.094+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94806845301344] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.094+0000 7f7e1c536800 20 remove_watcher() i=5 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.094+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94806845305808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05613a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.095+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94806845305808] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.095+0000 7f7e1c536800 20 remove_watcher() i=6 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.095+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94806845307408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5639f05990e0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94806845307408] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1000a4a0 con 0x7f7e0c0393c0 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 20 remove_watcher() i=7 2024-05-07T13:56:13.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7e0c0393c0 msgr2=0x7f7e0c0397e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7e0c0393c0 0x7f7e0c0397e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f0554800 msgr2=0x5639f0556cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f0554800 0x5639f0556cc0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7e080af040 msgr2=0x7f7e0809b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7e080af040 0x7f7e0809b040 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f0558f80 msgr2=0x5639f055b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f0558f80 0x5639f055b370 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7ce8036950 msgr2=0x7f7ce8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7ce8036950 0x7f7ce8038e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5639f0526f70 tx=0x7f7e0c011000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 msgr2=0x5639f05492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e1c536800 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f05492d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7e08044990 tx=0x7f7e0805af20 comp rx=0 tx=0).stop 2024-05-07T13:56:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.096+0000 7f7e18acd640 1 -- 172.21.15.50:0/297563257 reap_dead start 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 shutdown_connections 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 --2- 172.21.15.50:0/297563257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0542060 0x5639f05492d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 >> 172.21.15.50:0/297563257 conn(0x5639f053e3c0 msgr2=0x5639f053ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 shutdown_connections 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/297563257 wait complete. 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/1556131458 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7cf0036950 msgr2=0x7f7cf0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1556131458 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7cf0036950 0x7f7cf0038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5639f041a970 tx=0x7f7e0c006000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/1556131458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0534fd0 msgr2=0x5639f05353f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1556131458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0534fd0 0x5639f05353f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7e080066d0 tx=0x7f7e08006ba0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/1556131458 shutdown_connections 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1556131458 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7cf0036950 0x7f7cf0038e10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1556131458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f0534fd0 0x5639f05353f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/1556131458 >> 172.21.15.50:0/1556131458 conn(0x5639f0529070 msgr2=0x5639f0529470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/1556131458 shutdown_connections 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/1556131458 wait complete. 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5639f0523fa0 msgr2=0x5639f0526410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5639f0523fa0 0x5639f0526410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f041e200 msgr2=0x5639f051d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5639f041e200 0x5639f051d580 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f051fed0 msgr2=0x5639f0522360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.097+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5639f051fed0 0x5639f0522360 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.098+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7d00036950 msgr2=0x7f7d00038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.098+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7d00036950 0x7f7d00038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c001e10 tx=0x7f7e0c001390 comp rx=0 tx=0).stop 2024-05-07T13:56:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.098+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 msgr2=0x5639f041b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.098+0000 7f7e1c536800 1 --2- 172.21.15.50:0/1842393345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5639f038e8c0 0x5639f041b590 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7e08052540 tx=0x7f7e08003020 comp rx=0 tx=0).stop 2024-05-07T13:56:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.098+0000 7f7e18acd640 1 -- 172.21.15.50:0/1842393345 reap_dead start 2024-05-07T13:56:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.098+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 shutdown_connections 2024-05-07T13:56:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.098+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 >> 172.21.15.50:0/1842393345 conn(0x5639f0415560 msgr2=0x5639f0506820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.098+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 shutdown_connections 2024-05-07T13:56:13.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.098+0000 7f7e1c536800 1 -- 172.21.15.50:0/1842393345 wait complete. 2024-05-07T13:56:13.110 INFO:teuthology.orchestra.run.smithi050.stdout:{"key":"bucket:myfoo","ver":{"tag":"_MuOOEeb4_VTS_pUP8RpqHGU","ver":2},"mtime":"2024-05-07T13:56:12.795784Z","data":{"bucket":{"name":"myfoo","marker":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","bucket_id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-05-07T13:56:11.609586Z","linked":false,"has_bucket_info":false}} 2024-05-07T13:56:13.110 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_MuOOEeb4_VTS_pUP8RpqHGU', 'ver': 2}, 'mtime': '2024-05-07T13:56:12.795784Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'bucket_id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-05-07T13:56:11.609586Z', 'linked': False, 'has_bucket_info': False}} 2024-05-07T13:56:13.110 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1'] 2024-05-07T13:56:13.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1'] 2024-05-07T13:56:13.111 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:13.161 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:13.161 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.173+0000 7f4f35d36800 1 Processor -- start 2024-05-07T13:56:13.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.173+0000 7f4f35d36800 1 -- start start 2024-05-07T13:56:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.173+0000 7f4f35d36800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55863a5c6b80 0x55863a5c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.173+0000 7f4f35d36800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55863a5ccfc0 con 0x55863a5c94b0 2024-05-07T13:56:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.173+0000 7f4f35d36800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55863a457050 con 0x55863a5c6b80 2024-05-07T13:56:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.174+0000 7f4f31acc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55863a5c6b80 0x55863a5c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.174+0000 7f4f31acc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55863a5c6b80 0x55863a5c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46202/0 (socket says 172.21.15.50:46202) 2024-05-07T13:56:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.174+0000 7f4f31acc640 1 -- 172.21.15.50:0/1155165293 learned_addr learned my addr 172.21.15.50:0/1155165293 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.174+0000 7f4f312cb640 1 --1- 172.21.15.50:0/1155165293 >> v1:172.21.15.22:6789/0 conn(0x55863a5c94b0 0x55863a5cb8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39782/0 (socket says 172.21.15.50:39782) 2024-05-07T13:56:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.174+0000 7f4f31acc640 1 -- 172.21.15.50:0/1155165293 >> v1:172.21.15.22:6789/0 conn(0x55863a5c94b0 legacy=0x55863a5cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.174+0000 7f4f31acc640 1 -- 172.21.15.50:0/1155165293 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863a5ce1a0 con 0x55863a5c6b80 2024-05-07T13:56:13.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f31acc640 1 --2- 172.21.15.50:0/1155165293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a5c8f70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400a520 tx=0x7f4f2401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79279dd1cb37d939 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f30aca640 1 -- 172.21.15.50:0/1155165293 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f24057070 con 0x55863a5c6b80 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f30aca640 1 -- 172.21.15.50:0/1155165293 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f24052570 con 0x55863a5c6b80 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f30aca640 1 -- 172.21.15.50:0/1155165293 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f2404ae60 con 0x55863a5c6b80 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f35d36800 1 -- 172.21.15.50:0/1155165293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 msgr2=0x55863a5c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1155165293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a5c8f70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400a520 tx=0x7f4f2401d010 comp rx=0 tx=0).stop 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f35d36800 1 -- 172.21.15.50:0/1155165293 shutdown_connections 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1155165293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a5c8f70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f35d36800 1 -- 172.21.15.50:0/1155165293 >> 172.21.15.50:0/1155165293 conn(0x55863a5c05d0 msgr2=0x55863a5c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f35d36800 1 -- 172.21.15.50:0/1155165293 shutdown_connections 2024-05-07T13:56:13.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.176+0000 7f4f35d36800 1 -- 172.21.15.50:0/1155165293 wait complete. 2024-05-07T13:56:13.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.192+0000 7f4f35d36800 1 Processor -- start 2024-05-07T13:56:13.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.192+0000 7f4f35d36800 1 -- start start 2024-05-07T13:56:13.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.192+0000 7f4f35d36800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a6b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.192+0000 7f4f35d36800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55863a5111f0 con 0x55863a5c6b80 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.192+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a6b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.192+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a6b77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46208/0 (socket says 172.21.15.50:46208) 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.192+0000 7f4f31acc640 1 -- 172.21.15.50:0/1824785024 learned_addr learned my addr 172.21.15.50:0/1824785024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.193+0000 7f4f31acc640 1 -- 172.21.15.50:0/1824785024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863a6b7da0 con 0x55863a5c6b80 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.193+0000 7f4f31acc640 1 --2- 172.21.15.50:0/1824785024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a6b77d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4f24055040 tx=0x7f4f2404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edc6a795633a6fd server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.193+0000 7f4e1fe07640 1 -- 172.21.15.50:0/1824785024 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f24057040 con 0x55863a5c6b80 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.193+0000 7f4e1fe07640 1 -- 172.21.15.50:0/1824785024 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f24052720 con 0x55863a5c6b80 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.193+0000 7f4e1fe07640 1 -- 172.21.15.50:0/1824785024 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f24052a20 con 0x55863a5c6b80 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 -- 172.21.15.50:0/1824785024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 msgr2=0x55863a6b77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1824785024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a6b77d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4f24055040 tx=0x7f4f2404c000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 -- 172.21.15.50:0/1824785024 shutdown_connections 2024-05-07T13:56:13.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1824785024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a6b77d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 -- 172.21.15.50:0/1824785024 >> 172.21.15.50:0/1824785024 conn(0x55863a5c05d0 msgr2=0x55863a6b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 -- 172.21.15.50:0/1824785024 shutdown_connections 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 -- 172.21.15.50:0/1824785024 wait complete. 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 Processor -- start 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 -- start start 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a5c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.194+0000 7f4f35d36800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55863a5cd430 con 0x55863a5c6b80 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a5c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a5c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46218/0 (socket says 172.21.15.50:46218) 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4f31acc640 1 -- 172.21.15.50:0/1412133052 learned_addr learned my addr 172.21.15.50:0/1412133052 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4f31acc640 1 -- 172.21.15.50:0/1412133052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863a5c4bb0 con 0x55863a5c6b80 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4f31acc640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a5c64c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4f24052540 tx=0x7f4f24003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4e1e604640 1 -- 172.21.15.50:0/1412133052 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f24073070 con 0x55863a5c6b80 2024-05-07T13:56:13.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4e1e604640 1 -- 172.21.15.50:0/1412133052 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2405d440 con 0x55863a5c6b80 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55863a5c4e40 con 0x55863a5c6b80 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4e1e604640 1 -- 172.21.15.50:0/1412133052 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f24057070 con 0x55863a5c6b80 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.195+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863a5c5360 con 0x55863a5c6b80 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.196+0000 7f4e1e604640 1 -- 172.21.15.50:0/1412133052 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4f24076070 con 0x55863a5c6b80 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.196+0000 7f4e1e604640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e18036950 0x7f4e18038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.196+0000 7f4e1e604640 1 -- 172.21.15.50:0/1412133052 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4f2408dc00 con 0x55863a5c6b80 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.196+0000 7f4f312cb640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e18036950 0x7f4e18038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.197+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a5c94b0 0x55863a6c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.197+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a6c8bc0 con 0x55863a5c94b0 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.197+0000 7f4f322cd640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a5c94b0 0x55863a6c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.197+0000 7f4f312cb640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e18036950 0x7f4e18038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000f60 tx=0x7f4f28001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.197+0000 7f4f322cd640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a5c94b0 0x55863a6c8640 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.197+0000 7f4f322cd640 1 -- 172.21.15.50:0/1412133052 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a5c94b0 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.197+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a6c94d0 con 0x55863a5c94b0 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.198+0000 7f4f322cd640 1 -- 172.21.15.50:0/1412133052 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a5c94b0 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.198+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a6caf50 0x55863a6cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.198+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a6cdba0 con 0x55863a6caf50 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.198+0000 7f4f31acc640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a6caf50 0x55863a6cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.198+0000 7f4f31acc640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a6caf50 0x55863a6cd410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.198+0000 7f4f31acc640 1 -- 172.21.15.50:0/1412133052 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f24075030 con 0x55863a6caf50 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.198+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a6c9d50 con 0x55863a5c94b0 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.199+0000 7f4f322cd640 1 -- 172.21.15.50:0/1412133052 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a5c94b0 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.199+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55863a6cf050 0x55863a6d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.199+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a6d1c20 con 0x55863a6cf050 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.199+0000 7f4f312cb640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55863a6cf050 0x55863a6d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.199+0000 7f4f312cb640 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55863a6cf050 0x55863a6d14c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.199+0000 7f4f312cb640 1 -- 172.21.15.50:0/1412133052 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f2800f690 con 0x55863a6cf050 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.200+0000 7f4f35d36800 1 Processor -- start 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.200+0000 7f4f35d36800 1 -- start start 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.200+0000 7f4f35d36800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6e0080 0x55863a6e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.200+0000 7f4f35d36800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55863a5c6a00 con 0x55863a6e0080 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.200+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6e0080 0x55863a6e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.200+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6e0080 0x55863a6e04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46226/0 (socket says 172.21.15.50:46226) 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.200+0000 7f4f31acc640 1 -- 172.21.15.50:0/440413853 learned_addr learned my addr 172.21.15.50:0/440413853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.201+0000 7f4f31acc640 1 -- 172.21.15.50:0/440413853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863a6e09e0 con 0x55863a6e0080 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.201+0000 7f4f31acc640 1 --2- 172.21.15.50:0/440413853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6e0080 0x55863a6e04a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4f240066d0 tx=0x7f4f24076650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.201+0000 7f4e177fe640 1 -- 172.21.15.50:0/440413853 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f2405d720 con 0x55863a6e0080 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.201+0000 7f4e177fe640 1 -- 172.21.15.50:0/440413853 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2405d8c0 con 0x55863a6e0080 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.201+0000 7f4f35d36800 1 -- 172.21.15.50:0/440413853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55863a6e1450 con 0x55863a6e0080 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.201+0000 7f4e177fe640 1 -- 172.21.15.50:0/440413853 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f240773b0 con 0x55863a6e0080 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.201+0000 7f4f35d36800 1 -- 172.21.15.50:0/440413853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863a6e1950 con 0x55863a6e0080 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.202+0000 7f4e177fe640 1 -- 172.21.15.50:0/440413853 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4f24077550 con 0x55863a6e0080 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.202+0000 7f4e177fe640 1 --2- 172.21.15.50:0/440413853 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e0c036900 0x7f4e0c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.202+0000 7f4e177fe640 1 -- 172.21.15.50:0/440413853 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4f2409ba00 con 0x55863a6e0080 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.202+0000 7f4f312cb640 1 --2- 172.21.15.50:0/440413853 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e0c036900 0x7f4e0c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.202+0000 7f4f35d36800 1 Processor -- start 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.202+0000 7f4f35d36800 1 -- start start 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.202+0000 7f4f312cb640 1 --2- 172.21.15.50:0/440413853 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e0c036900 0x7f4e0c038dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55863a5c5880 tx=0x7f4f2800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.202+0000 7f4f35d36800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.202+0000 7f4f35d36800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55863a4b7cf0 con 0x55863a6ed180 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.203+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.203+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6ed5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46236/0 (socket says 172.21.15.50:46236) 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.203+0000 7f4f31acc640 1 -- 172.21.15.50:0/1587350724 learned_addr learned my addr 172.21.15.50:0/1587350724 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.203+0000 7f4f31acc640 1 -- 172.21.15.50:0/1587350724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863a6edb70 con 0x55863a6ed180 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.203+0000 7f4f31acc640 1 --2- 172.21.15.50:0/1587350724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6ed5a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4f2405dd10 tx=0x7f4f24096f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f9896c217757c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.203+0000 7f4e157fa640 1 -- 172.21.15.50:0/1587350724 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f2405cad0 con 0x55863a6ed180 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.203+0000 7f4e157fa640 1 -- 172.21.15.50:0/1587350724 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f240ab070 con 0x55863a6ed180 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.203+0000 7f4e157fa640 1 -- 172.21.15.50:0/1587350724 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f2408a8e0 con 0x55863a6ed180 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 -- 172.21.15.50:0/1587350724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 msgr2=0x55863a6ed5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1587350724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6ed5a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4f2405dd10 tx=0x7f4f24096f60 comp rx=0 tx=0).stop 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 -- 172.21.15.50:0/1587350724 shutdown_connections 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1587350724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6ed5a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 -- 172.21.15.50:0/1587350724 >> 172.21.15.50:0/1587350724 conn(0x55863a6e9490 msgr2=0x55863a6e74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 -- 172.21.15.50:0/1587350724 shutdown_connections 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 -- 172.21.15.50:0/1587350724 wait complete. 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 Processor -- start 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 -- start start 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f35d36800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55863a6ee080 con 0x55863a6ed180 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f31acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46242/0 (socket says 172.21.15.50:46242) 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.204+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 learned_addr learned my addr 172.21.15.50:0/700292267 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.205+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863a6f4910 con 0x55863a6ed180 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.205+0000 7f4f31acc640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6f43d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4f2404b890 tx=0x7f4f2408dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.205+0000 7f4e037fe640 1 -- 172.21.15.50:0/700292267 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f240b9070 con 0x55863a6ed180 2024-05-07T13:56:13.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.205+0000 7f4e037fe640 1 -- 172.21.15.50:0/700292267 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f24083890 con 0x55863a6ed180 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.205+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55863a6f4910 con 0x55863a6ed180 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.205+0000 7f4e037fe640 1 -- 172.21.15.50:0/700292267 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f24079960 con 0x55863a6ed180 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.205+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863a6f4db0 con 0x55863a6ed180 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.206+0000 7f4e037fe640 1 -- 172.21.15.50:0/700292267 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4f240bc070 con 0x55863a6ed180 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.206+0000 7f4e037fe640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4dfc036950 0x7f4dfc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.206+0000 7f4e037fe640 1 -- 172.21.15.50:0/700292267 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4f240a1040 con 0x55863a6ed180 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.206+0000 7f4f312cb640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4dfc036950 0x7f4dfc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.207+0000 7f4f312cb640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4dfc036950 0x7f4dfc038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55863a6d2020 tx=0x7f4f28010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.207+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.207+0000 7f4f35d36800 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a6ff940 0x55863a701e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.207+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a702550 con 0x55863a6ff940 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.207+0000 7f4f322cd640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a6ff940 0x55863a701e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.207+0000 7f4f322cd640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a6ff940 0x55863a701e00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a6ff940 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 20 realm 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a702960 con 0x55863a6ff940 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a6ff940 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a703230 con 0x55863a6ff940 2024-05-07T13:56:13.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a6ff940 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a6ff940 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a6ff940 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a704330 0x55863a706720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.208+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a706d30 con 0x55863a704330 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.209+0000 7f4f31acc640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a704330 0x55863a706720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.209+0000 7f4f31acc640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a704330 0x55863a706720 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.209+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.209+0000 7f4f35d36800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.209+0000 7f4f35d36800 20 searching for the correct realm 2024-05-07T13:56:13.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.209+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a708660 con 0x55863a704330 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.210+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.210+0000 7f4f31acc640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4f240be070 0x7f4f24096850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.210+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a708660 con 0x7f4f240be070 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.210+0000 7f4f312cb640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4f240be070 0x7f4f24096850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.210+0000 7f4f312cb640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4f240be070 0x7f4f24096850 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.210+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.210+0000 7f4f312cb640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4f2800f070 0x7f4f2802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.210+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a708660 con 0x7f4f2800f070 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.211+0000 7f4f322cd640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4f2800f070 0x7f4f2802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.211+0000 7f4f322cd640 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4f2800f070 0x7f4f2802e910 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.211+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x7f4f2800f070 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.211+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a6ff940 2024-05-07T13:56:13.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.211+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a6ff940 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.211+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a6ff940 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.212+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a6ff940 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.212+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f2800f070 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.212+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x7f4f2800f070 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.212+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f2800f070 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.212+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x7f4f2800f070 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.212+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f240be070 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.212+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.212+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a704330 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.212+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.213+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a6ff940 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.213+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a6ff940 2024-05-07T13:56:13.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.213+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f2800f070 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.213+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x7f4f2800f070 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.213+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a6ff940 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.213+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a6ff940 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.213+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f240be070 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.214+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.214+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a704330 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.214+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.214+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a704330 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.214+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.214+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f2800f070 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.214+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x7f4f2800f070 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.214+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a704330 2024-05-07T13:56:13.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.215+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.215+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a704330 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.215+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.215+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a6ff940 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.215+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c00a4a0 con 0x55863a6ff940 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.215+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a6ff940 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.215+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.215+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f2800f070 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.216+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.216+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a704330 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.216+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.216+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f240be070 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.216+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.216+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a6ff940 2024-05-07T13:56:13.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.216+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.217+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f2800f070 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.217+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.217+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a704330 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.217+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.217+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f2800f070 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.218+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.218+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f240be070 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.218+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.218+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a704330 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.218+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.218+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f2800f070 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.218+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.218+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x55863a6ff940 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55863a7035d0 con 0x7f4f240be070 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a7075f0 con 0x55863a6ff940 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.219+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a7079e0 con 0x55863a6ff940 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a7079e0 con 0x7f4f2800f070 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 20 zone default found 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 4 Realm: () 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:13.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 20 zonegroup default 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a708ae0 con 0x7f4f2800f070 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.220+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a70a4c0 con 0x55863a704330 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.221+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.221+0000 7f4f35d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.221+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.221+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a70a860 con 0x55863a704330 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.221+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.221+0000 7f4f35d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.221+0000 7f4f35d36800 20 started sync module instance, tier type = 2024-05-07T13:56:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.221+0000 7f4f35d36800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.221+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a709960 con 0x7f4f240be070 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.222+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.222+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94034994435248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70ac00 con 0x7f4f240be070 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.222+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70b490 con 0x55863a6ff940 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.223+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94034994435248] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.223+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.223+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94034994437504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70b8b0 con 0x55863a6ff940 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.223+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70c320 con 0x55863a704330 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.224+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94034994437504] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.225+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.225+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94034994445808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70c710 con 0x55863a704330 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.225+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70d150 con 0x7f4f240be070 2024-05-07T13:56:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.226+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94034994445808] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.226+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.226+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94034994442144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70d9f0 con 0x7f4f240be070 2024-05-07T13:56:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.226+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70e3b0 con 0x55863a6ff940 2024-05-07T13:56:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.227+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94034994442144] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.227+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.227+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94034994454272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70e7d0 con 0x55863a6ff940 2024-05-07T13:56:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.227+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70f190 con 0x7f4f2800f070 2024-05-07T13:56:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.228+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94034994454272] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.228+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.228+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94034994455808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70f190 con 0x7f4f2800f070 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.228+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70fb50 con 0x7f4f2800f070 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.229+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94034994455808] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.229+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.229+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94034994460800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70f190 con 0x7f4f2800f070 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.229+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a710560 con 0x7f4f2800f070 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94034994462896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a710980 con 0x7f4f2800f070 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f35d36800 20 add_watcher() i=0 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f35d36800 20 add_watcher() i=1 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f35d36800 20 add_watcher() i=2 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f35d36800 20 add_watcher() i=3 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f35d36800 20 add_watcher() i=4 2024-05-07T13:56:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f35d36800 20 add_watcher() i=5 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94034994460800] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.230+0000 7f4f35d36800 20 add_watcher() i=6 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.231+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94034994462896] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.231+0000 7f4f35d36800 20 add_watcher() i=7 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.231+0000 7f4f35d36800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.231+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a710980 con 0x55863a6ff940 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.232+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.232+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94034994463952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a7108f0 con 0x55863a6ff940 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94034994463952] v27'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4de37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4f35d36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4f35d36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4f35d36800 5 note: GC not initialized 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4de27fc640 20 reqs_thread_entry: start 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4f35d36800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4f35d36800 20 Filter name: none 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4d57fff640 20 reqs_thread_entry: start 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4f35d36800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.233+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a746ef0 con 0x7f4f2800f070 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a748e70 con 0x7f4f240be070 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 : miss 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.234+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a74a760 con 0x7f4f240be070 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.235+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(64 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.235+0000 7f4f35d36800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.235+0000 7f4f35d36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.235+0000 7f4f35d36800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.235+0000 7f4f35d36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.235+0000 7f4f35d36800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.235+0000 7f4f35d36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.235+0000 7f4f35d36800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.235+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a74ed70 con 0x7f4f240be070 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.236+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 foo.buckets [call] v27'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.236+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a754c70 con 0x7f4f240be070 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(66 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4f35d36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4f35d36800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4f35d36800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4f35d36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1, ofs0, ns] 2024-05-07T13:56:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94034994700336 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a74f1a0 con 0x7f4f240be070 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== watch-notify(notify (1) cookie 94034994435248 notify 115964117011 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55863a74ab50 con 0x7f4f240be070 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4e157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117011 cookie 94034994435248 notifier 4495 bl.length()=752 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4e157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4e157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4e157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4e157fa640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4df4003ea0 con 0x7f4f240be070 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.237+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(67 notify.0 [notify cookie 94034994700336 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.238+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.238+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== watch-notify(notify_complete (2) cookie 94034994700336 notify 115964117011 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55863a749cd0 con 0x7f4f240be070 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.238+0000 7f4f35d36800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_sources= new_sources= 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.238+0000 7f4f35d36800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential sources added=[] removed=[] 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.238+0000 7f4f35d36800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_dests= new_dests= 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.238+0000 7f4f35d36800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential dests added=[] removed=[] 2024-05-07T13:56:13.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.238+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a74a030 con 0x7f4f2800f070 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.239+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 fud.buckets [call] v27'3 uv3 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.239+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a74a030 con 0x7f4f240be070 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.240+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.240+0000 7f4f35d36800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.240+0000 7f4f35d36800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.240+0000 7f4f35d36800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.240+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94034994700336 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55863a753940 con 0x7f4f2800f070 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.241+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== watch-notify(notify (1) cookie 94034994460800 notify 115964116995 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f4f2c0279e0 con 0x7f4f2800f070 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.241+0000 7f4e14ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94034994460800 notifier 4495 bl.length()=314 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.241+0000 7f4e14ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.241+0000 7f4e14ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.241+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(71 notify.6 [notify cookie 94034994700336 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.241+0000 7f4e14ff9640 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4d64003430 con 0x7f4f2800f070 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.241+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.241+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== watch-notify(notify_complete (2) cookie 94034994700336 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4f2c027c80 con 0x7f4f2800f070 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.242+0000 7f4de37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.242+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94034994463952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a74a030 con 0x55863a6ff940 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.243+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94034994463952] v27'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.243+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94034994435248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a7104d0 con 0x7f4f240be070 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.244+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94034994435248] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.244+0000 7f4f35d36800 20 remove_watcher() i=0 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.244+0000 7f4f35d36800 2 removed watcher, disabling cache 2024-05-07T13:56:13.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.244+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94034994437504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a7104d0 con 0x55863a6ff940 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.245+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94034994437504] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.245+0000 7f4f35d36800 20 remove_watcher() i=1 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.245+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94034994445808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a7104d0 con 0x55863a704330 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.246+0000 7f4f31acc640 1 -- 172.21.15.50:0/700292267 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94034994445808] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f240c5070 con 0x55863a704330 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.246+0000 7f4f35d36800 20 remove_watcher() i=2 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.246+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94034994442144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a7094b0 con 0x7f4f240be070 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.247+0000 7f4f312cb640 1 -- 172.21.15.50:0/700292267 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94034994442144] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f28037040 con 0x7f4f240be070 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.247+0000 7f4f35d36800 20 remove_watcher() i=3 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.247+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94034994454272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70afa0 con 0x55863a6ff940 2024-05-07T13:56:13.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.248+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94034994454272] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x55863a6ff940 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.248+0000 7f4f35d36800 20 remove_watcher() i=4 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.248+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94034994455808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70afa0 con 0x7f4f2800f070 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.249+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94034994455808] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.249+0000 7f4f35d36800 20 remove_watcher() i=5 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.249+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94034994460800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70e500 con 0x7f4f2800f070 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.250+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94034994460800] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.250+0000 7f4f35d36800 20 remove_watcher() i=6 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.250+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94034994462896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55863a70afa0 con 0x7f4f2800f070 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.251+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94034994462896] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f2c02f060 con 0x7f4f2800f070 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.251+0000 7f4f35d36800 20 remove_watcher() i=7 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4f2800f070 msgr2=0x7f4f2802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4f2800f070 0x7f4f2802e910 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a6ff940 msgr2=0x55863a701e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a6ff940 0x55863a701e00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4f240be070 msgr2=0x7f4f24096850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4f240be070 0x7f4f24096850 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a704330 msgr2=0x55863a706720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a704330 0x55863a706720 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4dfc036950 msgr2=0x7f4dfc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4dfc036950 0x7f4dfc038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55863a6d2020 tx=0x7f4f28010000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 msgr2=0x55863a6f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/700292267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6ed180 0x55863a6f43d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4f2404b890 tx=0x7f4f2408dad0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 reap_dead start 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f322cd640 1 -- 172.21.15.50:0/700292267 reap_dead start 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 shutdown_connections 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 >> 172.21.15.50:0/700292267 conn(0x55863a6e9490 msgr2=0x55863a6e6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 shutdown_connections 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/700292267 wait complete. 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/440413853 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e0c036900 msgr2=0x7f4e0c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/440413853 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e0c036900 0x7f4e0c038dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55863a5c5880 tx=0x7f4f2800f000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/440413853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6e0080 msgr2=0x55863a6e04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/440413853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6e0080 0x55863a6e04a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4f240066d0 tx=0x7f4f24076650 comp rx=0 tx=0).stop 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/440413853 shutdown_connections 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/440413853 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e0c036900 0x7f4e0c038dc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 --2- 172.21.15.50:0/440413853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a6e0080 0x55863a6e04a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/440413853 >> 172.21.15.50:0/440413853 conn(0x55863a6d4120 msgr2=0x55863a6d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/440413853 shutdown_connections 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.252+0000 7f4f35d36800 1 -- 172.21.15.50:0/440413853 wait complete. 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55863a6cf050 msgr2=0x55863a6d14c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55863a6cf050 0x55863a6d14c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a5c94b0 msgr2=0x55863a6c8640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55863a5c94b0 0x55863a6c8640 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a6caf50 msgr2=0x55863a6cd410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55863a6caf50 0x55863a6cd410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e18036950 msgr2=0x7f4e18038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4e18036950 0x7f4e18038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000f60 tx=0x7f4f28001370 comp rx=0 tx=0).stop 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 msgr2=0x55863a5c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 --2- 172.21.15.50:0/1412133052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55863a5c6b80 0x55863a5c64c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4f24052540 tx=0x7f4f24003020 comp rx=0 tx=0).stop 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f322cd640 1 -- 172.21.15.50:0/1412133052 reap_dead start 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 shutdown_connections 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 >> 172.21.15.50:0/1412133052 conn(0x55863a5c05d0 msgr2=0x55863a6b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 shutdown_connections 2024-05-07T13:56:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.253+0000 7f4f35d36800 1 -- 172.21.15.50:0/1412133052 wait complete. 2024-05-07T13:56:13.251 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-07T13:56:13.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-07T13:56:13.252 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-07T13:56:13.297 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:13.297 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.309+0000 7f5851c3e800 1 Processor -- start 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.309+0000 7f5851c3e800 1 -- start start 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.310+0000 7f5851c3e800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561403c3b010 0x561403ccac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.310+0000 7f5851c3e800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561403ccef50 con 0x561403ccb200 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.310+0000 7f5851c3e800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x561403b59050 con 0x561403c3b010 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.310+0000 7f584c8d5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561403c3b010 0x561403ccac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.310+0000 7f584c0d4640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x561403ccb200 0x561403ccd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39788/0 (socket says 172.21.15.50:39788) 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.310+0000 7f584c8d5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561403c3b010 0x561403ccac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46248/0 (socket says 172.21.15.50:46248) 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.310+0000 7f584c0d4640 1 -- 172.21.15.50:0/1792242782 learned_addr learned my addr 172.21.15.50:0/1792242782 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.310+0000 7f584c8d5640 1 -- 172.21.15.50:0/1792242782 >> v1:172.21.15.22:6789/0 conn(0x561403ccb200 legacy=0x561403ccd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.310+0000 7f584c8d5640 1 -- 172.21.15.50:0/1792242782 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561403cd0180 con 0x561403c3b010 2024-05-07T13:56:13.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.312+0000 7f584c8d5640 1 --2- 172.21.15.50:0/1792242782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403ccac90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f583c00a470 tx=0x7f583c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18717b4a22e51dc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.312+0000 7f584b8d3640 1 -- 172.21.15.50:0/1792242782 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c057070 con 0x561403c3b010 2024-05-07T13:56:13.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.312+0000 7f584b8d3640 1 -- 172.21.15.50:0/1792242782 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c052570 con 0x561403c3b010 2024-05-07T13:56:13.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.312+0000 7f584b8d3640 1 -- 172.21.15.50:0/1792242782 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c052870 con 0x561403c3b010 2024-05-07T13:56:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.313+0000 7f5851c3e800 1 -- 172.21.15.50:0/1792242782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 msgr2=0x561403ccac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.313+0000 7f5851c3e800 1 --2- 172.21.15.50:0/1792242782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403ccac90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f583c00a470 tx=0x7f583c01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.313+0000 7f5851c3e800 1 -- 172.21.15.50:0/1792242782 shutdown_connections 2024-05-07T13:56:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.313+0000 7f5851c3e800 1 --2- 172.21.15.50:0/1792242782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403ccac90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.313+0000 7f5851c3e800 1 -- 172.21.15.50:0/1792242782 >> 172.21.15.50:0/1792242782 conn(0x561403cc25b0 msgr2=0x561403cc49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.313+0000 7f5851c3e800 1 -- 172.21.15.50:0/1792242782 shutdown_connections 2024-05-07T13:56:13.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.313+0000 7f5851c3e800 1 -- 172.21.15.50:0/1792242782 wait complete. 2024-05-07T13:56:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.327+0000 7f5851c3e800 1 Processor -- start 2024-05-07T13:56:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.327+0000 7f5851c3e800 1 -- start start 2024-05-07T13:56:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.328+0000 7f5851c3e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403cc85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.328+0000 7f5851c3e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561403c131d0 con 0x561403c3b010 2024-05-07T13:56:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.328+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403cc85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.328+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403cc85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46262/0 (socket says 172.21.15.50:46262) 2024-05-07T13:56:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.328+0000 7f584c8d5640 1 -- 172.21.15.50:0/453550193 learned_addr learned my addr 172.21.15.50:0/453550193 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.328+0000 7f584c8d5640 1 -- 172.21.15.50:0/453550193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561403cc6b80 con 0x561403c3b010 2024-05-07T13:56:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.328+0000 7f584c8d5640 1 --2- 172.21.15.50:0/453550193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403cc85c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f583c055040 tx=0x7f583c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4146682feab25 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f573ae0d640 1 -- 172.21.15.50:0/453550193 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c057040 con 0x561403c3b010 2024-05-07T13:56:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f573ae0d640 1 -- 172.21.15.50:0/453550193 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c052990 con 0x561403c3b010 2024-05-07T13:56:13.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f573ae0d640 1 -- 172.21.15.50:0/453550193 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c052c70 con 0x561403c3b010 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f5851c3e800 1 -- 172.21.15.50:0/453550193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 msgr2=0x561403cc85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f5851c3e800 1 --2- 172.21.15.50:0/453550193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403cc85c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f583c055040 tx=0x7f583c04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f5851c3e800 1 -- 172.21.15.50:0/453550193 shutdown_connections 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f5851c3e800 1 --2- 172.21.15.50:0/453550193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403cc85c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f5851c3e800 1 -- 172.21.15.50:0/453550193 >> 172.21.15.50:0/453550193 conn(0x561403cc25b0 msgr2=0x561403db5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f5851c3e800 1 -- 172.21.15.50:0/453550193 shutdown_connections 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.329+0000 7f5851c3e800 1 -- 172.21.15.50:0/453550193 wait complete. 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.330+0000 7f5851c3e800 1 Processor -- start 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.330+0000 7f5851c3e800 1 -- start start 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.330+0000 7f5851c3e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403dc33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.330+0000 7f5851c3e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561403ccf3c0 con 0x561403c3b010 2024-05-07T13:56:13.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.330+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403dc33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.330+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403dc33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46276/0 (socket says 172.21.15.50:46276) 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.330+0000 7f584c8d5640 1 -- 172.21.15.50:0/2008665790 learned_addr learned my addr 172.21.15.50:0/2008665790 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.330+0000 7f584c8d5640 1 -- 172.21.15.50:0/2008665790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561403dc38e0 con 0x561403c3b010 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.331+0000 7f584c8d5640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403dc33a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f583c00a470 tx=0x7f583c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.331+0000 7f573960a640 1 -- 172.21.15.50:0/2008665790 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c073070 con 0x561403c3b010 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.331+0000 7f573960a640 1 -- 172.21.15.50:0/2008665790 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c05d650 con 0x561403c3b010 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.331+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561403dc3b70 con 0x561403c3b010 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.331+0000 7f573960a640 1 -- 172.21.15.50:0/2008665790 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c057070 con 0x561403c3b010 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.331+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561403dc6820 con 0x561403c3b010 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.331+0000 7f573960a640 1 -- 172.21.15.50:0/2008665790 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f583c076070 con 0x561403c3b010 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.332+0000 7f573960a640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5734036950 0x7f5734038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.332+0000 7f573960a640 1 -- 172.21.15.50:0/2008665790 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f583c08dfc0 con 0x561403c3b010 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.332+0000 7f584c0d4640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5734036950 0x7f5734038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.332+0000 7f5851c3e800 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403ccb200 0x561403dca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.332+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403dcab20 con 0x561403ccb200 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.332+0000 7f584d0d6640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403ccb200 0x561403dca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.332+0000 7f584c0d4640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5734036950 0x7f5734038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5840000f60 tx=0x7f58400012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.332+0000 7f584d0d6640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403ccb200 0x561403dca5e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.333+0000 7f584d0d6640 1 -- 172.21.15.50:0/2008665790 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f584400a4a0 con 0x561403ccb200 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.333+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403dc7bb0 con 0x561403ccb200 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.333+0000 7f584d0d6640 1 -- 172.21.15.50:0/2008665790 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f584400a4a0 con 0x561403ccb200 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.333+0000 7f5851c3e800 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403dcce10 0x561403dcf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.333+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403dcf8f0 con 0x561403dcce10 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.333+0000 7f584c8d5640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403dcce10 0x561403dcf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.333+0000 7f584c8d5640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403dcce10 0x561403dcf200 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.334+0000 7f584c8d5640 1 -- 172.21.15.50:0/2008665790 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f583c075030 con 0x561403dcce10 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.334+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403dcbdc0 con 0x561403ccb200 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.334+0000 7f584d0d6640 1 -- 172.21.15.50:0/2008665790 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f584400a4a0 con 0x561403ccb200 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.334+0000 7f5851c3e800 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561403dd0da0 0x561403dd31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.334+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403dd3950 con 0x561403dd0da0 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.334+0000 7f584c0d4640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561403dd0da0 0x561403dd31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.335+0000 7f584c0d4640 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561403dd0da0 0x561403dd31f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.335+0000 7f584c0d4640 1 -- 172.21.15.50:0/2008665790 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5840009050 con 0x561403dd0da0 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.335+0000 7f5851c3e800 1 Processor -- start 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.335+0000 7f5851c3e800 1 -- start start 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.335+0000 7f5851c3e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403de1db0 0x561403de21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.335+0000 7f5851c3e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561403bb9cf0 con 0x561403de1db0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403de1db0 0x561403de21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403de1db0 0x561403de21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46290/0 (socket says 172.21.15.50:46290) 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f584c8d5640 1 -- 172.21.15.50:0/265069078 learned_addr learned my addr 172.21.15.50:0/265069078 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f584c8d5640 1 -- 172.21.15.50:0/265069078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561403de2710 con 0x561403de1db0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f584c8d5640 1 --2- 172.21.15.50:0/265069078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403de1db0 0x561403de21d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f583c006e60 tx=0x7f583c006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f57327fc640 1 -- 172.21.15.50:0/265069078 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c076db0 con 0x561403de1db0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f57327fc640 1 -- 172.21.15.50:0/265069078 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c088070 con 0x561403de1db0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f5851c3e800 1 -- 172.21.15.50:0/265069078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561403de3180 con 0x561403de1db0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f57327fc640 1 -- 172.21.15.50:0/265069078 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c05cb90 con 0x561403de1db0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.336+0000 7f5851c3e800 1 -- 172.21.15.50:0/265069078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561403de3680 con 0x561403de1db0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.337+0000 7f57327fc640 1 -- 172.21.15.50:0/265069078 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f583c08a020 con 0x561403de1db0 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.337+0000 7f57327fc640 1 --2- 172.21.15.50:0/265069078 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5724036950 0x7f5724038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.337+0000 7f57327fc640 1 -- 172.21.15.50:0/265069078 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f583c093ce0 con 0x561403de1db0 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.337+0000 7f584c0d4640 1 --2- 172.21.15.50:0/265069078 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5724036950 0x7f5724038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f5851c3e800 1 Processor -- start 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f5851c3e800 1 -- start start 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f584c0d4640 1 --2- 172.21.15.50:0/265069078 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5724036950 0x7f5724038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f584000bf50 tx=0x7f584000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f5851c3e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403def3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f5851c3e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561403cc6e40 con 0x561403deef80 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403def3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403def3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46300/0 (socket says 172.21.15.50:46300) 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f584c8d5640 1 -- 172.21.15.50:0/3382114409 learned_addr learned my addr 172.21.15.50:0/3382114409 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f584c8d5640 1 -- 172.21.15.50:0/3382114409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561403def970 con 0x561403deef80 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.338+0000 7f584c8d5640 1 --2- 172.21.15.50:0/3382114409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403def3a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f583c006b90 tx=0x7f583c079f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90040ab9b2d3f07 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.339+0000 7f5723fff640 1 -- 172.21.15.50:0/3382114409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c05ce60 con 0x561403deef80 2024-05-07T13:56:13.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.339+0000 7f5723fff640 1 -- 172.21.15.50:0/3382114409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c079990 con 0x561403deef80 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.339+0000 7f5723fff640 1 -- 172.21.15.50:0/3382114409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c084410 con 0x561403deef80 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 -- 172.21.15.50:0/3382114409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 msgr2=0x561403def3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 --2- 172.21.15.50:0/3382114409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403def3a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f583c006b90 tx=0x7f583c079f70 comp rx=0 tx=0).stop 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 -- 172.21.15.50:0/3382114409 shutdown_connections 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 --2- 172.21.15.50:0/3382114409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403def3a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 -- 172.21.15.50:0/3382114409 >> 172.21.15.50:0/3382114409 conn(0x561403deb250 msgr2=0x561403de92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 -- 172.21.15.50:0/3382114409 shutdown_connections 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 -- 172.21.15.50:0/3382114409 wait complete. 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 Processor -- start 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 -- start start 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403df62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.340+0000 7f5851c3e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561403deffd0 con 0x561403deef80 2024-05-07T13:56:13.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403df62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f584c8d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403df62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46316/0 (socket says 172.21.15.50:46316) 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 learned_addr learned my addr 172.21.15.50:0/433144759 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561403df6800 con 0x561403deef80 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f584c8d5640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403df62c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f583c06e5c0 tx=0x7f583c092000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f57227fc640 1 -- 172.21.15.50:0/433144759 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c0b8070 con 0x561403deef80 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f57227fc640 1 -- 172.21.15.50:0/433144759 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c079160 con 0x561403deef80 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561403df6800 con 0x561403deef80 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f57227fc640 1 -- 172.21.15.50:0/433144759 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583c079440 con 0x561403deef80 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.341+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561403df6800 con 0x561403deef80 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.342+0000 7f57227fc640 1 -- 172.21.15.50:0/433144759 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f583c0bb070 con 0x561403deef80 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.342+0000 7f57227fc640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f57180368b0 0x7f5718038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.342+0000 7f57227fc640 1 -- 172.21.15.50:0/433144759 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f583c0b0070 con 0x561403deef80 2024-05-07T13:56:13.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.342+0000 7f584c0d4640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f57180368b0 0x7f5718038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.343+0000 7f584c0d4640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f57180368b0 0x7f5718038d70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5840001b60 tx=0x7f5840010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.343+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.343+0000 7f5851c3e800 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403e01a40 0x561403e03f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.343+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e04650 con 0x561403e01a40 2024-05-07T13:56:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.343+0000 7f584d0d6640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403e01a40 0x561403e03f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.343+0000 7f584d0d6640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403e01a40 0x561403e03f00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f584400a4a0 con 0x561403e01a40 2024-05-07T13:56:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 20 realm 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e04a60 con 0x561403e01a40 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f584400a4a0 con 0x561403e01a40 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e05330 con 0x561403e01a40 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f584400a4a0 con 0x561403e01a40 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e01a40 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f584400a4a0 con 0x561403e01a40 2024-05-07T13:56:13.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403e06430 0x561403e08820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.344+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e08e30 con 0x561403e06430 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.345+0000 7f584c8d5640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403e06430 0x561403e08820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.345+0000 7f584c8d5640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403e06430 0x561403e08820 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.345+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.345+0000 7f5851c3e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.345+0000 7f5851c3e800 20 searching for the correct realm 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.345+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e0a760 con 0x561403e06430 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.346+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.346+0000 7f584c8d5640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f583c0bd060 0x7f583c0507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.346+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e0a760 con 0x7f583c0bd060 2024-05-07T13:56:13.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.346+0000 7f584c0d4640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f583c0bd060 0x7f583c0507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.346+0000 7f584c0d4640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f583c0bd060 0x7f583c0507c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.346+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5840009050 con 0x7f583c0bd060 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.346+0000 7f584c0d4640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5840038040 0x7f584001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.346+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e0a760 con 0x7f5840038040 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.347+0000 7f584d0d6640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5840038040 0x7f584001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.347+0000 7f584d0d6640 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5840038040 0x7f584001bab0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.347+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584400a4a0 con 0x7f5840038040 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.347+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e01a40 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.347+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584400a4a0 con 0x561403e01a40 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.347+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e01a40 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.348+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584400a4a0 con 0x561403e01a40 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.348+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f5840038040 2024-05-07T13:56:13.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.348+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584400a4a0 con 0x7f5840038040 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.348+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f5840038040 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.348+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f584400a4a0 con 0x7f5840038040 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.348+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f583c0bd060 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.348+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5840009050 con 0x7f583c0bd060 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.348+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e06430 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.349+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.349+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e01a40 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.349+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584400a4a0 con 0x561403e01a40 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.349+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f5840038040 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.349+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584400a4a0 con 0x7f5840038040 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.349+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e01a40 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.350+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584400a4a0 con 0x561403e01a40 2024-05-07T13:56:13.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.350+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f583c0bd060 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.350+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5840009050 con 0x7f583c0bd060 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.350+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e06430 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.350+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.350+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e06430 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.350+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.350+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f5840038040 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.351+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584400a4a0 con 0x7f5840038040 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.351+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e06430 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.351+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.351+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e06430 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.351+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.351+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e01a40 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.351+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584400a4a0 con 0x561403e01a40 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.351+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e01a40 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.352+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.352+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f5840038040 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.352+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.352+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e06430 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.352+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.352+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f583c0bd060 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.353+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5840009050 con 0x7f583c0bd060 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.353+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e01a40 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.353+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.353+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f5840038040 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.353+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.353+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e06430 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.354+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.354+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f5840038040 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.354+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.354+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f583c0bd060 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.354+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5840009050 con 0x7f583c0bd060 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.354+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e06430 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.354+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.354+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f5840038040 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x561403e01a40 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561403e056d0 con 0x7f583c0bd060 2024-05-07T13:56:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e096f0 con 0x561403e01a40 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.355+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e09ae0 con 0x561403e01a40 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e09ae0 con 0x7f5840038040 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 20 zone default found 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 4 Realm: () 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 20 zonegroup default 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e09270 con 0x7f5840038040 2024-05-07T13:56:13.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.356+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e09270 con 0x561403e06430 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.357+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.357+0000 7f5851c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.357+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.357+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e0c710 con 0x561403e06430 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.357+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.357+0000 7f5851c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.357+0000 7f5851c3e800 20 started sync module instance, tier type = 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.357+0000 7f5851c3e800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.357+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0ba60 con 0x7f583c0bd060 2024-05-07T13:56:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.358+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.358+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94643964395136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0b6c0 con 0x7f583c0bd060 2024-05-07T13:56:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.358+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0d640 con 0x561403e01a40 2024-05-07T13:56:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.359+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94643964395136] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.359+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.359+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94643964400016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0da60 con 0x561403e01a40 2024-05-07T13:56:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.359+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0e460 con 0x561403e06430 2024-05-07T13:56:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.360+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94643964400016] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.360+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.360+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94643964401072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0d9d0 con 0x561403e06430 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.360+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0f320 con 0x7f583c0bd060 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.361+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94643964401072] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.361+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.361+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94643964405840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0fbc0 con 0x7f583c0bd060 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.361+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e10580 con 0x561403e01a40 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.362+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94643964405840] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.363+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.363+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94643964412112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e109a0 con 0x561403e01a40 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.363+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e11360 con 0x7f5840038040 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.364+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94643964412112] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.364+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.364+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94643964413648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e11360 con 0x7f5840038040 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.364+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e11d20 con 0x7f5840038040 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.365+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.365+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94643964418160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e12140 con 0x7f5840038040 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.365+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e12c60 con 0x7f5840038040 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.365+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94643964413648] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94643964418160] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94643964421936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e12c20 con 0x7f5840038040 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f5851c3e800 20 add_watcher() i=0 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f5851c3e800 20 add_watcher() i=1 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f5851c3e800 20 add_watcher() i=2 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f5851c3e800 20 add_watcher() i=3 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f5851c3e800 20 add_watcher() i=4 2024-05-07T13:56:13.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f5851c3e800 20 add_watcher() i=5 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.366+0000 7f5851c3e800 20 add_watcher() i=6 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.367+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94643964421936] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.367+0000 7f5851c3e800 20 add_watcher() i=7 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.367+0000 7f5851c3e800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.367+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e11cc0 con 0x561403e01a40 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.367+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.367+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94643964415664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e11cc0 con 0x561403e01a40 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.368+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94643964415664] v27'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.368+0000 7f57037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.368+0000 7f5851c3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.368+0000 7f5851c3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:13.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.368+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1e4d0 con 0x561403e01a40 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.370+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.370+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1eba0 con 0x7f5840038040 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.371+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.371+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1efc0 con 0x561403e06430 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.372+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.372+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1f030 con 0x561403e01a40 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.373+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'113 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.373+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1f5a0 con 0x7f583c0bd060 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.374+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.374+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1ffc0 con 0x561403e06430 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.375+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.375+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1ffc0 con 0x561403e01a40 2024-05-07T13:56:13.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.376+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.376+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1ffc0 con 0x7f5840038040 2024-05-07T13:56:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.377+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.377+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1ffc0 con 0x7f583c0bd060 2024-05-07T13:56:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.378+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.378+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20530 con 0x561403e06430 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.379+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.379+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20530 con 0x7f583c0bd060 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.380+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.380+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20aa0 con 0x7f5840038040 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.381+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.381+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20aa0 con 0x7f583c0bd060 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.382+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.382+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20cd0 con 0x7f5840038040 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.383+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.383+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20cd0 con 0x561403e01a40 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.384+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.384+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e06430 2024-05-07T13:56:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.385+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.385+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x7f583c0bd060 2024-05-07T13:56:13.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.386+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.386+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e06430 2024-05-07T13:56:13.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.387+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.387+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e01a40 2024-05-07T13:56:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.388+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.389+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e01a40 2024-05-07T13:56:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.389+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.389+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e06430 2024-05-07T13:56:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.390+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.390+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x7f583c0bd060 2024-05-07T13:56:13.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.391+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.391+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e06430 2024-05-07T13:56:13.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.392+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.392+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e06430 2024-05-07T13:56:13.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.393+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.393+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e06430 2024-05-07T13:56:13.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.394+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.394+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e06430 2024-05-07T13:56:13.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.395+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.395+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x7f5840038040 2024-05-07T13:56:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.397+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.397+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e06430 2024-05-07T13:56:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.398+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.398+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x7f5840038040 2024-05-07T13:56:13.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.399+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.399+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x561403e06430 2024-05-07T13:56:13.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.400+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.400+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x7f5840038040 2024-05-07T13:56:13.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.401+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.401+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e20c40 con 0x7f583c0bd060 2024-05-07T13:56:13.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.402+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.402+0000 7f57027e4640 20 reqs_thread_entry: start 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.402+0000 7f5851c3e800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.402+0000 7f5851c3e800 20 Filter name: none 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.402+0000 7f56fb7fe640 20 reqs_thread_entry: start 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.402+0000 7f5851c3e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.402+0000 7f5851c3e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.402+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e4bc50 con 0x7f5840038040 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.403+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.403+0000 7f5851c3e800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.403+0000 7f5851c3e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.403+0000 7f5851c3e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.403+0000 7f5851c3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:13.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.403+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561403e4e580 con 0x7f5840038040 2024-05-07T13:56:13.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.403+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv3 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.393 INFO:teuthology.orchestra.run.smithi050.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-07T13:56:13.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.404+0000 7f57037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.404+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94643964415664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e1d320 con 0x561403e01a40 2024-05-07T13:56:13.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.405+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94643964415664] v27'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.405+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94643964395136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e10eb0 con 0x7f583c0bd060 2024-05-07T13:56:13.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.406+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94643964395136] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.406+0000 7f5851c3e800 20 remove_watcher() i=0 2024-05-07T13:56:13.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.406+0000 7f5851c3e800 2 removed watcher, disabling cache 2024-05-07T13:56:13.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.406+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94643964400016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e10eb0 con 0x561403e01a40 2024-05-07T13:56:13.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.408+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94643964400016] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.408+0000 7f5851c3e800 20 remove_watcher() i=1 2024-05-07T13:56:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.408+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94643964401072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0d190 con 0x561403e06430 2024-05-07T13:56:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.409+0000 7f584c8d5640 1 -- 172.21.15.50:0/433144759 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94643964401072] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583c0ba030 con 0x561403e06430 2024-05-07T13:56:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.409+0000 7f5851c3e800 20 remove_watcher() i=2 2024-05-07T13:56:13.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.409+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94643964405840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e10eb0 con 0x7f583c0bd060 2024-05-07T13:56:13.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.410+0000 7f584c0d4640 1 -- 172.21.15.50:0/433144759 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94643964405840] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5840045040 con 0x7f583c0bd060 2024-05-07T13:56:13.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.410+0000 7f5851c3e800 20 remove_watcher() i=3 2024-05-07T13:56:13.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.410+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94643964412112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e0e850 con 0x561403e01a40 2024-05-07T13:56:13.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.411+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94643964412112] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x561403e01a40 2024-05-07T13:56:13.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.411+0000 7f5851c3e800 20 remove_watcher() i=4 2024-05-07T13:56:13.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.411+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94643964413648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e10eb0 con 0x7f5840038040 2024-05-07T13:56:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.412+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94643964413648] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.412+0000 7f5851c3e800 20 remove_watcher() i=5 2024-05-07T13:56:13.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.412+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94643964418160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e100d0 con 0x7f5840038040 2024-05-07T13:56:13.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.413+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94643964418160] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.413+0000 7f5851c3e800 20 remove_watcher() i=6 2024-05-07T13:56:13.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.413+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94643964421936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561403e106d0 con 0x7f5840038040 2024-05-07T13:56:13.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94643964421936] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f584402f060 con 0x7f5840038040 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 20 remove_watcher() i=7 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5840038040 msgr2=0x7f584001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5840038040 0x7f584001bab0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403e01a40 msgr2=0x561403e03f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403e01a40 0x561403e03f00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f583c0bd060 msgr2=0x7f583c0507c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f583c0bd060 0x7f583c0507c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403e06430 msgr2=0x561403e08820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403e06430 0x561403e08820 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f57180368b0 msgr2=0x7f5718038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f57180368b0 0x7f5718038d70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5840001b60 tx=0x7f5840010000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f584d0d6640 1 -- 172.21.15.50:0/433144759 reap_dead start 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.414+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 msgr2=0x561403df62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403df62c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f583c06e5c0 tx=0x7f583c092000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 shutdown_connections 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 --2- 172.21.15.50:0/433144759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403deef80 0x561403df62c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 >> 172.21.15.50:0/433144759 conn(0x561403deb250 msgr2=0x561403de88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 shutdown_connections 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/433144759 wait complete. 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/265069078 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5724036950 msgr2=0x7f5724038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 --2- 172.21.15.50:0/265069078 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5724036950 0x7f5724038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f584000bf50 tx=0x7f584000f000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/265069078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403de1db0 msgr2=0x561403de21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 --2- 172.21.15.50:0/265069078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403de1db0 0x561403de21d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f583c006e60 tx=0x7f583c006650 comp rx=0 tx=0).stop 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/265069078 shutdown_connections 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 --2- 172.21.15.50:0/265069078 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5724036950 0x7f5724038e10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 --2- 172.21.15.50:0/265069078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403de1db0 0x561403de21d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/265069078 >> 172.21.15.50:0/265069078 conn(0x561403dd5e50 msgr2=0x561403dd6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/265069078 shutdown_connections 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/265069078 wait complete. 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561403dd0da0 msgr2=0x561403dd31f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561403dd0da0 0x561403dd31f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.415+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403ccb200 msgr2=0x561403dca5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561403ccb200 0x561403dca5e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403dcce10 msgr2=0x561403dcf200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561403dcce10 0x561403dcf200 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5734036950 msgr2=0x7f5734038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5734036950 0x7f5734038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5840000f60 tx=0x7f58400012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 msgr2=0x561403dc33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 --2- 172.21.15.50:0/2008665790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561403c3b010 0x561403dc33a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f583c00a470 tx=0x7f583c003020 comp rx=0 tx=0).stop 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f584d0d6640 1 -- 172.21.15.50:0/2008665790 reap_dead start 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 shutdown_connections 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 >> 172.21.15.50:0/2008665790 conn(0x561403cc25b0 msgr2=0x561403cc73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 shutdown_connections 2024-05-07T13:56:13.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.416+0000 7f5851c3e800 1 -- 172.21.15.50:0/2008665790 wait complete. 2024-05-07T13:56:13.413 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-07T13:56:13.414 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-07T13:56:13.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-07T13:56:13.414 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-05-07T13:56:13.461 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:13.462 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:13.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.474+0000 7f6f5c5a2800 1 Processor -- start 2024-05-07T13:56:13.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.474+0000 7f6f5c5a2800 1 -- start start 2024-05-07T13:56:13.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.474+0000 7f6f5c5a2800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562034a17150 0x562034a17570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.474+0000 7f6f5c5a2800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562034a17bf0 con 0x562034a18360 2024-05-07T13:56:13.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.474+0000 7f6f5c5a2800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5620348a8050 con 0x562034a17150 2024-05-07T13:56:13.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.474+0000 7f6f5a0a1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562034a17150 0x562034a17570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.474+0000 7f6f598a0640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x562034a18360 0x562034a187e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39790/0 (socket says 172.21.15.50:39790) 2024-05-07T13:56:13.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.474+0000 7f6f598a0640 1 -- 172.21.15.50:0/975106854 learned_addr learned my addr 172.21.15.50:0/975106854 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:13.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.475+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/975106854 >> v1:172.21.15.22:6789/0 conn(0x562034a18360 legacy=0x562034a187e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.475+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/975106854 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562034a18f20 con 0x562034a17150 2024-05-07T13:56:13.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.476+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/975106854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x562034a17570 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00a470 tx=0x7f6f4c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d36a41ac7de6ff server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5909f640 1 -- 172.21.15.50:0/975106854 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c057070 con 0x562034a17150 2024-05-07T13:56:13.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5909f640 1 -- 172.21.15.50:0/975106854 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c04adc0 con 0x562034a17150 2024-05-07T13:56:13.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5909f640 1 -- 172.21.15.50:0/975106854 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c052590 con 0x562034a17150 2024-05-07T13:56:13.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/975106854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 msgr2=0x562034a17570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/975106854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x562034a17570 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00a470 tx=0x7f6f4c01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:13.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/975106854 shutdown_connections 2024-05-07T13:56:13.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/975106854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x562034a17570 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/975106854 >> 172.21.15.50:0/975106854 conn(0x562034a12790 msgr2=0x562034a14bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/975106854 shutdown_connections 2024-05-07T13:56:13.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.477+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/975106854 wait complete. 2024-05-07T13:56:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.492+0000 7f6f5c5a2800 1 Processor -- start 2024-05-07T13:56:13.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.492+0000 7f6f5c5a2800 1 -- start start 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.492+0000 7f6f5c5a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x56203498c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.492+0000 7f6f5c5a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620349621c0 con 0x562034a17150 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.492+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x56203498c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.492+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x56203498c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46326/0 (socket says 172.21.15.50:46326) 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.492+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/600429301 learned_addr learned my addr 172.21.15.50:0/600429301 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.493+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/600429301 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56203498adc0 con 0x562034a17150 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.493+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/600429301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x56203498c800 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c055040 tx=0x7f6f4c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0745bc00c998e48 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.493+0000 7f6e48608640 1 -- 172.21.15.50:0/600429301 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c057040 con 0x562034a17150 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.493+0000 7f6e48608640 1 -- 172.21.15.50:0/600429301 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c063070 con 0x562034a17150 2024-05-07T13:56:13.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.493+0000 7f6e48608640 1 -- 172.21.15.50:0/600429301 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c05d790 con 0x562034a17150 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/600429301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 msgr2=0x56203498c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/600429301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x56203498c800 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c055040 tx=0x7f6f4c04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/600429301 shutdown_connections 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/600429301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x56203498c800 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/600429301 >> 172.21.15.50:0/600429301 conn(0x562034a12790 msgr2=0x562034b04100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/600429301 shutdown_connections 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/600429301 wait complete. 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 Processor -- start 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 -- start start 2024-05-07T13:56:13.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x562034b12490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.494+0000 7f6f5c5a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562034a20830 con 0x562034a17150 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x562034b12490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x562034b12490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46328/0 (socket says 172.21.15.50:46328) 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/4136553747 learned_addr learned my addr 172.21.15.50:0/4136553747 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/4136553747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562034b129d0 con 0x562034a17150 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x562034b12490 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00a470 tx=0x7f6f4c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6e46e05640 1 -- 172.21.15.50:0/4136553747 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c057050 con 0x562034a17150 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6e46e05640 1 -- 172.21.15.50:0/4136553747 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c05dc90 con 0x562034a17150 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562034b12c60 con 0x562034a17150 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6e46e05640 1 -- 172.21.15.50:0/4136553747 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c052440 con 0x562034a17150 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.495+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562034b15910 con 0x562034a17150 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.496+0000 7f6e46e05640 1 -- 172.21.15.50:0/4136553747 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f4c052670 con 0x562034a17150 2024-05-07T13:56:13.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.496+0000 7f6e46e05640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e40036900 0x7f6e40038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.496+0000 7f6e46e05640 1 -- 172.21.15.50:0/4136553747 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6f4c08dd30 con 0x562034a17150 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.496+0000 7f6f598a0640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e40036900 0x7f6e40038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.497+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034a18360 0x562034b196d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.497+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b19c50 con 0x562034a18360 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.497+0000 7f6f5a8a2640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034a18360 0x562034b196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.497+0000 7f6f598a0640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e40036900 0x7f6e40038dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f50000f60 tx=0x7f6f500012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.497+0000 7f6f5a8a2640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034a18360 0x562034b196d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.497+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/4136553747 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034a18360 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.497+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b16ca0 con 0x562034a18360 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.498+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/4136553747 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034a18360 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.498+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b1bf60 0x562034b1e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.498+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b1ea40 con 0x562034b1bf60 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.498+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b1bf60 0x562034b1e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.498+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b1bf60 0x562034b1e350 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.498+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/4136553747 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b1bf60 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.498+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b1af10 con 0x562034a18360 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.499+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/4136553747 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034a18360 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.499+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562034b1fef0 0x562034b22340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.499+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b22aa0 con 0x562034b1fef0 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.499+0000 7f6f598a0640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562034b1fef0 0x562034b22340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.499+0000 7f6f598a0640 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562034b1fef0 0x562034b22340 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.499+0000 7f6f598a0640 1 -- 172.21.15.50:0/4136553747 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6f50009050 con 0x562034b1fef0 2024-05-07T13:56:13.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.500+0000 7f6f5c5a2800 1 Processor -- start 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.500+0000 7f6f5c5a2800 1 -- start start 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.500+0000 7f6f5c5a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b30f00 0x562034b31320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.500+0000 7f6f5c5a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562034908cf0 con 0x562034b30f00 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.500+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b30f00 0x562034b31320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.500+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b30f00 0x562034b31320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46332/0 (socket says 172.21.15.50:46332) 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.500+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2287238069 learned_addr learned my addr 172.21.15.50:0/2287238069 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.500+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2287238069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562034b31860 con 0x562034b30f00 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.501+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/2287238069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b30f00 0x562034b31320 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c05ce60 tx=0x7f6f4c052c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.501+0000 7f6e3ffff640 1 -- 172.21.15.50:0/2287238069 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c08cbb0 con 0x562034b30f00 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.501+0000 7f6e3ffff640 1 -- 172.21.15.50:0/2287238069 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c08cd50 con 0x562034b30f00 2024-05-07T13:56:13.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.501+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2287238069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562034b322d0 con 0x562034b30f00 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.501+0000 7f6e3ffff640 1 -- 172.21.15.50:0/2287238069 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c0865b0 con 0x562034b30f00 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.501+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2287238069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562034b322d0 con 0x562034b30f00 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.502+0000 7f6e3ffff640 1 -- 172.21.15.50:0/2287238069 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f4c086750 con 0x562034b30f00 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.502+0000 7f6e3ffff640 1 --2- 172.21.15.50:0/2287238069 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e340368b0 0x7f6e34038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.502+0000 7f6e3ffff640 1 -- 172.21.15.50:0/2287238069 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6f4c096a00 con 0x562034b30f00 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.502+0000 7f6f598a0640 1 --2- 172.21.15.50:0/2287238069 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e340368b0 0x7f6e34038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.502+0000 7f6f5c5a2800 1 Processor -- start 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.502+0000 7f6f5c5a2800 1 -- start start 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.502+0000 7f6f598a0640 1 --2- 172.21.15.50:0/2287238069 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e340368b0 0x7f6e34038d70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000bf50 tx=0x7f6f5000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.502+0000 7f6f5c5a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b3e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.502+0000 7f6f5c5a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56203498b080 con 0x562034b3df00 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.503+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b3e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.503+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b3e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46344/0 (socket says 172.21.15.50:46344) 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.503+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/3333495909 learned_addr learned my addr 172.21.15.50:0/3333495909 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.503+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/3333495909 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562034b3e8f0 con 0x562034b3df00 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.503+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/3333495909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b3e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c05ca50 tx=0x7f6f4c071f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66dd1af360b5d4ff server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.503+0000 7f6e3dffb640 1 -- 172.21.15.50:0/3333495909 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c051d60 con 0x562034b3df00 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.503+0000 7f6e3dffb640 1 -- 172.21.15.50:0/3333495909 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c0a5070 con 0x562034b3df00 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.503+0000 7f6e3dffb640 1 -- 172.21.15.50:0/3333495909 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c07cab0 con 0x562034b3df00 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/3333495909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 msgr2=0x562034b3e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/3333495909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b3e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c05ca50 tx=0x7f6f4c071f70 comp rx=0 tx=0).stop 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/3333495909 shutdown_connections 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/3333495909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b3e320 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/3333495909 >> 172.21.15.50:0/3333495909 conn(0x562034b3a1d0 msgr2=0x562034b38230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/3333495909 shutdown_connections 2024-05-07T13:56:13.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/3333495909 wait complete. 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 Processor -- start 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 -- start start 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b45260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5c5a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562034b3ef50 con 0x562034b3df00 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b45260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5a0a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b45260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46354/0 (socket says 172.21.15.50:46354) 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.504+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 learned_addr learned my addr 172.21.15.50:0/2338511331 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.505+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562034b457a0 con 0x562034b3df00 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.505+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b45260 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c05ca50 tx=0x7f6f4c008130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.505+0000 7f6e2bfff640 1 -- 172.21.15.50:0/2338511331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c0af070 con 0x562034b3df00 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.505+0000 7f6e2bfff640 1 -- 172.21.15.50:0/2338511331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c051d60 con 0x562034b3df00 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.505+0000 7f6e2bfff640 1 -- 172.21.15.50:0/2338511331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c06ad80 con 0x562034b3df00 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.505+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562034b457a0 con 0x562034b3df00 2024-05-07T13:56:13.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.505+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562034b457a0 con 0x562034b3df00 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.506+0000 7f6e2bfff640 1 -- 172.21.15.50:0/2338511331 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f4c0ba060 con 0x562034b3df00 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.506+0000 7f6e2bfff640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e24036900 0x7f6e24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.506+0000 7f6e2bfff640 1 -- 172.21.15.50:0/2338511331 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f6f4c0b4c60 con 0x562034b3df00 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.506+0000 7f6f598a0640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e24036900 0x7f6e24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.507+0000 7f6f598a0640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e24036900 0x7f6e24038dc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6f50001b60 tx=0x7f6f50010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.507+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.507+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034b509e0 0x562034b52ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.507+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b535f0 con 0x562034b509e0 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.507+0000 7f6f5a8a2640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034b509e0 0x562034b52ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.507+0000 7f6f5a8a2640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034b509e0 0x562034b52ea0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034b509e0 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 20 realm 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b53a00 con 0x562034b509e0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034b509e0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b542d0 con 0x562034b509e0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034b509e0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b509e0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034b509e0 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b553d0 0x562034b577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.508+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b57dd0 con 0x562034b553d0 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.509+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b553d0 0x562034b577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.509+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b553d0 0x562034b577c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.509+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.509+0000 7f6f5c5a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.509+0000 7f6f5c5a2800 20 searching for the correct realm 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.509+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b59700 con 0x562034b553d0 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.510+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.510+0000 7f6f5a0a1640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f4c0bc070 0x7f6f4c06a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.510+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b59700 con 0x7f6f4c0bc070 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.510+0000 7f6f598a0640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f4c0bc070 0x7f6f4c06a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.510+0000 7f6f598a0640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f4c0bc070 0x7f6f4c06a070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.510+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50009050 con 0x7f6f4c0bc070 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.510+0000 7f6f598a0640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f50038040 0x7f6f5001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.510+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b59700 con 0x7f6f50038040 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.511+0000 7f6f5a8a2640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f50038040 0x7f6f5001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.511+0000 7f6f5a8a2640 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f50038040 0x7f6f5001bab0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.511+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5400a4a0 con 0x7f6f50038040 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.511+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b509e0 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.512+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034b509e0 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.512+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b509e0 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.512+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034b509e0 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.512+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f50038040 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.512+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5400a4a0 con 0x7f6f50038040 2024-05-07T13:56:13.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.512+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f50038040 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.512+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6f5400a4a0 con 0x7f6f50038040 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.512+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f4c0bc070 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.513+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50009050 con 0x7f6f4c0bc070 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.513+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b553d0 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.513+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.513+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b509e0 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.513+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034b509e0 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.513+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f50038040 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.513+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5400a4a0 con 0x7f6f50038040 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.513+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b509e0 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.514+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034b509e0 2024-05-07T13:56:13.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.514+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f4c0bc070 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.514+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6f50009050 con 0x7f6f4c0bc070 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.514+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b553d0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.514+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.514+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b553d0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.514+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.514+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f50038040 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.515+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5400a4a0 con 0x7f6f50038040 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.515+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b553d0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.515+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.515+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b553d0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.515+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.515+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b509e0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.516+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5400a4a0 con 0x562034b509e0 2024-05-07T13:56:13.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.516+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b509e0 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.516+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.516+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f50038040 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.516+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.516+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b553d0 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.517+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.517+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f4c0bc070 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.517+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50009050 con 0x7f6f4c0bc070 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.517+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b509e0 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.517+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.517+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f50038040 2024-05-07T13:56:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.518+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.518+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b553d0 2024-05-07T13:56:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.518+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.518+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f50038040 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.518+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.518+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f4c0bc070 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.518+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50009050 con 0x7f6f4c0bc070 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.518+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b553d0 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.519+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.519+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f50038040 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.519+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.519+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x562034b509e0 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.519+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562034b54670 con 0x7f6f4c0bc070 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:13.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b58690 con 0x562034b509e0 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b58a80 con 0x562034b509e0 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.520+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b58a80 con 0x7f6f50038040 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 20 zone default found 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 4 Realm: () 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 20 zonegroup default 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b59b80 con 0x7f6f50038040 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b5b560 con 0x562034b553d0 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.521+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.522+0000 7f6f5c5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.522+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.522+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b5b900 con 0x562034b553d0 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.522+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.522+0000 7f6f5c5a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.522+0000 7f6f5c5a2800 20 started sync module instance, tier type = 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.522+0000 7f6f5c5a2800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.522+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5aa00 con 0x7f6f4c0bc070 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.523+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.523+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94696323261776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5bca0 con 0x7f6f4c0bc070 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.523+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5c530 con 0x562034b509e0 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.524+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94696323261776] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.524+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.524+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94696323263984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5c920 con 0x562034b509e0 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.524+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5d390 con 0x562034b553d0 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.525+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.525+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94696323272288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5dc30 con 0x562034b553d0 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.525+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5e730 con 0x7f6f4c0bc070 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.525+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94696323263984] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.526+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94696323272288] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.526+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.526+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94696323277344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5eb20 con 0x7f6f4c0bc070 2024-05-07T13:56:13.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.526+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5f3b0 con 0x562034b509e0 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.527+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94696323277344] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.527+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.527+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94696323268672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5f7a0 con 0x562034b509e0 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.527+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b601e0 con 0x7f6f50038040 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.528+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94696323268672] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.529+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.529+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94696323284144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b601a0 con 0x7f6f50038040 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.529+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b60bf0 con 0x7f6f50038040 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.530+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.530+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94696323286848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b61010 con 0x7f6f50038040 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.530+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b61b30 con 0x7f6f50038040 2024-05-07T13:56:13.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.530+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94696323284144] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94696323286848] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94696323290624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b60b60 con 0x7f6f50038040 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5c5a2800 20 add_watcher() i=0 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5c5a2800 20 add_watcher() i=1 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5c5a2800 20 add_watcher() i=2 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5c5a2800 20 add_watcher() i=3 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5c5a2800 20 add_watcher() i=4 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5c5a2800 20 add_watcher() i=5 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.531+0000 7f6f5c5a2800 20 add_watcher() i=6 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.532+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94696323290624] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.532+0000 7f6f5c5a2800 20 add_watcher() i=7 2024-05-07T13:56:13.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.532+0000 7f6f5c5a2800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.532+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b64c30 con 0x562034b509e0 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.532+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.532+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94696323280576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b620b0 con 0x562034b509e0 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.533+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94696323280576] v27'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.533+0000 7f6e10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.533+0000 7f6f5c5a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.533+0000 7f6f5c5a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.533+0000 7f6f5c5a2800 5 note: GC not initialized 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6d8b7fe640 20 reqs_thread_entry: start 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 20 Filter name: none 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6d897fa640 20 reqs_thread_entry: start 2024-05-07T13:56:13.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b97f00 con 0x7f6f50038040 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.534+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b99e80 con 0x7f6f4c0bc070 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:13.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 : miss 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b9bad0 con 0x7f6f4c0bc070 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(64 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:13.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.535+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b9f1f0 con 0x7f6f50038040 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.536+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(65 fud.buckets [call] v27'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.537+0000 7f6f5c5a2800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.537+0000 7f6f5c5a2800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.537+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b9e1e0 con 0x7f6f4c0bc070 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.537+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.537+0000 7f6f5c5a2800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.537+0000 7f6f5c5a2800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.537+0000 7f6f5c5a2800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.537+0000 7f6f5c5a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.537+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034ba2c20 con 0x7f6f4c0bc070 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6f5c5a2800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6f5c5a2800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6f5c5a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94696323557040 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562034b9fa40 con 0x7f6f50038040 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== watch-notify(notify (1) cookie 94696323286848 notify 115964116996 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f6f5401e040 con 0x7f6f50038040 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6e3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94696323286848 notifier 4509 bl.length()=338 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6e3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(68 notify.6 [notify cookie 94696323557040 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6e3dffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.538+0000 7f6e3dffb640 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f6e20003ea0 con 0x7f6f50038040 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.539+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.539+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== watch-notify(notify_complete (2) cookie 94696323557040 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6f54027c70 con 0x7f6f50038040 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.540+0000 7f6e10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.540+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94696323280576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034ba26b0 con 0x562034b509e0 2024-05-07T13:56:13.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.541+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94696323280576] v27'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.541+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94696323261776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034ba26b0 con 0x7f6f4c0bc070 2024-05-07T13:56:13.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.542+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94696323261776] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.542+0000 7f6f5c5a2800 20 remove_watcher() i=0 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.542+0000 7f6f5c5a2800 2 removed watcher, disabling cache 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.542+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94696323263984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034ba26b0 con 0x562034b509e0 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.543+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94696323263984] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.543+0000 7f6f5c5a2800 20 remove_watcher() i=1 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.543+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94696323272288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034ba26b0 con 0x562034b553d0 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.544+0000 7f6f5a0a1640 1 -- 172.21.15.50:0/2338511331 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94696323272288] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4c078070 con 0x562034b553d0 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.544+0000 7f6f5c5a2800 20 remove_watcher() i=2 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.544+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94696323277344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034ba26b0 con 0x7f6f4c0bc070 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.545+0000 7f6f598a0640 1 -- 172.21.15.50:0/2338511331 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94696323277344] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f50045040 con 0x7f6f4c0bc070 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.545+0000 7f6f5c5a2800 20 remove_watcher() i=3 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.545+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94696323268672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034ba26b0 con 0x562034b509e0 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.546+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94696323268672] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x562034b509e0 2024-05-07T13:56:13.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.546+0000 7f6f5c5a2800 20 remove_watcher() i=4 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.546+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94696323284144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5c040 con 0x7f6f50038040 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.547+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94696323284144] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.547+0000 7f6f5c5a2800 20 remove_watcher() i=5 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.547+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94696323286848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034b5fcb0 con 0x7f6f50038040 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.548+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94696323286848] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.548+0000 7f6f5c5a2800 20 remove_watcher() i=6 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.548+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94696323290624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562034ba2bb0 con 0x7f6f50038040 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94696323290624] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5402f060 con 0x7f6f50038040 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5c5a2800 20 remove_watcher() i=7 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f50038040 msgr2=0x7f6f5001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6f50038040 0x7f6f5001bab0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034b509e0 msgr2=0x562034b52ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034b509e0 0x562034b52ea0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f4c0bc070 msgr2=0x7f6f4c06a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6f4c0bc070 0x7f6f4c06a070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b553d0 msgr2=0x562034b577c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.549+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b553d0 0x562034b577c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e24036900 msgr2=0x7f6e24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e24036900 0x7f6e24038dc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6f50001b60 tx=0x7f6f50010000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 msgr2=0x562034b45260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/2338511331 reap_dead start 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b45260 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c05ca50 tx=0x7f6f4c008130 comp rx=0 tx=0).stop 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 shutdown_connections 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2338511331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b3df00 0x562034b45260 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 >> 172.21.15.50:0/2338511331 conn(0x562034b3a1d0 msgr2=0x562034b37830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 shutdown_connections 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2338511331 wait complete. 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2287238069 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e340368b0 msgr2=0x7f6e34038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2287238069 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e340368b0 0x7f6e34038d70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000bf50 tx=0x7f6f5000f000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2287238069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b30f00 msgr2=0x562034b31320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2287238069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b30f00 0x562034b31320 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c05ce60 tx=0x7f6f4c052c50 comp rx=0 tx=0).stop 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2287238069 shutdown_connections 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2287238069 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e340368b0 0x7f6e34038d70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/2287238069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034b30f00 0x562034b31320 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2287238069 >> 172.21.15.50:0/2287238069 conn(0x562034b24fa0 msgr2=0x562034b253a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2287238069 shutdown_connections 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/2287238069 wait complete. 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562034b1fef0 msgr2=0x562034b22340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562034b1fef0 0x562034b22340 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.550+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034a18360 msgr2=0x562034b196d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562034a18360 0x562034b196d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b1bf60 msgr2=0x562034b1e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562034b1bf60 0x562034b1e350 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e40036900 msgr2=0x7f6e40038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6e40036900 0x7f6e40038dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f50000f60 tx=0x7f6f500012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 msgr2=0x562034b12490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 --2- 172.21.15.50:0/4136553747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562034a17150 0x562034b12490 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00a470 tx=0x7f6f4c002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5a8a2640 1 -- 172.21.15.50:0/4136553747 reap_dead start 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 shutdown_connections 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 >> 172.21.15.50:0/4136553747 conn(0x562034a12790 msgr2=0x56203498b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 shutdown_connections 2024-05-07T13:56:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.551+0000 7f6f5c5a2800 1 -- 172.21.15.50:0/4136553747 wait complete. 2024-05-07T13:56:13.552 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1'] 2024-05-07T13:56:13.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1'] 2024-05-07T13:56:13.553 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:13.602 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:13.603 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a16e0f800 1 Processor -- start 2024-05-07T13:56:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a16e0f800 1 -- start start 2024-05-07T13:56:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a16e0f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f71fbfc680 0x55f71fbfea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a16e0f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f71fbfefb0 con 0x55f71fbf8b70 2024-05-07T13:56:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a16e0f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55f71fa89050 con 0x55f71fbfc680 2024-05-07T13:56:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a11d5b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f71fbfc680 0x55f71fbfea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a11d5b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f71fbfc680 0x55f71fbfea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46364/0 (socket says 172.21.15.50:46364) 2024-05-07T13:56:13.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a1255c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55f71fbf8b70 0x55f71fbfaf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:39804/0 (socket says 172.21.15.50:39804) 2024-05-07T13:56:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1373232024 learned_addr learned my addr 172.21.15.50:0/1373232024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1373232024 >> v1:172.21.15.22:6789/0 conn(0x55f71fbf8b70 legacy=0x55f71fbfaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.615+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1373232024 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71fc00190 con 0x55f71fbfc680 2024-05-07T13:56:13.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.617+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1373232024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbfc680 0x55f71fbfea70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800a520 tx=0x7f1a0801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c068eebbd0824a8d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.617+0000 7f1a1155a640 1 -- 172.21.15.50:0/1373232024 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a08057070 con 0x55f71fbfc680 2024-05-07T13:56:13.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.618+0000 7f1a1155a640 1 -- 172.21.15.50:0/1373232024 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a08052570 con 0x55f71fbfc680 2024-05-07T13:56:13.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.618+0000 7f1a1155a640 1 -- 172.21.15.50:0/1373232024 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a0804ae60 con 0x55f71fbfc680 2024-05-07T13:56:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.618+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1373232024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbfc680 msgr2=0x55f71fbfea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.618+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1373232024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbfc680 0x55f71fbfea70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800a520 tx=0x7f1a0801d010 comp rx=0 tx=0).stop 2024-05-07T13:56:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.618+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1373232024 shutdown_connections 2024-05-07T13:56:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.618+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1373232024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbfc680 0x55f71fbfea70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.618+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1373232024 >> 172.21.15.50:0/1373232024 conn(0x55f71fbf25c0 msgr2=0x55f71fbf49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.618+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1373232024 shutdown_connections 2024-05-07T13:56:13.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.618+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1373232024 wait complete. 2024-05-07T13:56:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.633+0000 7f1a16e0f800 1 Processor -- start 2024-05-07T13:56:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.633+0000 7f1a16e0f800 1 -- start start 2024-05-07T13:56:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.633+0000 7f1a16e0f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fce97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.633+0000 7f1a16e0f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f71fb431f0 con 0x55f71fbf8b70 2024-05-07T13:56:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.634+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fce97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.634+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fce97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46378/0 (socket says 172.21.15.50:46378) 2024-05-07T13:56:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.634+0000 7f1a1255c640 1 -- 172.21.15.50:0/927384279 learned_addr learned my addr 172.21.15.50:0/927384279 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.634+0000 7f1a1255c640 1 -- 172.21.15.50:0/927384279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71fce9d80 con 0x55f71fbf8b70 2024-05-07T13:56:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.634+0000 7f1a1255c640 1 --2- 172.21.15.50:0/927384279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fce97b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1a04001e90 tx=0x7f1a0400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff781fe451434e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.634+0000 7f1900608640 1 -- 172.21.15.50:0/927384279 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a0400e5c0 con 0x55f71fbf8b70 2024-05-07T13:56:13.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.634+0000 7f1900608640 1 -- 172.21.15.50:0/927384279 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a04006070 con 0x55f71fbf8b70 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.634+0000 7f1900608640 1 -- 172.21.15.50:0/927384279 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a0400e890 con 0x55f71fbf8b70 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 -- 172.21.15.50:0/927384279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 msgr2=0x55f71fce97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/927384279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fce97b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1a04001e90 tx=0x7f1a0400b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 -- 172.21.15.50:0/927384279 shutdown_connections 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/927384279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fce97b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 -- 172.21.15.50:0/927384279 >> 172.21.15.50:0/927384279 conn(0x55f71fbf25c0 msgr2=0x55f71fce50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 -- 172.21.15.50:0/927384279 shutdown_connections 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 -- 172.21.15.50:0/927384279 wait complete. 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 Processor -- start 2024-05-07T13:56:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 -- start start 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fcf1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.635+0000 7f1a16e0f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f71fbff480 con 0x55f71fbf8b70 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fcf1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fcf1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46394/0 (socket says 172.21.15.50:46394) 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f1a1255c640 1 -- 172.21.15.50:0/1738472077 learned_addr learned my addr 172.21.15.50:0/1738472077 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f1a1255c640 1 -- 172.21.15.50:0/1738472077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71fcf1870 con 0x55f71fbf8b70 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f1a1255c640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fcf1330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1a04001ed0 tx=0x7f1a04000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f18fee05640 1 -- 172.21.15.50:0/1738472077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a0401a880 con 0x55f71fbf8b70 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f18fee05640 1 -- 172.21.15.50:0/1738472077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0401aa20 con 0x55f71fbf8b70 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f71fcf1b00 con 0x55f71fbf8b70 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f18fee05640 1 -- 172.21.15.50:0/1738472077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a0401ad40 con 0x55f71fbf8b70 2024-05-07T13:56:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.636+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f71fcf47b0 con 0x55f71fbf8b70 2024-05-07T13:56:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.637+0000 7f18fee05640 1 -- 172.21.15.50:0/1738472077 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a04017070 con 0x55f71fbf8b70 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.637+0000 7f18fee05640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18f8036950 0x7f18f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.637+0000 7f18fee05640 1 -- 172.21.15.50:0/1738472077 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1a04015020 con 0x55f71fbf8b70 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.638+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18f8036950 0x7f18f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.638+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fbfc680 0x55f71fcf8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.638+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fcf8b00 con 0x55f71fbfc680 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.638+0000 7f1a12d5d640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fbfc680 0x55f71fcf8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.638+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18f8036950 0x7f18f8038e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a08054000 tx=0x7f1a0804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.638+0000 7f1a12d5d640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fbfc680 0x55f71fcf8570 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.638+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1738472077 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fbfc680 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.638+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fcf5b40 con 0x55f71fbfc680 2024-05-07T13:56:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.639+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1738472077 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fbfc680 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.639+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fcfae50 0x55f71fcfd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.639+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fcfd930 con 0x55f71fcfae50 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.639+0000 7f1a1255c640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fcfae50 0x55f71fcfd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.639+0000 7f1a1255c640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fcfae50 0x55f71fcfd240 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.639+0000 7f1a1255c640 1 -- 172.21.15.50:0/1738472077 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1a0402e070 con 0x55f71fcfae50 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.639+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fcf9e00 con 0x55f71fbfc680 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.640+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1738472077 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fbfc680 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.640+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f71fcfede0 0x55f71fd01230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.640+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd01990 con 0x55f71fcfede0 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.640+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f71fcfede0 0x55f71fd01230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.640+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f71fcfede0 0x55f71fd01230 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.641+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1738472077 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1a0805a040 con 0x55f71fcfede0 2024-05-07T13:56:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.641+0000 7f1a16e0f800 1 Processor -- start 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.641+0000 7f1a16e0f800 1 -- start start 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.641+0000 7f1a16e0f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd0fdf0 0x55f71fd10210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.641+0000 7f1a16e0f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f71fae9cf0 con 0x55f71fd0fdf0 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.641+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd0fdf0 0x55f71fd10210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.641+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd0fdf0 0x55f71fd10210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46410/0 (socket says 172.21.15.50:46410) 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.641+0000 7f1a1255c640 1 -- 172.21.15.50:0/671304243 learned_addr learned my addr 172.21.15.50:0/671304243 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.642+0000 7f1a1255c640 1 -- 172.21.15.50:0/671304243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71fd10750 con 0x55f71fd0fdf0 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.642+0000 7f1a1255c640 1 --2- 172.21.15.50:0/671304243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd0fdf0 0x55f71fd10210 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1a0401cfd0 tx=0x7f1a0401b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.642+0000 7f18f7fff640 1 -- 172.21.15.50:0/671304243 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a04017d60 con 0x55f71fd0fdf0 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.642+0000 7f18f7fff640 1 -- 172.21.15.50:0/671304243 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a04046040 con 0x55f71fd0fdf0 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.642+0000 7f18f7fff640 1 -- 172.21.15.50:0/671304243 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a0401d580 con 0x55f71fd0fdf0 2024-05-07T13:56:13.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.642+0000 7f1a16e0f800 1 -- 172.21.15.50:0/671304243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f71fd111c0 con 0x55f71fd0fdf0 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.642+0000 7f1a16e0f800 1 -- 172.21.15.50:0/671304243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f71fd116c0 con 0x55f71fd0fdf0 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.643+0000 7f18f7fff640 1 -- 172.21.15.50:0/671304243 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a0401d720 con 0x55f71fd0fdf0 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.643+0000 7f18f7fff640 1 --2- 172.21.15.50:0/671304243 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18ec036950 0x7f18ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.643+0000 7f18f7fff640 1 -- 172.21.15.50:0/671304243 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1a0403cc90 con 0x55f71fd0fdf0 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.643+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/671304243 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18ec036950 0x7f18ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.643+0000 7f1a16e0f800 1 Processor -- start 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.643+0000 7f1a16e0f800 1 -- start start 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.643+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/671304243 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18ec036950 0x7f18ec038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55f71fcf9400 tx=0x7f1a08005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.643+0000 7f1a16e0f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fd1d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.643+0000 7f1a16e0f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f71fcea100 con 0x55f71fd1cf90 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.644+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fd1d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.644+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fd1d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46412/0 (socket says 172.21.15.50:46412) 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.644+0000 7f1a1255c640 1 -- 172.21.15.50:0/524916666 learned_addr learned my addr 172.21.15.50:0/524916666 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.644+0000 7f1a1255c640 1 -- 172.21.15.50:0/524916666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71fd1d9a0 con 0x55f71fd1cf90 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.644+0000 7f1a1255c640 1 --2- 172.21.15.50:0/524916666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fd1d3b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1a0401dfd0 tx=0x7f1a0403a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5e75fd89b0391f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.644+0000 7f18f5ffb640 1 -- 172.21.15.50:0/524916666 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a0404be60 con 0x55f71fd1cf90 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.644+0000 7f18f5ffb640 1 -- 172.21.15.50:0/524916666 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0404bba0 con 0x55f71fd1cf90 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.644+0000 7f18f5ffb640 1 -- 172.21.15.50:0/524916666 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a04019d20 con 0x55f71fd1cf90 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 -- 172.21.15.50:0/524916666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 msgr2=0x55f71fd1d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/524916666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fd1d3b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1a0401dfd0 tx=0x7f1a0403a3e0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 -- 172.21.15.50:0/524916666 shutdown_connections 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/524916666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fd1d3b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 -- 172.21.15.50:0/524916666 >> 172.21.15.50:0/524916666 conn(0x55f71fd192d0 msgr2=0x55f71fd17330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 -- 172.21.15.50:0/524916666 shutdown_connections 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 -- 172.21.15.50:0/524916666 wait complete. 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 Processor -- start 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 -- start start 2024-05-07T13:56:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fbf83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a16e0f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f71fd1df40 con 0x55f71fd1cf90 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fbf83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a1255c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fbf83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46418/0 (socket says 172.21.15.50:46418) 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.645+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 learned_addr learned my addr 172.21.15.50:0/1633045429 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.646+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71fbf8930 con 0x55f71fd1cf90 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.646+0000 7f1a1255c640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fbf83f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400bc10 tx=0x7f1a04044870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.646+0000 7f18e3fff640 1 -- 172.21.15.50:0/1633045429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a0406f070 con 0x55f71fd1cf90 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.646+0000 7f18e3fff640 1 -- 172.21.15.50:0/1633045429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a04031450 con 0x55f71fd1cf90 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.646+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f71fbf8930 con 0x55f71fd1cf90 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.646+0000 7f18e3fff640 1 -- 172.21.15.50:0/1633045429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a0404be60 con 0x55f71fd1cf90 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.646+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f71fbf8930 con 0x55f71fd1cf90 2024-05-07T13:56:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.647+0000 7f18e3fff640 1 -- 172.21.15.50:0/1633045429 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a04072070 con 0x55f71fd1cf90 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.647+0000 7f18e3fff640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18dc036860 0x7f18dc038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.647+0000 7f18e3fff640 1 -- 172.21.15.50:0/1633045429 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1a04066030 con 0x55f71fd1cf90 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.647+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18dc036860 0x7f18dc038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.647+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18dc036860 0x7f18dc038d20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a08052fd0 tx=0x7f1a0804f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.648+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.648+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fd31b40 0x55f71fd34000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.648+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd34750 con 0x55f71fd31b40 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.648+0000 7f1a12d5d640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fd31b40 0x55f71fd34000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.648+0000 7f1a12d5d640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fd31b40 0x55f71fd34000 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fd31b40 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 20 realm 2024-05-07T13:56:13.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd34b60 con 0x55f71fd31b40 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fd31b40 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd35430 con 0x55f71fd31b40 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fd31b40 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x55f71fd31b40 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fd31b40 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fd36530 0x55f71fd38920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd38f30 con 0x55f71fd36530 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.649+0000 7f1a1255c640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fd36530 0x55f71fd38920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.650+0000 7f1a1255c640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fd36530 0x55f71fd38920 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.650+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.650+0000 7f1a16e0f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.650+0000 7f1a16e0f800 20 searching for the correct realm 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.650+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3a860 con 0x55f71fd36530 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.650+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.651+0000 7f1a1255c640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1a04074060 0x7f1a040361f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.651+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3a860 con 0x7f1a04074060 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.651+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1a04074060 0x7f1a040361f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.651+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1a04074060 0x7f1a040361f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.651+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.651+0000 7f1a11d5b640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1a08074040 0x7f1a08081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.651+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3a860 con 0x7f1a08074040 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.651+0000 7f1a12d5d640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1a08074040 0x7f1a08081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.652+0000 7f1a12d5d640 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1a08074040 0x7f1a08081410 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.652+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x7f1a08074040 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.652+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x55f71fd31b40 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.652+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fd31b40 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.652+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x55f71fd31b40 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.652+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fd31b40 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.652+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x7f1a08074040 2024-05-07T13:56:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.653+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x7f1a08074040 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.653+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x7f1a08074040 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.653+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x7f1a08074040 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.653+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x7f1a04074060 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.653+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.653+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x55f71fd36530 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.653+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.653+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x55f71fd31b40 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.654+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fd31b40 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.654+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x7f1a08074040 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.654+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x7f1a08074040 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.654+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x55f71fd31b40 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.654+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fd31b40 2024-05-07T13:56:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.654+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd357d0 con 0x7f1a04074060 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.654+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.655+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd36530 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.655+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.655+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd36530 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.655+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.655+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x7f1a08074040 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.655+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x7f1a08074040 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.655+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd36530 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.656+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.656+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd36530 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.656+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.656+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd31b40 2024-05-07T13:56:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.656+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c00a4a0 con 0x55f71fd31b40 2024-05-07T13:56:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.656+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd31b40 2024-05-07T13:56:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.656+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.656+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x7f1a08074040 2024-05-07T13:56:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.657+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.657+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd36530 2024-05-07T13:56:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.657+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.657+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x7f1a04074060 2024-05-07T13:56:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.657+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.657+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd31b40 2024-05-07T13:56:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.657+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.657+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x7f1a08074040 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.658+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.658+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd36530 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.658+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.658+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x7f1a08074040 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.659+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.659+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x7f1a04074060 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.659+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.659+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd36530 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.659+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.659+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x7f1a08074040 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.659+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x55f71fd31b40 2024-05-07T13:56:13.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1a0808e060 con 0x7f1a04074060 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd397f0 con 0x55f71fd31b40 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.660+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd39be0 con 0x55f71fd31b40 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd39be0 con 0x7f1a08074040 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 zone default found 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 4 Realm: () 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:13.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 zonegroup default 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd39370 con 0x7f1a08074040 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd39370 con 0x55f71fd36530 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.661+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3c800 con 0x55f71fd36530 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.662+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.662+0000 7f1a16e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.662+0000 7f1a16e0f800 20 started sync module instance, tier type = 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.662+0000 7f1a16e0f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.662+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3bb60 con 0x7f1a04074060 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.663+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.663+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94519879253840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3d110 con 0x7f1a04074060 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.663+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3d960 con 0x55f71fd31b40 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.664+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94519879253840] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.664+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.664+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94519879257184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3d960 con 0x55f71fd31b40 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.664+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3e450 con 0x55f71fd36530 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.665+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.665+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94519879261984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3ecf0 con 0x55f71fd36530 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.665+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3f7f0 con 0x7f1a04074060 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.666+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94519879257184] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.666+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94519879261984] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.666+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.666+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94519879259312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3ecf0 con 0x7f1a04074060 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.666+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd40090 con 0x55f71fd31b40 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.668+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94519879259312] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.668+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.668+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94519879269344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd40000 con 0x55f71fd31b40 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.668+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd40f90 con 0x7f1a08074040 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.668+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94519879269344] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.669+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.669+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94519879271472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd40f50 con 0x7f1a08074040 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.669+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd419a0 con 0x7f1a08074040 2024-05-07T13:56:13.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.670+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94519879271472] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.670+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.670+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94519879273600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd419a0 con 0x7f1a08074040 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.670+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd42360 con 0x7f1a08074040 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94519879273600] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94519879276240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd42360 con 0x7f1a08074040 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a16e0f800 20 add_watcher() i=0 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a16e0f800 20 add_watcher() i=1 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a16e0f800 20 add_watcher() i=2 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a16e0f800 20 add_watcher() i=3 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a16e0f800 20 add_watcher() i=4 2024-05-07T13:56:13.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a16e0f800 20 add_watcher() i=5 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.671+0000 7f1a16e0f800 20 add_watcher() i=6 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.672+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94519879276240] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.672+0000 7f1a16e0f800 20 add_watcher() i=7 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.672+0000 7f1a16e0f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.672+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd45790 con 0x55f71fd31b40 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.672+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.672+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94519879278672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd42c50 con 0x55f71fd31b40 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.673+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94519879278672] v27'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.673+0000 7f18c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f1a16e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f1a16e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f1a16e0f800 5 note: GC not initialized 2024-05-07T13:56:13.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f18437fe640 20 reqs_thread_entry: start 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f1a16e0f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f1a16e0f800 20 Filter name: none 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f18417fa640 20 reqs_thread_entry: start 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f1a16e0f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.674+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd78cb0 con 0x55f71fd31b40 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:13.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd7ac30 con 0x7f1a04074060 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 : miss 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd7c330 con 0x7f1a04074060 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(64 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:13.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.675+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd80ba0 con 0x7f1a08074040 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.676+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(65 fud.buckets [call] v27'5 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.677+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd86a60 con 0x7f1a04074060 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1, ofs0, ns] 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94519879518704 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd80fd0 con 0x7f1a04074060 2024-05-07T13:56:13.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== watch-notify(notify (1) cookie 94519879253840 notify 115964117012 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55f71fd7c720 con 0x7f1a04074060 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f18f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117012 cookie 94519879253840 notifier 4516 bl.length()=752 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(67 notify.0 [notify cookie 94519879518704 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f18f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f18f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f18f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f18f5ffb640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f18d8003ea0 con 0x7f1a04074060 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== watch-notify(notify_complete (2) cookie 94519879518704 notify 115964117012 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f71fd7b850 con 0x7f1a04074060 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_sources= new_sources= 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential sources added=[] removed=[] 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_dests= new_dests= 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential dests added=[] removed=[] 2024-05-07T13:56:13.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.678+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd852c0 con 0x7f1a04074060 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.679+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(69 foo.buckets [call] v27'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.679+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd7c9d0 con 0x7f1a04074060 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f1a16e0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f1a16e0f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f1a16e0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94519879518672 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd85770 con 0x7f1a08074040 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== watch-notify(notify (1) cookie 94519879273600 notify 115964116997 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f1a0c0279c0 con 0x7f1a08074040 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f18f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94519879273600 notifier 4516 bl.length()=314 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f18f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f18f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.6 [notify cookie 94519879518672 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f18f5ffb640 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f18d8003ea0 con 0x7f1a08074040 2024-05-07T13:56:13.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.681+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== watch-notify(notify_complete (2) cookie 94519879518672 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1a0c027c60 con 0x7f1a08074040 2024-05-07T13:56:13.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.682+0000 7f18c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.682+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94519879278672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd7d580 con 0x55f71fd31b40 2024-05-07T13:56:13.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.683+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94519879278672] v27'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.683+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94519879253840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd42020 con 0x7f1a04074060 2024-05-07T13:56:13.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.684+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94519879253840] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.684+0000 7f1a16e0f800 20 remove_watcher() i=0 2024-05-07T13:56:13.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.684+0000 7f1a16e0f800 2 removed watcher, disabling cache 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.684+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94519879257184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3bf50 con 0x55f71fd31b40 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.685+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94519879257184] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.685+0000 7f1a16e0f800 20 remove_watcher() i=1 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.685+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94519879261984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3bf50 con 0x55f71fd36530 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.687+0000 7f1a1255c640 1 -- 172.21.15.50:0/1633045429 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94519879261984] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a04071030 con 0x55f71fd36530 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.687+0000 7f1a16e0f800 20 remove_watcher() i=2 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.687+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94519879259312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3bf50 con 0x7f1a04074060 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.688+0000 7f1a11d5b640 1 -- 172.21.15.50:0/1633045429 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94519879259312] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0807f070 con 0x7f1a04074060 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.688+0000 7f1a16e0f800 20 remove_watcher() i=3 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.688+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94519879269344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3bf50 con 0x55f71fd31b40 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.689+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94519879269344] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x55f71fd31b40 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.689+0000 7f1a16e0f800 20 remove_watcher() i=4 2024-05-07T13:56:13.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.689+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94519879271472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3fbe0 con 0x7f1a08074040 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.690+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94519879271472] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.690+0000 7f1a16e0f800 20 remove_watcher() i=5 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.690+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94519879273600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd3bf50 con 0x7f1a08074040 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.691+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94519879273600] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.691+0000 7f1a16e0f800 20 remove_watcher() i=6 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.691+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94519879276240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f71fd40430 con 0x7f1a08074040 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94519879276240] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a0c02f060 con 0x7f1a08074040 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 20 remove_watcher() i=7 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1a08074040 msgr2=0x7f1a08081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1a08074040 0x7f1a08081410 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fd31b40 msgr2=0x55f71fd34000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fd31b40 0x55f71fd34000 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1a04074060 msgr2=0x7f1a040361f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1a04074060 0x7f1a040361f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fd36530 msgr2=0x55f71fd38920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fd36530 0x55f71fd38920 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18dc036860 msgr2=0x7f18dc038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18dc036860 0x7f18dc038d20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a08052fd0 tx=0x7f1a0804f000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 msgr2=0x55f71fbf83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fbf83f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400bc10 tx=0x7f1a04044870 comp rx=0 tx=0).stop 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1633045429 reap_dead start 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 shutdown_connections 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1633045429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd1cf90 0x55f71fbf83f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 >> 172.21.15.50:0/1633045429 conn(0x55f71fd192d0 msgr2=0x55f71fd16930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 shutdown_connections 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1633045429 wait complete. 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/671304243 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18ec036950 msgr2=0x7f18ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/671304243 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18ec036950 0x7f18ec038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55f71fcf9400 tx=0x7f1a08005ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/671304243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd0fdf0 msgr2=0x55f71fd10210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/671304243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd0fdf0 0x55f71fd10210 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1a0401cfd0 tx=0x7f1a0401b960 comp rx=0 tx=0).stop 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/671304243 shutdown_connections 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/671304243 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18ec036950 0x7f18ec038e10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/671304243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fd0fdf0 0x55f71fd10210 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.692+0000 7f1a16e0f800 1 -- 172.21.15.50:0/671304243 >> 172.21.15.50:0/671304243 conn(0x55f71fd03e90 msgr2=0x55f71fd04290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/671304243 shutdown_connections 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/671304243 wait complete. 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f71fcfede0 msgr2=0x55f71fd01230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f71fcfede0 0x55f71fd01230 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fbfc680 msgr2=0x55f71fcf8570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f71fbfc680 0x55f71fcf8570 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fcfae50 msgr2=0x55f71fcfd240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f71fcfae50 0x55f71fcfd240 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18f8036950 msgr2=0x7f18f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f18f8036950 0x7f18f8038e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a08054000 tx=0x7f1a0804e000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 msgr2=0x55f71fcf1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 --2- 172.21.15.50:0/1738472077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f71fbf8b70 0x55f71fcf1330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1a04001ed0 tx=0x7f1a04000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a12d5d640 1 -- 172.21.15.50:0/1738472077 reap_dead start 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 shutdown_connections 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 >> 172.21.15.50:0/1738472077 conn(0x55f71fbf25c0 msgr2=0x55f71fce38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 shutdown_connections 2024-05-07T13:56:13.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.693+0000 7f1a16e0f800 1 -- 172.21.15.50:0/1738472077 wait complete. 2024-05-07T13:56:13.697 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-07T13:56:13.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-07T13:56:13.697 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-07T13:56:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:13.742 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.754+0000 7fce55e12800 1 Processor -- start 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.754+0000 7fce55e12800 1 -- start start 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.755+0000 7fce55e12800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d54c415fd0 0x55d54c4163f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.755+0000 7fce55e12800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d54c416a70 con 0x55d54c417230 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.755+0000 7fce55e12800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55d54c2a8050 con 0x55d54c415fd0 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.755+0000 7fce5147d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d54c415fd0 0x55d54c4163f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.755+0000 7fce5147d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d54c415fd0 0x55d54c4163f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50180/0 (socket says 172.21.15.50:50180) 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.755+0000 7fce5147d640 1 -- 172.21.15.50:0/2907994126 learned_addr learned my addr 172.21.15.50:0/2907994126 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.755+0000 7fce50c7c640 1 --1- 172.21.15.50:0/2907994126 >> v1:172.21.15.22:6789/0 conn(0x55d54c417230 0x55d54c4176b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40714/0 (socket says 172.21.15.50:40714) 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.755+0000 7fce5147d640 1 -- 172.21.15.50:0/2907994126 >> v1:172.21.15.22:6789/0 conn(0x55d54c417230 legacy=0x55d54c4176b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.755+0000 7fce5147d640 1 -- 172.21.15.50:0/2907994126 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54c417df0 con 0x55d54c415fd0 2024-05-07T13:56:13.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.757+0000 7fce5147d640 1 --2- 172.21.15.50:0/2907994126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c4163f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fce4400a520 tx=0x7fce4401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc368f0192fc734 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.757+0000 7fce43fff640 1 -- 172.21.15.50:0/2907994126 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce44057070 con 0x55d54c415fd0 2024-05-07T13:56:13.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.757+0000 7fce43fff640 1 -- 172.21.15.50:0/2907994126 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44052570 con 0x55d54c415fd0 2024-05-07T13:56:13.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.757+0000 7fce43fff640 1 -- 172.21.15.50:0/2907994126 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce44052870 con 0x55d54c415fd0 2024-05-07T13:56:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.758+0000 7fce55e12800 1 -- 172.21.15.50:0/2907994126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 msgr2=0x55d54c4163f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.758+0000 7fce55e12800 1 --2- 172.21.15.50:0/2907994126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c4163f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fce4400a520 tx=0x7fce4401d010 comp rx=0 tx=0).stop 2024-05-07T13:56:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.758+0000 7fce55e12800 1 -- 172.21.15.50:0/2907994126 shutdown_connections 2024-05-07T13:56:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.758+0000 7fce55e12800 1 --2- 172.21.15.50:0/2907994126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c4163f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.758+0000 7fce55e12800 1 -- 172.21.15.50:0/2907994126 >> 172.21.15.50:0/2907994126 conn(0x55d54c4115b0 msgr2=0x55d54c4139d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.758+0000 7fce55e12800 1 -- 172.21.15.50:0/2907994126 shutdown_connections 2024-05-07T13:56:13.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.758+0000 7fce55e12800 1 -- 172.21.15.50:0/2907994126 wait complete. 2024-05-07T13:56:13.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.773+0000 7fce55e12800 1 Processor -- start 2024-05-07T13:56:13.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.773+0000 7fce55e12800 1 -- start start 2024-05-07T13:56:13.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.773+0000 7fce55e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c389e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.773+0000 7fce55e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d54c3621d0 con 0x55d54c415fd0 2024-05-07T13:56:13.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.773+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c389e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.773+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c389e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50190/0 (socket says 172.21.15.50:50190) 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.773+0000 7fce5147d640 1 -- 172.21.15.50:0/2637661399 learned_addr learned my addr 172.21.15.50:0/2637661399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.774+0000 7fce5147d640 1 -- 172.21.15.50:0/2637661399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54c50b560 con 0x55d54c415fd0 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.774+0000 7fce5147d640 1 --2- 172.21.15.50:0/2637661399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c389e40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fce44055040 tx=0x7fce4404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea02368cc6a5f03 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.774+0000 7fcd3f606640 1 -- 172.21.15.50:0/2637661399 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce44057040 con 0x55d54c415fd0 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.774+0000 7fcd3f606640 1 -- 172.21.15.50:0/2637661399 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44052850 con 0x55d54c415fd0 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.774+0000 7fcd3f606640 1 -- 172.21.15.50:0/2637661399 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce44052b50 con 0x55d54c415fd0 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 -- 172.21.15.50:0/2637661399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 msgr2=0x55d54c389e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 --2- 172.21.15.50:0/2637661399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c389e40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fce44055040 tx=0x7fce4404c000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 -- 172.21.15.50:0/2637661399 shutdown_connections 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 --2- 172.21.15.50:0/2637661399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c389e40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 -- 172.21.15.50:0/2637661399 >> 172.21.15.50:0/2637661399 conn(0x55d54c4115b0 msgr2=0x55d54c503050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 -- 172.21.15.50:0/2637661399 shutdown_connections 2024-05-07T13:56:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 -- 172.21.15.50:0/2637661399 wait complete. 2024-05-07T13:56:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 Processor -- start 2024-05-07T13:56:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 -- start start 2024-05-07T13:56:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c510230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.775+0000 7fce55e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d54c41f700 con 0x55d54c415fd0 2024-05-07T13:56:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c510230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c510230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50194/0 (socket says 172.21.15.50:50194) 2024-05-07T13:56:13.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fce5147d640 1 -- 172.21.15.50:0/2454814203 learned_addr learned my addr 172.21.15.50:0/2454814203 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fce5147d640 1 -- 172.21.15.50:0/2454814203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54c510770 con 0x55d54c415fd0 2024-05-07T13:56:13.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fce5147d640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c510230 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fce4400a520 tx=0x7fce44003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fcd3de03640 1 -- 172.21.15.50:0/2454814203 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce44073070 con 0x55d54c415fd0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fcd3de03640 1 -- 172.21.15.50:0/2454814203 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4405d650 con 0x55d54c415fd0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d54c510a00 con 0x55d54c415fd0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fcd3de03640 1 -- 172.21.15.50:0/2454814203 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce44057070 con 0x55d54c415fd0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.776+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d54c5136b0 con 0x55d54c415fd0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.777+0000 7fcd3de03640 1 -- 172.21.15.50:0/2454814203 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce44076070 con 0x55d54c415fd0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.777+0000 7fcd3de03640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd38036900 0x7fcd38038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.777+0000 7fcd3de03640 1 -- 172.21.15.50:0/2454814203 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fce4408e010 con 0x55d54c415fd0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.777+0000 7fce50c7c640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd38036900 0x7fcd38038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.778+0000 7fce55e12800 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c417230 0x55d54c517470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.778+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5179f0 con 0x55d54c417230 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.778+0000 7fce51c7e640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c417230 0x55d54c517470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.778+0000 7fce50c7c640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd38036900 0x7fcd38038dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce48000f60 tx=0x7fce48001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.778+0000 7fce51c7e640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c417230 0x55d54c517470 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.778+0000 7fce51c7e640 1 -- 172.21.15.50:0/2454814203 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c417230 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.778+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c514a40 con 0x55d54c417230 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.779+0000 7fce51c7e640 1 -- 172.21.15.50:0/2454814203 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c417230 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.779+0000 7fce55e12800 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c519d40 0x55d54c51c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.779+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c51c820 con 0x55d54c519d40 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.779+0000 7fce5147d640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c519d40 0x55d54c51c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.779+0000 7fce5147d640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c519d40 0x55d54c51c130 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.779+0000 7fce5147d640 1 -- 172.21.15.50:0/2454814203 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce44075030 con 0x55d54c519d40 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.779+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c518cf0 con 0x55d54c417230 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.780+0000 7fce51c7e640 1 -- 172.21.15.50:0/2454814203 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c417230 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.780+0000 7fce55e12800 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d54c51dcd0 0x55d54c520120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.780+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c520880 con 0x55d54c51dcd0 2024-05-07T13:56:13.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.780+0000 7fce50c7c640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d54c51dcd0 0x55d54c520120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.780+0000 7fce50c7c640 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d54c51dcd0 0x55d54c520120 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.780+0000 7fce50c7c640 1 -- 172.21.15.50:0/2454814203 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce4800f690 con 0x55d54c51dcd0 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.781+0000 7fce55e12800 1 Processor -- start 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.781+0000 7fce55e12800 1 -- start start 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.781+0000 7fce55e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c52ece0 0x55d54c52f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.781+0000 7fce55e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d54c308cf0 con 0x55d54c52ece0 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.781+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c52ece0 0x55d54c52f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.781+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c52ece0 0x55d54c52f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50204/0 (socket says 172.21.15.50:50204) 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.781+0000 7fce5147d640 1 -- 172.21.15.50:0/2642919908 learned_addr learned my addr 172.21.15.50:0/2642919908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.781+0000 7fce5147d640 1 -- 172.21.15.50:0/2642919908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54c52f640 con 0x55d54c52ece0 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.782+0000 7fce5147d640 1 --2- 172.21.15.50:0/2642919908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c52ece0 0x55d54c52f100 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fce4406d000 tx=0x7fce4405cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.782+0000 7fcd36ffd640 1 -- 172.21.15.50:0/2642919908 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce440069b0 con 0x55d54c52ece0 2024-05-07T13:56:13.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.782+0000 7fcd36ffd640 1 -- 172.21.15.50:0/2642919908 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4405d950 con 0x55d54c52ece0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.782+0000 7fce55e12800 1 -- 172.21.15.50:0/2642919908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d54c5300b0 con 0x55d54c52ece0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.782+0000 7fcd36ffd640 1 -- 172.21.15.50:0/2642919908 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4405dc50 con 0x55d54c52ece0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.782+0000 7fce55e12800 1 -- 172.21.15.50:0/2642919908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d54c5305b0 con 0x55d54c52ece0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.782+0000 7fcd36ffd640 1 -- 172.21.15.50:0/2642919908 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce4408d760 con 0x55d54c52ece0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fcd36ffd640 1 --2- 172.21.15.50:0/2642919908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd28036900 0x7fcd28038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fcd36ffd640 1 -- 172.21.15.50:0/2642919908 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fce44002000 con 0x55d54c52ece0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fce50c7c640 1 --2- 172.21.15.50:0/2642919908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd28036900 0x7fcd28038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fce55e12800 1 Processor -- start 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fce55e12800 1 -- start start 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fce50c7c640 1 --2- 172.21.15.50:0/2642919908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd28036900 0x7fcd28038dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55d54c5182f0 tx=0x7fce4800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fce55e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c508fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fce55e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d54c50b7f0 con 0x55d54c508bc0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c508fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c508fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50214/0 (socket says 172.21.15.50:50214) 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.783+0000 7fce5147d640 1 -- 172.21.15.50:0/2761508812 learned_addr learned my addr 172.21.15.50:0/2761508812 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fce5147d640 1 -- 172.21.15.50:0/2761508812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54c5073d0 con 0x55d54c508bc0 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fce5147d640 1 --2- 172.21.15.50:0/2761508812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c508fe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fce44076ff0 tx=0x7fce44084580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf007a15d4e301 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fcd34ff9640 1 -- 172.21.15.50:0/2761508812 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce440ac070 con 0x55d54c508bc0 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fcd34ff9640 1 -- 172.21.15.50:0/2761508812 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44086210 con 0x55d54c508bc0 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fcd34ff9640 1 -- 172.21.15.50:0/2761508812 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce440931f0 con 0x55d54c508bc0 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fce55e12800 1 -- 172.21.15.50:0/2761508812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 msgr2=0x55d54c508fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fce55e12800 1 --2- 172.21.15.50:0/2761508812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c508fe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fce44076ff0 tx=0x7fce44084580 comp rx=0 tx=0).stop 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fce55e12800 1 -- 172.21.15.50:0/2761508812 shutdown_connections 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fce55e12800 1 --2- 172.21.15.50:0/2761508812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c508fe0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.784+0000 7fce55e12800 1 -- 172.21.15.50:0/2761508812 >> 172.21.15.50:0/2761508812 conn(0x55d54c538200 msgr2=0x55d54c536260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce55e12800 1 -- 172.21.15.50:0/2761508812 shutdown_connections 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce55e12800 1 -- 172.21.15.50:0/2761508812 wait complete. 2024-05-07T13:56:13.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce55e12800 1 Processor -- start 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce55e12800 1 -- start start 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce55e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c545510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce55e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d54c5077e0 con 0x55d54c508bc0 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c545510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce5147d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c545510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50222/0 (socket says 172.21.15.50:50222) 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 learned_addr learned my addr 172.21.15.50:0/647688819 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.785+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54c545a50 con 0x55d54c508bc0 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.786+0000 7fce5147d640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c545510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fce440769f0 tx=0x7fce4406bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.786+0000 7fcd26ffd640 1 -- 172.21.15.50:0/647688819 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce440b7070 con 0x55d54c508bc0 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.786+0000 7fcd26ffd640 1 -- 172.21.15.50:0/647688819 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4408db80 con 0x55d54c508bc0 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.786+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d54c545a50 con 0x55d54c508bc0 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.786+0000 7fcd26ffd640 1 -- 172.21.15.50:0/647688819 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce440ac040 con 0x55d54c508bc0 2024-05-07T13:56:13.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.786+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d54c545a50 con 0x55d54c508bc0 2024-05-07T13:56:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.787+0000 7fcd26ffd640 1 -- 172.21.15.50:0/647688819 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce440ba070 con 0x55d54c508bc0 2024-05-07T13:56:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.787+0000 7fcd26ffd640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd1c036950 0x7fcd1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.787+0000 7fcd26ffd640 1 -- 172.21.15.50:0/647688819 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fce440a4070 con 0x55d54c508bc0 2024-05-07T13:56:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.787+0000 7fce50c7c640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd1c036950 0x7fcd1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.787+0000 7fce50c7c640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd1c036950 0x7fcd1c038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55d54c520c80 tx=0x7fce48010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce55e12800 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c550c40 0x55d54c553100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c553850 con 0x55d54c550c40 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce51c7e640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c550c40 0x55d54c553100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce51c7e640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c550c40 0x55d54c553100 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c550c40 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce55e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce55e12800 20 realm 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.788+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c553c60 con 0x55d54c550c40 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c550c40 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:13.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c554530 con 0x55d54c550c40 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c550c40 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c550c40 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c550c40 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c555630 0x55d54c557a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c558030 con 0x55d54c555630 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce5147d640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c555630 0x55d54c557a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.789+0000 7fce5147d640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c555630 0x55d54c557a20 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.790+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.790+0000 7fce55e12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.790+0000 7fce55e12800 20 searching for the correct realm 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.790+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c559940 con 0x55d54c555630 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.790+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.790+0000 7fce5147d640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fce440bc070 0x7fce44084870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.790+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c559940 con 0x7fce440bc070 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.790+0000 7fce50c7c640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fce440bc070 0x7fce44084870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.791+0000 7fce50c7c640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fce440bc070 0x7fce44084870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.791+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.791+0000 7fce50c7c640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fce4800f070 0x7fce4802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.791+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c559940 con 0x7fce4800f070 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.791+0000 7fce51c7e640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fce4800f070 0x7fce4802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.792+0000 7fce51c7e640 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fce4800f070 0x7fce4802e910 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.792+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c00a4a0 con 0x7fce4800f070 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.792+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c550c40 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.792+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c550c40 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.792+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c550c40 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.792+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c550c40 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.792+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce4800f070 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.793+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c00a4a0 con 0x7fce4800f070 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.793+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce4800f070 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.793+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce4c00a4a0 con 0x7fce4800f070 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.793+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce440bc070 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.793+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.793+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c555630 2024-05-07T13:56:13.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.793+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.793+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c550c40 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.794+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c550c40 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.794+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce4800f070 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.794+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c00a4a0 con 0x7fce4800f070 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.794+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c550c40 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.794+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c550c40 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.794+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce440bc070 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.794+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.794+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c555630 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.795+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.795+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c555630 2024-05-07T13:56:13.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.795+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.795+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce4800f070 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.795+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c00a4a0 con 0x7fce4800f070 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.795+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c555630 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.795+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.795+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c555630 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.796+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.796+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c550c40 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.796+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c00a4a0 con 0x55d54c550c40 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.796+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c550c40 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.796+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.796+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce4800f070 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.796+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.796+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c555630 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.797+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.797+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce440bc070 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.797+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.797+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c550c40 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.797+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.797+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce4800f070 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.797+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.797+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c555630 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.798+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.798+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce4800f070 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.798+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.798+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce440bc070 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.798+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.798+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c555630 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce4800f070 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x55d54c550c40 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5548d0 con 0x7fce440bc070 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce55e12800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce55e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce55e12800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce55e12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce55e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:13.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce55e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.799+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5588f0 con 0x55d54c550c40 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c558ce0 con 0x55d54c550c40 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c558ce0 con 0x7fce4800f070 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:13.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 20 zone default found 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 4 Realm: () 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 20 zonegroup default 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.800+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c558470 con 0x7fce4800f070 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55b7a0 con 0x55d54c555630 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55bb40 con 0x55d54c555630 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 20 started sync module instance, tier type = 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.801+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55ac40 con 0x7fce440bc070 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.802+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.802+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94374597076880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55bee0 con 0x7fce440bc070 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.802+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55c7b0 con 0x55d54c550c40 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.803+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94374597076880] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.804+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.804+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94374597083776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55cba0 con 0x55d54c550c40 2024-05-07T13:56:13.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.804+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55d5e0 con 0x55d54c555630 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.805+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.805+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94374597087408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55de80 con 0x55d54c555630 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.805+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55e960 con 0x7fce440bc070 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.805+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94374597083776] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.806+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94374597087408] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.806+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.806+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94374597079136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55de80 con 0x7fce440bc070 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.806+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55f260 con 0x55d54c550c40 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.807+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94374597079136] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.807+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.807+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94374597094736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55f680 con 0x55d54c550c40 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.807+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c560080 con 0x7fce4800f070 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.808+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94374597094736] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.808+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.808+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94374597089744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c560040 con 0x7fce4800f070 2024-05-07T13:56:13.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.808+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c560a80 con 0x7fce4800f070 2024-05-07T13:56:13.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.809+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.809+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94374597100880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c560ef0 con 0x7fce4800f070 2024-05-07T13:56:13.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.809+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5619f0 con 0x7fce4800f070 2024-05-07T13:56:13.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.810+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94374597089744] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.810+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.810+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94374597104864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c5619b0 con 0x7fce4800f070 2024-05-07T13:56:13.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 20 add_watcher() i=0 2024-05-07T13:56:13.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 20 add_watcher() i=1 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 20 add_watcher() i=2 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 20 add_watcher() i=3 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 20 add_watcher() i=4 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 20 add_watcher() i=5 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94374597100880] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 20 add_watcher() i=6 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94374597104864] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 20 add_watcher() i=7 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.811+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c560a40 con 0x55d54c550c40 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.812+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.812+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94374597098384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c560a40 con 0x55d54c550c40 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.813+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94374597098384] v27'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.813+0000 7fcd077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.813+0000 7fce55e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.813+0000 7fce55e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.813+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56d250 con 0x55d54c550c40 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.814+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.814+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56d920 con 0x7fce4800f070 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.815+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.815+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56dd40 con 0x55d54c555630 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.816+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.816+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56dc00 con 0x55d54c550c40 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.818+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'122 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.818+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56e330 con 0x7fce440bc070 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.819+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.819+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56e830 con 0x55d54c555630 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.819+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.819+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56e830 con 0x55d54c550c40 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.821+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.821+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56e830 con 0x7fce4800f070 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.822+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.822+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56e830 con 0x7fce440bc070 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.823+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.823+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56ee20 con 0x55d54c555630 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.824+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.824+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56eeb0 con 0x7fce440bc070 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.825+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.825+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56ef40 con 0x7fce4800f070 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.826+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.826+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f000 con 0x7fce440bc070 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.827+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.827+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f000 con 0x7fce4800f070 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.828+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.828+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56efd0 con 0x55d54c550c40 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.829+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.829+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56ef40 con 0x55d54c555630 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.830+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.830+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56ef40 con 0x7fce440bc070 2024-05-07T13:56:13.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.831+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.831+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c555630 2024-05-07T13:56:13.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.832+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.832+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c550c40 2024-05-07T13:56:13.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.833+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.833+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c550c40 2024-05-07T13:56:13.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.834+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.834+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c555630 2024-05-07T13:56:13.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.835+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.835+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x7fce440bc070 2024-05-07T13:56:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.836+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.836+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c555630 2024-05-07T13:56:13.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.837+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.837+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c555630 2024-05-07T13:56:13.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.838+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.838+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c555630 2024-05-07T13:56:13.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.839+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.839+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c555630 2024-05-07T13:56:13.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.841+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.841+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x7fce4800f070 2024-05-07T13:56:13.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.842+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.842+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c555630 2024-05-07T13:56:13.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.843+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.843+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x7fce4800f070 2024-05-07T13:56:13.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.844+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.844+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x55d54c555630 2024-05-07T13:56:13.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.845+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.845+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x7fce4800f070 2024-05-07T13:56:13.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.846+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.846+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c56f700 con 0x7fce440bc070 2024-05-07T13:56:13.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.847+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fcd067e4640 20 reqs_thread_entry: start 2024-05-07T13:56:13.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:13.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 20 Filter name: none 2024-05-07T13:56:13.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fcc77fff640 20 reqs_thread_entry: start 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59a4f0 con 0x7fce4800f070 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.848+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59ce20 con 0x7fce4800f070 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.849+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv4 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.849+0000 7fce55e12800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-07T13:56:13.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.849+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59ae00 con 0x7fce4800f070 2024-05-07T13:56:13.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.850+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v27'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.850+0000 7fce55e12800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-07T13:56:13.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.850+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94374597343504 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59d410 con 0x55d54c555630 2024-05-07T13:56:13.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.850+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== watch-notify(notify (1) cookie 94374597087408 notify 115964116995 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d54c56e3d0 con 0x55d54c555630 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.850+0000 7fcd34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94374597087408 notifier 4523 bl.length()=170 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.850+0000 7fcd34ff9640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcd14003d60 con 0x55d54c555630 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.850+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(97 notify.2 [notify cookie 94374597343504 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.851+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.851+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== watch-notify(notify_complete (2) cookie 94374597343504 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d54c52f640 con 0x55d54c555630 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.851+0000 7fce55e12800 10 removing email index: 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.851+0000 7fce55e12800 10 removing user buckets index 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.851+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59d390 con 0x7fce4800f070 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.852+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(99 fud.buckets [delete] v27'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.852+0000 7fce55e12800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-07T13:56:13.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.852+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94374597350288 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59c920 con 0x7fce4800f070 2024-05-07T13:56:13.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.852+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== watch-notify(notify (1) cookie 94374597100880 notify 115964116998 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d54c56ebd0 con 0x7fce4800f070 2024-05-07T13:56:13.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.852+0000 7fcd27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94374597100880 notifier 4523 bl.length()=160 2024-05-07T13:56:13.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.852+0000 7fcd27fff640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcc840032c0 con 0x7fce4800f070 2024-05-07T13:56:13.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.852+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(100 notify.6 [notify cookie 94374597350288 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.853+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== watch-notify(notify_complete (2) cookie 94374597350288 notify 115964116998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d54c5300b0 con 0x7fce4800f070 2024-05-07T13:56:13.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.853+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.853+0000 7fce55e12800 10 removing user index: fud 2024-05-07T13:56:13.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.853+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59c920 con 0x7fce4800f070 2024-05-07T13:56:13.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== osd_op_reply(102 fud [call,call,delete] v27'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fce55e12800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-07T13:56:13.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fce55e12800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-07T13:56:13.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94374597350288 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59b910 con 0x7fce4800f070 2024-05-07T13:56:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== watch-notify(notify (1) cookie 94374597089744 notify 115964116999 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55d54c5300b0 con 0x7fce4800f070 2024-05-07T13:56:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fcd34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 94374597089744 notifier 4523 bl.length()=152 2024-05-07T13:56:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fcd34ff9640 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcd14003d60 con 0x7fce4800f070 2024-05-07T13:56:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(103 notify.5 [notify cookie 94374597350288 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.854+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== watch-notify(notify_complete (2) cookie 94374597350288 notify 115964116999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d54c56d3e0 con 0x7fce4800f070 2024-05-07T13:56:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.855+0000 7fcd077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.855+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94374597098384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59d390 con 0x55d54c550c40 2024-05-07T13:56:13.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.856+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94374597098384] v27'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.856+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94374597076880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59d390 con 0x7fce440bc070 2024-05-07T13:56:13.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.857+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94374597076880] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.857+0000 7fce55e12800 20 remove_watcher() i=0 2024-05-07T13:56:13.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.857+0000 7fce55e12800 2 removed watcher, disabling cache 2024-05-07T13:56:13.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.857+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94374597083776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55a790 con 0x55d54c550c40 2024-05-07T13:56:13.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.858+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94374597083776] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.858+0000 7fce55e12800 20 remove_watcher() i=1 2024-05-07T13:56:13.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.858+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94374597087408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c59d390 con 0x55d54c555630 2024-05-07T13:56:13.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.859+0000 7fce5147d640 1 -- 172.21.15.50:0/647688819 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94374597087408] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce440b9030 con 0x55d54c555630 2024-05-07T13:56:13.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.859+0000 7fce55e12800 20 remove_watcher() i=2 2024-05-07T13:56:13.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.859+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94374597079136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55c280 con 0x7fce440bc070 2024-05-07T13:56:13.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.860+0000 7fce50c7c640 1 -- 172.21.15.50:0/647688819 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94374597079136] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce48037040 con 0x7fce440bc070 2024-05-07T13:56:13.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.860+0000 7fce55e12800 20 remove_watcher() i=3 2024-05-07T13:56:13.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.860+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94374597094736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55a790 con 0x55d54c550c40 2024-05-07T13:56:13.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.861+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94374597094736] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x55d54c550c40 2024-05-07T13:56:13.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.861+0000 7fce55e12800 20 remove_watcher() i=4 2024-05-07T13:56:13.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.861+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94374597089744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55c280 con 0x7fce4800f070 2024-05-07T13:56:13.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.863+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94374597089744] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.863+0000 7fce55e12800 20 remove_watcher() i=5 2024-05-07T13:56:13.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.863+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94374597100880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55ed50 con 0x7fce4800f070 2024-05-07T13:56:13.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.864+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94374597100880] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.864+0000 7fce55e12800 20 remove_watcher() i=6 2024-05-07T13:56:13.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.864+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94374597104864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d54c55a790 con 0x7fce4800f070 2024-05-07T13:56:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.864+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 <== osd.0 v2:172.21.15.22:6800/2215278347 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94374597104864] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c02f060 con 0x7fce4800f070 2024-05-07T13:56:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.864+0000 7fce55e12800 20 remove_watcher() i=7 2024-05-07T13:56:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fce4800f070 msgr2=0x7fce4802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fce4800f070 0x7fce4802e910 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c550c40 msgr2=0x55d54c553100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c550c40 0x55d54c553100 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fce440bc070 msgr2=0x7fce44084870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fce440bc070 0x7fce44084870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c555630 msgr2=0x55d54c557a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c555630 0x55d54c557a20 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd1c036950 msgr2=0x7fcd1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd1c036950 0x7fcd1c038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55d54c520c80 tx=0x7fce48010000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 msgr2=0x55d54c545510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce51c7e640 1 -- 172.21.15.50:0/647688819 reap_dead start 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c545510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fce440769f0 tx=0x7fce4406bf30 comp rx=0 tx=0).stop 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 shutdown_connections 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/647688819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c508bc0 0x55d54c545510 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 >> 172.21.15.50:0/647688819 conn(0x55d54c538200 msgr2=0x55d54c535860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 shutdown_connections 2024-05-07T13:56:13.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/647688819 wait complete. 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/2642919908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd28036900 msgr2=0x7fcd28038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/2642919908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd28036900 0x7fcd28038dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55d54c5182f0 tx=0x7fce4800f000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/2642919908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c52ece0 msgr2=0x55d54c52f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/2642919908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c52ece0 0x55d54c52f100 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fce4406d000 tx=0x7fce4405cf20 comp rx=0 tx=0).stop 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/2642919908 shutdown_connections 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/2642919908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd28036900 0x7fcd28038dc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 --2- 172.21.15.50:0/2642919908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c52ece0 0x55d54c52f100 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/2642919908 >> 172.21.15.50:0/2642919908 conn(0x55d54c522d80 msgr2=0x55d54c523180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/2642919908 shutdown_connections 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.865+0000 7fce55e12800 1 -- 172.21.15.50:0/2642919908 wait complete. 2024-05-07T13:56:13.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d54c51dcd0 msgr2=0x55d54c520120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d54c51dcd0 0x55d54c520120 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c417230 msgr2=0x55d54c517470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d54c417230 0x55d54c517470 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c519d40 msgr2=0x55d54c51c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d54c519d40 0x55d54c51c130 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd38036900 msgr2=0x7fcd38038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcd38036900 0x7fcd38038dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce48000f60 tx=0x7fce48001370 comp rx=0 tx=0).stop 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 msgr2=0x55d54c510230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 --2- 172.21.15.50:0/2454814203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d54c415fd0 0x55d54c510230 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fce4400a520 tx=0x7fce44003020 comp rx=0 tx=0).stop 2024-05-07T13:56:13.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce51c7e640 1 -- 172.21.15.50:0/2454814203 reap_dead start 2024-05-07T13:56:13.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 shutdown_connections 2024-05-07T13:56:13.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 >> 172.21.15.50:0/2454814203 conn(0x55d54c4115b0 msgr2=0x55d54c501850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 shutdown_connections 2024-05-07T13:56:13.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.866+0000 7fce55e12800 1 -- 172.21.15.50:0/2454814203 wait complete. 2024-05-07T13:56:13.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-07T13:56:13.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-07T13:56:13.864 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-07T13:56:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.932+0000 7ff4d5a62800 1 Processor -- start 2024-05-07T13:56:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.932+0000 7ff4d5a62800 1 -- start start 2024-05-07T13:56:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.933+0000 7ff4d5a62800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a618f6e9d0 0x55a618f6edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.933+0000 7ff4d5a62800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a618ee3130 con 0x55a618f6f330 2024-05-07T13:56:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.933+0000 7ff4d5a62800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55a618e01050 con 0x55a618f6e9d0 2024-05-07T13:56:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.933+0000 7ff4d3568640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a618f6e9d0 0x55a618f6edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.933+0000 7ff4d2d67640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55a618f6f330 0x55a618f6f7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40716/0 (socket says 172.21.15.50:40716) 2024-05-07T13:56:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.933+0000 7ff4d3568640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a618f6e9d0 0x55a618f6edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50224/0 (socket says 172.21.15.50:50224) 2024-05-07T13:56:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.933+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2867647654 learned_addr learned my addr 172.21.15.50:0/2867647654 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.933+0000 7ff4d3568640 1 -- 172.21.15.50:0/2867647654 >> v1:172.21.15.22:6789/0 conn(0x55a618f6f330 legacy=0x55a618f6f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.933+0000 7ff4d3568640 1 -- 172.21.15.50:0/2867647654 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a618f6fef0 con 0x55a618f6e9d0 2024-05-07T13:56:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.935+0000 7ff4d3568640 1 --2- 172.21.15.50:0/2867647654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a618f6edf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400a470 tx=0x7ff4c401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a101f9c291516f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.935+0000 7ff4d2566640 1 -- 172.21.15.50:0/2867647654 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c4057070 con 0x55a618f6e9d0 2024-05-07T13:56:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.935+0000 7ff4d2566640 1 -- 172.21.15.50:0/2867647654 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c4052570 con 0x55a618f6e9d0 2024-05-07T13:56:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.935+0000 7ff4d2566640 1 -- 172.21.15.50:0/2867647654 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c4052870 con 0x55a618f6e9d0 2024-05-07T13:56:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.936+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2867647654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 msgr2=0x55a618f6edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.936+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2867647654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a618f6edf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400a470 tx=0x7ff4c401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.936+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2867647654 shutdown_connections 2024-05-07T13:56:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.936+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2867647654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a618f6edf0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.936+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2867647654 >> 172.21.15.50:0/2867647654 conn(0x55a618f6a550 msgr2=0x55a618f6c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.936+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2867647654 shutdown_connections 2024-05-07T13:56:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.936+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2867647654 wait complete. 2024-05-07T13:56:13.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.951+0000 7ff4d5a62800 1 Processor -- start 2024-05-07T13:56:13.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.951+0000 7ff4d5a62800 1 -- start start 2024-05-07T13:56:13.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.951+0000 7ff4d5a62800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a619063c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.951+0000 7ff4d5a62800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a618ebb170 con 0x55a618f6e9d0 2024-05-07T13:56:13.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.952+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a619063c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.952+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a619063c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50236/0 (socket says 172.21.15.50:50236) 2024-05-07T13:56:13.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.952+0000 7ff4d3568640 1 -- 172.21.15.50:0/2214679530 learned_addr learned my addr 172.21.15.50:0/2214679530 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.952+0000 7ff4d3568640 1 -- 172.21.15.50:0/2214679530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6190641e0 con 0x55a618f6e9d0 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.952+0000 7ff4d3568640 1 --2- 172.21.15.50:0/2214679530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a619063c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4055040 tx=0x7ff4c404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8deaab8a9b9fd2a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.952+0000 7ff3c160a640 1 -- 172.21.15.50:0/2214679530 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c4057070 con 0x55a618f6e9d0 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.952+0000 7ff3c160a640 1 -- 172.21.15.50:0/2214679530 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c4063070 con 0x55a618f6e9d0 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.952+0000 7ff3c160a640 1 -- 172.21.15.50:0/2214679530 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c4052720 con 0x55a618f6e9d0 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.953+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2214679530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 msgr2=0x55a619063c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.953+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2214679530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a619063c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4055040 tx=0x7ff4c404c000 comp rx=0 tx=0).stop 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.953+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2214679530 shutdown_connections 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.953+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2214679530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a619063c10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.953+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2214679530 >> 172.21.15.50:0/2214679530 conn(0x55a618f6a550 msgr2=0x55a61905f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.953+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2214679530 shutdown_connections 2024-05-07T13:56:13.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.953+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2214679530 wait complete. 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.953+0000 7ff4d5a62800 1 Processor -- start 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.953+0000 7ff4d5a62800 1 -- start start 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.954+0000 7ff4d5a62800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a61906b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.954+0000 7ff4d5a62800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a618f703c0 con 0x55a618f6e9d0 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.954+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a61906b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.954+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a61906b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50244/0 (socket says 172.21.15.50:50244) 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.954+0000 7ff4d3568640 1 -- 172.21.15.50:0/1197391335 learned_addr learned my addr 172.21.15.50:0/1197391335 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.954+0000 7ff4d3568640 1 -- 172.21.15.50:0/1197391335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61906bbd0 con 0x55a618f6e9d0 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.954+0000 7ff4d3568640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a61906b690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4000c00 tx=0x7ff4c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.955+0000 7ff3bfe07640 1 -- 172.21.15.50:0/1197391335 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c4052db0 con 0x55a618f6e9d0 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.955+0000 7ff3bfe07640 1 -- 172.21.15.50:0/1197391335 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c406c070 con 0x55a618f6e9d0 2024-05-07T13:56:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.955+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a61906be60 con 0x55a618f6e9d0 2024-05-07T13:56:13.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.955+0000 7ff3bfe07640 1 -- 172.21.15.50:0/1197391335 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c405e5b0 con 0x55a618f6e9d0 2024-05-07T13:56:13.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.955+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a61906eb10 con 0x55a618f6e9d0 2024-05-07T13:56:13.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.955+0000 7ff3bfe07640 1 -- 172.21.15.50:0/1197391335 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff4c4077060 con 0x55a618f6e9d0 2024-05-07T13:56:13.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.956+0000 7ff3bfe07640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3b8036900 0x7ff3b8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.956+0000 7ff3bfe07640 1 -- 172.21.15.50:0/1197391335 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff4c408e430 con 0x55a618f6e9d0 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.956+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3b8036900 0x7ff3b8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.956+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a618f6f330 0x55a6190728d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.956+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a619072e50 con 0x55a618f6f330 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.956+0000 7ff4d3d69640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a618f6f330 0x55a6190728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.956+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3b8036900 0x7ff3b8038dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8000f60 tx=0x7ff4c80012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.956+0000 7ff4d3d69640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a618f6f330 0x55a6190728d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.957+0000 7ff4d3d69640 1 -- 172.21.15.50:0/1197391335 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a618f6f330 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.957+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a61906fea0 con 0x55a618f6f330 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.957+0000 7ff4d3d69640 1 -- 172.21.15.50:0/1197391335 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a618f6f330 2024-05-07T13:56:13.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.957+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a619075180 0x55a619077570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.957+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a619077c60 con 0x55a619075180 2024-05-07T13:56:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.957+0000 7ff4d3568640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a619075180 0x55a619077570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.957+0000 7ff4d3568640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a619075180 0x55a619077570 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.958+0000 7ff4d3568640 1 -- 172.21.15.50:0/1197391335 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a619075180 2024-05-07T13:56:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.958+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a619074130 con 0x55a618f6f330 2024-05-07T13:56:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.958+0000 7ff4d3d69640 1 -- 172.21.15.50:0/1197391335 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a618f6f330 2024-05-07T13:56:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.958+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a619079110 0x55a61907b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.958+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a61907bcc0 con 0x55a619079110 2024-05-07T13:56:13.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.958+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a619079110 0x55a61907b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.959+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a619079110 0x55a61907b560 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.959+0000 7ff4d2d67640 1 -- 172.21.15.50:0/1197391335 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff4c8009050 con 0x55a619079110 2024-05-07T13:56:13.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.959+0000 7ff4d5a62800 1 Processor -- start 2024-05-07T13:56:13.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.959+0000 7ff4d5a62800 1 -- start start 2024-05-07T13:56:13.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.959+0000 7ff4d5a62800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a61908a120 0x55a61908a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.959+0000 7ff4d5a62800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a618e61cf0 con 0x55a61908a120 2024-05-07T13:56:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.959+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a61908a120 0x55a61908a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.960+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a61908a120 0x55a61908a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50246/0 (socket says 172.21.15.50:50246) 2024-05-07T13:56:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.960+0000 7ff4d3568640 1 -- 172.21.15.50:0/449683082 learned_addr learned my addr 172.21.15.50:0/449683082 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.960+0000 7ff4d3568640 1 -- 172.21.15.50:0/449683082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61908aa80 con 0x55a61908a120 2024-05-07T13:56:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.960+0000 7ff4d3568640 1 --2- 172.21.15.50:0/449683082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a61908a120 0x55a61908a540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff4c408c780 tx=0x7ff4c408e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.960+0000 7ff3bd602640 1 -- 172.21.15.50:0/449683082 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c408b460 con 0x55a61908a120 2024-05-07T13:56:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.960+0000 7ff3bd602640 1 -- 172.21.15.50:0/449683082 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c4058040 con 0x55a61908a120 2024-05-07T13:56:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.960+0000 7ff3bd602640 1 -- 172.21.15.50:0/449683082 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c4068bf0 con 0x55a61908a120 2024-05-07T13:56:13.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.960+0000 7ff4d5a62800 1 -- 172.21.15.50:0/449683082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a61908b4f0 con 0x55a61908a120 2024-05-07T13:56:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.960+0000 7ff4d5a62800 1 -- 172.21.15.50:0/449683082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a61908b9f0 con 0x55a61908a120 2024-05-07T13:56:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.961+0000 7ff3bd602640 1 -- 172.21.15.50:0/449683082 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff4c406e030 con 0x55a61908a120 2024-05-07T13:56:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.961+0000 7ff3bd602640 1 --2- 172.21.15.50:0/449683082 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3ac036900 0x7ff3ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.961+0000 7ff3bd602640 1 -- 172.21.15.50:0/449683082 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff4c4087070 con 0x55a61908a120 2024-05-07T13:56:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.961+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/449683082 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3ac036900 0x7ff3ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.961+0000 7ff4d5a62800 1 Processor -- start 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff4d5a62800 1 -- start start 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/449683082 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3ac036900 0x7ff3ac038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800bf50 tx=0x7ff4c800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff4d5a62800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a6190976a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff4d5a62800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a6190644a0 con 0x55a619097280 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a6190976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a6190976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50248/0 (socket says 172.21.15.50:50248) 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff4d3568640 1 -- 172.21.15.50:0/3803254309 learned_addr learned my addr 172.21.15.50:0/3803254309 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff4d3568640 1 -- 172.21.15.50:0/3803254309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a619097c70 con 0x55a619097280 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff4d3568640 1 --2- 172.21.15.50:0/3803254309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a6190976a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4053f90 tx=0x7ff4c40865a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bdf47be707deaa server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.962+0000 7ff3b6ffd640 1 -- 172.21.15.50:0/3803254309 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c40a7070 con 0x55a619097280 2024-05-07T13:56:13.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff3b6ffd640 1 -- 172.21.15.50:0/3803254309 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c408c960 con 0x55a619097280 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff3b6ffd640 1 -- 172.21.15.50:0/3803254309 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c4068690 con 0x55a619097280 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff4d5a62800 1 -- 172.21.15.50:0/3803254309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 msgr2=0x55a6190976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/3803254309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a6190976a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4053f90 tx=0x7ff4c40865a0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff4d5a62800 1 -- 172.21.15.50:0/3803254309 shutdown_connections 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/3803254309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a6190976a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff4d5a62800 1 -- 172.21.15.50:0/3803254309 >> 172.21.15.50:0/3803254309 conn(0x55a6190935e0 msgr2=0x55a619091640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff4d5a62800 1 -- 172.21.15.50:0/3803254309 shutdown_connections 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff4d5a62800 1 -- 172.21.15.50:0/3803254309 wait complete. 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff4d5a62800 1 Processor -- start 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.963+0000 7ff4d5a62800 1 -- start start 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff4d5a62800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a61909e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff4d5a62800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a619098320 con 0x55a619097280 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a61909e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff4d3568640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a61909e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50260/0 (socket says 172.21.15.50:50260) 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 learned_addr learned my addr 172.21.15.50:0/2593115773 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61909eb90 con 0x55a619097280 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff4d3568640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a61909e650 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4069c60 tx=0x7ff4c407def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff3b57fa640 1 -- 172.21.15.50:0/2593115773 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c40b1020 con 0x55a619097280 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff3b57fa640 1 -- 172.21.15.50:0/2593115773 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c40a8040 con 0x55a619097280 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a61909eb90 con 0x55a619097280 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff3b57fa640 1 -- 172.21.15.50:0/2593115773 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c40a7070 con 0x55a619097280 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.964+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a61909eb90 con 0x55a619097280 2024-05-07T13:56:13.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.965+0000 7ff3b57fa640 1 -- 172.21.15.50:0/2593115773 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff4c40b4020 con 0x55a619097280 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.965+0000 7ff3b57fa640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff39c036900 0x7ff39c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.965+0000 7ff3b57fa640 1 -- 172.21.15.50:0/2593115773 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7ff4c40b7c60 con 0x55a619097280 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.965+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff39c036900 0x7ff39c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.966+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff39c036900 0x7ff39c038dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8001b60 tx=0x7ff4c8010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.966+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.966+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a6190a9e10 0x55a6190ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.966+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190aca20 con 0x55a6190a9e10 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.966+0000 7ff4d3d69640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a6190a9e10 0x55a6190ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d3d69640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a6190a9e10 0x55a6190ac2d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a6190a9e10 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 20 realm 2024-05-07T13:56:13.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190ace30 con 0x55a6190a9e10 2024-05-07T13:56:13.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a6190a9e10 2024-05-07T13:56:13.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:13.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190ad700 con 0x55a6190a9e10 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a6190a9e10 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.967+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190a9e10 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a6190a9e10 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d5a62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a6190ae800 0x55a6190b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b1200 con 0x55a6190ae800 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d3568640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a6190ae800 0x55a6190b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d3568640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a6190ae800 0x55a6190b0bf0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d5a62800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d5a62800 20 searching for the correct realm 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.968+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b2b10 con 0x55a6190ae800 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.969+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.969+0000 7ff4d3568640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4c40b6020 0x7ff4c407e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.969+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b2b10 con 0x7ff4c40b6020 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.969+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4c40b6020 0x7ff4c407e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.969+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4c40b6020 0x7ff4c407e960 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.970+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c8009050 con 0x7ff4c40b6020 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.970+0000 7ff4d2d67640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff4c8038040 0x7ff4c801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:13.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.970+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b2b10 con 0x7ff4c8038040 2024-05-07T13:56:13.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.970+0000 7ff4d3d69640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff4c8038040 0x7ff4c801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:13.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.970+0000 7ff4d3d69640 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff4c8038040 0x7ff4c801bab0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:13.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.970+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x7ff4c8038040 2024-05-07T13:56:13.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.970+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190a9e10 2024-05-07T13:56:13.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.971+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a6190a9e10 2024-05-07T13:56:13.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.971+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190a9e10 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.971+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a6190a9e10 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.971+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c8038040 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.971+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x7ff4c8038040 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.971+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c8038040 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.971+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x7ff4c8038040 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.971+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c40b6020 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.972+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c8009050 con 0x7ff4c40b6020 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.972+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190ae800 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.972+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.972+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190a9e10 2024-05-07T13:56:13.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.972+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a6190a9e10 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.972+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c8038040 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.972+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x7ff4c8038040 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.972+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190a9e10 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.973+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a6190a9e10 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.973+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c40b6020 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.973+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff4c8009050 con 0x7ff4c40b6020 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.973+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190ae800 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.973+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.973+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190ae800 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.974+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.974+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c8038040 2024-05-07T13:56:13.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.974+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x7ff4c8038040 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.974+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190ae800 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.974+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.974+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190ae800 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.974+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.975+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190a9e10 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.975+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc00a4a0 con 0x55a6190a9e10 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.975+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190a9e10 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.975+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.975+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c8038040 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.976+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:13.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.976+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190ae800 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.976+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.976+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c40b6020 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.976+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c8009050 con 0x7ff4c40b6020 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.976+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190a9e10 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.976+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.976+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c8038040 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.977+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.977+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190ae800 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.977+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.977+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c8038040 2024-05-07T13:56:13.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.977+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.977+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c40b6020 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.977+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c8009050 con 0x7ff4c40b6020 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.977+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190ae800 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.978+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.978+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c8038040 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.978+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.978+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x55a6190a9e10 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.978+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.978+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a6190adaa0 con 0x7ff4c40b6020 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4c8045040 con 0x7ff4c40b6020 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:13.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b1ac0 con 0x55a6190a9e10 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b1eb0 con 0x55a6190a9e10 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:13.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b1eb0 con 0x7ff4c8038040 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.979+0000 7ff4d5a62800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 20 zone default found 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 4 Realm: () 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 20 zonegroup default 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b2f90 con 0x7ff4c8038040 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b4970 con 0x55a6190ae800 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.980+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b4d10 con 0x55a6190ae800 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.981+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.981+0000 7ff4d5a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:13.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.981+0000 7ff4d5a62800 20 started sync module instance, tier type = 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.981+0000 7ff4d5a62800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.981+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b3e10 con 0x7ff4c40b6020 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.982+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c8045040 con 0x7ff4c40b6020 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.982+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94171873098080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b50b0 con 0x7ff4c40b6020 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.982+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b59a0 con 0x55a6190a9e10 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.983+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.983+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94171873098080] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c8045040 con 0x7ff4c40b6020 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.983+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94171873100336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b5d90 con 0x55a6190a9e10 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.983+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b67f0 con 0x55a6190ae800 2024-05-07T13:56:13.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.984+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.984+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94171873108688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b7090 con 0x55a6190ae800 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.984+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b7b50 con 0x7ff4c40b6020 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.984+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94171873100336] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.985+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94171873108688] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.985+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c8045040 con 0x7ff4c40b6020 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.985+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94171873113632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b7f40 con 0x7ff4c40b6020 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.985+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b87d0 con 0x55a6190a9e10 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.986+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94171873113632] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c8045040 con 0x7ff4c40b6020 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.986+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.986+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94171873104976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b8bc0 con 0x55a6190a9e10 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.986+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b95f0 con 0x7ff4c8038040 2024-05-07T13:56:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.987+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94171873104976] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.987+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.988+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94171873120512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b95f0 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.988+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190ba030 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.989+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.989+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94171873120512] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.989+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94171873123200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b9fa0 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.989+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190ba9e0 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94171873123200] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94171873125552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190ba9a0 con 0x7ff4c8038040 2024-05-07T13:56:14.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d5a62800 20 add_watcher() i=0 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d5a62800 20 add_watcher() i=1 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d5a62800 20 add_watcher() i=2 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d5a62800 20 add_watcher() i=3 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d5a62800 20 add_watcher() i=4 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d5a62800 20 add_watcher() i=5 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.990+0000 7ff4d5a62800 20 add_watcher() i=6 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.991+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94171873125552] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.991+0000 7ff4d5a62800 20 add_watcher() i=7 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.991+0000 7ff4d5a62800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.991+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190bde60 con 0x55a6190a9e10 2024-05-07T13:56:14.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.991+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.991+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94171873116896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190bb380 con 0x55a6190a9e10 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.992+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94171873116896] v27'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.992+0000 7ff389fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.992+0000 7ff4d5a62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.992+0000 7ff4d5a62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.992+0000 7ff4d5a62800 5 note: GC not initialized 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.993+0000 7ff388fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.993+0000 7ff4d5a62800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.993+0000 7ff4d5a62800 20 Filter name: none 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.993+0000 7ff3027fc640 20 reqs_thread_entry: start 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.993+0000 7ff4d5a62800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-07T13:56:14.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.993+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.993+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190f15a0 con 0x7ff4c8038040 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.993+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190efc90 con 0x7ff4c8038040 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-07T13:56:14.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.994+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190f3fc0 con 0x7ff4c8038040 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v27'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff4d5a62800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff4d5a62800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff4d5a62800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94171873356224 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190f4b30 con 0x7ff4c40b6020 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== watch-notify(notify (1) cookie 94171873113632 notify 115964117013 ret 0) ==== 652+0+0 (crc 0 0 0) 0x55a618ee3130 con 0x7ff4c40b6020 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff3b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117013 cookie 94171873113632 notifier 4530 bl.length()=610 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(65 notify.3 [notify cookie 94171873356224 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff4c8045040 con 0x7ff4c40b6020 2024-05-07T13:56:14.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff3b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff3b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.995+0000 7ff3b6ffd640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff398003ea0 con 0x7ff4c40b6020 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.996+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c8045040 con 0x7ff4c40b6020 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.996+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== watch-notify(notify_complete (2) cookie 94171873356224 notify 115964117013 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff4c802cdb0 con 0x7ff4c40b6020 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.996+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190f19b0 con 0x7ff4c8038040 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v27'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff4d5a62800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff4d5a62800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff4d5a62800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-07T13:56:14.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94171873363424 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a6190f39b0 con 0x55a6190ae800 2024-05-07T13:56:14.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== watch-notify(notify (1) cookie 94171873108688 notify 115964116996 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55a61908b4f0 con 0x55a6190ae800 2024-05-07T13:56:14.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff3b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94171873108688 notifier 4530 bl.length()=192 2024-05-07T13:56:14.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff3b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-07T13:56:14.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff3b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:56:14.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff3b6ffd640 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff398003ea0 con 0x55a6190ae800 2024-05-07T13:56:14.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(68 notify.2 [notify cookie 94171873363424 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:14.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:14.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.997+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== watch-notify(notify_complete (2) cookie 94171873363424 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a61908aa80 con 0x55a6190ae800 2024-05-07T13:56:14.007 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-07T13:56:13.995676Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:13.995658Z","tags":[],"group_ids":[]} 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.998+0000 7ff389fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.998+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94171873116896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190f0810 con 0x55a6190a9e10 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.999+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94171873116896] v27'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:13.999+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94171873098080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b82e0 con 0x7ff4c40b6020 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.000+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94171873098080] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c8045040 con 0x7ff4c40b6020 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.000+0000 7ff4d5a62800 20 remove_watcher() i=0 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.000+0000 7ff4d5a62800 2 removed watcher, disabling cache 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.000+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94171873100336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b3960 con 0x55a6190a9e10 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.001+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94171873100336] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.001+0000 7ff4d5a62800 20 remove_watcher() i=1 2024-05-07T13:56:14.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.001+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94171873108688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b4230 con 0x55a6190ae800 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.002+0000 7ff4d3568640 1 -- 172.21.15.50:0/2593115773 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94171873108688] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c404bda0 con 0x55a6190ae800 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.002+0000 7ff4d5a62800 20 remove_watcher() i=2 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.002+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94171873113632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b4230 con 0x7ff4c40b6020 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.003+0000 7ff4d2d67640 1 -- 172.21.15.50:0/2593115773 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94171873113632] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4c8045040 con 0x7ff4c40b6020 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.003+0000 7ff4d5a62800 20 remove_watcher() i=3 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.003+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94171873104976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b4230 con 0x55a6190a9e10 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.004+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94171873104976] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x55a6190a9e10 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.004+0000 7ff4d5a62800 20 remove_watcher() i=4 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.004+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94171873120512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b4230 con 0x7ff4c8038040 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.005+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94171873120512] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.005+0000 7ff4d5a62800 20 remove_watcher() i=5 2024-05-07T13:56:14.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.005+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94171873123200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b9100 con 0x7ff4c8038040 2024-05-07T13:56:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.006+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94171873123200] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.006+0000 7ff4d5a62800 20 remove_watcher() i=6 2024-05-07T13:56:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.006+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94171873125552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a6190b4230 con 0x7ff4c8038040 2024-05-07T13:56:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94171873125552] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4cc02f060 con 0x7ff4c8038040 2024-05-07T13:56:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d5a62800 20 remove_watcher() i=7 2024-05-07T13:56:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff4c8038040 msgr2=0x7ff4c801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7ff4c8038040 0x7ff4c801bab0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a6190a9e10 msgr2=0x55a6190ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a6190a9e10 0x55a6190ac2d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4c40b6020 msgr2=0x7ff4c407e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7ff4c40b6020 0x7ff4c407e960 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a6190ae800 msgr2=0x55a6190b0bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.007+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a6190ae800 0x55a6190b0bf0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff39c036900 msgr2=0x7ff39c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff39c036900 0x7ff39c038dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8001b60 tx=0x7ff4c8010000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 msgr2=0x55a61909e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d3d69640 1 -- 172.21.15.50:0/2593115773 reap_dead start 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a61909e650 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4069c60 tx=0x7ff4c407def0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 shutdown_connections 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/2593115773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a619097280 0x55a61909e650 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 >> 172.21.15.50:0/2593115773 conn(0x55a6190935e0 msgr2=0x55a619090c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 shutdown_connections 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/2593115773 wait complete. 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/449683082 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3ac036900 msgr2=0x7ff3ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/449683082 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3ac036900 0x7ff3ac038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800bf50 tx=0x7ff4c800f000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/449683082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a61908a120 msgr2=0x55a61908a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/449683082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a61908a120 0x55a61908a540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff4c408c780 tx=0x7ff4c408e110 comp rx=0 tx=0).stop 2024-05-07T13:56:14.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/449683082 shutdown_connections 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/449683082 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3ac036900 0x7ff3ac038dc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/449683082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a61908a120 0x55a61908a540 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/449683082 >> 172.21.15.50:0/449683082 conn(0x55a61907e1c0 msgr2=0x55a61907e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/449683082 shutdown_connections 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.008+0000 7ff4d5a62800 1 -- 172.21.15.50:0/449683082 wait complete. 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a619079110 msgr2=0x55a61907b560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a619079110 0x55a61907b560 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a618f6f330 msgr2=0x55a6190728d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a618f6f330 0x55a6190728d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a619075180 msgr2=0x55a619077570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a619075180 0x55a619077570 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3b8036900 msgr2=0x7ff3b8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ff3b8036900 0x7ff3b8038dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8000f60 tx=0x7ff4c80012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 msgr2=0x55a61906b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 --2- 172.21.15.50:0/1197391335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a618f6e9d0 0x55a61906b690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4000c00 tx=0x7ff4c4002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d3d69640 1 -- 172.21.15.50:0/1197391335 reap_dead start 2024-05-07T13:56:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 shutdown_connections 2024-05-07T13:56:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 >> 172.21.15.50:0/1197391335 conn(0x55a618f6a550 msgr2=0x55a61905dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 shutdown_connections 2024-05-07T13:56:14.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.009+0000 7ff4d5a62800 1 -- 172.21.15.50:0/1197391335 wait complete. 2024-05-07T13:56:14.020 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-07T13:56:13.995676Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:13.995658Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:14.021 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-07T13:56:14.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-07T13:56:14.021 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-05-07T13:56:14.070 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:14.071 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:14.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.083+0000 7f7c6fd38800 1 Processor -- start 2024-05-07T13:56:14.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.083+0000 7f7c6fd38800 1 -- start start 2024-05-07T13:56:14.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.083+0000 7f7c6fd38800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x555a4279d030 0x555a4282ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.083+0000 7f7c6fd38800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a42830f70 con 0x555a4282d220 2024-05-07T13:56:14.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.083+0000 7f7c6fd38800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x555a426bb050 con 0x555a4279d030 2024-05-07T13:56:14.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.083+0000 7f7c6ba96640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x555a4279d030 0x555a4282ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.083+0000 7f7c6ba96640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x555a4279d030 0x555a4282ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50268/0 (socket says 172.21.15.50:50268) 2024-05-07T13:56:14.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.083+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3279455407 learned_addr learned my addr 172.21.15.50:0/3279455407 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.083+0000 7f7c63fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x555a4282d220 0x555a4282f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40722/0 (socket says 172.21.15.50:40722) 2024-05-07T13:56:14.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.084+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3279455407 >> v1:172.21.15.22:6789/0 conn(0x555a4282d220 legacy=0x555a4282f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.084+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3279455407 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a428321a0 con 0x555a4279d030 2024-05-07T13:56:14.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.084+0000 7f7c6b295640 1 -- 172.21.15.50:0/3279455407 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620940339 0 0) 0x555a42830f70 con 0x555a4282d220 2024-05-07T13:56:14.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/3279455407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a4282ccb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00a520 tx=0x7f7c5c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d621ff43cb7701cb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6b295640 1 -- 172.21.15.50:0/3279455407 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c057070 con 0x555a4279d030 2024-05-07T13:56:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6b295640 1 -- 172.21.15.50:0/3279455407 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c052570 con 0x555a4279d030 2024-05-07T13:56:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6b295640 1 -- 172.21.15.50:0/3279455407 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c04ae60 con 0x555a4279d030 2024-05-07T13:56:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3279455407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 msgr2=0x555a4282ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3279455407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a4282ccb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00a520 tx=0x7f7c5c01d010 comp rx=0 tx=0).stop 2024-05-07T13:56:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3279455407 shutdown_connections 2024-05-07T13:56:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3279455407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a4282ccb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3279455407 >> 172.21.15.50:0/3279455407 conn(0x555a428245d0 msgr2=0x555a428269f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3279455407 shutdown_connections 2024-05-07T13:56:14.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.086+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3279455407 wait complete. 2024-05-07T13:56:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.101+0000 7f7c6fd38800 1 Processor -- start 2024-05-07T13:56:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.101+0000 7f7c6fd38800 1 -- start start 2024-05-07T13:56:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.101+0000 7f7c6fd38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a4291b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.101+0000 7f7c6fd38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555a427751f0 con 0x555a4279d030 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.102+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a4291b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.102+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a4291b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50280/0 (socket says 172.21.15.50:50280) 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.102+0000 7f7c6ba96640 1 -- 172.21.15.50:0/2498946975 learned_addr learned my addr 172.21.15.50:0/2498946975 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.102+0000 7f7c6ba96640 1 -- 172.21.15.50:0/2498946975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a4291bb30 con 0x555a4279d030 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.102+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/2498946975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a4291b560 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c055040 tx=0x7f7c5c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5fdc7d778a5282 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7b59e0b640 1 -- 172.21.15.50:0/2498946975 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c057040 con 0x555a4279d030 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7b59e0b640 1 -- 172.21.15.50:0/2498946975 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c052720 con 0x555a4279d030 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7b59e0b640 1 -- 172.21.15.50:0/2498946975 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c052a20 con 0x555a4279d030 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2498946975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 msgr2=0x555a4291b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2498946975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a4291b560 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c055040 tx=0x7f7c5c04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2498946975 shutdown_connections 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2498946975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a4291b560 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2498946975 >> 172.21.15.50:0/2498946975 conn(0x555a428245d0 msgr2=0x555a42916e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2498946975 shutdown_connections 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.103+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2498946975 wait complete. 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.104+0000 7f7c6fd38800 1 Processor -- start 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.104+0000 7f7c6fd38800 1 -- start start 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.104+0000 7f7c6fd38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a42922fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.104+0000 7f7c6fd38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555a42831440 con 0x555a4279d030 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.104+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a42922fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.104+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a42922fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50296/0 (socket says 172.21.15.50:50296) 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.104+0000 7f7c6ba96640 1 -- 172.21.15.50:0/2831969462 learned_addr learned my addr 172.21.15.50:0/2831969462 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.104+0000 7f7c6ba96640 1 -- 172.21.15.50:0/2831969462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a42923520 con 0x555a4279d030 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.104+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a42922fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c052540 tx=0x7f7c5c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.105+0000 7f7b53fff640 1 -- 172.21.15.50:0/2831969462 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c073070 con 0x555a4279d030 2024-05-07T13:56:14.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.105+0000 7f7b53fff640 1 -- 172.21.15.50:0/2831969462 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c05d440 con 0x555a4279d030 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.105+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a429237b0 con 0x555a4279d030 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.105+0000 7f7b53fff640 1 -- 172.21.15.50:0/2831969462 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c057070 con 0x555a4279d030 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.105+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a42926410 con 0x555a4279d030 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.106+0000 7f7b53fff640 1 -- 172.21.15.50:0/2831969462 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7c5c076070 con 0x555a4279d030 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.106+0000 7f7b53fff640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b54036950 0x7f7b54038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.106+0000 7f7b53fff640 1 -- 172.21.15.50:0/2831969462 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7c5c08dc60 con 0x555a4279d030 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.106+0000 7f7c63fff640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b54036950 0x7f7b54038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.106+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a4282d220 0x555a4292a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.106+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a4292a710 con 0x555a4282d220 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.106+0000 7f7c6c297640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a4282d220 0x555a4292a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.106+0000 7f7c63fff640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b54036950 0x7f7b54038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7c54000c00 tx=0x7f7c540013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.106+0000 7f7c6c297640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a4282d220 0x555a4292a1d0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.107+0000 7f7c6c297640 1 -- 172.21.15.50:0/2831969462 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a4282d220 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.107+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a42927780 con 0x555a4282d220 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.107+0000 7f7c6c297640 1 -- 172.21.15.50:0/2831969462 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a4282d220 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.107+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a4292ca00 0x555a4292edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.107+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a4292f4c0 con 0x555a4292ca00 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.107+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a4292ca00 0x555a4292edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.107+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a4292ca00 0x555a4292edf0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.108+0000 7f7c6ba96640 1 -- 172.21.15.50:0/2831969462 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7c5c075030 con 0x555a4292ca00 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.108+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a4292b9b0 con 0x555a4282d220 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.108+0000 7f7c6c297640 1 -- 172.21.15.50:0/2831969462 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a4282d220 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.108+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555a42930900 0x555a42932dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.108+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a42933550 con 0x555a42930900 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.109+0000 7f7c63fff640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555a42930900 0x555a42932dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.109+0000 7f7c63fff640 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555a42930900 0x555a42932dc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.109+0000 7f7c63fff640 1 -- 172.21.15.50:0/2831969462 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7c5400f670 con 0x555a42930900 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.110+0000 7f7c6fd38800 1 Processor -- start 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.110+0000 7f7c6fd38800 1 -- start start 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.110+0000 7f7c6fd38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a42941a00 0x555a42941e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.110+0000 7f7c6fd38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555a4271bcf0 con 0x555a42941a00 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.110+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a42941a00 0x555a42941e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.110+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a42941a00 0x555a42941e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50312/0 (socket says 172.21.15.50:50312) 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.110+0000 7f7c6ba96640 1 -- 172.21.15.50:0/1007913655 learned_addr learned my addr 172.21.15.50:0/1007913655 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.110+0000 7f7c6ba96640 1 -- 172.21.15.50:0/1007913655 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a42942360 con 0x555a42941a00 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.110+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/1007913655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a42941a00 0x555a42941e20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c08bfc0 tx=0x7f7c5c077a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.111+0000 7f7b517fa640 1 -- 172.21.15.50:0/1007913655 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c05cdc0 con 0x555a42941a00 2024-05-07T13:56:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.111+0000 7f7b517fa640 1 -- 172.21.15.50:0/1007913655 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c054a50 con 0x555a42941a00 2024-05-07T13:56:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.111+0000 7f7c6fd38800 1 -- 172.21.15.50:0/1007913655 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a42942dd0 con 0x555a42941a00 2024-05-07T13:56:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.111+0000 7f7b517fa640 1 -- 172.21.15.50:0/1007913655 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c054d70 con 0x555a42941a00 2024-05-07T13:56:14.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.111+0000 7f7c6fd38800 1 -- 172.21.15.50:0/1007913655 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a429432d0 con 0x555a42941a00 2024-05-07T13:56:14.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.111+0000 7f7b517fa640 1 -- 172.21.15.50:0/1007913655 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7c5c05d720 con 0x555a42941a00 2024-05-07T13:56:14.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.112+0000 7f7b517fa640 1 --2- 172.21.15.50:0/1007913655 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b44036950 0x7f7b44038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.112+0000 7f7b517fa640 1 -- 172.21.15.50:0/1007913655 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7c5c083040 con 0x555a42941a00 2024-05-07T13:56:14.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.112+0000 7f7c63fff640 1 --2- 172.21.15.50:0/1007913655 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b44036950 0x7f7b44038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.112+0000 7f7c6fd38800 1 Processor -- start 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.112+0000 7f7c6fd38800 1 -- start start 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.112+0000 7f7c63fff640 1 --2- 172.21.15.50:0/1007913655 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b44036950 0x7f7b44038e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x555a4292aba0 tx=0x7f7c54006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.112+0000 7f7c6fd38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a4294ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.112+0000 7f7c6fd38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555a4291bdf0 con 0x555a4294eb50 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.112+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a4294ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.113+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a4294ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50328/0 (socket says 172.21.15.50:50328) 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.113+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3644212601 learned_addr learned my addr 172.21.15.50:0/3644212601 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.113+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3644212601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a4294f540 con 0x555a4294eb50 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.113+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/3644212601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a4294ef70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c09e020 tx=0x7f7c5c079f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c1bd4a8dde8110 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.113+0000 7f7b4affd640 1 -- 172.21.15.50:0/3644212601 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c09e3f0 con 0x555a4294eb50 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.113+0000 7f7b4affd640 1 -- 172.21.15.50:0/3644212601 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c085de0 con 0x555a4294eb50 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.113+0000 7f7b4affd640 1 -- 172.21.15.50:0/3644212601 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c085700 con 0x555a4294eb50 2024-05-07T13:56:14.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3644212601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 msgr2=0x555a4294ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3644212601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a4294ef70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c09e020 tx=0x7f7c5c079f00 comp rx=0 tx=0).stop 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3644212601 shutdown_connections 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3644212601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a4294ef70 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3644212601 >> 172.21.15.50:0/3644212601 conn(0x555a4294ae60 msgr2=0x555a42948ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3644212601 shutdown_connections 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3644212601 wait complete. 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 Processor -- start 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 -- start start 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a42955fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6fd38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555a4294fbd0 con 0x555a4294eb50 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a42955fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6ba96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a42955fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50330/0 (socket says 172.21.15.50:50330) 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.114+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 learned_addr learned my addr 172.21.15.50:0/3228492080 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.115+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a429564e0 con 0x555a4294eb50 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.115+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a42955fa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c044990 tx=0x7f7c5c08da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.115+0000 7f7b497fa640 1 -- 172.21.15.50:0/3228492080 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c0b1040 con 0x555a4294eb50 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.115+0000 7f7b497fa640 1 -- 172.21.15.50:0/3228492080 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c085b20 con 0x555a4294eb50 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.115+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a429564e0 con 0x555a4294eb50 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.115+0000 7f7b497fa640 1 -- 172.21.15.50:0/3228492080 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5c08d540 con 0x555a4294eb50 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.115+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a429564e0 con 0x555a4294eb50 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.116+0000 7f7b497fa640 1 -- 172.21.15.50:0/3228492080 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7c5c0be020 con 0x555a4294eb50 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.116+0000 7f7b497fa640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b34036950 0x7f7b34038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.116+0000 7f7b497fa640 1 -- 172.21.15.50:0/3228492080 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7c5c0bc020 con 0x555a4294eb50 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.116+0000 7f7c63fff640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b34036950 0x7f7b34038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.117+0000 7f7c63fff640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b34036950 0x7f7b34038e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x555a42933950 tx=0x7f7c54023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.117+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.117+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a429616a0 0x555a42963b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.117+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429642b0 con 0x555a429616a0 2024-05-07T13:56:14.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.117+0000 7f7c6c297640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a429616a0 0x555a42963b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.117+0000 7f7c6c297640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a429616a0 0x555a42963b60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a429616a0 2024-05-07T13:56:14.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 20 realm 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429646c0 con 0x555a429616a0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a429616a0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a42964f90 con 0x555a429616a0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a429616a0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a429616a0 2024-05-07T13:56:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a429616a0 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a42966090 0x555a42968480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.118+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a42968a40 con 0x555a42966090 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.119+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a42966090 0x555a42968480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.119+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a42966090 0x555a42968480 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.119+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.119+0000 7f7c6fd38800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.119+0000 7f7c6fd38800 20 searching for the correct realm 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.119+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a4296a370 con 0x555a42966090 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.120+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.120+0000 7f7c6ba96640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7c5c078060 0x7f7c5c061910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.120+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a4296a370 con 0x7f7c5c078060 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.120+0000 7f7c63fff640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7c5c078060 0x7f7c5c061910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.120+0000 7f7c63fff640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7c5c078060 0x7f7c5c061910 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.120+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.120+0000 7f7c63fff640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7c5403a3c0 0x7f7c5403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.120+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a4296a370 con 0x7f7c5403a3c0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.121+0000 7f7c6c297640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7c5403a3c0 0x7f7c5403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.121+0000 7f7c6c297640 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7c5403a3c0 0x7f7c5403a810 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.121+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6400a4a0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.121+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a429616a0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.121+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a429616a0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.121+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a429616a0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.122+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a429616a0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.122+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5403a3c0 2024-05-07T13:56:14.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.122+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6400a4a0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.122+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5403a3c0 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.122+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7c6400a4a0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.122+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5c078060 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.122+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.122+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a42966090 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.123+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.123+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a429616a0 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.123+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a429616a0 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.123+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5403a3c0 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.123+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6400a4a0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.123+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a429616a0 2024-05-07T13:56:14.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.123+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a429616a0 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.124+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5c078060 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.124+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.124+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a42966090 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.124+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.124+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a42966090 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.124+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.124+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5403a3c0 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.125+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6400a4a0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.125+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a42966090 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.125+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.125+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a42966090 2024-05-07T13:56:14.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.125+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.125+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a429616a0 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.125+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6400a4a0 con 0x555a429616a0 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.125+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a429616a0 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.126+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.126+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5403a3c0 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.126+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.126+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a42966090 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.126+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.126+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5c078060 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.126+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.127+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a429616a0 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.127+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.127+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5403a3c0 2024-05-07T13:56:14.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.127+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.127+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a42966090 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.128+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.128+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5403a3c0 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.128+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.128+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5c078060 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.128+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.128+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a42966090 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5403a3c0 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x555a429616a0 2024-05-07T13:56:14.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a42965330 con 0x7f7c5c078060 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6fd38800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6fd38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6fd38800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6fd38800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6fd38800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6fd38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.129+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a42969300 con 0x555a429616a0 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.130+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.130+0000 7f7c6fd38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.130+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.130+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429696f0 con 0x555a429616a0 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.130+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.130+0000 7f7c6fd38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.130+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.130+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429696f0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 20 zone default found 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 4 Realm: () 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:14.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 20 zonegroup default 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a42968f60 con 0x7f7c5403a3c0 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a42968f60 con 0x555a42966090 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a4296c2b0 con 0x555a42966090 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.131+0000 7f7c6fd38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.132+0000 7f7c6fd38800 20 started sync module instance, tier type = 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.132+0000 7f7c6fd38800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.132+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a4296b670 con 0x7f7c5c078060 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.133+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.133+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93846152592016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a4296b2d0 con 0x7f7c5c078060 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.133+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a4296d1e0 con 0x555a429616a0 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.134+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93846152592016] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.134+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.134+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93846152596784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a4296d150 con 0x555a429616a0 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.134+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a4296e0a0 con 0x555a42966090 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.135+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.135+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93846152600560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a4296e940 con 0x555a42966090 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.135+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a4296f410 con 0x7f7c5c078060 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.135+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93846152596784] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.136+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93846152600560] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.136+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.136+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93846152605440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a4296f800 con 0x7f7c5c078060 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.136+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42970090 con 0x555a429616a0 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.137+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.137+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93846152608672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42970930 con 0x555a429616a0 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.137+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93846152605440] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.137+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42971410 con 0x7f7c5403a3c0 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.138+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93846152608672] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.138+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.138+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93846152613664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42970860 con 0x7f7c5403a3c0 2024-05-07T13:56:14.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.138+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a429718c0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.139+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93846152613664] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.139+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.139+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93846152611216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a429718c0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.140+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42972280 con 0x7f7c5403a3c0 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.140+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93846152611216] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.140+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93846152615408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42972280 con 0x7f7c5403a3c0 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 20 add_watcher() i=0 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 20 add_watcher() i=1 2024-05-07T13:56:14.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 20 add_watcher() i=2 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 20 add_watcher() i=3 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 20 add_watcher() i=4 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 20 add_watcher() i=5 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 20 add_watcher() i=6 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93846152615408] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 20 add_watcher() i=7 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.141+0000 7f7c6fd38800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.142+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429755e0 con 0x555a429616a0 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.142+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.142+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93846152630240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a429723f0 con 0x555a429616a0 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.143+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93846152630240] v27'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.143+0000 7f7b21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.143+0000 7f7c6fd38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.143+0000 7f7c6fd38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.143+0000 7f7c6fd38800 5 note: GC not initialized 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.143+0000 7f7b20fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.143+0000 7f7c6fd38800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 20 Filter name: none 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7a9a7fc640 20 reqs_thread_entry: start 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429a8c00 con 0x7f7c5403a3c0 2024-05-07T13:56:14.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 20 rados_obj.operate() r=0 bl.length=419 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.144+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429a8650 con 0x7f7c5c078060 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:56:14.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 : miss 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429ac140 con 0x7f7c5c078060 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(64 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:14.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:14.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-05-07T13:56:14.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.145+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a429b0960 con 0x7f7c5c078060 2024-05-07T13:56:14.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.147+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 foo.buckets [call] v27'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.147+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 8.0 8:04fc31cd:root::.bucket.meta.testx%3amyfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a429b4270 con 0x555a42966090 2024-05-07T13:56:14.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [create,call,writefull 0~412,setxattr (203)] v27'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7c6fd38800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x7 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7c6fd38800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7c6fd38800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7c6fd38800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1, ofs0, ns] 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 93846152879856 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429b3bd0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== watch-notify(notify (1) cookie 93846152615408 notify 115964117000 ret 0) ==== 889+0+0 (crc 0 0 0) 0x7f7c6401e040 con 0x7f7c5403a3c0 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7b4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 93846152615408 notifier 4537 bl.length()=847 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7b4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x7 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7b4affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7b4affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(67 notify.7 [notify cookie 93846152879856 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.148+0000 7f7b4affd640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f7b30003ea0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.149+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.149+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== watch-notify(notify_complete (2) cookie 93846152879856 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7c64027ab0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.149+0000 7f7c6fd38800 20 handle_bi_update(): bucket=testx:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_sources= new_sources= 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.149+0000 7f7c6fd38800 20 handle_bi_update(): bucket=testx:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential sources added=[] removed=[] 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.149+0000 7f7c6fd38800 20 handle_bi_update(): bucket=testx:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_dests= new_dests= 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.149+0000 7f7c6fd38800 20 handle_bi_update(): bucket=testx:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential dests added=[] removed=[] 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.149+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a429afb90 con 0x555a429616a0 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.150+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v27'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.150+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a429b2f00 con 0x555a429616a0 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v27'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7c6fd38800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-07T13:56:14.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7c6fd38800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7c6fd38800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 93846152869600 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429b2f00 con 0x555a429616a0 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 93846152608672 notify 115964117003 ret 0) ==== 390+0+0 (crc 0 0 0) 0x555a429afb90 con 0x555a429616a0 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7b4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 93846152608672 notifier 4537 bl.length()=348 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7b4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7b4a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(71 notify.4 [notify cookie 93846152869600 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7b4a7fc640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f7aa0003400 con 0x555a429616a0 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.151+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.152+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 93846152869600 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a429b4450 con 0x555a429616a0 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.152+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a429af6e0 con 0x7f7c5c078060 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.153+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(73 myfoo [call,delete] v27'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.153+0000 7f7c6fd38800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.153+0000 7f7c6fd38800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.153+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93846152869600 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429b0ee0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.153+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== watch-notify(notify (1) cookie 93846152611216 notify 115964117001 ret 0) ==== 191+0+0 (crc 0 0 0) 0x555a429b4450 con 0x7f7c5403a3c0 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.153+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(74 notify.6 [notify cookie 93846152869600 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.153+0000 7f7b4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 93846152611216 notifier 4537 bl.length()=149 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.153+0000 7f7b4affd640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f7b30003ea0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.154+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== watch-notify(notify_complete (2) cookie 93846152869600 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7c64027ab0 con 0x7f7c5403a3c0 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.154+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.154+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:76 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a429af6e0 con 0x7f7c5c078060 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(76 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call,delete] v27'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7c6fd38800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 from cache 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7c6fd38800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1, ofs0, ns] 2024-05-07T13:56:14.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93846152869600 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a429afdf0 con 0x7f7c5c078060 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== watch-notify(notify (1) cookie 93846152592016 notify 115964117014 ret 0) ==== 248+0+0 (crc 0 0 0) 0x555a429ac530 con 0x7f7c5c078060 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7b4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117014 cookie 93846152592016 notifier 4537 bl.length()=206 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7b4affd640 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f7b30003ea0 con 0x7f7c5c078060 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(77 notify.0 [notify cookie 93846152869600 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.155+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== watch-notify(notify_complete (2) cookie 93846152869600 notify 115964117014 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a429ab6e0 con 0x7f7c5c078060 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.156+0000 7f7b21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.156+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93846152630240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42991490 con 0x555a429616a0 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.157+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93846152630240] v27'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.157+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93846152592016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42991490 con 0x7f7c5c078060 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.158+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93846152592016] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.158+0000 7f7c6fd38800 20 remove_watcher() i=0 2024-05-07T13:56:14.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.158+0000 7f7c6fd38800 2 removed watcher, disabling cache 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.158+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93846152596784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42991490 con 0x555a429616a0 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.159+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93846152596784] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.159+0000 7f7c6fd38800 20 remove_watcher() i=1 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.159+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93846152600560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42991490 con 0x555a42966090 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.160+0000 7f7c6ba96640 1 -- 172.21.15.50:0/3228492080 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93846152600560] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c5c075030 con 0x555a42966090 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.161+0000 7f7c6fd38800 20 remove_watcher() i=2 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.161+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93846152605440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42991490 con 0x7f7c5c078060 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.161+0000 7f7c63fff640 1 -- 172.21.15.50:0/3228492080 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93846152605440] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54037040 con 0x7f7c5c078060 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.162+0000 7f7c6fd38800 20 remove_watcher() i=3 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.162+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93846152608672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42991490 con 0x555a429616a0 2024-05-07T13:56:14.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.163+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93846152608672] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x555a429616a0 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.163+0000 7f7c6fd38800 20 remove_watcher() i=4 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.163+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93846152613664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42991490 con 0x7f7c5403a3c0 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.163+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93846152613664] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.163+0000 7f7c6fd38800 20 remove_watcher() i=5 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.163+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93846152611216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42991490 con 0x7f7c5403a3c0 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.164+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93846152611216] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.164+0000 7f7c6fd38800 20 remove_watcher() i=6 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.164+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93846152615408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a42991490 con 0x7f7c5403a3c0 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.165+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93846152615408] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c6402f060 con 0x7f7c5403a3c0 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.165+0000 7f7c6fd38800 20 remove_watcher() i=7 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.165+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7c5403a3c0 msgr2=0x7f7c5403a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.165+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7c5403a3c0 0x7f7c5403a810 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.165+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a429616a0 msgr2=0x555a42963b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.165+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a429616a0 0x555a42963b60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.165+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7c5c078060 msgr2=0x7f7c5c061910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7c5c078060 0x7f7c5c061910 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a42966090 msgr2=0x555a42968480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a42966090 0x555a42968480 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b34036950 msgr2=0x7f7b34038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b34036950 0x7f7b34038e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x555a42933950 tx=0x7f7c54023040 comp rx=0 tx=0).stop 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 msgr2=0x555a42955fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/3228492080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4294eb50 0x555a42955fa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c044990 tx=0x7f7c5c08da90 comp rx=0 tx=0).stop 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 reap_dead start 2024-05-07T13:56:14.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6c297640 1 -- 172.21.15.50:0/3228492080 reap_dead start 2024-05-07T13:56:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 shutdown_connections 2024-05-07T13:56:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 >> 172.21.15.50:0/3228492080 conn(0x555a4294ae60 msgr2=0x555a429484c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 shutdown_connections 2024-05-07T13:56:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/3228492080 wait complete. 2024-05-07T13:56:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/1007913655 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b44036950 msgr2=0x7f7b44038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/1007913655 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b44036950 0x7f7b44038e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x555a4292aba0 tx=0x7f7c54006000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/1007913655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a42941a00 msgr2=0x555a42941e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/1007913655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a42941a00 0x555a42941e20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c08bfc0 tx=0x7f7c5c077a30 comp rx=0 tx=0).stop 2024-05-07T13:56:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/1007913655 shutdown_connections 2024-05-07T13:56:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/1007913655 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b44036950 0x7f7b44038e10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/1007913655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a42941a00 0x555a42941e20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/1007913655 >> 172.21.15.50:0/1007913655 conn(0x555a42935aa0 msgr2=0x555a42935ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/1007913655 shutdown_connections 2024-05-07T13:56:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.166+0000 7f7c6fd38800 1 -- 172.21.15.50:0/1007913655 wait complete. 2024-05-07T13:56:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555a42930900 msgr2=0x555a42932dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x555a42930900 0x555a42932dc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a4282d220 msgr2=0x555a4292a1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x555a4282d220 0x555a4292a1d0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a4292ca00 msgr2=0x555a4292edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x555a4292ca00 0x555a4292edf0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b54036950 msgr2=0x7f7b54038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7b54036950 0x7f7b54038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7c54000c00 tx=0x7f7c540013b0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 msgr2=0x555a42922fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 --2- 172.21.15.50:0/2831969462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555a4279d030 0x555a42922fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c052540 tx=0x7f7c5c003020 comp rx=0 tx=0).stop 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6c297640 1 -- 172.21.15.50:0/2831969462 reap_dead start 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 shutdown_connections 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 >> 172.21.15.50:0/2831969462 conn(0x555a428245d0 msgr2=0x555a42915680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 shutdown_connections 2024-05-07T13:56:14.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.167+0000 7f7c6fd38800 1 -- 172.21.15.50:0/2831969462 wait complete. 2024-05-07T13:56:14.178 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-05-07T13:56:14.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-05-07T13:56:14.178 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-05-07T13:56:14.222 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:14.223 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:14.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f2dd46800 1 Processor -- start 2024-05-07T13:56:14.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f2dd46800 1 -- start start 2024-05-07T13:56:14.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f2dd46800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55815dd5ba00 0x55815dd5be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f2dd46800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55815dcd0a40 con 0x55815dd5c360 2024-05-07T13:56:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f2dd46800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55815dbee050 con 0x55815dd5ba00 2024-05-07T13:56:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f2b845640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55815dd5ba00 0x55815dd5be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f2b845640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55815dd5ba00 0x55815dd5be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50332/0 (socket says 172.21.15.50:50332) 2024-05-07T13:56:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f2b845640 1 -- 172.21.15.50:0/34754444 learned_addr learned my addr 172.21.15.50:0/34754444 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f23044640 1 --1- 172.21.15.50:0/34754444 >> v1:172.21.15.22:6789/0 conn(0x55815dd5c360 0x55815dd5c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40724/0 (socket says 172.21.15.50:40724) 2024-05-07T13:56:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.235+0000 7f5f2b845640 1 -- 172.21.15.50:0/34754444 >> v1:172.21.15.22:6789/0 conn(0x55815dd5c360 legacy=0x55815dd5c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.236+0000 7f5f2b044640 1 -- 172.21.15.50:0/34754444 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399401538 0 0) 0x55815dcd0a40 con 0x55815dd5c360 2024-05-07T13:56:14.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.236+0000 7f5f2b845640 1 -- 172.21.15.50:0/34754444 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55815dd5cf20 con 0x55815dd5ba00 2024-05-07T13:56:14.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.237+0000 7f5f2b845640 1 --2- 172.21.15.50:0/34754444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815dd5be20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00a520 tx=0x7f5f1c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca5bb4056bdf76f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2b044640 1 -- 172.21.15.50:0/34754444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c057070 con 0x55815dd5ba00 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2b044640 1 -- 172.21.15.50:0/34754444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c052570 con 0x55815dd5ba00 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2b044640 1 -- 172.21.15.50:0/34754444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c04ae60 con 0x55815dd5ba00 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2dd46800 1 -- 172.21.15.50:0/34754444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 msgr2=0x55815dd5be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/34754444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815dd5be20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00a520 tx=0x7f5f1c01d010 comp rx=0 tx=0).stop 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2dd46800 1 -- 172.21.15.50:0/34754444 shutdown_connections 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/34754444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815dd5be20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2dd46800 1 -- 172.21.15.50:0/34754444 >> 172.21.15.50:0/34754444 conn(0x55815dd57560 msgr2=0x55815dd59980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2dd46800 1 -- 172.21.15.50:0/34754444 shutdown_connections 2024-05-07T13:56:14.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.238+0000 7f5f2dd46800 1 -- 172.21.15.50:0/34754444 wait complete. 2024-05-07T13:56:14.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.253+0000 7f5f2dd46800 1 Processor -- start 2024-05-07T13:56:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.254+0000 7f5f2dd46800 1 -- start start 2024-05-07T13:56:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.254+0000 7f5f2dd46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de50a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.254+0000 7f5f2dd46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55815dca81d0 con 0x55815dd5ba00 2024-05-07T13:56:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.254+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de50a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.254+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de50a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50334/0 (socket says 172.21.15.50:50334) 2024-05-07T13:56:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.254+0000 7f5f2b845640 1 -- 172.21.15.50:0/2363786618 learned_addr learned my addr 172.21.15.50:0/2363786618 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.254+0000 7f5f2b845640 1 -- 172.21.15.50:0/2363786618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55815de50ff0 con 0x55815dd5ba00 2024-05-07T13:56:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.254+0000 7f5f2b845640 1 --2- 172.21.15.50:0/2363786618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de50a20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c055040 tx=0x7f5f1c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f526b37b2b0ba027 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5e19e0b640 1 -- 172.21.15.50:0/2363786618 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c057040 con 0x55815dd5ba00 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5e19e0b640 1 -- 172.21.15.50:0/2363786618 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c052720 con 0x55815dd5ba00 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5e19e0b640 1 -- 172.21.15.50:0/2363786618 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c052a40 con 0x55815dd5ba00 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2363786618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 msgr2=0x55815de50a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2363786618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de50a20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c055040 tx=0x7f5f1c04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2363786618 shutdown_connections 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2363786618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de50a20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2363786618 >> 172.21.15.50:0/2363786618 conn(0x55815dd57560 msgr2=0x55815de4c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2363786618 shutdown_connections 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.255+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2363786618 wait complete. 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.256+0000 7f5f2dd46800 1 Processor -- start 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.256+0000 7f5f2dd46800 1 -- start start 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.256+0000 7f5f2dd46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de58450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.256+0000 7f5f2dd46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55815dd5d4b0 con 0x55815dd5ba00 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.256+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de58450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.256+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de58450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50342/0 (socket says 172.21.15.50:50342) 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.256+0000 7f5f2b845640 1 -- 172.21.15.50:0/2377503053 learned_addr learned my addr 172.21.15.50:0/2377503053 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.256+0000 7f5f2b845640 1 -- 172.21.15.50:0/2377503053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55815de58990 con 0x55815dd5ba00 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.257+0000 7f5f2b845640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de58450 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c052540 tx=0x7f5f1c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.257+0000 7f5e13fff640 1 -- 172.21.15.50:0/2377503053 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c073070 con 0x55815dd5ba00 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.257+0000 7f5e13fff640 1 -- 172.21.15.50:0/2377503053 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c05d440 con 0x55815dd5ba00 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.257+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55815de58c20 con 0x55815dd5ba00 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.257+0000 7f5e13fff640 1 -- 172.21.15.50:0/2377503053 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c057070 con 0x55815dd5ba00 2024-05-07T13:56:14.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.257+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55815de5b8d0 con 0x55815dd5ba00 2024-05-07T13:56:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.258+0000 7f5e13fff640 1 -- 172.21.15.50:0/2377503053 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f1c076070 con 0x55815dd5ba00 2024-05-07T13:56:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.258+0000 7f5e13fff640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e14036950 0x7f5e14038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.258+0000 7f5e13fff640 1 -- 172.21.15.50:0/2377503053 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5f1c08db90 con 0x55815dd5ba00 2024-05-07T13:56:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.258+0000 7f5f23044640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e14036950 0x7f5e14038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.258+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815dd5c360 0x55815de5f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.258+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de5fbd0 con 0x55815dd5c360 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.258+0000 7f5f2c046640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815dd5c360 0x55815de5f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.258+0000 7f5f23044640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e14036950 0x7f5e14038e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f14000c00 tx=0x7f5f140013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.258+0000 7f5f2c046640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815dd5c360 0x55815de5f690 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.259+0000 7f5f2c046640 1 -- 172.21.15.50:0/2377503053 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815dd5c360 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.259+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de5cc40 con 0x55815dd5c360 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.259+0000 7f5f2c046640 1 -- 172.21.15.50:0/2377503053 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815dd5c360 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.259+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de61ef0 0x55815de642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.259+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de649d0 con 0x55815de61ef0 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.259+0000 7f5f2b845640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de61ef0 0x55815de642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.259+0000 7f5f2b845640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de61ef0 0x55815de642e0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.260+0000 7f5f2b845640 1 -- 172.21.15.50:0/2377503053 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f1c075030 con 0x55815de61ef0 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.260+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de60ea0 con 0x55815dd5c360 2024-05-07T13:56:14.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.260+0000 7f5f2c046640 1 -- 172.21.15.50:0/2377503053 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815dd5c360 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.260+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55815de65e80 0x55815de682d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.260+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de68a30 con 0x55815de65e80 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.260+0000 7f5f23044640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55815de65e80 0x55815de682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.261+0000 7f5f23044640 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55815de65e80 0x55815de682d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.261+0000 7f5f23044640 1 -- 172.21.15.50:0/2377503053 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f1400f670 con 0x55815de65e80 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.261+0000 7f5f2dd46800 1 Processor -- start 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.261+0000 7f5f2dd46800 1 -- start start 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5f2dd46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de76e90 0x55815de772b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5f2dd46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55815dc4ecf0 con 0x55815de76e90 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de76e90 0x55815de772b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de76e90 0x55815de772b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50358/0 (socket says 172.21.15.50:50358) 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5f2b845640 1 -- 172.21.15.50:0/3771920780 learned_addr learned my addr 172.21.15.50:0/3771920780 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5f2b845640 1 -- 172.21.15.50:0/3771920780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55815de777f0 con 0x55815de76e90 2024-05-07T13:56:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5f2b845640 1 --2- 172.21.15.50:0/3771920780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de76e90 0x55815de772b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c076b10 tx=0x7f5f1c0776a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5e117fa640 1 -- 172.21.15.50:0/3771920780 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c083040 con 0x55815de76e90 2024-05-07T13:56:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5e117fa640 1 -- 172.21.15.50:0/3771920780 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c054dd0 con 0x55815de76e90 2024-05-07T13:56:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5e117fa640 1 -- 172.21.15.50:0/3771920780 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c05cbb0 con 0x55815de76e90 2024-05-07T13:56:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5f2dd46800 1 -- 172.21.15.50:0/3771920780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55815de78260 con 0x55815de76e90 2024-05-07T13:56:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.262+0000 7f5f2dd46800 1 -- 172.21.15.50:0/3771920780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55815de78760 con 0x55815de76e90 2024-05-07T13:56:14.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.263+0000 7f5e117fa640 1 -- 172.21.15.50:0/3771920780 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f1c05d720 con 0x55815de76e90 2024-05-07T13:56:14.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.263+0000 7f5e117fa640 1 --2- 172.21.15.50:0/3771920780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e04036900 0x7f5e04038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.263+0000 7f5e117fa640 1 -- 172.21.15.50:0/3771920780 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5f1c098c60 con 0x55815de76e90 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.263+0000 7f5f23044640 1 --2- 172.21.15.50:0/3771920780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e04036900 0x7f5e04038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.264+0000 7f5f2dd46800 1 Processor -- start 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.264+0000 7f5f2dd46800 1 -- start start 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.264+0000 7f5f23044640 1 --2- 172.21.15.50:0/3771920780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e04036900 0x7f5e04038dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55815de604a0 tx=0x7f5f14006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.264+0000 7f5f2dd46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de84480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.264+0000 7f5f2dd46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55815de512b0 con 0x55815de84060 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.264+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de84480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.264+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de84480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50362/0 (socket says 172.21.15.50:50362) 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.264+0000 7f5f2b845640 1 -- 172.21.15.50:0/2520885334 learned_addr learned my addr 172.21.15.50:0/2520885334 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5f2b845640 1 -- 172.21.15.50:0/2520885334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55815de84a50 con 0x55815de84060 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5f2b845640 1 --2- 172.21.15.50:0/2520885334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de84480 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c073ff0 tx=0x7f5f1c0885f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8e2ff281a3a7ad server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5e0affd640 1 -- 172.21.15.50:0/2520885334 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c0a5030 con 0x55815de84060 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5e0affd640 1 -- 172.21.15.50:0/2520885334 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c08a3e0 con 0x55815de84060 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5e0affd640 1 -- 172.21.15.50:0/2520885334 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c05c890 con 0x55815de84060 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2520885334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 msgr2=0x55815de84480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2520885334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de84480 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c073ff0 tx=0x7f5f1c0885f0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2520885334 shutdown_connections 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2520885334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de84480 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2520885334 >> 172.21.15.50:0/2520885334 conn(0x55815de80330 msgr2=0x55815de7e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2520885334 shutdown_connections 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.265+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2520885334 wait complete. 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.266+0000 7f5f2dd46800 1 Processor -- start 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.266+0000 7f5f2dd46800 1 -- start start 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.266+0000 7f5f2dd46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de8b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.266+0000 7f5f2dd46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55815de850b0 con 0x55815de84060 2024-05-07T13:56:14.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.266+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de8b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.266+0000 7f5f2b845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de8b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50376/0 (socket says 172.21.15.50:50376) 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.266+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 learned_addr learned my addr 172.21.15.50:0/1079310910 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.266+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55815de8b890 con 0x55815de84060 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.266+0000 7f5f2b845640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de8b350 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c08db60 tx=0x7f5f1c08dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.267+0000 7f5e097fa640 1 -- 172.21.15.50:0/1079310910 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c07f210 con 0x55815de84060 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.267+0000 7f5e097fa640 1 -- 172.21.15.50:0/1079310910 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c0bc070 con 0x55815de84060 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.267+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55815de8b890 con 0x55815de84060 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.267+0000 7f5e097fa640 1 -- 172.21.15.50:0/1079310910 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c061c50 con 0x55815de84060 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.267+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55815de8b890 con 0x55815de84060 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.268+0000 7f5e097fa640 1 -- 172.21.15.50:0/1079310910 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f1c078600 con 0x55815de84060 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.268+0000 7f5e097fa640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036950 0x7f5df4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.268+0000 7f5e097fa640 1 -- 172.21.15.50:0/1079310910 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5f1c0a9070 con 0x55815de84060 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.268+0000 7f5f23044640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036950 0x7f5df4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.268+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.268+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815de96930 0x55815de98df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.268+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de99540 con 0x55815de96930 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.268+0000 7f5f2c046640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815de96930 0x55815de98df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.268+0000 7f5f23044640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036950 0x7f5df4038e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55815de68e30 tx=0x7f5f14023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2c046640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815de96930 0x55815de98df0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 20 realm 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de99950 con 0x55815de96930 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a220 con 0x55815de96930 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.269+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de96930 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2dd46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de9b0b0 0x55815de9d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de9dc00 con 0x55815de9b0b0 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2b845640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de9b0b0 0x55815de9d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2b845640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de9b0b0 0x55815de9d4a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2dd46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2dd46800 20 searching for the correct realm 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.270+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9f5e0 con 0x55815de9b0b0 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.271+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.271+0000 7f5f2b845640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f1c097020 0x7f5f1c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.271+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9f5e0 con 0x7f5f1c097020 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.271+0000 7f5f23044640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f1c097020 0x7f5f1c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.271+0000 7f5f23044640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f1c097020 0x7f5f1c0ae880 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.271+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.271+0000 7f5f23044640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f1403a3c0 0x7f5f1403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.271+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9f5e0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.272+0000 7f5f2c046640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f1403a3c0 0x7f5f1403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.272+0000 7f5f2c046640 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f1403a3c0 0x7f5f1403a810 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.272+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.272+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de96930 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.272+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.272+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de96930 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.273+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.273+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.273+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.273+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.273+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.273+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1c097020 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.273+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.273+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de9b0b0 2024-05-07T13:56:14.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.274+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.274+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de96930 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.274+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.274+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.274+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.274+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de96930 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.274+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.275+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1c097020 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.275+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.275+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de9b0b0 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.275+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.275+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de9b0b0 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.275+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.275+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.276+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.276+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de9b0b0 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.276+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.276+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de9b0b0 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.276+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.276+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de96930 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.277+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.277+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de96930 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.277+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.277+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.277+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.277+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de9b0b0 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.277+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.277+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1c097020 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.278+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.278+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de96930 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.278+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.278+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.278+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.278+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de9b0b0 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.279+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.279+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.279+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.279+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1c097020 2024-05-07T13:56:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.279+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.279+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de9b0b0 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.279+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.279+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.280+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.280+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x55815de96930 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.280+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.280+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55815de9a5c0 con 0x7f5f1c097020 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.280+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de9e5b0 con 0x55815de96930 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de9e9a0 con 0x55815de96930 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.281+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de9e9a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 zone default found 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 4 Realm: () 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 zonegroup default 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de9edc0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815de9f1e0 con 0x55815de9b0b0 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815dea1490 con 0x55815de9b0b0 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 started sync module instance, tier type = 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.282+0000 7f5f2dd46800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.283+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea0930 con 0x7f5f1c097020 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.284+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.284+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94014114762016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea0590 con 0x7f5f1c097020 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.284+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea2340 con 0x55815de96930 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.285+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.285+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94014114766416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea2be0 con 0x55815de96930 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.285+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea3680 con 0x55815de9b0b0 2024-05-07T13:56:14.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.285+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94014114762016] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.286+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94014114766416] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.286+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.286+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94014114771312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea2730 con 0x55815de9b0b0 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.286+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea3ca0 con 0x7f5f1c097020 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.287+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94014114771312] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.287+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.287+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94014114772976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea4040 con 0x7f5f1c097020 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.287+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea4a00 con 0x55815de96930 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.288+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.288+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94014114776880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea52a0 con 0x55815de96930 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.288+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea5d90 con 0x7f5f1403a3c0 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.288+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94014114772976] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.289+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.289+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94014114776880] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.289+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94014114781280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea5d50 con 0x7f5f1403a3c0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.289+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea4df0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.290+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94014114781280] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.290+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.290+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94014114778608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea62f0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.290+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea6cb0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94014114778608] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94014114764848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea6cb0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2dd46800 20 add_watcher() i=0 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2dd46800 20 add_watcher() i=1 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2dd46800 20 add_watcher() i=2 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2dd46800 20 add_watcher() i=3 2024-05-07T13:56:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2dd46800 20 add_watcher() i=4 2024-05-07T13:56:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2dd46800 20 add_watcher() i=5 2024-05-07T13:56:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.291+0000 7f5f2dd46800 20 add_watcher() i=6 2024-05-07T13:56:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.292+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94014114764848] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.292+0000 7f5f2dd46800 20 add_watcher() i=7 2024-05-07T13:56:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.292+0000 7f5f2dd46800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.292+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815dea9fc0 con 0x55815de96930 2024-05-07T13:56:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.292+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.292+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94014114785648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea7240 con 0x55815de96930 2024-05-07T13:56:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.293+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94014114785648] v27'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.293+0000 7f5de1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.293+0000 7f5f2dd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.293+0000 7f5f2dd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.294+0000 7f5f2dd46800 5 note: GC not initialized 2024-05-07T13:56:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.294+0000 7f5de0fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.294+0000 7f5f2dd46800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.294+0000 7f5f2dd46800 20 Filter name: none 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.294+0000 7f5d5a7fc640 20 reqs_thread_entry: start 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.294+0000 7f5f2dd46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.294+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55815dedcfa0 con 0x55815de96930 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.295+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.295+0000 7f5f2dd46800 20 rados_obj.operate() r=0 bl.length=193 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.295+0000 7f5de1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.295+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94014114785648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815de926b0 con 0x55815de96930 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.296+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94014114785648] v27'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.296+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94014114762016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815de926b0 con 0x7f5f1c097020 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.297+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94014114762016] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.297+0000 7f5f2dd46800 20 remove_watcher() i=0 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.297+0000 7f5f2dd46800 2 removed watcher, disabling cache 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.297+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94014114766416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea0d20 con 0x55815de96930 2024-05-07T13:56:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.299+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94014114766416] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.299+0000 7f5f2dd46800 20 remove_watcher() i=1 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.299+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94014114771312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea0d20 con 0x55815de9b0b0 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.299+0000 7f5f2b845640 1 -- 172.21.15.50:0/1079310910 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94014114771312] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1c09e070 con 0x55815de9b0b0 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.299+0000 7f5f2dd46800 20 remove_watcher() i=2 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.300+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94014114772976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea0d20 con 0x7f5f1c097020 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.300+0000 7f5f23044640 1 -- 172.21.15.50:0/1079310910 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94014114772976] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f14037040 con 0x7f5f1c097020 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.300+0000 7f5f2dd46800 20 remove_watcher() i=3 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.300+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94014114776880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea0d20 con 0x55815de96930 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.302+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94014114776880] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x55815de96930 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.302+0000 7f5f2dd46800 20 remove_watcher() i=4 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.302+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94014114781280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea4730 con 0x7f5f1403a3c0 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.303+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94014114781280] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.303+0000 7f5f2dd46800 20 remove_watcher() i=5 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.303+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94014114778608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea0d20 con 0x7f5f1403a3c0 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.304+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94014114778608] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.304+0000 7f5f2dd46800 20 remove_watcher() i=6 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.304+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94014114764848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55815dea5860 con 0x7f5f1403a3c0 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94014114764848] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2400a4a0 con 0x7f5f1403a3c0 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 20 remove_watcher() i=7 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f1403a3c0 msgr2=0x7f5f1403a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f1403a3c0 0x7f5f1403a810 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815de96930 msgr2=0x55815de98df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815de96930 0x55815de98df0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f1c097020 msgr2=0x7f5f1c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5f1c097020 0x7f5f1c0ae880 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de9b0b0 msgr2=0x55815de9d4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de9b0b0 0x55815de9d4a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036950 msgr2=0x7f5df4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036950 0x7f5df4038e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55815de68e30 tx=0x7f5f14023040 comp rx=0 tx=0).stop 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 msgr2=0x55815de8b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de8b350 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c08db60 tx=0x7f5f1c08dab0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2c046640 1 -- 172.21.15.50:0/1079310910 reap_dead start 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 shutdown_connections 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/1079310910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de84060 0x55815de8b350 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 >> 172.21.15.50:0/1079310910 conn(0x55815de80330 msgr2=0x55815de7d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 shutdown_connections 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/1079310910 wait complete. 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/3771920780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e04036900 msgr2=0x7f5e04038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/3771920780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e04036900 0x7f5e04038dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55815de604a0 tx=0x7f5f14006000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/3771920780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de76e90 msgr2=0x55815de772b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/3771920780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de76e90 0x55815de772b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c076b10 tx=0x7f5f1c0776a0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/3771920780 shutdown_connections 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/3771920780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e04036900 0x7f5e04038dc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/3771920780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815de76e90 0x55815de772b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/3771920780 >> 172.21.15.50:0/3771920780 conn(0x55815de6af30 msgr2=0x55815de6b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.305+0000 7f5f2dd46800 1 -- 172.21.15.50:0/3771920780 shutdown_connections 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/3771920780 wait complete. 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55815de65e80 msgr2=0x55815de682d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55815de65e80 0x55815de682d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815dd5c360 msgr2=0x55815de5f690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55815dd5c360 0x55815de5f690 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de61ef0 msgr2=0x55815de642e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55815de61ef0 0x55815de642e0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e14036950 msgr2=0x7f5e14038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5e14036950 0x7f5e14038e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f14000c00 tx=0x7f5f140013b0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 msgr2=0x55815de58450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 --2- 172.21.15.50:0/2377503053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55815dd5ba00 0x55815de58450 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c052540 tx=0x7f5f1c003020 comp rx=0 tx=0).stop 2024-05-07T13:56:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2c046640 1 -- 172.21.15.50:0/2377503053 reap_dead start 2024-05-07T13:56:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 shutdown_connections 2024-05-07T13:56:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 >> 172.21.15.50:0/2377503053 conn(0x55815dd57560 msgr2=0x55815de4ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 shutdown_connections 2024-05-07T13:56:14.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.306+0000 7f5f2dd46800 1 -- 172.21.15.50:0/2377503053 wait complete. 2024-05-07T13:56:14.305 INFO:teuthology.orchestra.run.smithi050.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"2QESg81scydHqgi4d+7uzKN3","ver":2},"mtime":"2024-05-07T13:56:14.151615Z","data":{"bucket":{"name":"myfoo","marker":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","bucket_id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-05-07T13:56:11.609586Z","linked":true,"has_bucket_info":false}} 2024-05-07T13:56:14.305 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '2QESg81scydHqgi4d+7uzKN3', 'ver': 2}, 'mtime': '2024-05-07T13:56:14.151615Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'bucket_id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-05-07T13:56:11.609586Z', 'linked': True, 'has_bucket_info': False}} 2024-05-07T13:56:14.305 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-07T13:56:14.305 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-07T13:56:14.306 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-05-07T13:56:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.367+0000 7f4ff561d800 1 Processor -- start 2024-05-07T13:56:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.367+0000 7f4ff561d800 1 -- start start 2024-05-07T13:56:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.367+0000 7f4ff561d800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558edc427680 0x558edc429a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.367+0000 7f4ff561d800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558edc429fb0 con 0x558edc423b70 2024-05-07T13:56:14.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.367+0000 7f4ff561d800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x558edc2b4050 con 0x558edc427680 2024-05-07T13:56:14.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.368+0000 7f4fea91b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558edc427680 0x558edc429a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.368+0000 7f4ff311c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x558edc423b70 0x558edc425f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40734/0 (socket says 172.21.15.50:40734) 2024-05-07T13:56:14.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.368+0000 7f4ff311c640 1 -- 172.21.15.50:0/1717424484 learned_addr learned my addr 172.21.15.50:0/1717424484 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:14.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.368+0000 7f4fea91b640 1 --2- 172.21.15.50:0/1717424484 >> v2:172.21.15.22:3300/0 conn(0x558edc427680 0x558edc429a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50390/0 (socket says 172.21.15.50:50390) 2024-05-07T13:56:14.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.368+0000 7f4fea91b640 1 -- 172.21.15.50:0/1717424484 >> v1:172.21.15.22:6789/0 conn(0x558edc423b70 legacy=0x558edc425f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.368+0000 7f4fea91b640 1 -- 172.21.15.50:0/1717424484 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edc42b190 con 0x558edc427680 2024-05-07T13:56:14.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4fea91b640 1 --2- 172.21.15.50:0/1717424484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc427680 0x558edc429a70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00a470 tx=0x7f4fdc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6935f85107e6a18 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff291b640 1 -- 172.21.15.50:0/1717424484 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc057070 con 0x558edc427680 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff291b640 1 -- 172.21.15.50:0/1717424484 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fdc052570 con 0x558edc427680 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff291b640 1 -- 172.21.15.50:0/1717424484 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fdc052870 con 0x558edc427680 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff561d800 1 -- 172.21.15.50:0/1717424484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc427680 msgr2=0x558edc429a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff561d800 1 --2- 172.21.15.50:0/1717424484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc427680 0x558edc429a70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00a470 tx=0x7f4fdc01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff561d800 1 -- 172.21.15.50:0/1717424484 shutdown_connections 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff561d800 1 --2- 172.21.15.50:0/1717424484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc427680 0x558edc429a70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff561d800 1 -- 172.21.15.50:0/1717424484 >> 172.21.15.50:0/1717424484 conn(0x558edc41d5c0 msgr2=0x558edc41f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff561d800 1 -- 172.21.15.50:0/1717424484 shutdown_connections 2024-05-07T13:56:14.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.370+0000 7f4ff561d800 1 -- 172.21.15.50:0/1717424484 wait complete. 2024-05-07T13:56:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.386+0000 7f4ff561d800 1 Processor -- start 2024-05-07T13:56:14.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.386+0000 7f4ff561d800 1 -- start start 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.386+0000 7f4ff561d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc4234b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.386+0000 7f4ff561d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558edc36e1c0 con 0x558edc423b70 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.386+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc4234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.386+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc4234b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50402/0 (socket says 172.21.15.50:50402) 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.386+0000 7f4ff311c640 1 -- 172.21.15.50:0/188016850 learned_addr learned my addr 172.21.15.50:0/188016850 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.387+0000 7f4ff311c640 1 -- 172.21.15.50:0/188016850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edc421a70 con 0x558edc423b70 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.387+0000 7f4ff311c640 1 --2- 172.21.15.50:0/188016850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc4234b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4001de0 tx=0x7f4fe400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239b6217ce1d091d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.387+0000 7f4ee160a640 1 -- 172.21.15.50:0/188016850 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe4012020 con 0x558edc423b70 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.387+0000 7f4ee160a640 1 -- 172.21.15.50:0/188016850 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe400e5a0 con 0x558edc423b70 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.387+0000 7f4ee160a640 1 -- 172.21.15.50:0/188016850 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe400e8c0 con 0x558edc423b70 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 -- 172.21.15.50:0/188016850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 msgr2=0x558edc4234b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 --2- 172.21.15.50:0/188016850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc4234b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4001de0 tx=0x7f4fe400b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 -- 172.21.15.50:0/188016850 shutdown_connections 2024-05-07T13:56:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 --2- 172.21.15.50:0/188016850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc4234b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 -- 172.21.15.50:0/188016850 >> 172.21.15.50:0/188016850 conn(0x558edc41d5c0 msgr2=0x558edc510040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 -- 172.21.15.50:0/188016850 shutdown_connections 2024-05-07T13:56:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 -- 172.21.15.50:0/188016850 wait complete. 2024-05-07T13:56:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 Processor -- start 2024-05-07T13:56:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 -- start start 2024-05-07T13:56:14.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc51e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff561d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558edc42a480 con 0x558edc423b70 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc51e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc51e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50406/0 (socket says 172.21.15.50:50406) 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.388+0000 7f4ff311c640 1 -- 172.21.15.50:0/2123245649 learned_addr learned my addr 172.21.15.50:0/2123245649 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.389+0000 7f4ff311c640 1 -- 172.21.15.50:0/2123245649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edc51e9c0 con 0x558edc423b70 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.389+0000 7f4ff311c640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc51e480 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400c010 tx=0x7f4fe4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.389+0000 7f4edfe07640 1 -- 172.21.15.50:0/2123245649 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe4012070 con 0x558edc423b70 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.389+0000 7f4edfe07640 1 -- 172.21.15.50:0/2123245649 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe401a7a0 con 0x558edc423b70 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.389+0000 7f4edfe07640 1 -- 172.21.15.50:0/2123245649 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe401aa80 con 0x558edc423b70 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.389+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558edc51ec50 con 0x558edc423b70 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.389+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558edc521900 con 0x558edc423b70 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.390+0000 7f4edfe07640 1 -- 172.21.15.50:0/2123245649 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4fe4015020 con 0x558edc423b70 2024-05-07T13:56:14.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.390+0000 7f4edfe07640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ed8036950 0x7f4ed8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.390+0000 7f4edfe07640 1 -- 172.21.15.50:0/2123245649 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4fe4020070 con 0x558edc423b70 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.390+0000 7f4fea91b640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ed8036950 0x7f4ed8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.390+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc427680 0x558edc5256c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.390+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc525c00 con 0x558edc427680 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.390+0000 7f4ff391d640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc427680 0x558edc5256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.391+0000 7f4fea91b640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ed8036950 0x7f4ed8038e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc054000 tx=0x7f4fdc04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.391+0000 7f4ff391d640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc427680 0x558edc5256c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.391+0000 7f4ff391d640 1 -- 172.21.15.50:0/2123245649 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc427680 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.391+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc522c90 con 0x558edc427680 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.391+0000 7f4ff391d640 1 -- 172.21.15.50:0/2123245649 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc427680 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.391+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc527ef0 0x558edc52a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.391+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc52a9d0 con 0x558edc527ef0 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.392+0000 7f4ff311c640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc527ef0 0x558edc52a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.392+0000 7f4ff311c640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc527ef0 0x558edc52a2e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.392+0000 7f4ff311c640 1 -- 172.21.15.50:0/2123245649 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc527ef0 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.392+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc526ea0 con 0x558edc427680 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.392+0000 7f4ff391d640 1 -- 172.21.15.50:0/2123245649 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc427680 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.393+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558edc52be80 0x558edc52e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.393+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc52ea30 con 0x558edc52be80 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.393+0000 7f4fea91b640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558edc52be80 0x558edc52e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.393+0000 7f4fea91b640 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558edc52be80 0x558edc52e2d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.393+0000 7f4fea91b640 1 -- 172.21.15.50:0/2123245649 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4fdc05a040 con 0x558edc52be80 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.394+0000 7f4ff561d800 1 Processor -- start 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.394+0000 7f4ff561d800 1 -- start start 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.394+0000 7f4ff561d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc53ce90 0x558edc53d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.394+0000 7f4ff561d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558edc314cf0 con 0x558edc53ce90 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.394+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc53ce90 0x558edc53d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.394+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc53ce90 0x558edc53d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50410/0 (socket says 172.21.15.50:50410) 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.394+0000 7f4ff311c640 1 -- 172.21.15.50:0/382714878 learned_addr learned my addr 172.21.15.50:0/382714878 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.394+0000 7f4ff311c640 1 -- 172.21.15.50:0/382714878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edc53d7f0 con 0x558edc53ce90 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.395+0000 7f4ff311c640 1 --2- 172.21.15.50:0/382714878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc53ce90 0x558edc53d2b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4fe404aa30 tx=0x7f4fe404ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.395+0000 7f4edd602640 1 -- 172.21.15.50:0/382714878 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe404c3f0 con 0x558edc53ce90 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.395+0000 7f4edd602640 1 -- 172.21.15.50:0/382714878 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe40490e0 con 0x558edc53ce90 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.395+0000 7f4ff561d800 1 -- 172.21.15.50:0/382714878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558edc53e260 con 0x558edc53ce90 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.395+0000 7f4edd602640 1 -- 172.21.15.50:0/382714878 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe40493c0 con 0x558edc53ce90 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.395+0000 7f4ff561d800 1 -- 172.21.15.50:0/382714878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558edc53e260 con 0x558edc53ce90 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.395+0000 7f4edd602640 1 -- 172.21.15.50:0/382714878 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4fe4044000 con 0x558edc53ce90 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.396+0000 7f4edd602640 1 --2- 172.21.15.50:0/382714878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ecc036950 0x7f4ecc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.396+0000 7f4edd602640 1 -- 172.21.15.50:0/382714878 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4fe400a810 con 0x558edc53ce90 2024-05-07T13:56:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.396+0000 7f4fea91b640 1 --2- 172.21.15.50:0/382714878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ecc036950 0x7f4ecc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.396+0000 7f4ff561d800 1 Processor -- start 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.396+0000 7f4ff561d800 1 -- start start 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.396+0000 7f4fea91b640 1 --2- 172.21.15.50:0/382714878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ecc036950 0x7f4ecc038e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x558edc5264a0 tx=0x7f4fdc005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.396+0000 7f4ff561d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc54a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.396+0000 7f4ff561d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558edc421df0 con 0x558edc549dc0 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.397+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc54a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.397+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc54a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50426/0 (socket says 172.21.15.50:50426) 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.397+0000 7f4ff311c640 1 -- 172.21.15.50:0/785856620 learned_addr learned my addr 172.21.15.50:0/785856620 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.397+0000 7f4ff311c640 1 -- 172.21.15.50:0/785856620 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edc54a7b0 con 0x558edc549dc0 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.397+0000 7f4ff311c640 1 --2- 172.21.15.50:0/785856620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc54a1e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400a4f0 tx=0x7f4fe400a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f1fe0382f0e74d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.397+0000 7f4ed6ffd640 1 -- 172.21.15.50:0/785856620 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe405c070 con 0x558edc549dc0 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.397+0000 7f4ed6ffd640 1 -- 172.21.15.50:0/785856620 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe4024d80 con 0x558edc549dc0 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.397+0000 7f4ed6ffd640 1 -- 172.21.15.50:0/785856620 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe403d070 con 0x558edc549dc0 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 -- 172.21.15.50:0/785856620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 msgr2=0x558edc54a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 --2- 172.21.15.50:0/785856620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc54a1e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400a4f0 tx=0x7f4fe400a600 comp rx=0 tx=0).stop 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 -- 172.21.15.50:0/785856620 shutdown_connections 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 --2- 172.21.15.50:0/785856620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc54a1e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 -- 172.21.15.50:0/785856620 >> 172.21.15.50:0/785856620 conn(0x558edc546120 msgr2=0x558edc544180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 -- 172.21.15.50:0/785856620 shutdown_connections 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 -- 172.21.15.50:0/785856620 wait complete. 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 Processor -- start 2024-05-07T13:56:14.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 -- start start 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc5511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff561d800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558edc54ae60 con 0x558edc549dc0 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.398+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc5511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.399+0000 7f4ff311c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc5511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50442/0 (socket says 172.21.15.50:50442) 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.399+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 learned_addr learned my addr 172.21.15.50:0/2387556164 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.399+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edc551720 con 0x558edc549dc0 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.399+0000 7f4ff311c640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc5511e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4047bc0 tx=0x7f4fe400a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.399+0000 7f4ed57fa640 1 -- 172.21.15.50:0/2387556164 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe4067020 con 0x558edc549dc0 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.399+0000 7f4ed57fa640 1 -- 172.21.15.50:0/2387556164 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe400d3d0 con 0x558edc549dc0 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.399+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558edc551720 con 0x558edc549dc0 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.399+0000 7f4ed57fa640 1 -- 172.21.15.50:0/2387556164 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe405c040 con 0x558edc549dc0 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.399+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558edc551720 con 0x558edc549dc0 2024-05-07T13:56:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.400+0000 7f4ed57fa640 1 -- 172.21.15.50:0/2387556164 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4fe406a020 con 0x558edc549dc0 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.400+0000 7f4ed57fa640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ebc036950 0x7f4ebc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.400+0000 7f4ed57fa640 1 -- 172.21.15.50:0/2387556164 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4fe4052030 con 0x558edc549dc0 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.400+0000 7f4fea91b640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ebc036950 0x7f4ebc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.401+0000 7f4fea91b640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ebc036950 0x7f4ebc038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x558edc52ee30 tx=0x7f4fdc04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.401+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.401+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc55c930 0x558edc55edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.401+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc55f540 con 0x558edc55c930 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.401+0000 7f4ff391d640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc55c930 0x558edc55edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.401+0000 7f4ff391d640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc55c930 0x558edc55edf0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc55c930 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 20 realm 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc55f950 con 0x558edc55c930 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc55c930 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc560220 con 0x558edc55c930 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc55c930 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x558edc55c930 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.402+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc55c930 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff561d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc561320 0x558edc563710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc563d20 con 0x558edc561320 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff311c640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc561320 0x558edc563710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff311c640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc561320 0x558edc563710 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff561d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff561d800 20 searching for the correct realm 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.403+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc565630 con 0x558edc561320 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.404+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.404+0000 7f4ff311c640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4fe4077040 0x7f4fe4011170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.404+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc565630 con 0x7f4fe4077040 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.404+0000 7f4fea91b640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4fe4077040 0x7f4fe4011170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.404+0000 7f4fea91b640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4fe4077040 0x7f4fe4011170 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.404+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.405+0000 7f4fea91b640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4fdc074040 0x7f4fdc081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.405+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc565630 con 0x7f4fdc074040 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.405+0000 7f4ff391d640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4fdc074040 0x7f4fdc081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.405+0000 7f4ff391d640 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4fdc074040 0x7f4fdc081410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.405+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec00a4a0 con 0x7f4fdc074040 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.406+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x558edc55c930 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.406+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc55c930 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.406+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x558edc55c930 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.406+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc55c930 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.406+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x7f4fdc074040 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.406+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec00a4a0 con 0x7f4fdc074040 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.406+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x7f4fdc074040 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.407+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4fec00a4a0 con 0x7f4fdc074040 2024-05-07T13:56:14.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.407+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x7f4fe4077040 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.407+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.407+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x558edc561320 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.407+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.407+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x558edc55c930 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.407+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc55c930 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.407+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x7f4fdc074040 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.408+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec00a4a0 con 0x7f4fdc074040 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.408+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x558edc55c930 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.408+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc55c930 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.408+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558edc5605c0 con 0x7f4fe4077040 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.408+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.408+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc561320 2024-05-07T13:56:14.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.408+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.408+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc561320 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.409+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.409+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x7f4fdc074040 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.409+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec00a4a0 con 0x7f4fdc074040 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.409+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc561320 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.409+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.409+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc561320 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.410+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.410+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc55c930 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.410+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec00a4a0 con 0x558edc55c930 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.410+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc55c930 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.410+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.410+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x7f4fdc074040 2024-05-07T13:56:14.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.410+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.410+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc561320 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.411+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.411+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x7f4fe4077040 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.411+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.411+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc55c930 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.411+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.411+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x7f4fdc074040 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.412+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.412+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc561320 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.412+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.412+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x7f4fdc074040 2024-05-07T13:56:14.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.412+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.412+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x7f4fe4077040 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.412+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.412+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc561320 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x7f4fdc074040 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x558edc55c930 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fdc08e060 con 0x7f4fe4077040 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff561d800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff561d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff561d800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:14.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff561d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff561d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff561d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.413+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5645e0 con 0x558edc55c930 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5649d0 con 0x558edc55c930 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5649d0 con 0x7f4fdc074040 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 20 zone default found 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 4 Realm: () 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 20 zonegroup default 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.414+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc565ab0 con 0x7f4fdc074040 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc567490 con 0x558edc561320 2024-05-07T13:56:14.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc567830 con 0x558edc561320 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 20 started sync module instance, tier type = 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.415+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc566930 con 0x7f4fe4077040 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.416+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.416+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94072070366336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc567bd0 con 0x7f4fe4077040 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.416+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc568420 con 0x558edc55c930 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.417+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94072070366336] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.417+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.417+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94072070373232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc568390 con 0x558edc55c930 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.417+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5692e0 con 0x558edc561320 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.418+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.418+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94072070377008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc569b80 con 0x558edc561320 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.418+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc56a650 con 0x7f4fe4077040 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.418+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94072070373232] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.419+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94072070377008] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.419+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.419+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94072070381888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc56aa70 con 0x7f4fe4077040 2024-05-07T13:56:14.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.420+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc56b2c0 con 0x558edc55c930 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.420+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.420+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94072070381888] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.421+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94072070385680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc56bb60 con 0x558edc55c930 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.421+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc568810 con 0x7f4fdc074040 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.422+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.422+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94072070390048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc568810 con 0x7f4fdc074040 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.422+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc56d050 con 0x7f4fdc074040 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.422+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94072070385680] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.422+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94072070390048] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.423+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.423+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94072070391104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc56cb60 con 0x7f4fdc074040 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.423+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc56d520 con 0x7f4fdc074040 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94072070391104] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94072070387376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc56d520 con 0x7f4fdc074040 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff561d800 20 add_watcher() i=0 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff561d800 20 add_watcher() i=1 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff561d800 20 add_watcher() i=2 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff561d800 20 add_watcher() i=3 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff561d800 20 add_watcher() i=4 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff561d800 20 add_watcher() i=5 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff561d800 20 add_watcher() i=6 2024-05-07T13:56:14.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.424+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94072070387376] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.425+0000 7f4ff561d800 20 add_watcher() i=7 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.425+0000 7f4ff561d800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.425+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc570860 con 0x558edc55c930 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.425+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.425+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94072070394336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc56dab0 con 0x558edc55c930 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.426+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94072070394336] v27'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.426+0000 7f4ea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.426+0000 7f4ff561d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.426+0000 7f4ff561d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.426+0000 7f4ff561d800 5 note: GC not initialized 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.426+0000 7f4ea8fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:14.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 20 Filter name: none 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4e227fc640 20 reqs_thread_entry: start 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5a3de0 con 0x558edc55c930 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.427+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5a5d60 con 0x558edc55c930 2024-05-07T13:56:14.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 20 rados_obj.operate() r=0 bl.length=193 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 : miss 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 8.0 8:04fc31cd:root::.bucket.meta.testx%3amyfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5a7490 con 0x558edc561320 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 20 rados_obj.operate() r=0 bl.length=412 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-07T13:56:14.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.428+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5ab780 con 0x558edc55c930 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.429+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v27'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.429+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5af090 con 0x7f4fe4077040 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.430+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [create,call,writefull 0~379,setxattr (123)] v27'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.430+0000 7f4ff561d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x7 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.430+0000 7f4ff561d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.430+0000 7f4ff561d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.430+0000 7f4ff561d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1, ofs0, ns] 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.430+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94072070655344 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aea10 con 0x7f4fe4077040 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== watch-notify(notify (1) cookie 94072070366336 notify 115964117015 ret 0) ==== 770+0+0 (crc 0 0 0) 0x558edc5af430 con 0x7f4fe4077040 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ed6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117015 cookie 94072070366336 notifier 4551 bl.length()=728 2024-05-07T13:56:14.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ed6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x7 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ed6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ed6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ed6ffd640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4eb8003ea0 con 0x7f4fe4077040 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [notify cookie 94072070655344 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== watch-notify(notify_complete (2) cookie 94072070655344 notify 115964117015 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558edc5ab1b0 con 0x7f4fe4077040 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ff561d800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_sources= new_sources= 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ff561d800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential sources added=[] removed=[] 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ff561d800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_dests= new_dests= 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ff561d800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential dests added=[] removed=[] 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.431+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aa820 con 0x7f4fe4077040 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.432+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(69 foo.buckets [call] v27'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.432+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aa820 con 0x7f4fe4077040 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.433+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.433+0000 7f4ff561d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.433+0000 7f4ff561d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.433+0000 7f4ff561d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.433+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94072070644592 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aa790 con 0x7f4fdc074040 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.434+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== watch-notify(notify (1) cookie 94072070391104 notify 115964117002 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f4fec0279c0 con 0x7f4fdc074040 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.434+0000 7f4ed67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 94072070391104 notifier 4551 bl.length()=314 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.434+0000 7f4ed67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.434+0000 7f4ed67fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.434+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(71 notify.6 [notify cookie 94072070644592 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.434+0000 7f4ed67fc640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4e28003400 con 0x7f4fdc074040 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.434+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.434+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== watch-notify(notify_complete (2) cookie 94072070644592 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4fec027c80 con 0x7f4fdc074040 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.434+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aa820 con 0x558edc55c930 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.435+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v27'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.435+0000 7f4ff561d800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.435+0000 7f4ff561d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.435+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94072070644592 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aa790 con 0x558edc55c930 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.435+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify (1) cookie 94072070385680 notify 115964117004 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f4fec027c80 con 0x558edc55c930 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.435+0000 7f4ed67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 94072070385680 notifier 4551 bl.length()=155 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.435+0000 7f4ed67fc640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4e28003400 con 0x558edc55c930 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.435+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(74 notify.4 [notify cookie 94072070644592 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.436+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== watch-notify(notify_complete (2) cookie 94072070644592 notify 115964117004 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4fec018530 con 0x558edc55c930 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.436+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.436+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:76 8.0 8:04fc31cd:root::.bucket.meta.testx%3amyfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aa820 con 0x558edc561320 2024-05-07T13:56:14.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.437+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call,delete] v27'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.437+0000 7f4ff561d800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 from cache 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.437+0000 7f4ff561d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1, ofs0, ns] 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.437+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94072070632448 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aa820 con 0x7f4fdc074040 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.437+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== watch-notify(notify (1) cookie 94072070387376 notify 115964117003 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7f4fec018530 con 0x7f4fdc074040 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.437+0000 7f4ed6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 94072070387376 notifier 4551 bl.length()=212 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.437+0000 7f4ed6ffd640 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4eb8003ea0 con 0x7f4fdc074040 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.437+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(77 notify.7 [notify cookie 94072070632448 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.438+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== watch-notify(notify_complete (2) cookie 94072070632448 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4fec018900 con 0x7f4fdc074040 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.438+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.439+0000 7f4ea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.439+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94072070394336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aadf0 con 0x558edc55c930 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.440+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94072070394336] v27'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.440+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94072070366336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aadf0 con 0x7f4fe4077040 2024-05-07T13:56:14.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.441+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94072070366336] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.441+0000 7f4ff561d800 20 remove_watcher() i=0 2024-05-07T13:56:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.441+0000 7f4ff561d800 2 removed watcher, disabling cache 2024-05-07T13:56:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.441+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94072070373232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc566480 con 0x558edc55c930 2024-05-07T13:56:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.442+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94072070373232] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.442+0000 7f4ff561d800 20 remove_watcher() i=1 2024-05-07T13:56:14.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.442+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94072070377008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aad90 con 0x558edc561320 2024-05-07T13:56:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.443+0000 7f4ff311c640 1 -- 172.21.15.50:0/2387556164 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94072070377008] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fe402b070 con 0x558edc561320 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.443+0000 7f4ff561d800 20 remove_watcher() i=2 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.443+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94072070381888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc567f70 con 0x7f4fe4077040 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.444+0000 7f4fea91b640 1 -- 172.21.15.50:0/2387556164 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94072070381888] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc07f070 con 0x7f4fe4077040 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.444+0000 7f4ff561d800 20 remove_watcher() i=3 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.444+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94072070385680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc566480 con 0x558edc55c930 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.445+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94072070385680] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x558edc55c930 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.445+0000 7f4ff561d800 20 remove_watcher() i=4 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.445+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94072070390048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc568e30 con 0x7f4fdc074040 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.446+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94072070390048] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.446+0000 7f4ff561d800 20 remove_watcher() i=5 2024-05-07T13:56:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.446+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94072070391104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc5aad90 con 0x7f4fdc074040 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.447+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94072070391104] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.447+0000 7f4ff561d800 20 remove_watcher() i=6 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.447+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94072070387376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558edc567f70 con 0x7f4fdc074040 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94072070387376] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec02f060 con 0x7f4fdc074040 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 20 remove_watcher() i=7 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4fdc074040 msgr2=0x7f4fdc081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4fdc074040 0x7f4fdc081410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc55c930 msgr2=0x558edc55edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc55c930 0x558edc55edf0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4fe4077040 msgr2=0x7f4fe4011170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4fe4077040 0x7f4fe4011170 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc561320 msgr2=0x558edc563710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc561320 0x558edc563710 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ebc036950 msgr2=0x7f4ebc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ebc036950 0x7f4ebc038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x558edc52ee30 tx=0x7f4fdc04f000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 msgr2=0x558edc5511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2387556164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc549dc0 0x558edc5511e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4047bc0 tx=0x7f4fe400a480 comp rx=0 tx=0).stop 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.448+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 reap_dead start 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff391d640 1 -- 172.21.15.50:0/2387556164 reap_dead start 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 shutdown_connections 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 >> 172.21.15.50:0/2387556164 conn(0x558edc546120 msgr2=0x558edc543780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 shutdown_connections 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/2387556164 wait complete. 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/382714878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ecc036950 msgr2=0x7f4ecc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 --2- 172.21.15.50:0/382714878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ecc036950 0x7f4ecc038e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x558edc5264a0 tx=0x7f4fdc005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/382714878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc53ce90 msgr2=0x558edc53d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 --2- 172.21.15.50:0/382714878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc53ce90 0x558edc53d2b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4fe404aa30 tx=0x7f4fe404ac30 comp rx=0 tx=0).stop 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/382714878 shutdown_connections 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 --2- 172.21.15.50:0/382714878 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ecc036950 0x7f4ecc038e10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 --2- 172.21.15.50:0/382714878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc53ce90 0x558edc53d2b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/382714878 >> 172.21.15.50:0/382714878 conn(0x558edc530f30 msgr2=0x558edc531330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/382714878 shutdown_connections 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/382714878 wait complete. 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558edc52be80 msgr2=0x558edc52e2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558edc52be80 0x558edc52e2d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc427680 msgr2=0x558edc5256c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558edc427680 0x558edc5256c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc527ef0 msgr2=0x558edc52a2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558edc527ef0 0x558edc52a2e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ed8036950 msgr2=0x7f4ed8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4ed8036950 0x7f4ed8038e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc054000 tx=0x7f4fdc04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 msgr2=0x558edc51e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff561d800 1 --2- 172.21.15.50:0/2123245649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558edc423b70 0x558edc51e480 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400c010 tx=0x7f4fe4000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.449+0000 7f4ff391d640 1 -- 172.21.15.50:0/2123245649 reap_dead start 2024-05-07T13:56:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.450+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 shutdown_connections 2024-05-07T13:56:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.450+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 >> 172.21.15.50:0/2123245649 conn(0x558edc41d5c0 msgr2=0x558edc422350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.450+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 shutdown_connections 2024-05-07T13:56:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.450+0000 7f4ff561d800 1 -- 172.21.15.50:0/2123245649 wait complete. 2024-05-07T13:56:14.471 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-07T13:56:14.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-07T13:56:14.472 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-05-07T13:56:14.519 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:14.520 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.532+0000 7f8b2c610800 1 Processor -- start 2024-05-07T13:56:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.532+0000 7f8b2c610800 1 -- start start 2024-05-07T13:56:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.532+0000 7f8b2c610800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ba4d6daa00 0x55ba4d6dae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.532+0000 7f8b2c610800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba4d64f1e0 con 0x55ba4d6db360 2024-05-07T13:56:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.532+0000 7f8b2c610800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55ba4d56d050 con 0x55ba4d6daa00 2024-05-07T13:56:14.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.532+0000 7f8b27dc0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ba4d6daa00 0x55ba4d6dae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.532+0000 7f8b27dc0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ba4d6daa00 0x55ba4d6dae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50450/0 (socket says 172.21.15.50:50450) 2024-05-07T13:56:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.532+0000 7f8b275bf640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55ba4d6db360 0x55ba4d6db810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40748/0 (socket says 172.21.15.50:40748) 2024-05-07T13:56:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.532+0000 7f8b27dc0640 1 -- 172.21.15.50:0/2595757284 learned_addr learned my addr 172.21.15.50:0/2595757284 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.533+0000 7f8b27dc0640 1 -- 172.21.15.50:0/2595757284 >> v1:172.21.15.22:6789/0 conn(0x55ba4d6db360 legacy=0x55ba4d6db810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.533+0000 7f8b27dc0640 1 -- 172.21.15.50:0/2595757284 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba4d6dbf20 con 0x55ba4d6daa00 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.534+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/2595757284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d6dae20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800a520 tx=0x7f8b1801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db18a47ef14ffaf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b26dbe640 1 -- 172.21.15.50:0/2595757284 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18057070 con 0x55ba4d6daa00 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b26dbe640 1 -- 172.21.15.50:0/2595757284 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18052570 con 0x55ba4d6daa00 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b26dbe640 1 -- 172.21.15.50:0/2595757284 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1804ae60 con 0x55ba4d6daa00 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b2c610800 1 -- 172.21.15.50:0/2595757284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 msgr2=0x55ba4d6dae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b2c610800 1 --2- 172.21.15.50:0/2595757284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d6dae20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800a520 tx=0x7f8b1801d010 comp rx=0 tx=0).stop 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b2c610800 1 -- 172.21.15.50:0/2595757284 shutdown_connections 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b2c610800 1 --2- 172.21.15.50:0/2595757284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d6dae20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b2c610800 1 -- 172.21.15.50:0/2595757284 >> 172.21.15.50:0/2595757284 conn(0x55ba4d6d65c0 msgr2=0x55ba4d6d89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b2c610800 1 -- 172.21.15.50:0/2595757284 shutdown_connections 2024-05-07T13:56:14.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.535+0000 7f8b2c610800 1 -- 172.21.15.50:0/2595757284 wait complete. 2024-05-07T13:56:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.550+0000 7f8b2c610800 1 Processor -- start 2024-05-07T13:56:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.551+0000 7f8b2c610800 1 -- start start 2024-05-07T13:56:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.551+0000 7f8b2c610800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.551+0000 7f8b2c610800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ba4d6271c0 con 0x55ba4d6daa00 2024-05-07T13:56:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.551+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.551+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50460/0 (socket says 172.21.15.50:50460) 2024-05-07T13:56:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.551+0000 7f8b27dc0640 1 -- 172.21.15.50:0/726815540 learned_addr learned my addr 172.21.15.50:0/726815540 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.551+0000 7f8b27dc0640 1 -- 172.21.15.50:0/726815540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba4d7d0110 con 0x55ba4d6daa00 2024-05-07T13:56:14.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.551+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/726815540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7cfb40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8b18055040 tx=0x7f8b1804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc142ce5310d3ab server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.552+0000 7f8a15e0b640 1 -- 172.21.15.50:0/726815540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18057040 con 0x55ba4d6daa00 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.552+0000 7f8a15e0b640 1 -- 172.21.15.50:0/726815540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18052720 con 0x55ba4d6daa00 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.552+0000 7f8a15e0b640 1 -- 172.21.15.50:0/726815540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18052a20 con 0x55ba4d6daa00 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.552+0000 7f8b2c610800 1 -- 172.21.15.50:0/726815540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 msgr2=0x55ba4d7cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.552+0000 7f8b2c610800 1 --2- 172.21.15.50:0/726815540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7cfb40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8b18055040 tx=0x7f8b1804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.552+0000 7f8b2c610800 1 -- 172.21.15.50:0/726815540 shutdown_connections 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.552+0000 7f8b2c610800 1 --2- 172.21.15.50:0/726815540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7cfb40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b2c610800 1 -- 172.21.15.50:0/726815540 >> 172.21.15.50:0/726815540 conn(0x55ba4d6d65c0 msgr2=0x55ba4d7cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b2c610800 1 -- 172.21.15.50:0/726815540 shutdown_connections 2024-05-07T13:56:14.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b2c610800 1 -- 172.21.15.50:0/726815540 wait complete. 2024-05-07T13:56:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b2c610800 1 Processor -- start 2024-05-07T13:56:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b2c610800 1 -- start start 2024-05-07T13:56:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b2c610800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7d7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b2c610800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ba4d6dc450 con 0x55ba4d6daa00 2024-05-07T13:56:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7d7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7d7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50462/0 (socket says 172.21.15.50:50462) 2024-05-07T13:56:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.553+0000 7f8b27dc0640 1 -- 172.21.15.50:0/1598640797 learned_addr learned my addr 172.21.15.50:0/1598640797 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.554+0000 7f8b27dc0640 1 -- 172.21.15.50:0/1598640797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba4d7d7a90 con 0x55ba4d6daa00 2024-05-07T13:56:14.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.554+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7d7550 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8b180524f0 tx=0x7f8b18003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.554+0000 7f8a0ffff640 1 -- 172.21.15.50:0/1598640797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18073070 con 0x55ba4d6daa00 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.554+0000 7f8a0ffff640 1 -- 172.21.15.50:0/1598640797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1805d440 con 0x55ba4d6daa00 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.554+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba4d7d7d20 con 0x55ba4d6daa00 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.554+0000 7f8a0ffff640 1 -- 172.21.15.50:0/1598640797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18057070 con 0x55ba4d6daa00 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.554+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba4d7da9d0 con 0x55ba4d6daa00 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.555+0000 7f8a0ffff640 1 -- 172.21.15.50:0/1598640797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b18076070 con 0x55ba4d6daa00 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.555+0000 7f8a0ffff640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a10036950 0x7f8a10038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.555+0000 7f8a0ffff640 1 -- 172.21.15.50:0/1598640797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8b1808dd20 con 0x55ba4d6daa00 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.555+0000 7f8b275bf640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a10036950 0x7f8a10038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.555+0000 7f8b2c610800 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d6db360 0x55ba4d7de790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.555+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d7decd0 con 0x55ba4d6db360 2024-05-07T13:56:14.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.555+0000 7f8b285c1640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d6db360 0x55ba4d7de790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.555+0000 7f8b275bf640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a10036950 0x7f8a10038e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8b10000f60 tx=0x7f8b10001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.556+0000 7f8b285c1640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d6db360 0x55ba4d7de790 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.556+0000 7f8b285c1640 1 -- 172.21.15.50:0/1598640797 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d6db360 2024-05-07T13:56:14.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.556+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d7dbd60 con 0x55ba4d6db360 2024-05-07T13:56:14.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.556+0000 7f8b285c1640 1 -- 172.21.15.50:0/1598640797 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d6db360 2024-05-07T13:56:14.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.556+0000 7f8b2c610800 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d7e1020 0x55ba4d7e3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.556+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d7e3b00 con 0x55ba4d7e1020 2024-05-07T13:56:14.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.556+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d7e1020 0x55ba4d7e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.557+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d7e1020 0x55ba4d7e3410 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.557+0000 7f8b27dc0640 1 -- 172.21.15.50:0/1598640797 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b18075030 con 0x55ba4d7e1020 2024-05-07T13:56:14.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.557+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d7dffd0 con 0x55ba4d6db360 2024-05-07T13:56:14.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.557+0000 7f8b285c1640 1 -- 172.21.15.50:0/1598640797 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d6db360 2024-05-07T13:56:14.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.557+0000 7f8b2c610800 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ba4d7e4fb0 0x55ba4d7e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.557+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d7e7b60 con 0x55ba4d7e4fb0 2024-05-07T13:56:14.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.558+0000 7f8b275bf640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ba4d7e4fb0 0x55ba4d7e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.558+0000 7f8b275bf640 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ba4d7e4fb0 0x55ba4d7e7400 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.558+0000 7f8b275bf640 1 -- 172.21.15.50:0/1598640797 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b1000f690 con 0x55ba4d7e4fb0 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.558+0000 7f8b2c610800 1 Processor -- start 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.559+0000 7f8b2c610800 1 -- start start 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.559+0000 7f8b2c610800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d7f5fc0 0x55ba4d7f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.559+0000 7f8b2c610800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ba4d5cdcf0 con 0x55ba4d7f5fc0 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.559+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d7f5fc0 0x55ba4d7f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.559+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d7f5fc0 0x55ba4d7f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50478/0 (socket says 172.21.15.50:50478) 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.559+0000 7f8b27dc0640 1 -- 172.21.15.50:0/2008448011 learned_addr learned my addr 172.21.15.50:0/2008448011 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.559+0000 7f8b27dc0640 1 -- 172.21.15.50:0/2008448011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba4d7f6920 con 0x55ba4d7f5fc0 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.559+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/2008448011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d7f5fc0 0x55ba4d7f63e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8b1808c0f0 tx=0x7f8b180666c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.559+0000 7f8a0d7fa640 1 -- 172.21.15.50:0/2008448011 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18092070 con 0x55ba4d7f5fc0 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.560+0000 7f8a0d7fa640 1 -- 172.21.15.50:0/2008448011 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18089030 con 0x55ba4d7f5fc0 2024-05-07T13:56:14.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.560+0000 7f8b2c610800 1 -- 172.21.15.50:0/2008448011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba4d7f7390 con 0x55ba4d7f5fc0 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.560+0000 7f8a0d7fa640 1 -- 172.21.15.50:0/2008448011 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18076360 con 0x55ba4d7f5fc0 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.560+0000 7f8b2c610800 1 -- 172.21.15.50:0/2008448011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba4d7f7890 con 0x55ba4d7f5fc0 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.560+0000 7f8a0d7fa640 1 -- 172.21.15.50:0/2008448011 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b18095070 con 0x55ba4d7f5fc0 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.560+0000 7f8a0d7fa640 1 --2- 172.21.15.50:0/2008448011 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a00036950 0x7f8a00038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8a0d7fa640 1 -- 172.21.15.50:0/2008448011 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8b18098cc0 con 0x55ba4d7f5fc0 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8b275bf640 1 --2- 172.21.15.50:0/2008448011 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a00036950 0x7f8a00038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8b2c610800 1 Processor -- start 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8b275bf640 1 --2- 172.21.15.50:0/2008448011 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a00036950 0x7f8a00038e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55ba4d7df5d0 tx=0x7f8b1000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8b2c610800 1 -- start start 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8b2c610800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d803470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8b2c610800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ba4d7d03d0 con 0x55ba4d803050 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d803470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d803470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50482/0 (socket says 172.21.15.50:50482) 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.561+0000 7f8b27dc0640 1 -- 172.21.15.50:0/2664815873 learned_addr learned my addr 172.21.15.50:0/2664815873 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8b27dc0640 1 -- 172.21.15.50:0/2664815873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba4d803a40 con 0x55ba4d803050 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/2664815873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d803470 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8b18099000 tx=0x7f8b1805cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3247be573ff896 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8a06ffd640 1 -- 172.21.15.50:0/2664815873 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b180870e0 con 0x55ba4d803050 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8a06ffd640 1 -- 172.21.15.50:0/2664815873 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1808c460 con 0x55ba4d803050 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8a06ffd640 1 -- 172.21.15.50:0/2664815873 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18087280 con 0x55ba4d803050 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8b2c610800 1 -- 172.21.15.50:0/2664815873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 msgr2=0x55ba4d803470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8b2c610800 1 --2- 172.21.15.50:0/2664815873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d803470 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8b18099000 tx=0x7f8b1805cda0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8b2c610800 1 -- 172.21.15.50:0/2664815873 shutdown_connections 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8b2c610800 1 --2- 172.21.15.50:0/2664815873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d803470 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8b2c610800 1 -- 172.21.15.50:0/2664815873 >> 172.21.15.50:0/2664815873 conn(0x55ba4d7ff360 msgr2=0x55ba4d7fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8b2c610800 1 -- 172.21.15.50:0/2664815873 shutdown_connections 2024-05-07T13:56:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.562+0000 7f8b2c610800 1 -- 172.21.15.50:0/2664815873 wait complete. 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.563+0000 7f8b2c610800 1 Processor -- start 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.563+0000 7f8b2c610800 1 -- start start 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.563+0000 7f8b2c610800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d80a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.563+0000 7f8b2c610800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ba4d804150 con 0x55ba4d803050 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.563+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d80a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.563+0000 7f8b27dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d80a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50492/0 (socket says 172.21.15.50:50492) 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.563+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 learned_addr learned my addr 172.21.15.50:0/4240257825 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.563+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba4d80a9a0 con 0x55ba4d803050 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.564+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d80a460 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8b18079b30 tx=0x7f8b1806cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.564+0000 7f8a057fa640 1 -- 172.21.15.50:0/4240257825 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1808c610 con 0x55ba4d803050 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.564+0000 7f8a057fa640 1 -- 172.21.15.50:0/4240257825 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18079730 con 0x55ba4d803050 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.564+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba4d80a9a0 con 0x55ba4d803050 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.564+0000 7f8a057fa640 1 -- 172.21.15.50:0/4240257825 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1806e880 con 0x55ba4d803050 2024-05-07T13:56:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.564+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba4d80a9a0 con 0x55ba4d803050 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.565+0000 7f8a057fa640 1 -- 172.21.15.50:0/4240257825 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b1806ea20 con 0x55ba4d803050 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.565+0000 7f8a057fa640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f89f0036900 0x7f89f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.565+0000 7f8a057fa640 1 -- 172.21.15.50:0/4240257825 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8b180a2070 con 0x55ba4d803050 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.565+0000 7f8b275bf640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f89f0036900 0x7f89f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.565+0000 7f8b275bf640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f89f0036900 0x7f89f0038dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55ba4d7e7f60 tx=0x7f8b10010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b2c610800 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d815bd0 0x55ba4d818090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8187e0 con 0x55ba4d815bd0 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b285c1640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d815bd0 0x55ba4d818090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b285c1640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d815bd0 0x55ba4d818090 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d815bd0 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b2c610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b2c610800 20 realm 2024-05-07T13:56:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.566+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d818bf0 con 0x55ba4d815bd0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d815bd0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8194c0 con 0x55ba4d815bd0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d815bd0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d815bd0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d815bd0 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d81a5c0 0x55ba4d81c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81cfc0 con 0x55ba4d81a5c0 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.567+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d81a5c0 0x55ba4d81c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.568+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d81a5c0 0x55ba4d81c9b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.568+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.568+0000 7f8b2c610800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.568+0000 7f8b2c610800 20 searching for the correct realm 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.568+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81e8f0 con 0x55ba4d81a5c0 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.568+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.568+0000 7f8b27dc0640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8b180b0040 0x7f8b180b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.568+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81e8f0 con 0x7f8b180b0040 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.569+0000 7f8b275bf640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8b180b0040 0x7f8b180b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.569+0000 7f8b275bf640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8b180b0040 0x7f8b180b0420 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.569+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.569+0000 7f8b275bf640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8b1000f070 0x7f8b1002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.569+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81e8f0 con 0x7f8b1000f070 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.569+0000 7f8b285c1640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8b1000f070 0x7f8b1002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.570+0000 7f8b285c1640 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8b1000f070 0x7f8b1002e910 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.570+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1000f070 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.570+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d815bd0 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.570+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d815bd0 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.570+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d815bd0 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.571+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d815bd0 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.571+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b1000f070 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.571+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1000f070 2024-05-07T13:56:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.571+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b1000f070 2024-05-07T13:56:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.571+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1000f070 2024-05-07T13:56:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.571+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b180b0040 2024-05-07T13:56:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.571+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.571+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d81a5c0 2024-05-07T13:56:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.572+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.572+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d815bd0 2024-05-07T13:56:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.572+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d815bd0 2024-05-07T13:56:14.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.572+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b1000f070 2024-05-07T13:56:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.572+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1000f070 2024-05-07T13:56:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.572+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d815bd0 2024-05-07T13:56:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.572+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d815bd0 2024-05-07T13:56:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.572+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b180b0040 2024-05-07T13:56:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.573+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.573+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d81a5c0 2024-05-07T13:56:14.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.573+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.573+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d81a5c0 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.573+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.573+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b1000f070 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.574+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1000f070 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.574+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d81a5c0 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.574+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.574+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d81a5c0 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.574+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.574+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d815bd0 2024-05-07T13:56:14.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.574+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x55ba4d815bd0 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.574+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d815bd0 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.575+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.575+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b1000f070 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.575+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.575+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d81a5c0 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.575+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.575+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b180b0040 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.575+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.575+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d815bd0 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.576+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.576+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b1000f070 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.576+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.576+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d81a5c0 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.576+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.576+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b1000f070 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.576+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.576+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b180b0040 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.577+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.577+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d81a5c0 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.577+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.577+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b1000f070 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.577+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.577+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x55ba4d815bd0 2024-05-07T13:56:14.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d819860 con 0x7f8b180b0040 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81d880 con 0x55ba4d815bd0 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.578+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81dc70 con 0x55ba4d815bd0 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81dc70 con 0x7f8b1000f070 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 zone default found 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 4 Realm: () 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:14.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 zonegroup default 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81d400 con 0x7f8b1000f070 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81d400 con 0x55ba4d81a5c0 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.579+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.580+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d820840 con 0x55ba4d81a5c0 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.580+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.580+0000 7f8b2c610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.580+0000 7f8b2c610800 20 started sync module instance, tier type = 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.580+0000 7f8b2c610800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.580+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81fbf0 con 0x7f8b180b0040 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.581+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.581+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94258652643344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d81f850 con 0x7f8b180b0040 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.581+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d821770 con 0x55ba4d815bd0 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.582+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94258652643344] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.582+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.582+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94258652648128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8216e0 con 0x55ba4d815bd0 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.582+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d822630 con 0x55ba4d81a5c0 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.583+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.583+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94258652651904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d822ed0 con 0x55ba4d81a5c0 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.583+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d823980 con 0x7f8b180b0040 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.584+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94258652648128] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.584+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94258652651904] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.585+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.585+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94258652650336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d823da0 con 0x7f8b180b0040 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.585+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d824650 con 0x55ba4d815bd0 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.586+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.586+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94258652660032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d824ef0 con 0x55ba4d815bd0 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.586+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94258652650336] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.586+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8234d0 con 0x7f8b1000f070 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.587+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94258652660032] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.587+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.587+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94258652662256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d825460 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.587+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d825e20 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.588+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94258652662256] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.588+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.588+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94258652663312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d825e20 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.588+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8267e0 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94258652663312] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94258652666224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8269c0 con 0x7f8b1000f070 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b2c610800 20 add_watcher() i=0 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b2c610800 20 add_watcher() i=1 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b2c610800 20 add_watcher() i=2 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b2c610800 20 add_watcher() i=3 2024-05-07T13:56:14.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b2c610800 20 add_watcher() i=4 2024-05-07T13:56:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b2c610800 20 add_watcher() i=5 2024-05-07T13:56:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.589+0000 7f8b2c610800 20 add_watcher() i=6 2024-05-07T13:56:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.590+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94258652666224] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.590+0000 7f8b2c610800 20 add_watcher() i=7 2024-05-07T13:56:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.590+0000 7f8b2c610800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.590+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d829b70 con 0x55ba4d815bd0 2024-05-07T13:56:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.591+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.591+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94258652669296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d826e40 con 0x55ba4d815bd0 2024-05-07T13:56:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.592+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94258652669296] v27'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.592+0000 7f89ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.592+0000 7f8b2c610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.592+0000 7f8b2c610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.592+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d829370 con 0x55ba4d815bd0 2024-05-07T13:56:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.593+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.593+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d832c30 con 0x7f8b1000f070 2024-05-07T13:56:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.594+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.594+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d832c30 con 0x55ba4d81a5c0 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.595+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.595+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d833480 con 0x55ba4d815bd0 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.596+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'135 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.596+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8339f0 con 0x7f8b180b0040 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.597+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.597+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d833ea0 con 0x55ba4d81a5c0 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.598+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.598+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d833ea0 con 0x55ba4d815bd0 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.599+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.599+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d833ea0 con 0x7f8b1000f070 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.600+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.600+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d833ea0 con 0x7f8b180b0040 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.601+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.601+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8346c0 con 0x55ba4d81a5c0 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.602+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.602+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8346c0 con 0x7f8b180b0040 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.603+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.603+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x7f8b1000f070 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.604+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.604+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x7f8b180b0040 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.605+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.605+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x7f8b1000f070 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.606+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.606+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x55ba4d815bd0 2024-05-07T13:56:14.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.607+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.607+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x55ba4d81a5c0 2024-05-07T13:56:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.608+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.608+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x7f8b180b0040 2024-05-07T13:56:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.609+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.609+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834c00 con 0x55ba4d81a5c0 2024-05-07T13:56:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.610+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.610+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834c00 con 0x55ba4d815bd0 2024-05-07T13:56:14.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.611+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.611+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834c00 con 0x55ba4d815bd0 2024-05-07T13:56:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.612+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.612+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x55ba4d81a5c0 2024-05-07T13:56:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.614+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.614+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x7f8b180b0040 2024-05-07T13:56:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.614+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.615+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x55ba4d81a5c0 2024-05-07T13:56:14.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.615+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.615+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x55ba4d81a5c0 2024-05-07T13:56:14.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.616+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.616+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x55ba4d81a5c0 2024-05-07T13:56:14.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.617+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.617+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x55ba4d81a5c0 2024-05-07T13:56:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.618+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.618+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x7f8b1000f070 2024-05-07T13:56:14.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.620+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.620+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x55ba4d81a5c0 2024-05-07T13:56:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.620+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.620+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x7f8b1000f070 2024-05-07T13:56:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.622+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.622+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x55ba4d81a5c0 2024-05-07T13:56:14.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.622+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.622+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x7f8b1000f070 2024-05-07T13:56:14.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.623+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.624+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d834b70 con 0x7f8b180b0040 2024-05-07T13:56:14.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.625+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.625+0000 7f89dcfe1640 20 reqs_thread_entry: start 2024-05-07T13:56:14.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.625+0000 7f8b2c610800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:14.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.625+0000 7f8b2c610800 20 Filter name: none 2024-05-07T13:56:14.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.625+0000 7f89567fc640 20 reqs_thread_entry: start 2024-05-07T13:56:14.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.625+0000 7f8b2c610800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-07T13:56:14.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.625+0000 7f8b2c610800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.625+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d85fca0 con 0x7f8b1000f070 2024-05-07T13:56:14.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.626+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.626+0000 7f8b2c610800 20 rados_obj.operate() r=0 bl.length=419 2024-05-07T13:56:14.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.626+0000 7f8b2c610800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-07T13:56:14.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.626+0000 7f8b2c610800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-07T13:56:14.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.626+0000 7f8b2c610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:14.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.626+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d85f780 con 0x55ba4d815bd0 2024-05-07T13:56:14.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.626+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.626+0000 7f8b2c610800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-07T13:56:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.626+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d85f780 con 0x7f8b1000f070 2024-05-07T13:56:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.627+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v27'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.627+0000 7f8b2c610800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-07T13:56:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.627+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94258652905648 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d862ad0 con 0x55ba4d81a5c0 2024-05-07T13:56:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.627+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== watch-notify(notify (1) cookie 94258652651904 notify 115964116997 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55ba4d833a40 con 0x55ba4d81a5c0 2024-05-07T13:56:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.627+0000 7f8a06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94258652651904 notifier 4558 bl.length()=170 2024-05-07T13:56:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.627+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(97 notify.2 [notify cookie 94258652905648 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.627+0000 7f8a06ffd640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f89ec003d60 con 0x55ba4d81a5c0 2024-05-07T13:56:14.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.628+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.628+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== watch-notify(notify_complete (2) cookie 94258652905648 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba4d7f6920 con 0x55ba4d81a5c0 2024-05-07T13:56:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.628+0000 7f8b2c610800 10 removing email index: 2024-05-07T13:56:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.628+0000 7f8b2c610800 10 removing user buckets index 2024-05-07T13:56:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.628+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8600b0 con 0x55ba4d815bd0 2024-05-07T13:56:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v27'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8b2c610800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-05-07T13:56:14.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94258652911120 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8600b0 con 0x55ba4d815bd0 2024-05-07T13:56:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== watch-notify(notify (1) cookie 94258652660032 notify 115964117005 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55ba4d8344d0 con 0x55ba4d815bd0 2024-05-07T13:56:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8a06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117005 cookie 94258652660032 notifier 4558 bl.length()=175 2024-05-07T13:56:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8a06ffd640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f89ec003d60 con 0x55ba4d815bd0 2024-05-07T13:56:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(100 notify.4 [notify cookie 94258652911120 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== watch-notify(notify_complete (2) cookie 94258652911120 notify 115964117005 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba4d7f7390 con 0x55ba4d815bd0 2024-05-07T13:56:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8b2c610800 10 removing user index: testx$tenanteduser 2024-05-07T13:56:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.629+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8600b0 con 0x7f8b1000f070 2024-05-07T13:56:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v27'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8b2c610800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-05-07T13:56:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8b2c610800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-07T13:56:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94258652906928 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d8600b0 con 0x7f8b180b0040 2024-05-07T13:56:14.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== watch-notify(notify (1) cookie 94258652650336 notify 115964117016 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55ba4d8331a0 con 0x7f8b180b0040 2024-05-07T13:56:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8a067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117016 cookie 94258652650336 notifier 4558 bl.length()=167 2024-05-07T13:56:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8a067fc640 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f895c0032c0 con 0x7f8b180b0040 2024-05-07T13:56:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(103 notify.3 [notify cookie 94258652906928 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.631+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== watch-notify(notify_complete (2) cookie 94258652906928 notify 115964117016 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba4d828da0 con 0x7f8b180b0040 2024-05-07T13:56:14.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.632+0000 7f89ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.632+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94258652669296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d82ef60 con 0x55ba4d815bd0 2024-05-07T13:56:14.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.633+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94258652669296] v27'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.633+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94258652643344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d82ef60 con 0x7f8b180b0040 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.634+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94258652643344] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.634+0000 7f8b2c610800 20 remove_watcher() i=0 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.634+0000 7f8b2c610800 2 removed watcher, disabling cache 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.634+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94258652648128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d82ef60 con 0x55ba4d815bd0 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.635+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94258652648128] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.635+0000 7f8b2c610800 20 remove_watcher() i=1 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.635+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94258652651904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d82ef60 con 0x55ba4d81a5c0 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.636+0000 7f8b27dc0640 1 -- 172.21.15.50:0/4240257825 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94258652651904] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b180bf020 con 0x55ba4d81a5c0 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.636+0000 7f8b2c610800 20 remove_watcher() i=2 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.636+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94258652650336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d82ef60 con 0x7f8b180b0040 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.637+0000 7f8b275bf640 1 -- 172.21.15.50:0/4240257825 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94258652650336] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b10037040 con 0x7f8b180b0040 2024-05-07T13:56:14.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.637+0000 7f8b2c610800 20 remove_watcher() i=3 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.637+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94258652660032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d82ef60 con 0x55ba4d815bd0 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.638+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.1 v2:172.21.15.50:6800/3441257969 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94258652660032] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x55ba4d815bd0 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.638+0000 7f8b2c610800 20 remove_watcher() i=4 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.638+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94258652662256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d82ef60 con 0x7f8b1000f070 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.639+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94258652662256] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.639+0000 7f8b2c610800 20 remove_watcher() i=5 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.639+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94258652663312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d82ef60 con 0x7f8b1000f070 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.640+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94258652663312] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.640+0000 7f8b2c610800 20 remove_watcher() i=6 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.640+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94258652666224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ba4d824ea0 con 0x7f8b1000f070 2024-05-07T13:56:14.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.641+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94258652666224] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b2002f060 con 0x7f8b1000f070 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.641+0000 7f8b2c610800 20 remove_watcher() i=7 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.641+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8b1000f070 msgr2=0x7f8b1002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.641+0000 7f8b2c610800 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f8b1000f070 0x7f8b1002e910 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.641+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d815bd0 msgr2=0x55ba4d818090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.641+0000 7f8b2c610800 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d815bd0 0x55ba4d818090 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.641+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8b180b0040 msgr2=0x7f8b180b0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.641+0000 7f8b2c610800 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f8b180b0040 0x7f8b180b0420 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.641+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d81a5c0 msgr2=0x55ba4d81c9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d81a5c0 0x55ba4d81c9b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f89f0036900 msgr2=0x7f89f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f89f0036900 0x7f89f0038dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55ba4d7e7f60 tx=0x7f8b10010000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b285c1640 1 -- 172.21.15.50:0/4240257825 reap_dead start 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 msgr2=0x55ba4d80a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d80a460 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8b18079b30 tx=0x7f8b1806cf50 comp rx=0 tx=0).stop 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 shutdown_connections 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 --2- 172.21.15.50:0/4240257825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d803050 0x55ba4d80a460 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 >> 172.21.15.50:0/4240257825 conn(0x55ba4d7ff360 msgr2=0x55ba4d7fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 shutdown_connections 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/4240257825 wait complete. 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/2008448011 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a00036950 msgr2=0x7f8a00038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 --2- 172.21.15.50:0/2008448011 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a00036950 0x7f8a00038e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55ba4d7df5d0 tx=0x7f8b1000f000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/2008448011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d7f5fc0 msgr2=0x55ba4d7f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 --2- 172.21.15.50:0/2008448011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d7f5fc0 0x55ba4d7f63e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8b1808c0f0 tx=0x7f8b180666c0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/2008448011 shutdown_connections 2024-05-07T13:56:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 --2- 172.21.15.50:0/2008448011 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a00036950 0x7f8a00038e10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 --2- 172.21.15.50:0/2008448011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d7f5fc0 0x55ba4d7f63e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/2008448011 >> 172.21.15.50:0/2008448011 conn(0x55ba4d7ea060 msgr2=0x55ba4d7ea460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/2008448011 shutdown_connections 2024-05-07T13:56:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.642+0000 7f8b2c610800 1 -- 172.21.15.50:0/2008448011 wait complete. 2024-05-07T13:56:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ba4d7e4fb0 msgr2=0x55ba4d7e7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55ba4d7e4fb0 0x55ba4d7e7400 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d6db360 msgr2=0x55ba4d7de790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ba4d6db360 0x55ba4d7de790 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d7e1020 msgr2=0x55ba4d7e3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ba4d7e1020 0x55ba4d7e3410 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a10036950 msgr2=0x7f8a10038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8a10036950 0x7f8a10038e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8b10000f60 tx=0x7f8b10001370 comp rx=0 tx=0).stop 2024-05-07T13:56:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 msgr2=0x55ba4d7d7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 --2- 172.21.15.50:0/1598640797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba4d6daa00 0x55ba4d7d7550 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8b180524f0 tx=0x7f8b18003020 comp rx=0 tx=0).stop 2024-05-07T13:56:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b285c1640 1 -- 172.21.15.50:0/1598640797 reap_dead start 2024-05-07T13:56:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 shutdown_connections 2024-05-07T13:56:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 >> 172.21.15.50:0/1598640797 conn(0x55ba4d6d65c0 msgr2=0x55ba4d7c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 shutdown_connections 2024-05-07T13:56:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.643+0000 7f8b2c610800 1 -- 172.21.15.50:0/1598640797 wait complete. 2024-05-07T13:56:14.650 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-07T13:56:14.653 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-05-07T13:56:14.655 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:14.656 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-07T13:56:14.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-07T13:56:14.656 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-05-07T13:56:14.704 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:14.704 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:14.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.716+0000 7fba58f75800 1 Processor -- start 2024-05-07T13:56:14.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.716+0000 7fba58f75800 1 -- start start 2024-05-07T13:56:14.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.716+0000 7fba58f75800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a47e85aa20 0x55a47e85ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.716+0000 7fba58f75800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a47e7cf1c0 con 0x55a47e85b380 2024-05-07T13:56:14.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.716+0000 7fba58f75800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55a47e6ed050 con 0x55a47e85aa20 2024-05-07T13:56:14.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.717+0000 7fba56a74640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a47e85aa20 0x55a47e85ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.717+0000 7fba56a74640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a47e85aa20 0x55a47e85ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50500/0 (socket says 172.21.15.50:50500) 2024-05-07T13:56:14.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.717+0000 7fba56a74640 1 -- 172.21.15.50:0/2638302189 learned_addr learned my addr 172.21.15.50:0/2638302189 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.717+0000 7fba56273640 1 --1- 172.21.15.50:0/2638302189 >> v1:172.21.15.22:6789/0 conn(0x55a47e85b380 0x55a47e85b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40762/0 (socket says 172.21.15.50:40762) 2024-05-07T13:56:14.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.717+0000 7fba56a74640 1 -- 172.21.15.50:0/2638302189 >> v1:172.21.15.22:6789/0 conn(0x55a47e85b380 legacy=0x55a47e85b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.717+0000 7fba56a74640 1 -- 172.21.15.50:0/2638302189 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a47e85bf40 con 0x55a47e85aa20 2024-05-07T13:56:14.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.719+0000 7fba56a74640 1 --2- 172.21.15.50:0/2638302189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e85ae40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fba4800a520 tx=0x7fba4801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5922775a670b31b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.719+0000 7fba55a72640 1 -- 172.21.15.50:0/2638302189 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48057070 con 0x55a47e85aa20 2024-05-07T13:56:14.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.719+0000 7fba55a72640 1 -- 172.21.15.50:0/2638302189 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48052570 con 0x55a47e85aa20 2024-05-07T13:56:14.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.719+0000 7fba55a72640 1 -- 172.21.15.50:0/2638302189 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4804ae60 con 0x55a47e85aa20 2024-05-07T13:56:14.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.719+0000 7fba58f75800 1 -- 172.21.15.50:0/2638302189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 msgr2=0x55a47e85ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.719+0000 7fba58f75800 1 --2- 172.21.15.50:0/2638302189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e85ae40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fba4800a520 tx=0x7fba4801d010 comp rx=0 tx=0).stop 2024-05-07T13:56:14.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.719+0000 7fba58f75800 1 -- 172.21.15.50:0/2638302189 shutdown_connections 2024-05-07T13:56:14.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.719+0000 7fba58f75800 1 --2- 172.21.15.50:0/2638302189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e85ae40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.719+0000 7fba58f75800 1 -- 172.21.15.50:0/2638302189 >> 172.21.15.50:0/2638302189 conn(0x55a47e8565c0 msgr2=0x55a47e8589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.720+0000 7fba58f75800 1 -- 172.21.15.50:0/2638302189 shutdown_connections 2024-05-07T13:56:14.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.720+0000 7fba58f75800 1 -- 172.21.15.50:0/2638302189 wait complete. 2024-05-07T13:56:14.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.735+0000 7fba58f75800 1 Processor -- start 2024-05-07T13:56:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.735+0000 7fba58f75800 1 -- start start 2024-05-07T13:56:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.735+0000 7fba58f75800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e94fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.735+0000 7fba58f75800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a47e7a71c0 con 0x55a47e85aa20 2024-05-07T13:56:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.735+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e94fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.735+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e94fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50510/0 (socket says 172.21.15.50:50510) 2024-05-07T13:56:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.735+0000 7fba56a74640 1 -- 172.21.15.50:0/548784946 learned_addr learned my addr 172.21.15.50:0/548784946 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.736+0000 7fba56a74640 1 -- 172.21.15.50:0/548784946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a47e950130 con 0x55a47e85aa20 2024-05-07T13:56:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.736+0000 7fba56a74640 1 --2- 172.21.15.50:0/548784946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e94fb60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fba48055040 tx=0x7fba4804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a415556458ead8f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.736+0000 7fb944e09640 1 -- 172.21.15.50:0/548784946 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48057040 con 0x55a47e85aa20 2024-05-07T13:56:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.736+0000 7fb944e09640 1 -- 172.21.15.50:0/548784946 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48052720 con 0x55a47e85aa20 2024-05-07T13:56:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.736+0000 7fb944e09640 1 -- 172.21.15.50:0/548784946 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48052a20 con 0x55a47e85aa20 2024-05-07T13:56:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 -- 172.21.15.50:0/548784946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 msgr2=0x55a47e94fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 --2- 172.21.15.50:0/548784946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e94fb60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fba48055040 tx=0x7fba4804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 -- 172.21.15.50:0/548784946 shutdown_connections 2024-05-07T13:56:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 --2- 172.21.15.50:0/548784946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e94fb60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 -- 172.21.15.50:0/548784946 >> 172.21.15.50:0/548784946 conn(0x55a47e8565c0 msgr2=0x55a47e94b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 -- 172.21.15.50:0/548784946 shutdown_connections 2024-05-07T13:56:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 -- 172.21.15.50:0/548784946 wait complete. 2024-05-07T13:56:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 Processor -- start 2024-05-07T13:56:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 -- start start 2024-05-07T13:56:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e9575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba58f75800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a47e85c470 con 0x55a47e85aa20 2024-05-07T13:56:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e9575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e9575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50512/0 (socket says 172.21.15.50:50512) 2024-05-07T13:56:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.737+0000 7fba56a74640 1 -- 172.21.15.50:0/2539417868 learned_addr learned my addr 172.21.15.50:0/2539417868 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.738+0000 7fba56a74640 1 -- 172.21.15.50:0/2539417868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a47e957b20 con 0x55a47e85aa20 2024-05-07T13:56:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.738+0000 7fba56a74640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e9575e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fba48052540 tx=0x7fba48003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.738+0000 7fb943606640 1 -- 172.21.15.50:0/2539417868 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48073070 con 0x55a47e85aa20 2024-05-07T13:56:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.738+0000 7fb943606640 1 -- 172.21.15.50:0/2539417868 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4805d440 con 0x55a47e85aa20 2024-05-07T13:56:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.738+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a47e957db0 con 0x55a47e85aa20 2024-05-07T13:56:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.738+0000 7fb943606640 1 -- 172.21.15.50:0/2539417868 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48057070 con 0x55a47e85aa20 2024-05-07T13:56:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.738+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a47e95aa60 con 0x55a47e85aa20 2024-05-07T13:56:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.739+0000 7fb943606640 1 -- 172.21.15.50:0/2539417868 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fba48076070 con 0x55a47e85aa20 2024-05-07T13:56:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.739+0000 7fb943606640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb93c036950 0x7fb93c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.739+0000 7fb943606640 1 -- 172.21.15.50:0/2539417868 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fba4808dc40 con 0x55a47e85aa20 2024-05-07T13:56:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.739+0000 7fba56273640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb93c036950 0x7fb93c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.739+0000 7fba58f75800 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e85b380 0x55a47e95e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.739+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e95ed60 con 0x55a47e85b380 2024-05-07T13:56:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.739+0000 7fba57275640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e85b380 0x55a47e95e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.740+0000 7fba57275640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e85b380 0x55a47e95e820 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.740+0000 7fba56273640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb93c036950 0x7fb93c038e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba4c000f60 tx=0x7fba4c001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.740+0000 7fba57275640 1 -- 172.21.15.50:0/2539417868 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e85b380 2024-05-07T13:56:14.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.740+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e95bdb0 con 0x55a47e85b380 2024-05-07T13:56:14.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.740+0000 7fba57275640 1 -- 172.21.15.50:0/2539417868 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e85b380 2024-05-07T13:56:14.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.740+0000 7fba58f75800 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e961050 0x55a47e963440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.740+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e963b10 con 0x55a47e961050 2024-05-07T13:56:14.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.740+0000 7fba56a74640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e961050 0x55a47e963440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.741+0000 7fba56a74640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e961050 0x55a47e963440 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.741+0000 7fba56a74640 1 -- 172.21.15.50:0/2539417868 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fba48075030 con 0x55a47e961050 2024-05-07T13:56:14.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.741+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e960000 con 0x55a47e85b380 2024-05-07T13:56:14.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.741+0000 7fba57275640 1 -- 172.21.15.50:0/2539417868 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e85b380 2024-05-07T13:56:14.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.741+0000 7fba58f75800 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a47e964fc0 0x55a47e967410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.741+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e967b70 con 0x55a47e964fc0 2024-05-07T13:56:14.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.742+0000 7fba56273640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a47e964fc0 0x55a47e967410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.742+0000 7fba56273640 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a47e964fc0 0x55a47e967410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.742+0000 7fba56273640 1 -- 172.21.15.50:0/2539417868 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fba4c00f690 con 0x55a47e964fc0 2024-05-07T13:56:14.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.743+0000 7fba58f75800 1 Processor -- start 2024-05-07T13:56:14.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.743+0000 7fba58f75800 1 -- start start 2024-05-07T13:56:14.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.743+0000 7fba58f75800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e975fd0 0x55a47e9763f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.743+0000 7fba58f75800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a47e74dcf0 con 0x55a47e975fd0 2024-05-07T13:56:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.743+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e975fd0 0x55a47e9763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.743+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e975fd0 0x55a47e9763f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50518/0 (socket says 172.21.15.50:50518) 2024-05-07T13:56:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.743+0000 7fba56a74640 1 -- 172.21.15.50:0/2203974966 learned_addr learned my addr 172.21.15.50:0/2203974966 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.743+0000 7fba56a74640 1 -- 172.21.15.50:0/2203974966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a47e976930 con 0x55a47e975fd0 2024-05-07T13:56:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.744+0000 7fba56a74640 1 --2- 172.21.15.50:0/2203974966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e975fd0 0x55a47e9763f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fba480066d0 tx=0x7fba48006ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.744+0000 7fb940e01640 1 -- 172.21.15.50:0/2203974966 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48077b80 con 0x55a47e975fd0 2024-05-07T13:56:14.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.744+0000 7fb940e01640 1 -- 172.21.15.50:0/2203974966 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48077d20 con 0x55a47e975fd0 2024-05-07T13:56:14.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.744+0000 7fb940e01640 1 -- 172.21.15.50:0/2203974966 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4805d850 con 0x55a47e975fd0 2024-05-07T13:56:14.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.744+0000 7fba58f75800 1 -- 172.21.15.50:0/2203974966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a47e9773a0 con 0x55a47e975fd0 2024-05-07T13:56:14.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.744+0000 7fba58f75800 1 -- 172.21.15.50:0/2203974966 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a47e9778a0 con 0x55a47e975fd0 2024-05-07T13:56:14.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.745+0000 7fb940e01640 1 -- 172.21.15.50:0/2203974966 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fba4805d9f0 con 0x55a47e975fd0 2024-05-07T13:56:14.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.745+0000 7fb940e01640 1 --2- 172.21.15.50:0/2203974966 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb930036900 0x7fb930038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.745+0000 7fb940e01640 1 -- 172.21.15.50:0/2203974966 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fba4809ba00 con 0x55a47e975fd0 2024-05-07T13:56:14.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.745+0000 7fba56273640 1 --2- 172.21.15.50:0/2203974966 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb930036900 0x7fb930038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.745+0000 7fba58f75800 1 Processor -- start 2024-05-07T13:56:14.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.745+0000 7fba58f75800 1 -- start start 2024-05-07T13:56:14.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.745+0000 7fba56273640 1 --2- 172.21.15.50:0/2203974966 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb930036900 0x7fb930038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a47e95f600 tx=0x7fba4c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.745+0000 7fba58f75800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e983530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.745+0000 7fba58f75800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a47e9503f0 con 0x55a47e983110 2024-05-07T13:56:14.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.746+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e983530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.746+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e983530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50530/0 (socket says 172.21.15.50:50530) 2024-05-07T13:56:14.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.746+0000 7fba56a74640 1 -- 172.21.15.50:0/3684529813 learned_addr learned my addr 172.21.15.50:0/3684529813 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.746+0000 7fba56a74640 1 -- 172.21.15.50:0/3684529813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a47e983b00 con 0x55a47e983110 2024-05-07T13:56:14.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.746+0000 7fba56a74640 1 --2- 172.21.15.50:0/3684529813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e983530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fba48092040 tx=0x7fba4805c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29cc796db76bb0d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.746+0000 7fb93a7fc640 1 -- 172.21.15.50:0/3684529813 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4808d910 con 0x55a47e983110 2024-05-07T13:56:14.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.746+0000 7fb93a7fc640 1 -- 172.21.15.50:0/3684529813 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4808d3f0 con 0x55a47e983110 2024-05-07T13:56:14.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.746+0000 7fb93a7fc640 1 -- 172.21.15.50:0/3684529813 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4809bd20 con 0x55a47e983110 2024-05-07T13:56:14.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 -- 172.21.15.50:0/3684529813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 msgr2=0x55a47e983530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 --2- 172.21.15.50:0/3684529813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e983530 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fba48092040 tx=0x7fba4805c880 comp rx=0 tx=0).stop 2024-05-07T13:56:14.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 -- 172.21.15.50:0/3684529813 shutdown_connections 2024-05-07T13:56:14.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 --2- 172.21.15.50:0/3684529813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e983530 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 -- 172.21.15.50:0/3684529813 >> 172.21.15.50:0/3684529813 conn(0x55a47e97f3e0 msgr2=0x55a47e97d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 -- 172.21.15.50:0/3684529813 shutdown_connections 2024-05-07T13:56:14.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 -- 172.21.15.50:0/3684529813 wait complete. 2024-05-07T13:56:14.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 Processor -- start 2024-05-07T13:56:14.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 -- start start 2024-05-07T13:56:14.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e98a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba58f75800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a47e984160 con 0x55a47e983110 2024-05-07T13:56:14.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e98a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba56a74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e98a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50544/0 (socket says 172.21.15.50:50544) 2024-05-07T13:56:14.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.747+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 learned_addr learned my addr 172.21.15.50:0/2528472991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.748+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a47e98a990 con 0x55a47e983110 2024-05-07T13:56:14.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.748+0000 7fba56a74640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e98a450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fba48092040 tx=0x7fba48080ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.748+0000 7fb938ff9640 1 -- 172.21.15.50:0/2528472991 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4808a8d0 con 0x55a47e983110 2024-05-07T13:56:14.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.748+0000 7fb938ff9640 1 -- 172.21.15.50:0/2528472991 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba480b6070 con 0x55a47e983110 2024-05-07T13:56:14.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.748+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a47e98a990 con 0x55a47e983110 2024-05-07T13:56:14.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.748+0000 7fb938ff9640 1 -- 172.21.15.50:0/2528472991 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4808aba0 con 0x55a47e983110 2024-05-07T13:56:14.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.748+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a47e98a990 con 0x55a47e983110 2024-05-07T13:56:14.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.749+0000 7fb938ff9640 1 -- 172.21.15.50:0/2528472991 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fba480ad040 con 0x55a47e983110 2024-05-07T13:56:14.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.749+0000 7fb938ff9640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb9200368b0 0x7fb920038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.749+0000 7fb938ff9640 1 -- 172.21.15.50:0/2528472991 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fba480ab020 con 0x55a47e983110 2024-05-07T13:56:14.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.749+0000 7fba56273640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb9200368b0 0x7fb920038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba56273640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb9200368b0 0x7fb920038d70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a47e967f70 tx=0x7fba4c010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba58f75800 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e995a50 0x55a47e997f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e998660 con 0x55a47e995a50 2024-05-07T13:56:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba57275640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e995a50 0x55a47e997f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba57275640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e995a50 0x55a47e997f10 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e995a50 2024-05-07T13:56:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba58f75800 20 realm 2024-05-07T13:56:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.750+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e998a70 con 0x55a47e995a50 2024-05-07T13:56:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e995a50 2024-05-07T13:56:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e999340 con 0x55a47e995a50 2024-05-07T13:56:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e995a50 2024-05-07T13:56:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e995a50 2024-05-07T13:56:14.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e995a50 2024-05-07T13:56:14.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e99a440 0x55a47e99c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e99ce40 con 0x55a47e99a440 2024-05-07T13:56:14.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.751+0000 7fba56a74640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e99a440 0x55a47e99c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.752+0000 7fba56a74640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e99a440 0x55a47e99c830 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.752+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.752+0000 7fba58f75800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.752+0000 7fba58f75800 20 searching for the correct realm 2024-05-07T13:56:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.752+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e99e790 con 0x55a47e99a440 2024-05-07T13:56:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.752+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.753+0000 7fba56a74640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fba48078060 0x7fba48057210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.753+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e99e790 con 0x7fba48078060 2024-05-07T13:56:14.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.753+0000 7fba56273640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fba48078060 0x7fba48057210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.753+0000 7fba56273640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fba48078060 0x7fba48057210 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.753+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.753+0000 7fba56273640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fba4c00f070 0x7fba4c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.753+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e99e790 con 0x7fba4c00f070 2024-05-07T13:56:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.753+0000 7fba57275640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fba4c00f070 0x7fba4c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.754+0000 7fba57275640 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fba4c00f070 0x7fba4c02e910 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.754+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5000a4a0 con 0x7fba4c00f070 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.754+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e995a50 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.754+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e995a50 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.754+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e995a50 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.754+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e995a50 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.754+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba4c00f070 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.755+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5000a4a0 con 0x7fba4c00f070 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.755+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba4c00f070 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.755+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fba5000a4a0 con 0x7fba4c00f070 2024-05-07T13:56:14.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.755+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba48078060 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.755+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.755+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e99a440 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.755+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.755+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e995a50 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.756+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e995a50 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.756+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba4c00f070 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.756+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5000a4a0 con 0x7fba4c00f070 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.756+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e995a50 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.756+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e995a50 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.756+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba48078060 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.756+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.756+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e99a440 2024-05-07T13:56:14.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.757+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.757+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e99a440 2024-05-07T13:56:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.757+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.757+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba4c00f070 2024-05-07T13:56:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.757+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5000a4a0 con 0x7fba4c00f070 2024-05-07T13:56:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.757+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e99a440 2024-05-07T13:56:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.758+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.758+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e99a440 2024-05-07T13:56:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.758+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.758+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e995a50 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.758+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5000a4a0 con 0x55a47e995a50 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.758+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e995a50 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.758+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.758+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba4c00f070 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.759+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.759+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e99a440 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.759+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.759+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba48078060 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.759+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.759+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e995a50 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.759+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.759+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba4c00f070 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.760+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.760+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e99a440 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.760+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.760+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba4c00f070 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.760+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.760+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba48078060 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.760+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.760+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e99a440 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.761+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.761+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba4c00f070 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.761+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.761+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x55a47e995a50 2024-05-07T13:56:14.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.761+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9996e0 con 0x7fba48078060 2024-05-07T13:56:14.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:14.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:14.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:14.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:14.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:14.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:14.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e99d700 con 0x55a47e995a50 2024-05-07T13:56:14.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e99daf0 con 0x55a47e995a50 2024-05-07T13:56:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.762+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e99daf0 con 0x7fba4c00f070 2024-05-07T13:56:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 20 zone default found 2024-05-07T13:56:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 4 Realm: () 2024-05-07T13:56:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 20 zonegroup default 2024-05-07T13:56:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e99d300 con 0x7fba4c00f070 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a05c0 con 0x55a47e99a440 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.763+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a0960 con 0x55a47e99a440 2024-05-07T13:56:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.764+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.764+0000 7fba58f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.764+0000 7fba58f75800 20 started sync module instance, tier type = 2024-05-07T13:56:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.764+0000 7fba58f75800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.764+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e99fa60 con 0x7fba48078060 2024-05-07T13:56:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.765+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.765+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94164987016624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a0d00 con 0x7fba48078060 2024-05-07T13:56:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.765+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a15b0 con 0x55a47e995a50 2024-05-07T13:56:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.766+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94164987016624] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.766+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.766+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94164987023520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a19a0 con 0x55a47e995a50 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.766+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a2400 con 0x55a47e99a440 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.767+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94164987023520] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.767+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.767+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94164987027120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a27f0 con 0x55a47e99a440 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.767+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a3230 con 0x7fba48078060 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.768+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94164987027120] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.768+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.768+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94164987018880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a3ad0 con 0x7fba48078060 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.768+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a4490 con 0x55a47e995a50 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.769+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.769+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94164987036096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a4c90 con 0x55a47e995a50 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.769+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94164987018880] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.769+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a5280 con 0x7fba4c00f070 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.770+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94164987036096] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.771+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.771+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94164987033120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a5280 con 0x7fba4c00f070 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.771+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a5c90 con 0x7fba4c00f070 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.771+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.771+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94164987041760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a5c00 con 0x7fba4c00f070 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.771+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a6bf0 con 0x7fba4c00f070 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94164987033120] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94164987041760] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94164987043968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a66d0 con 0x7fba4c00f070 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba58f75800 20 add_watcher() i=0 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba58f75800 20 add_watcher() i=1 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba58f75800 20 add_watcher() i=2 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba58f75800 20 add_watcher() i=3 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba58f75800 20 add_watcher() i=4 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba58f75800 20 add_watcher() i=5 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.772+0000 7fba58f75800 20 add_watcher() i=6 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.773+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94164987043968] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.773+0000 7fba58f75800 20 add_watcher() i=7 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.773+0000 7fba58f75800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.773+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a9c20 con 0x55a47e995a50 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.774+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.774+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94164987037408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9a70a0 con 0x55a47e995a50 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.775+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94164987037408] v27'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.775+0000 7fb90d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.775+0000 7fba58f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.775+0000 7fba58f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.775+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b23f0 con 0x55a47e995a50 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.777+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.777+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b2ac0 con 0x7fba4c00f070 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.778+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.778+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b2ee0 con 0x55a47e99a440 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.778+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.779+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b2e50 con 0x55a47e995a50 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.779+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'140 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.779+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b3520 con 0x7fba48078060 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.780+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.780+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b3a90 con 0x55a47e99a440 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.781+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.781+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b3f10 con 0x55a47e995a50 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.782+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.782+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b3f10 con 0x7fba4c00f070 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.783+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.783+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b3f10 con 0x7fba48078060 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.784+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.784+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b43c0 con 0x55a47e99a440 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.785+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.785+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b43c0 con 0x7fba48078060 2024-05-07T13:56:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.786+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.786+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b43c0 con 0x7fba4c00f070 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.787+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.787+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b43c0 con 0x7fba48078060 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.788+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.788+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x7fba4c00f070 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.789+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.789+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e995a50 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.791+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.791+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e99a440 2024-05-07T13:56:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.792+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.792+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x7fba48078060 2024-05-07T13:56:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.793+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.793+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e99a440 2024-05-07T13:56:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.794+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.794+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e995a50 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.795+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.795+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e995a50 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.795+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.796+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e99a440 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.797+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.797+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x7fba48078060 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.797+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.797+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e99a440 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.798+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.798+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e99a440 2024-05-07T13:56:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.799+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.799+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e99a440 2024-05-07T13:56:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.800+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.800+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e99a440 2024-05-07T13:56:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.801+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.801+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x7fba4c00f070 2024-05-07T13:56:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.802+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.802+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e99a440 2024-05-07T13:56:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.803+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.803+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x7fba4c00f070 2024-05-07T13:56:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.805+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.805+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x55a47e99a440 2024-05-07T13:56:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.806+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.806+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x7fba4c00f070 2024-05-07T13:56:14.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.807+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.807+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9b4780 con 0x7fba48078060 2024-05-07T13:56:14.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.808+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.808+0000 7fb887fff640 20 reqs_thread_entry: start 2024-05-07T13:56:14.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.808+0000 7fba58f75800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:14.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 20 Filter name: none 2024-05-07T13:56:14.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fb885ffb640 20 reqs_thread_entry: start 2024-05-07T13:56:14.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:14.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9df7a0 con 0x7fba48078060 2024-05-07T13:56:14.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:14.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:56:14.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:14.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 : miss 2024-05-07T13:56:14.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e1230 con 0x7fba48078060 2024-05-07T13:56:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.809+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(95 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:14.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 20 get_obj_state: octx=0x7fba5000aad0 obj=myfoo:four state=0x55a47e9e2518 s->prefetch_data=0 2024-05-07T13:56:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 3.35s0 3:ae19b1aa:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e3340 con 0x55a47e995a50 2024-05-07T13:56:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(96 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 10 manifest: total_size = 4 2024-05-07T13:56:14.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 20 get_obj_state: setting s->obj_tag to 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9187961377893097943 2024-05-07T13:56:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 20 get_obj_state: octx=0x7fba5000aad0 obj=myfoo:four state=0x55a47e9e2518 s->prefetch_data=0 2024-05-07T13:56:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 20 prepare_atomic_modification: state is not atomic. state=0x55a47e9e2518 2024-05-07T13:56:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6 2024-05-07T13:56:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.810+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:97 4.a 4:50fb99c4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x7fba48078060 2024-05-07T13:56:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.811+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(97 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6 [stat,call,call] v27'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.811+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:98 3.35s0 3:ae19b1aa:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x55a47e995a50 2024-05-07T13:56:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.812+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(98 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1_four [call] v27'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.812+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:99 4.a 4:50fb99c4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x7fba48078060 2024-05-07T13:56:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.814+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(99 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6 [stat,call,call] v27'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.814+0000 7fb93a7fc640 20 handle_completion(): completion ok for obj=four 2024-05-07T13:56:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.814+0000 7fb90d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.814+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94164987037408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x55a47e995a50 2024-05-07T13:56:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.815+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94164987037408] v27'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.815+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94164987016624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x7fba48078060 2024-05-07T13:56:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.816+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94164987016624] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.816+0000 7fba58f75800 20 remove_watcher() i=0 2024-05-07T13:56:14.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.816+0000 7fba58f75800 2 removed watcher, disabling cache 2024-05-07T13:56:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.816+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94164987023520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x55a47e995a50 2024-05-07T13:56:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.817+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94164987023520] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.817+0000 7fba58f75800 20 remove_watcher() i=1 2024-05-07T13:56:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.817+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94164987027120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x55a47e99a440 2024-05-07T13:56:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.818+0000 7fba56a74640 1 -- 172.21.15.50:0/2528472991 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94164987027120] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48093020 con 0x55a47e99a440 2024-05-07T13:56:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.818+0000 7fba58f75800 20 remove_watcher() i=2 2024-05-07T13:56:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.818+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94164987018880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x7fba48078060 2024-05-07T13:56:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.819+0000 7fba56273640 1 -- 172.21.15.50:0/2528472991 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94164987018880] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba4c037040 con 0x7fba48078060 2024-05-07T13:56:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.819+0000 7fba58f75800 20 remove_watcher() i=3 2024-05-07T13:56:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.819+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94164987036096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x55a47e995a50 2024-05-07T13:56:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.820+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94164987036096] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x55a47e995a50 2024-05-07T13:56:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.820+0000 7fba58f75800 20 remove_watcher() i=4 2024-05-07T13:56:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.820+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94164987033120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x7fba4c00f070 2024-05-07T13:56:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.821+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94164987033120] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.821+0000 7fba58f75800 20 remove_watcher() i=5 2024-05-07T13:56:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.821+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94164987041760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x7fba4c00f070 2024-05-07T13:56:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.822+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94164987041760] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.822+0000 7fba58f75800 20 remove_watcher() i=6 2024-05-07T13:56:14.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.822+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94164987043968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a47e9e7cb0 con 0x7fba4c00f070 2024-05-07T13:56:14.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.823+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94164987043968] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba5002f060 con 0x7fba4c00f070 2024-05-07T13:56:14.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.823+0000 7fba58f75800 20 remove_watcher() i=7 2024-05-07T13:56:14.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fba4c00f070 msgr2=0x7fba4c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fba4c00f070 0x7fba4c02e910 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e995a50 msgr2=0x55a47e997f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e995a50 0x55a47e997f10 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fba48078060 msgr2=0x7fba48057210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fba48078060 0x7fba48057210 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e99a440 msgr2=0x55a47e99c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e99a440 0x55a47e99c830 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb9200368b0 msgr2=0x7fb920038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb9200368b0 0x7fb920038d70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a47e967f70 tx=0x7fba4c010000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 msgr2=0x55a47e98a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2528472991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e983110 0x55a47e98a450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fba48092040 tx=0x7fba48080ef0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 reap_dead start 2024-05-07T13:56:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba57275640 1 -- 172.21.15.50:0/2528472991 reap_dead start 2024-05-07T13:56:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 shutdown_connections 2024-05-07T13:56:14.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 >> 172.21.15.50:0/2528472991 conn(0x55a47e97f3e0 msgr2=0x55a47e97ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 shutdown_connections 2024-05-07T13:56:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2528472991 wait complete. 2024-05-07T13:56:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2203974966 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb930036900 msgr2=0x7fb930038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2203974966 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb930036900 0x7fb930038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a47e95f600 tx=0x7fba4c00f000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2203974966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e975fd0 msgr2=0x55a47e9763f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2203974966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e975fd0 0x55a47e9763f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fba480066d0 tx=0x7fba48006ba0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2203974966 shutdown_connections 2024-05-07T13:56:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2203974966 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb930036900 0x7fb930038dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 --2- 172.21.15.50:0/2203974966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e975fd0 0x55a47e9763f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2203974966 >> 172.21.15.50:0/2203974966 conn(0x55a47e96a070 msgr2=0x55a47e96a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2203974966 shutdown_connections 2024-05-07T13:56:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.824+0000 7fba58f75800 1 -- 172.21.15.50:0/2203974966 wait complete. 2024-05-07T13:56:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a47e964fc0 msgr2=0x55a47e967410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a47e964fc0 0x55a47e967410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e85b380 msgr2=0x55a47e95e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a47e85b380 0x55a47e95e820 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e961050 msgr2=0x55a47e963440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a47e961050 0x55a47e963440 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb93c036950 msgr2=0x7fb93c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb93c036950 0x7fb93c038e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba4c000f60 tx=0x7fba4c001370 comp rx=0 tx=0).stop 2024-05-07T13:56:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 msgr2=0x55a47e9575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 --2- 172.21.15.50:0/2539417868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a47e85aa20 0x55a47e9575e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fba48052540 tx=0x7fba48003020 comp rx=0 tx=0).stop 2024-05-07T13:56:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba57275640 1 -- 172.21.15.50:0/2539417868 reap_dead start 2024-05-07T13:56:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 shutdown_connections 2024-05-07T13:56:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 >> 172.21.15.50:0/2539417868 conn(0x55a47e8565c0 msgr2=0x55a47e949c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 shutdown_connections 2024-05-07T13:56:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.825+0000 7fba58f75800 1 -- 172.21.15.50:0/2539417868 wait complete. 2024-05-07T13:56:14.835 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-07T13:56:14.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-07T13:56:14.835 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-07T13:56:14.881 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:14.881 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.893+0000 7f95f1430800 1 Processor -- start 2024-05-07T13:56:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.893+0000 7f95f1430800 1 -- start start 2024-05-07T13:56:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.893+0000 7f95f1430800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562a8386bbd0 0x562a8386dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.893+0000 7f95f1430800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a83872010 con 0x562a8386e500 2024-05-07T13:56:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.893+0000 7f95f1430800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x562a836fc050 con 0x562a8386bbd0 2024-05-07T13:56:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.893+0000 7f95ec68b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562a8386bbd0 0x562a8386dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.893+0000 7f95ebe8a640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x562a8386e500 0x562a838708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40776/0 (socket says 172.21.15.50:40776) 2024-05-07T13:56:14.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.893+0000 7f95ec68b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562a8386bbd0 0x562a8386dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50552/0 (socket says 172.21.15.50:50552) 2024-05-07T13:56:14.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.893+0000 7f95ebe8a640 1 -- 172.21.15.50:0/3943901865 learned_addr learned my addr 172.21.15.50:0/3943901865 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:14.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.894+0000 7f95ec68b640 1 -- 172.21.15.50:0/3943901865 >> v1:172.21.15.22:6789/0 conn(0x562a8386e500 legacy=0x562a838708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.894+0000 7f95ec68b640 1 -- 172.21.15.50:0/3943901865 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a838731f0 con 0x562a8386bbd0 2024-05-07T13:56:14.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95ec68b640 1 --2- 172.21.15.50:0/3943901865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8386dfc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00a470 tx=0x7f95dc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42d84403fd8b6b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95eb689640 1 -- 172.21.15.50:0/3943901865 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc057070 con 0x562a8386bbd0 2024-05-07T13:56:14.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95eb689640 1 -- 172.21.15.50:0/3943901865 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc052570 con 0x562a8386bbd0 2024-05-07T13:56:14.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95eb689640 1 -- 172.21.15.50:0/3943901865 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc052870 con 0x562a8386bbd0 2024-05-07T13:56:14.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95f1430800 1 -- 172.21.15.50:0/3943901865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 msgr2=0x562a8386dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95f1430800 1 --2- 172.21.15.50:0/3943901865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8386dfc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00a470 tx=0x7f95dc01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:14.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95f1430800 1 -- 172.21.15.50:0/3943901865 shutdown_connections 2024-05-07T13:56:14.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95f1430800 1 --2- 172.21.15.50:0/3943901865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8386dfc0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95f1430800 1 -- 172.21.15.50:0/3943901865 >> 172.21.15.50:0/3943901865 conn(0x562a83865560 msgr2=0x562a83867980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95f1430800 1 -- 172.21.15.50:0/3943901865 shutdown_connections 2024-05-07T13:56:14.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.896+0000 7f95f1430800 1 -- 172.21.15.50:0/3943901865 wait complete. 2024-05-07T13:56:14.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.911+0000 7f95f1430800 1 Processor -- start 2024-05-07T13:56:14.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.911+0000 7f95f1430800 1 -- start start 2024-05-07T13:56:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.911+0000 7f95f1430800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8395c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.911+0000 7f95f1430800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a837b61d0 con 0x562a8386bbd0 2024-05-07T13:56:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.912+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8395c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.912+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8395c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50566/0 (socket says 172.21.15.50:50566) 2024-05-07T13:56:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.912+0000 7f95ec68b640 1 -- 172.21.15.50:0/305160600 learned_addr learned my addr 172.21.15.50:0/305160600 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.912+0000 7f95ec68b640 1 -- 172.21.15.50:0/305160600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a8395cc90 con 0x562a8386bbd0 2024-05-07T13:56:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.912+0000 7f95ec68b640 1 --2- 172.21.15.50:0/305160600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8395c6c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f95dc055040 tx=0x7f95dc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc9b2585e949b14 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.912+0000 7f94da60c640 1 -- 172.21.15.50:0/305160600 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc057040 con 0x562a8386bbd0 2024-05-07T13:56:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.912+0000 7f94da60c640 1 -- 172.21.15.50:0/305160600 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc052990 con 0x562a8386bbd0 2024-05-07T13:56:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.912+0000 7f94da60c640 1 -- 172.21.15.50:0/305160600 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc052c70 con 0x562a8386bbd0 2024-05-07T13:56:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.913+0000 7f95f1430800 1 -- 172.21.15.50:0/305160600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 msgr2=0x562a8395c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.913+0000 7f95f1430800 1 --2- 172.21.15.50:0/305160600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8395c6c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f95dc055040 tx=0x7f95dc04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.913+0000 7f95f1430800 1 -- 172.21.15.50:0/305160600 shutdown_connections 2024-05-07T13:56:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.913+0000 7f95f1430800 1 --2- 172.21.15.50:0/305160600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8395c6c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.913+0000 7f95f1430800 1 -- 172.21.15.50:0/305160600 >> 172.21.15.50:0/305160600 conn(0x562a83865560 msgr2=0x562a83957fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.913+0000 7f95f1430800 1 -- 172.21.15.50:0/305160600 shutdown_connections 2024-05-07T13:56:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.913+0000 7f95f1430800 1 -- 172.21.15.50:0/305160600 wait complete. 2024-05-07T13:56:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.913+0000 7f95f1430800 1 Processor -- start 2024-05-07T13:56:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.914+0000 7f95f1430800 1 -- start start 2024-05-07T13:56:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.914+0000 7f95f1430800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8386b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.914+0000 7f95f1430800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a83872480 con 0x562a8386bbd0 2024-05-07T13:56:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.914+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8386b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.914+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8386b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50572/0 (socket says 172.21.15.50:50572) 2024-05-07T13:56:14.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.914+0000 7f95ec68b640 1 -- 172.21.15.50:0/3567744443 learned_addr learned my addr 172.21.15.50:0/3567744443 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.914+0000 7f95ec68b640 1 -- 172.21.15.50:0/3567744443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a83869c00 con 0x562a8386bbd0 2024-05-07T13:56:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.914+0000 7f95ec68b640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8386b510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00a470 tx=0x7f95dc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.915+0000 7f94d8e09640 1 -- 172.21.15.50:0/3567744443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc073070 con 0x562a8386bbd0 2024-05-07T13:56:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.915+0000 7f94d8e09640 1 -- 172.21.15.50:0/3567744443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc05d650 con 0x562a8386bbd0 2024-05-07T13:56:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.915+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a83869e90 con 0x562a8386bbd0 2024-05-07T13:56:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.915+0000 7f94d8e09640 1 -- 172.21.15.50:0/3567744443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc057070 con 0x562a8386bbd0 2024-05-07T13:56:14.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.915+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a8386a3b0 con 0x562a8386bbd0 2024-05-07T13:56:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.915+0000 7f94d8e09640 1 -- 172.21.15.50:0/3567744443 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f95dc076070 con 0x562a8386bbd0 2024-05-07T13:56:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.916+0000 7f94d8e09640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94d4036900 0x7f94d4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.916+0000 7f94d8e09640 1 -- 172.21.15.50:0/3567744443 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f95dc08df50 con 0x562a8386bbd0 2024-05-07T13:56:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.916+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94d4036900 0x7f94d4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.916+0000 7f95f1430800 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a8386e500 0x562a8396d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.916+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a8396db60 con 0x562a8386e500 2024-05-07T13:56:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.916+0000 7f95ece8c640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a8386e500 0x562a8396d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.916+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94d4036900 0x7f94d4038dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.916+0000 7f95ece8c640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a8386e500 0x562a8396d540 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.917+0000 7f95ece8c640 1 -- 172.21.15.50:0/3567744443 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a8386e500 2024-05-07T13:56:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.917+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a8396e420 con 0x562a8386e500 2024-05-07T13:56:14.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.917+0000 7f95ece8c640 1 -- 172.21.15.50:0/3567744443 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a8386e500 2024-05-07T13:56:14.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.917+0000 7f95f1430800 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a8396fe50 0x562a839722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.917+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a83972a70 con 0x562a8396fe50 2024-05-07T13:56:14.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.917+0000 7f95ec68b640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a8396fe50 0x562a839722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.917+0000 7f95ec68b640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a8396fe50 0x562a839722e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.918+0000 7f95ec68b640 1 -- 172.21.15.50:0/3567744443 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f95dc075030 con 0x562a8396fe50 2024-05-07T13:56:14.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.918+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a8396eca0 con 0x562a8386e500 2024-05-07T13:56:14.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.918+0000 7f95ece8c640 1 -- 172.21.15.50:0/3567744443 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a8386e500 2024-05-07T13:56:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.918+0000 7f95f1430800 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562a83973f20 0x562a83976390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.918+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a83976af0 con 0x562a83973f20 2024-05-07T13:56:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.918+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562a83973f20 0x562a83976390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.919+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562a83973f20 0x562a83976390 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.919+0000 7f95ebe8a640 1 -- 172.21.15.50:0/3567744443 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f95e0009050 con 0x562a83973f20 2024-05-07T13:56:14.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.919+0000 7f95f1430800 1 Processor -- start 2024-05-07T13:56:14.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.919+0000 7f95f1430800 1 -- start start 2024-05-07T13:56:14.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.919+0000 7f95f1430800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83984f50 0x562a83985370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.919+0000 7f95f1430800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a8386ba50 con 0x562a83984f50 2024-05-07T13:56:14.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83984f50 0x562a83985370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83984f50 0x562a83985370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50586/0 (socket says 172.21.15.50:50586) 2024-05-07T13:56:14.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f95ec68b640 1 -- 172.21.15.50:0/3927581007 learned_addr learned my addr 172.21.15.50:0/3927581007 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f95ec68b640 1 -- 172.21.15.50:0/3927581007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a839858b0 con 0x562a83984f50 2024-05-07T13:56:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f95ec68b640 1 --2- 172.21.15.50:0/3927581007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83984f50 0x562a83985370 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f95dc066fd0 tx=0x7f95dc05cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f94d1ffb640 1 -- 172.21.15.50:0/3927581007 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc05ea70 con 0x562a83984f50 2024-05-07T13:56:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f94d1ffb640 1 -- 172.21.15.50:0/3927581007 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc05ec10 con 0x562a83984f50 2024-05-07T13:56:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f95f1430800 1 -- 172.21.15.50:0/3927581007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a83986320 con 0x562a83984f50 2024-05-07T13:56:14.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f94d1ffb640 1 -- 172.21.15.50:0/3927581007 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc0773b0 con 0x562a83984f50 2024-05-07T13:56:14.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.920+0000 7f95f1430800 1 -- 172.21.15.50:0/3927581007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a83986820 con 0x562a83984f50 2024-05-07T13:56:14.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.921+0000 7f94d1ffb640 1 -- 172.21.15.50:0/3927581007 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f95dc077550 con 0x562a83984f50 2024-05-07T13:56:14.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.921+0000 7f94d1ffb640 1 --2- 172.21.15.50:0/3927581007 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94c4036900 0x7f94c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.921+0000 7f94d1ffb640 1 -- 172.21.15.50:0/3927581007 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f95dc002000 con 0x562a83984f50 2024-05-07T13:56:14.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.921+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/3927581007 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94c4036900 0x7f94c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95f1430800 1 Processor -- start 2024-05-07T13:56:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/3927581007 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94c4036900 0x7f94c4038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f95e000bf50 tx=0x7f95e000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95f1430800 1 -- start start 2024-05-07T13:56:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95f1430800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83992490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95f1430800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a8375ccf0 con 0x562a83992070 2024-05-07T13:56:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83992490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83992490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50596/0 (socket says 172.21.15.50:50596) 2024-05-07T13:56:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95ec68b640 1 -- 172.21.15.50:0/3857541275 learned_addr learned my addr 172.21.15.50:0/3857541275 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95ec68b640 1 -- 172.21.15.50:0/3857541275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a83992a60 con 0x562a83992070 2024-05-07T13:56:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f95ec68b640 1 --2- 172.21.15.50:0/3857541275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83992490 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f95dc080f90 tx=0x7f95dc0786e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc71bb00abcd4dc server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.922+0000 7f94cb7fe640 1 -- 172.21.15.50:0/3857541275 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc091da0 con 0x562a83992070 2024-05-07T13:56:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f94cb7fe640 1 -- 172.21.15.50:0/3857541275 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc0a9070 con 0x562a83992070 2024-05-07T13:56:14.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f94cb7fe640 1 -- 172.21.15.50:0/3857541275 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc0766e0 con 0x562a83992070 2024-05-07T13:56:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f95f1430800 1 -- 172.21.15.50:0/3857541275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 msgr2=0x562a83992490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f95f1430800 1 --2- 172.21.15.50:0/3857541275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83992490 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f95dc080f90 tx=0x7f95dc0786e0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f95f1430800 1 -- 172.21.15.50:0/3857541275 shutdown_connections 2024-05-07T13:56:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f95f1430800 1 --2- 172.21.15.50:0/3857541275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83992490 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f95f1430800 1 -- 172.21.15.50:0/3857541275 >> 172.21.15.50:0/3857541275 conn(0x562a8398e3d0 msgr2=0x562a8398c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:14.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f95f1430800 1 -- 172.21.15.50:0/3857541275 shutdown_connections 2024-05-07T13:56:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f95f1430800 1 -- 172.21.15.50:0/3857541275 wait complete. 2024-05-07T13:56:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f95f1430800 1 Processor -- start 2024-05-07T13:56:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.923+0000 7f95f1430800 1 -- start start 2024-05-07T13:56:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f95f1430800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83999310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f95f1430800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a83992f90 con 0x562a83992070 2024-05-07T13:56:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83999310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f95ec68b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83999310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50612/0 (socket says 172.21.15.50:50612) 2024-05-07T13:56:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 learned_addr learned my addr 172.21.15.50:0/2196938183 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a83999850 con 0x562a83992070 2024-05-07T13:56:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f95ec68b640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83999310 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f95dc080f90 tx=0x7f95dc090f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f94c9ffb640 1 -- 172.21.15.50:0/2196938183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc0bc070 con 0x562a83992070 2024-05-07T13:56:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f94c9ffb640 1 -- 172.21.15.50:0/2196938183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc08c990 con 0x562a83992070 2024-05-07T13:56:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a83999850 con 0x562a83992070 2024-05-07T13:56:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f94c9ffb640 1 -- 172.21.15.50:0/2196938183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95dc06f540 con 0x562a83992070 2024-05-07T13:56:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.924+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a83999cf0 con 0x562a83992070 2024-05-07T13:56:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.925+0000 7f94c9ffb640 1 -- 172.21.15.50:0/2196938183 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f95dc0bf070 con 0x562a83992070 2024-05-07T13:56:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.926+0000 7f94c9ffb640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94bc036950 0x7f94bc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.926+0000 7f94c9ffb640 1 -- 172.21.15.50:0/2196938183 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f95dc0c2ca0 con 0x562a83992070 2024-05-07T13:56:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.926+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94bc036950 0x7f94bc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.926+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.926+0000 7f95f1430800 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a839a49d0 0x562a839a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.926+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839a75e0 con 0x562a839a49d0 2024-05-07T13:56:14.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.926+0000 7f95ece8c640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a839a49d0 0x562a839a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.926+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94bc036950 0x7f94bc038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f95e0001b60 tx=0x7f95e0010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.926+0000 7f95ece8c640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a839a49d0 0x562a839a6e90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 20 realm 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839a79f0 con 0x562a839a49d0 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839a82c0 con 0x562a839a49d0 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a49d0 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a839a9150 0x562a839ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.927+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839abca0 con 0x562a839a9150 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.928+0000 7f95ec68b640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a839a9150 0x562a839ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.928+0000 7f95ec68b640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a839a9150 0x562a839ab540 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.928+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.928+0000 7f95f1430800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.928+0000 7f95f1430800 20 searching for the correct realm 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.928+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839ad680 con 0x562a839a9150 2024-05-07T13:56:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.929+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.929+0000 7f95ec68b640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f95dc0c1060 0x7f95dc05b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.929+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839ad680 con 0x7f95dc0c1060 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.929+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f95dc0c1060 0x7f95dc05b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.929+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f95dc0c1060 0x7f95dc05b710 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.929+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0009050 con 0x7f95dc0c1060 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.929+0000 7f95ebe8a640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f95e0038040 0x7f95e001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.929+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839ad680 con 0x7f95e0038040 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.930+0000 7f95ece8c640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f95e0038040 0x7f95e001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.930+0000 7f95ece8c640 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f95e0038040 0x7f95e001bab0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.931+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.931+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a49d0 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.931+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.931+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a49d0 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.931+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.931+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95e0038040 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.931+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.931+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95e0038040 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.932+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.932+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95dc0c1060 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.932+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0009050 con 0x7f95dc0c1060 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.932+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a9150 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.932+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.932+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a49d0 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.932+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.932+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95e0038040 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.933+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.933+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a49d0 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.933+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.933+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95dc0c1060 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.933+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f95e0009050 con 0x7f95dc0c1060 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.933+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a9150 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.933+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.933+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a9150 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.934+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.934+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95e0038040 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.934+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.934+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a9150 2024-05-07T13:56:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.934+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.934+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a9150 2024-05-07T13:56:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.934+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.934+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a49d0 2024-05-07T13:56:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.935+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.935+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a49d0 2024-05-07T13:56:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.935+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.935+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95e0038040 2024-05-07T13:56:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.935+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.935+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a9150 2024-05-07T13:56:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.935+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.935+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95dc0c1060 2024-05-07T13:56:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.936+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0009050 con 0x7f95dc0c1060 2024-05-07T13:56:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.936+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a49d0 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.936+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.936+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95e0038040 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.936+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.936+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a9150 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.937+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.937+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95e0038040 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.937+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.937+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95dc0c1060 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.938+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0009050 con 0x7f95dc0c1060 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.938+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a9150 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.938+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.938+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95e0038040 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.938+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.938+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x562a839a49d0 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562a839a8660 con 0x7f95dc0c1060 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839ac650 con 0x562a839a49d0 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839aca40 con 0x562a839a49d0 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.939+0000 7f95f1430800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839aca40 con 0x7f95e0038040 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 20 zone default found 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 4 Realm: () 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 20 zonegroup default 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839ace60 con 0x7f95e0038040 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.940+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839ad280 con 0x562a839a9150 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.941+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.941+0000 7f95f1430800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.941+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.941+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839af530 con 0x562a839a9150 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.941+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.941+0000 7f95f1430800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.941+0000 7f95f1430800 20 started sync module instance, tier type = 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.941+0000 7f95f1430800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.941+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839ae9d0 con 0x7f95dc0c1060 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.942+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.942+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94740596583872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839ae630 con 0x7f95dc0c1060 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.942+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b03a0 con 0x562a839a49d0 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.943+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.943+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94740596588752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b0b40 con 0x562a839a49d0 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.943+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b1660 con 0x562a839a9150 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.943+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94740596583872] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.944+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94740596588752] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.944+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.945+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94740596592944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b0590 con 0x562a839a9150 2024-05-07T13:56:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.945+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b2070 con 0x7f95dc0c1060 2024-05-07T13:56:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.946+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94740596592944] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.946+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.946+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94740596586704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b28c0 con 0x7f95dc0c1060 2024-05-07T13:56:14.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.946+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b3110 con 0x562a839a49d0 2024-05-07T13:56:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.947+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94740596586704] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.947+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.947+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94740596599904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b3080 con 0x562a839a49d0 2024-05-07T13:56:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.947+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b4010 con 0x7f95e0038040 2024-05-07T13:56:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.948+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94740596599904] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.948+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.948+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94740596602032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b3fd0 con 0x7f95e0038040 2024-05-07T13:56:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.948+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b4a20 con 0x7f95e0038040 2024-05-07T13:56:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.949+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94740596602032] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.949+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.949+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94740596604160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b4a20 con 0x7f95e0038040 2024-05-07T13:56:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.949+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b53e0 con 0x7f95e0038040 2024-05-07T13:56:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:14.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94740596608816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b5800 con 0x7f95e0038040 2024-05-07T13:56:14.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95f1430800 20 add_watcher() i=0 2024-05-07T13:56:14.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95f1430800 20 add_watcher() i=1 2024-05-07T13:56:14.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95f1430800 20 add_watcher() i=2 2024-05-07T13:56:14.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95f1430800 20 add_watcher() i=3 2024-05-07T13:56:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95f1430800 20 add_watcher() i=4 2024-05-07T13:56:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95f1430800 20 add_watcher() i=5 2024-05-07T13:56:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94740596604160] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.950+0000 7f95f1430800 20 add_watcher() i=6 2024-05-07T13:56:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.951+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94740596608816] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:15.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.951+0000 7f95f1430800 20 add_watcher() i=7 2024-05-07T13:56:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.951+0000 7f95f1430800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.951+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839b4570 con 0x562a839a49d0 2024-05-07T13:56:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.951+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.951+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94740596609872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839b4570 con 0x562a839a49d0 2024-05-07T13:56:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.952+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94740596609872] v27'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.952+0000 7f94a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.952+0000 7f95f1430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.952+0000 7f95f1430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f95f1430800 5 note: GC not initialized 2024-05-07T13:56:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f94a17e2640 20 reqs_thread_entry: start 2024-05-07T13:56:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f95f1430800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f95f1430800 20 Filter name: none 2024-05-07T13:56:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f9412ffd640 20 reqs_thread_entry: start 2024-05-07T13:56:15.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839ebdd0 con 0x7f95dc0c1060 2024-05-07T13:56:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f95f1430800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.953+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839ec930 con 0x7f95dc0c1060 2024-05-07T13:56:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(63 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:15.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-07T13:56:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839ec970 con 0x7f95dc0c1060 2024-05-07T13:56:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839ee090 con 0x7f95dc0c1060 2024-05-07T13:56:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(65 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-07T13:56:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 4.14 4:293cf68a:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839ed680 con 0x562a839a9150 2024-05-07T13:56:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.954+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:67 4.26 4:6704b11e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839f2c00 con 0x7f95e0038040 2024-05-07T13:56:15.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 4.9 4:909e4f72:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839f54f0 con 0x562a839a49d0 2024-05-07T13:56:15.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 4.1f 4:f81bf5a8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839f8120 con 0x562a839a9150 2024-05-07T13:56:15.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 4.30 4:0e03b4bd:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839f54f0 con 0x562a839a9150 2024-05-07T13:56:15.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 4.1d 4:bb05b52e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839fd1c0 con 0x562a839a9150 2024-05-07T13:56:15.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 4.a 4:50fb99c4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a839ffbb0 con 0x7f95dc0c1060 2024-05-07T13:56:15.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 4.35 4:ad982cc1:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a83a02610 con 0x562a839a49d0 2024-05-07T13:56:15.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:74 4.5 4:a1423e85:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a83a05480 con 0x562a839a9150 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 4.8 4:10d422e9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a83a07eb0 con 0x562a839a9150 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:76 4.30 4:0cdb3134:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562a83a0aca0 con 0x562a839a9150 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(67 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(68 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(73 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(72 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(69 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(70 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(71 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(75 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:15.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(76 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.955+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(74 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.956+0000 7f94a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.956+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94740596609872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a83a07eb0 con 0x562a839a49d0 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.957+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94740596609872] v27'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.957+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94740596583872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839d42f0 con 0x7f95dc0c1060 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.958+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94740596583872] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.959+0000 7f95f1430800 20 remove_watcher() i=0 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.959+0000 7f95f1430800 2 removed watcher, disabling cache 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.959+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94740596588752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a83a07e80 con 0x562a839a49d0 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.959+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94740596588752] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.959+0000 7f95f1430800 20 remove_watcher() i=1 2024-05-07T13:56:15.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.959+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94740596592944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839d42f0 con 0x562a839a9150 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.960+0000 7f95ec68b640 1 -- 172.21.15.50:0/2196938183 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94740596592944] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95dc0be030 con 0x562a839a9150 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.961+0000 7f95f1430800 20 remove_watcher() i=2 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.961+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94740596586704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a83a07e80 con 0x7f95dc0c1060 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.962+0000 7f95ebe8a640 1 -- 172.21.15.50:0/2196938183 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94740596586704] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0045040 con 0x7f95dc0c1060 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.962+0000 7f95f1430800 20 remove_watcher() i=3 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.962+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94740596599904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839d42f0 con 0x562a839a49d0 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.963+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94740596599904] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x562a839a49d0 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.963+0000 7f95f1430800 20 remove_watcher() i=4 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.963+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94740596602032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a83a07e80 con 0x7f95e0038040 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.964+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94740596602032] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.964+0000 7f95f1430800 20 remove_watcher() i=5 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.964+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94740596604160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a839d42f0 con 0x7f95e0038040 2024-05-07T13:56:15.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.965+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94740596604160] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.965+0000 7f95f1430800 20 remove_watcher() i=6 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.965+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94740596608816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562a83a07e80 con 0x7f95e0038040 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94740596608816] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e400a4a0 con 0x7f95e0038040 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 20 remove_watcher() i=7 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f95e0038040 msgr2=0x7f95e001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f95e0038040 0x7f95e001bab0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a839a49d0 msgr2=0x562a839a6e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a839a49d0 0x562a839a6e90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f95dc0c1060 msgr2=0x7f95dc05b710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f95dc0c1060 0x7f95dc05b710 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a839a9150 msgr2=0x562a839ab540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a839a9150 0x562a839ab540 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94bc036950 msgr2=0x7f94bc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94bc036950 0x7f94bc038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f95e0001b60 tx=0x7f95e0010000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 msgr2=0x562a83999310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83999310 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f95dc080f90 tx=0x7f95dc090f60 comp rx=0 tx=0).stop 2024-05-07T13:56:15.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95ece8c640 1 -- 172.21.15.50:0/2196938183 reap_dead start 2024-05-07T13:56:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 shutdown_connections 2024-05-07T13:56:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.966+0000 7f95f1430800 1 --2- 172.21.15.50:0/2196938183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83992070 0x562a83999310 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 >> 172.21.15.50:0/2196938183 conn(0x562a8398e3d0 msgr2=0x562a8398ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 shutdown_connections 2024-05-07T13:56:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/2196938183 wait complete. 2024-05-07T13:56:15.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3927581007 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94c4036900 msgr2=0x7f94c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 --2- 172.21.15.50:0/3927581007 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94c4036900 0x7f94c4038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f95e000bf50 tx=0x7f95e000f000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3927581007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83984f50 msgr2=0x562a83985370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 --2- 172.21.15.50:0/3927581007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83984f50 0x562a83985370 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f95dc066fd0 tx=0x7f95dc05cf60 comp rx=0 tx=0).stop 2024-05-07T13:56:15.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3927581007 shutdown_connections 2024-05-07T13:56:15.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 --2- 172.21.15.50:0/3927581007 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94c4036900 0x7f94c4038dc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 --2- 172.21.15.50:0/3927581007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a83984f50 0x562a83985370 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3927581007 >> 172.21.15.50:0/3927581007 conn(0x562a83978ff0 msgr2=0x562a839793f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3927581007 shutdown_connections 2024-05-07T13:56:15.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3927581007 wait complete. 2024-05-07T13:56:15.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562a83973f20 msgr2=0x562a83976390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562a83973f20 0x562a83976390 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a8386e500 msgr2=0x562a8396d540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562a8386e500 0x562a8396d540 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a8396fe50 msgr2=0x562a839722e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562a8396fe50 0x562a839722e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94d4036900 msgr2=0x7f94d4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f94d4036900 0x7f94d4038dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e00012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 msgr2=0x562a8386b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.967+0000 7f95f1430800 1 --2- 172.21.15.50:0/3567744443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a8386bbd0 0x562a8386b510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00a470 tx=0x7f95dc003020 comp rx=0 tx=0).stop 2024-05-07T13:56:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.968+0000 7f95ece8c640 1 -- 172.21.15.50:0/3567744443 reap_dead start 2024-05-07T13:56:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.968+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 shutdown_connections 2024-05-07T13:56:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.968+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 >> 172.21.15.50:0/3567744443 conn(0x562a83865560 msgr2=0x562a839567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.968+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 shutdown_connections 2024-05-07T13:56:15.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:14.968+0000 7f95f1430800 1 -- 172.21.15.50:0/3567744443 wait complete. 2024-05-07T13:56:15.018 INFO:teuthology.orchestra.run.smithi050.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"02b45de7-8fca-4685-ae50-761ba20a02e2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","marker":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-07T13:56:14.431130Z","creation_time":"2024-05-07T13:56:11.609586Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-07T13:56:15.019 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '02b45de7-8fca-4685-ae50-761ba20a02e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-07T13:56:14.431130Z', 'creation_time': '2024-05-07T13:56:11.609586Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-07T13:56:15.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-05-07T13:56:15.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-05-07T13:56:15.020 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-05-07T13:56:15.063 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.076+0000 7fae9a946800 1 Processor -- start 2024-05-07T13:56:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.076+0000 7fae9a946800 1 -- start start 2024-05-07T13:56:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.076+0000 7fae9a946800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562c0a2af740 0x562c0a2afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.076+0000 7fae9a946800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c0a2b01e0 con 0x562c0a2b09a0 2024-05-07T13:56:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.076+0000 7fae9a946800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x562c0a142050 con 0x562c0a2af740 2024-05-07T13:56:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.076+0000 7fae98445640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562c0a2af740 0x562c0a2afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.076+0000 7fae98445640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562c0a2af740 0x562c0a2afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50624/0 (socket says 172.21.15.50:50624) 2024-05-07T13:56:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.076+0000 7fae98445640 1 -- 172.21.15.50:0/1695063238 learned_addr learned my addr 172.21.15.50:0/1695063238 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.076+0000 7fae97c44640 1 --1- 172.21.15.50:0/1695063238 >> v1:172.21.15.22:6789/0 conn(0x562c0a2b09a0 0x562c0a2b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40778/0 (socket says 172.21.15.50:40778) 2024-05-07T13:56:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.077+0000 7fae98445640 1 -- 172.21.15.50:0/1695063238 >> v1:172.21.15.22:6789/0 conn(0x562c0a2b09a0 legacy=0x562c0a2b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.077+0000 7fae98445640 1 -- 172.21.15.50:0/1695063238 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0a2b1560 con 0x562c0a2af740 2024-05-07T13:56:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae98445640 1 --2- 172.21.15.50:0/1695063238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a2afb60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fae880095b0 tx=0x7fae8801ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924c9f31ff9efc10 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae97443640 1 -- 172.21.15.50:0/1695063238 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88009200 con 0x562c0a2af740 2024-05-07T13:56:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae97443640 1 -- 172.21.15.50:0/1695063238 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae88007490 con 0x562c0a2af740 2024-05-07T13:56:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae97443640 1 -- 172.21.15.50:0/1695063238 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88007790 con 0x562c0a2af740 2024-05-07T13:56:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae9a946800 1 -- 172.21.15.50:0/1695063238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 msgr2=0x562c0a2afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae9a946800 1 --2- 172.21.15.50:0/1695063238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a2afb60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fae880095b0 tx=0x7fae8801ddd0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae9a946800 1 -- 172.21.15.50:0/1695063238 shutdown_connections 2024-05-07T13:56:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae9a946800 1 --2- 172.21.15.50:0/1695063238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a2afb60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae9a946800 1 -- 172.21.15.50:0/1695063238 >> 172.21.15.50:0/1695063238 conn(0x562c0a2aad20 msgr2=0x562c0a2ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae9a946800 1 -- 172.21.15.50:0/1695063238 shutdown_connections 2024-05-07T13:56:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.079+0000 7fae9a946800 1 -- 172.21.15.50:0/1695063238 wait complete. 2024-05-07T13:56:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.095+0000 7fae9a946800 1 Processor -- start 2024-05-07T13:56:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.095+0000 7fae9a946800 1 -- start start 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.095+0000 7fae9a946800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.095+0000 7fae9a946800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562c0a1fc1c0 con 0x562c0a2af740 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.095+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.095+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50636/0 (socket says 172.21.15.50:50636) 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.095+0000 7fae98445640 1 -- 172.21.15.50:0/1098377288 learned_addr learned my addr 172.21.15.50:0/1098377288 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.095+0000 7fae98445640 1 -- 172.21.15.50:0/1098377288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0a3a0b50 con 0x562c0a2af740 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.096+0000 7fae98445640 1 --2- 172.21.15.50:0/1098377288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a0580 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fae88055040 tx=0x7fae8804d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b9894426e0c2a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.096+0000 7fad8660c640 1 -- 172.21.15.50:0/1098377288 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88009200 con 0x562c0a2af740 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.096+0000 7fad8660c640 1 -- 172.21.15.50:0/1098377288 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae88007640 con 0x562c0a2af740 2024-05-07T13:56:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.096+0000 7fad8660c640 1 -- 172.21.15.50:0/1098377288 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88007940 con 0x562c0a2af740 2024-05-07T13:56:15.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.096+0000 7fae9a946800 1 -- 172.21.15.50:0/1098377288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 msgr2=0x562c0a3a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.096+0000 7fae9a946800 1 --2- 172.21.15.50:0/1098377288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a0580 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fae88055040 tx=0x7fae8804d000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.096+0000 7fae9a946800 1 -- 172.21.15.50:0/1098377288 shutdown_connections 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.096+0000 7fae9a946800 1 --2- 172.21.15.50:0/1098377288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a0580 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.096+0000 7fae9a946800 1 -- 172.21.15.50:0/1098377288 >> 172.21.15.50:0/1098377288 conn(0x562c0a2aad20 msgr2=0x562c0a39bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.097+0000 7fae9a946800 1 -- 172.21.15.50:0/1098377288 shutdown_connections 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.097+0000 7fae9a946800 1 -- 172.21.15.50:0/1098377288 wait complete. 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.097+0000 7fae9a946800 1 Processor -- start 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.097+0000 7fae9a946800 1 -- start start 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.097+0000 7fae9a946800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.097+0000 7fae9a946800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562c0a214090 con 0x562c0a2af740 2024-05-07T13:56:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.097+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.097+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50644/0 (socket says 172.21.15.50:50644) 2024-05-07T13:56:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.097+0000 7fae98445640 1 -- 172.21.15.50:0/2795399974 learned_addr learned my addr 172.21.15.50:0/2795399974 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.098+0000 7fae98445640 1 -- 172.21.15.50:0/2795399974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0a3a8680 con 0x562c0a2af740 2024-05-07T13:56:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.098+0000 7fae98445640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a8140 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fae88045a40 tx=0x7fae88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.098+0000 7fad84e09640 1 -- 172.21.15.50:0/2795399974 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88074070 con 0x562c0a2af740 2024-05-07T13:56:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.098+0000 7fad84e09640 1 -- 172.21.15.50:0/2795399974 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae88007cb0 con 0x562c0a2af740 2024-05-07T13:56:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.098+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c0a3a8910 con 0x562c0a2af740 2024-05-07T13:56:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.098+0000 7fad84e09640 1 -- 172.21.15.50:0/2795399974 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae8806b070 con 0x562c0a2af740 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.098+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0a3ab570 con 0x562c0a2af740 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.099+0000 7fad84e09640 1 -- 172.21.15.50:0/2795399974 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fae88066480 con 0x562c0a2af740 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.099+0000 7fad84e09640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad80036950 0x7fad80038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.099+0000 7fad84e09640 1 -- 172.21.15.50:0/2795399974 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fae8808fd80 con 0x562c0a2af740 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.099+0000 7fae97c44640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad80036950 0x7fad80038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.099+0000 7fae9a946800 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a2b09a0 0x562c0a3af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.099+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3af8b0 con 0x562c0a2b09a0 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.099+0000 7fae98c46640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a2b09a0 0x562c0a3af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.099+0000 7fae97c44640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad80036950 0x7fad80038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae8c000f60 tx=0x7fae8c001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.100+0000 7fae98c46640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a2b09a0 0x562c0a3af330 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.100+0000 7fae98c46640 1 -- 172.21.15.50:0/2795399974 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a2b09a0 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.100+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ac900 con 0x562c0a2b09a0 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.100+0000 7fae98c46640 1 -- 172.21.15.50:0/2795399974 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a2b09a0 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.100+0000 7fae9a946800 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3b1c10 0x562c0a3b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.100+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3b46f0 con 0x562c0a3b1c10 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.100+0000 7fae98445640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3b1c10 0x562c0a3b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.101+0000 7fae98445640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3b1c10 0x562c0a3b4000 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.101+0000 7fae98445640 1 -- 172.21.15.50:0/2795399974 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3b1c10 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.101+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3b0bc0 con 0x562c0a2b09a0 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.101+0000 7fae98c46640 1 -- 172.21.15.50:0/2795399974 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a2b09a0 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.101+0000 7fae9a946800 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562c0a3b5ba0 0x562c0a3b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.101+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3b8750 con 0x562c0a3b5ba0 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.102+0000 7fae97c44640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562c0a3b5ba0 0x562c0a3b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.102+0000 7fae97c44640 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562c0a3b5ba0 0x562c0a3b7ff0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.102+0000 7fae97c44640 1 -- 172.21.15.50:0/2795399974 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fae8c00f690 con 0x562c0a3b5ba0 2024-05-07T13:56:15.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.102+0000 7fae9a946800 1 Processor -- start 2024-05-07T13:56:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.103+0000 7fae9a946800 1 -- start start 2024-05-07T13:56:15.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.103+0000 7fae9a946800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3caf50 0x562c0a3cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.103+0000 7fae9a946800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562c0a1a2cf0 con 0x562c0a3caf50 2024-05-07T13:56:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.103+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3caf50 0x562c0a3cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.103+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3caf50 0x562c0a3cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50646/0 (socket says 172.21.15.50:50646) 2024-05-07T13:56:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.103+0000 7fae98445640 1 -- 172.21.15.50:0/1565559077 learned_addr learned my addr 172.21.15.50:0/1565559077 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.103+0000 7fae98445640 1 -- 172.21.15.50:0/1565559077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0a3cb8b0 con 0x562c0a3caf50 2024-05-07T13:56:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.103+0000 7fae98445640 1 --2- 172.21.15.50:0/1565559077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3caf50 0x562c0a3cb370 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fae8806e8a0 tx=0x7fae880536e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.104+0000 7fad7dffb640 1 -- 172.21.15.50:0/1565559077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae880597f0 con 0x562c0a3caf50 2024-05-07T13:56:15.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.104+0000 7fad7dffb640 1 -- 172.21.15.50:0/1565559077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae88059990 con 0x562c0a3caf50 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.104+0000 7fad7dffb640 1 -- 172.21.15.50:0/1565559077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88053be0 con 0x562c0a3caf50 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.104+0000 7fae9a946800 1 -- 172.21.15.50:0/1565559077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c0a3cc320 con 0x562c0a3caf50 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.104+0000 7fae9a946800 1 -- 172.21.15.50:0/1565559077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0a3cc820 con 0x562c0a3caf50 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.104+0000 7fad7dffb640 1 -- 172.21.15.50:0/1565559077 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fae88066770 con 0x562c0a3caf50 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.104+0000 7fad7dffb640 1 --2- 172.21.15.50:0/1565559077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad70036950 0x7fad70038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fad7dffb640 1 -- 172.21.15.50:0/1565559077 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fae880890c0 con 0x562c0a3caf50 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fae97c44640 1 --2- 172.21.15.50:0/1565559077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad70036950 0x7fad70038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fae9a946800 1 Processor -- start 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fae9a946800 1 -- start start 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fae97c44640 1 --2- 172.21.15.50:0/1565559077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad70036950 0x7fad70038e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x562c0a3b01c0 tx=0x7fae8c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fae9a946800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3d8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fae9a946800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562c0a3a0e70 con 0x562c0a3d8110 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3d8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50654/0 (socket says 172.21.15.50:50654) 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.105+0000 7fae98445640 1 -- 172.21.15.50:0/506571240 learned_addr learned my addr 172.21.15.50:0/506571240 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fae98445640 1 -- 172.21.15.50:0/506571240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0a3d8b00 con 0x562c0a3d8110 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fae98445640 1 --2- 172.21.15.50:0/506571240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3d8530 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fae88052b50 tx=0x7fae88052580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffee9d0b155ebe3 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fad6f7fe640 1 -- 172.21.15.50:0/506571240 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae8804d0e0 con 0x562c0a3d8110 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fad6f7fe640 1 -- 172.21.15.50:0/506571240 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae880a8070 con 0x562c0a3d8110 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fad6f7fe640 1 -- 172.21.15.50:0/506571240 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88066a60 con 0x562c0a3d8110 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fae9a946800 1 -- 172.21.15.50:0/506571240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 msgr2=0x562c0a3d8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fae9a946800 1 --2- 172.21.15.50:0/506571240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3d8530 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fae88052b50 tx=0x7fae88052580 comp rx=0 tx=0).stop 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fae9a946800 1 -- 172.21.15.50:0/506571240 shutdown_connections 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fae9a946800 1 --2- 172.21.15.50:0/506571240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3d8530 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fae9a946800 1 -- 172.21.15.50:0/506571240 >> 172.21.15.50:0/506571240 conn(0x562c0a3d4420 msgr2=0x562c0a3d2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fae9a946800 1 -- 172.21.15.50:0/506571240 shutdown_connections 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.106+0000 7fae9a946800 1 -- 172.21.15.50:0/506571240 wait complete. 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.107+0000 7fae9a946800 1 Processor -- start 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.107+0000 7fae9a946800 1 -- start start 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.107+0000 7fae9a946800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3df520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.107+0000 7fae9a946800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562c0a3d9190 con 0x562c0a3d8110 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.107+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3df520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.107+0000 7fae98445640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3df520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50670/0 (socket says 172.21.15.50:50670) 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.107+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 learned_addr learned my addr 172.21.15.50:0/3132930148 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.107+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0a3dfa60 con 0x562c0a3d8110 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.108+0000 7fae98445640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3df520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fae880a5040 tx=0x7fae8805b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.108+0000 7fad6dffb640 1 -- 172.21.15.50:0/3132930148 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88079530 con 0x562c0a3d8110 2024-05-07T13:56:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.108+0000 7fad6dffb640 1 -- 172.21.15.50:0/3132930148 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae88087460 con 0x562c0a3d8110 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.108+0000 7fad6dffb640 1 -- 172.21.15.50:0/3132930148 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae88093b00 con 0x562c0a3d8110 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.108+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c0a3dfa60 con 0x562c0a3d8110 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.108+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0a3dfa60 con 0x562c0a3d8110 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.109+0000 7fad6dffb640 1 -- 172.21.15.50:0/3132930148 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fae880a2070 con 0x562c0a3d8110 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.109+0000 7fad6dffb640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad60036900 0x7fad60038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.109+0000 7fad6dffb640 1 -- 172.21.15.50:0/3132930148 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fae8805f1e0 con 0x562c0a3d8110 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.109+0000 7fae97c44640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad60036900 0x7fad60038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae97c44640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad60036900 0x7fad60038dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x562c0a3b8b50 tx=0x7fae8c010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae9a946800 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a3eaa20 0x562c0a3ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ed630 con 0x562c0a3eaa20 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae98c46640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a3eaa20 0x562c0a3ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae98c46640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a3eaa20 0x562c0a3ecee0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae9a946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae9a946800 20 realm 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3eda40 con 0x562c0a3eaa20 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.110+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee310 con 0x562c0a3eaa20 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3ef1a0 0x562c0a3f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f1cf0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae98445640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3ef1a0 0x562c0a3f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.111+0000 7fae98445640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3ef1a0 0x562c0a3f1590 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.112+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.112+0000 7fae9a946800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.112+0000 7fae9a946800 20 searching for the correct realm 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.112+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f36d0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.112+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.112+0000 7fae98445640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fae8806f070 0x7fae8806d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.112+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f36d0 con 0x7fae8806f070 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.112+0000 7fae97c44640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fae8806f070 0x7fae8806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.113+0000 7fae97c44640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fae8806f070 0x7fae8806d510 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.113+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.113+0000 7fae97c44640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fae8c00f070 0x7fae8c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.113+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f36d0 con 0x7fae8c00f070 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.113+0000 7fae98c46640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fae8c00f070 0x7fae8c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.114+0000 7fae98c46640 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fae8c00f070 0x7fae8c02e910 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.114+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.114+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.114+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.114+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.114+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.114+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8c00f070 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.114+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.114+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8c00f070 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.115+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.115+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8806f070 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.115+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.115+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.115+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.115+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.116+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.116+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8c00f070 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.116+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.116+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.116+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.116+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8806f070 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.116+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.116+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.116+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.117+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.117+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.117+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8c00f070 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.117+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.117+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.117+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.117+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.117+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.117+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.118+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.118+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.118+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.118+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8c00f070 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.119+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.119+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.119+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.119+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8806f070 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.119+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.119+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.119+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.119+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8c00f070 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.120+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.120+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.120+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.120+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8c00f070 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.120+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.120+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8806f070 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.121+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.121+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.121+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.121+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8c00f070 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.121+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.121+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3ee6b0 con 0x7fae8806f070 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:15.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f26a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f2a90 con 0x562c0a3eaa20 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.122+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f2a90 con 0x7fae8c00f070 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 20 zone default found 2024-05-07T13:56:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 4 Realm: () 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 20 zonegroup default 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f2eb0 con 0x7fae8c00f070 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.123+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f32d0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.124+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.124+0000 7fae9a946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.124+0000 7fae9a946800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.124+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f5580 con 0x562c0a3ef1a0 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.124+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.124+0000 7fae9a946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.124+0000 7fae9a946800 20 started sync module instance, tier type = 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.124+0000 7fae9a946800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.124+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f4a20 con 0x7fae8806f070 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.125+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.125+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94747150470720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f4680 con 0x7fae8806f070 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.125+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f63f0 con 0x562c0a3eaa20 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.126+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94747150470720] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.126+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.126+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94747150475072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f6810 con 0x562c0a3eaa20 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.126+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f70c0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.127+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94747150475072] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.128+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.128+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94747150476608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f74b0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.128+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f7ed0 con 0x7fae8806f070 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.129+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.129+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94747150484160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8806f070 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.129+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f95c0 con 0x562c0a3eaa20 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.129+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94747150476608] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.130+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.130+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94747150477728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f99e0 con 0x562c0a3eaa20 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.130+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94747150484160] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.130+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8700 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.131+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94747150477728] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.131+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.131+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94747150487760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8700 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.131+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3fa9f0 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.132+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94747150487760] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.132+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.132+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94747150491424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3fa9f0 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.132+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3fb3b0 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94747150491424] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94747150493472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3fb3b0 con 0x7fae8c00f070 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae9a946800 20 add_watcher() i=0 2024-05-07T13:56:15.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae9a946800 20 add_watcher() i=1 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae9a946800 20 add_watcher() i=2 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae9a946800 20 add_watcher() i=3 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae9a946800 20 add_watcher() i=4 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae9a946800 20 add_watcher() i=5 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.133+0000 7fae9a946800 20 add_watcher() i=6 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.134+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94747150493472] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.134+0000 7fae9a946800 20 add_watcher() i=7 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.134+0000 7fae9a946800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.134+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3fe650 con 0x562c0a3eaa20 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.134+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.134+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94747150495856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3fb940 con 0x562c0a3eaa20 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.135+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94747150495856] v27'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.135+0000 7fad4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.136+0000 7fae9a946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.136+0000 7fae9a946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.136+0000 7fae9a946800 5 note: GC not initialized 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.136+0000 7fad4dfdb640 20 reqs_thread_entry: start 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.136+0000 7fae9a946800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.136+0000 7fae9a946800 20 Filter name: none 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.136+0000 7facbf7fe640 20 reqs_thread_entry: start 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.136+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a4311b0 con 0x7fae8c00f070 2024-05-07T13:56:15.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.137+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(62 [pgnls start_epoch 27 out=254b] v27'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.137+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f26a0 con 0x7fae8c00f070 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.137+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(63 [pgnls start_epoch 27 out=131b] v27'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.137+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f26a0 con 0x562c0a3ef1a0 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.138+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.138+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f26a0 con 0x7fae8c00f070 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.138+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(65 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.138+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f26a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.139+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(66 [pgnls start_epoch 27 out=335b] v27'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.139+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f26a0 con 0x7fae8806f070 2024-05-07T13:56:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.139+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(67 [pgnls start_epoch 27 out=213b] v27'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.139+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.139+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(68 [pgnls start_epoch 27 out=254b] v27'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.139+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.140+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(69 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.140+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.140+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(70 [pgnls start_epoch 27 out=213b] v27'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.140+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8806f070 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.140+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(71 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.140+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8806f070 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.141+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 [pgnls start_epoch 27 out=336b] v27'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.141+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.141+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(73 [pgnls start_epoch 27 out=131b] v27'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.141+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.141+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(74 [pgnls start_epoch 27 out=254b] v27'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.141+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.141+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(75 [pgnls start_epoch 27 out=90b] v27'18 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.141+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3eaa20 2024-05-07T13:56:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.142+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(76 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.142+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.142+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(77 [pgnls start_epoch 27 out=254b] v27'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.142+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3eaa20 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.142+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(78 [pgnls start_epoch 27 out=254b] v27'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.142+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.143+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(79 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.143+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.143+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(80 [pgnls start_epoch 27 out=172b] v27'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.143+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3eaa20 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.143+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(81 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.143+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8806f070 2024-05-07T13:56:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.143+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(82 [pgnls start_epoch 27 out=276b] v27'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.143+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8806f070 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.144+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(83 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.144+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3eaa20 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.144+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(84 [pgnls start_epoch 27 out=295b] v27'26 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.144+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8c00f070 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.145+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(85 [pgnls start_epoch 27 out=172b] v27'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.145+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8806f070 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.145+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(86 [pgnls start_epoch 27 out=213b] v27'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.145+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8c00f070 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.145+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(87 [pgnls start_epoch 27 out=172b] v27'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.145+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.145+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(88 [pgnls start_epoch 27 out=172b] v27'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.145+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.146+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(89 [pgnls start_epoch 27 out=90b] v27'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.146+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.146+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(90 [pgnls start_epoch 27 out=90b] v27'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.146+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x562c0a3eaa20 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.146+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(91 [pgnls start_epoch 27 out=131b] v27'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.146+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8806f070 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.147+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(92 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.147+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f8b90 con 0x7fae8c00f070 2024-05-07T13:56:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.147+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(93 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.148 INFO:teuthology.orchestra.run.smithi050.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-05-07T13:56:15.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.149+0000 7fad4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:15.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.149+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94747150495856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a4349b0 con 0x562c0a3eaa20 2024-05-07T13:56:15.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.150+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94747150495856] v27'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.150+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94747150470720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a4349b0 con 0x7fae8806f070 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.151+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94747150470720] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.151+0000 7fae9a946800 20 remove_watcher() i=0 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.151+0000 7fae9a946800 2 removed watcher, disabling cache 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.151+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94747150475072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f4e40 con 0x562c0a3eaa20 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.152+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94747150475072] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.152+0000 7fae9a946800 20 remove_watcher() i=1 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.152+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94747150476608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f5f40 con 0x562c0a3ef1a0 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.154+0000 7fae98445640 1 -- 172.21.15.50:0/3132930148 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94747150476608] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae88059c90 con 0x562c0a3ef1a0 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.154+0000 7fae9a946800 20 remove_watcher() i=2 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.154+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94747150484160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f6540 con 0x7fae8806f070 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.155+0000 7fae97c44640 1 -- 172.21.15.50:0/3132930148 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94747150484160] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae8c037040 con 0x7fae8806f070 2024-05-07T13:56:15.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.155+0000 7fae9a946800 20 remove_watcher() i=3 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.155+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94747150477728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f82c0 con 0x562c0a3eaa20 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.156+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94747150477728] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x562c0a3eaa20 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.156+0000 7fae9a946800 20 remove_watcher() i=4 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.156+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94747150487760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f82c0 con 0x7fae8c00f070 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.157+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94747150487760] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.157+0000 7fae9a946800 20 remove_watcher() i=5 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.157+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94747150491424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f90d0 con 0x7fae8c00f070 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.158+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94747150491424] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.158+0000 7fae9a946800 20 remove_watcher() i=6 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.158+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94747150493472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562c0a3f90d0 con 0x7fae8c00f070 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94747150493472] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae9000a4a0 con 0x7fae8c00f070 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 20 remove_watcher() i=7 2024-05-07T13:56:15.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fae8c00f070 msgr2=0x7fae8c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fae8c00f070 0x7fae8c02e910 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a3eaa20 msgr2=0x562c0a3ecee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a3eaa20 0x562c0a3ecee0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fae8806f070 msgr2=0x7fae8806d510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fae8806f070 0x7fae8806d510 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3ef1a0 msgr2=0x562c0a3f1590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3ef1a0 0x562c0a3f1590 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad60036900 msgr2=0x7fad60038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad60036900 0x7fad60038dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x562c0a3b8b50 tx=0x7fae8c010000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 msgr2=0x562c0a3df520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3df520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fae880a5040 tx=0x7fae8805b720 comp rx=0 tx=0).stop 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae98c46640 1 -- 172.21.15.50:0/3132930148 reap_dead start 2024-05-07T13:56:15.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 shutdown_connections 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 --2- 172.21.15.50:0/3132930148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3d8110 0x562c0a3df520 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 >> 172.21.15.50:0/3132930148 conn(0x562c0a3d4420 msgr2=0x562c0a3d1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 shutdown_connections 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.159+0000 7fae9a946800 1 -- 172.21.15.50:0/3132930148 wait complete. 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/1565559077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad70036950 msgr2=0x7fad70038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 --2- 172.21.15.50:0/1565559077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad70036950 0x7fad70038e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x562c0a3b01c0 tx=0x7fae8c00f000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/1565559077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3caf50 msgr2=0x562c0a3cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 --2- 172.21.15.50:0/1565559077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3caf50 0x562c0a3cb370 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fae8806e8a0 tx=0x7fae880536e0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/1565559077 shutdown_connections 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 --2- 172.21.15.50:0/1565559077 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad70036950 0x7fad70038e10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 --2- 172.21.15.50:0/1565559077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a3caf50 0x562c0a3cb370 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/1565559077 >> 172.21.15.50:0/1565559077 conn(0x562c0a3babe0 msgr2=0x562c0a3bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/1565559077 shutdown_connections 2024-05-07T13:56:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/1565559077 wait complete. 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562c0a3b5ba0 msgr2=0x562c0a3b7ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562c0a3b5ba0 0x562c0a3b7ff0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a2b09a0 msgr2=0x562c0a3af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562c0a2b09a0 0x562c0a3af330 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3b1c10 msgr2=0x562c0a3b4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562c0a3b1c10 0x562c0a3b4000 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad80036950 msgr2=0x7fad80038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fad80036950 0x7fad80038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae8c000f60 tx=0x7fae8c001370 comp rx=0 tx=0).stop 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 msgr2=0x562c0a3a8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 --2- 172.21.15.50:0/2795399974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562c0a2af740 0x562c0a3a8140 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fae88045a40 tx=0x7fae88002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae98c46640 1 -- 172.21.15.50:0/2795399974 reap_dead start 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 shutdown_connections 2024-05-07T13:56:15.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 >> 172.21.15.50:0/2795399974 conn(0x562c0a2aad20 msgr2=0x562c0a39a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 shutdown_connections 2024-05-07T13:56:15.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.160+0000 7fae9a946800 1 -- 172.21.15.50:0/2795399974 wait complete. 2024-05-07T13:56:15.160 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-05-07T13:56:15.160 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-07T13:56:15.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-07T13:56:15.160 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-07T13:56:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:15.246 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.258+0000 7f4b8c498800 1 Processor -- start 2024-05-07T13:56:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.258+0000 7f4b8c498800 1 -- start start 2024-05-07T13:56:15.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.258+0000 7f4b8c498800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e0331ef720 0x55e0331f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.258+0000 7f4b8c498800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e0331f20e0 con 0x55e0331eb2f0 2024-05-07T13:56:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.258+0000 7f4b8c498800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55e03307a050 con 0x55e0331ef720 2024-05-07T13:56:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.259+0000 7f4b8979d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e0331ef720 0x55e0331f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.259+0000 7f4b89f9e640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55e0331eb2f0 0x55e0331eb710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40780/0 (socket says 172.21.15.50:40780) 2024-05-07T13:56:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.259+0000 7f4b8979d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e0331ef720 0x55e0331f1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50674/0 (socket says 172.21.15.50:50674) 2024-05-07T13:56:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.259+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4014458266 learned_addr learned my addr 172.21.15.50:0/4014458266 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.259+0000 7f4b8979d640 1 -- 172.21.15.50:0/4014458266 >> v1:172.21.15.22:6789/0 conn(0x55e0331eb2f0 legacy=0x55e0331eb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.259+0000 7f4b8979d640 1 -- 172.21.15.50:0/4014458266 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0331f3310 con 0x55e0331ef720 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.261+0000 7f4b8979d640 1 --2- 172.21.15.50:0/4014458266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331ef720 0x55e0331f1b10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400a470 tx=0x7f4b7401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0684086373da97 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.261+0000 7f4b88f9c640 1 -- 172.21.15.50:0/4014458266 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b74057070 con 0x55e0331ef720 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.261+0000 7f4b88f9c640 1 -- 172.21.15.50:0/4014458266 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b74052570 con 0x55e0331ef720 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.261+0000 7f4b88f9c640 1 -- 172.21.15.50:0/4014458266 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b74052870 con 0x55e0331ef720 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.262+0000 7f4b8c498800 1 -- 172.21.15.50:0/4014458266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331ef720 msgr2=0x55e0331f1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.262+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4014458266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331ef720 0x55e0331f1b10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400a470 tx=0x7f4b7401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.262+0000 7f4b8c498800 1 -- 172.21.15.50:0/4014458266 shutdown_connections 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.262+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4014458266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331ef720 0x55e0331f1b10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.262+0000 7f4b8c498800 1 -- 172.21.15.50:0/4014458266 >> 172.21.15.50:0/4014458266 conn(0x55e03315e970 msgr2=0x55e0331e9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.262+0000 7f4b8c498800 1 -- 172.21.15.50:0/4014458266 shutdown_connections 2024-05-07T13:56:15.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.262+0000 7f4b8c498800 1 -- 172.21.15.50:0/4014458266 wait complete. 2024-05-07T13:56:15.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.277+0000 7f4b8c498800 1 Processor -- start 2024-05-07T13:56:15.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.277+0000 7f4b8c498800 1 -- start start 2024-05-07T13:56:15.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.277+0000 7f4b8c498800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332dc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.277+0000 7f4b8c498800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e0331341d0 con 0x55e0331eb2f0 2024-05-07T13:56:15.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.277+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332dc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.277+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332dc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50690/0 (socket says 172.21.15.50:50690) 2024-05-07T13:56:15.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.277+0000 7f4b89f9e640 1 -- 172.21.15.50:0/3070384611 learned_addr learned my addr 172.21.15.50:0/3070384611 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.278+0000 7f4b89f9e640 1 -- 172.21.15.50:0/3070384611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0332dcdd0 con 0x55e0331eb2f0 2024-05-07T13:56:15.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.278+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/3070384611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332dc800 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c001d80 tx=0x7f4b7c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf279c7d268dabf server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.278+0000 7f4a77e07640 1 -- 172.21.15.50:0/3070384611 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c013030 con 0x55e0331eb2f0 2024-05-07T13:56:15.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.278+0000 7f4a77e07640 1 -- 172.21.15.50:0/3070384611 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c00e470 con 0x55e0331eb2f0 2024-05-07T13:56:15.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.278+0000 7f4a77e07640 1 -- 172.21.15.50:0/3070384611 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c00e810 con 0x55e0331eb2f0 2024-05-07T13:56:15.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 -- 172.21.15.50:0/3070384611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 msgr2=0x55e0332dc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 --2- 172.21.15.50:0/3070384611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332dc800 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c001d80 tx=0x7f4b7c001e70 comp rx=0 tx=0).stop 2024-05-07T13:56:15.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 -- 172.21.15.50:0/3070384611 shutdown_connections 2024-05-07T13:56:15.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 --2- 172.21.15.50:0/3070384611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332dc800 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 -- 172.21.15.50:0/3070384611 >> 172.21.15.50:0/3070384611 conn(0x55e03315e970 msgr2=0x55e0332d8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 -- 172.21.15.50:0/3070384611 shutdown_connections 2024-05-07T13:56:15.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 -- 172.21.15.50:0/3070384611 wait complete. 2024-05-07T13:56:15.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 Processor -- start 2024-05-07T13:56:15.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 -- start start 2024-05-07T13:56:15.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b8c498800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e0331f25b0 con 0x55e0331eb2f0 2024-05-07T13:56:15.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332e4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50706/0 (socket says 172.21.15.50:50706) 2024-05-07T13:56:15.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.279+0000 7f4b89f9e640 1 -- 172.21.15.50:0/2078956390 learned_addr learned my addr 172.21.15.50:0/2078956390 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.280+0000 7f4b89f9e640 1 -- 172.21.15.50:0/2078956390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0332e48b0 con 0x55e0331eb2f0 2024-05-07T13:56:15.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.280+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332e4370 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c004000 tx=0x7f4b7c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.280+0000 7f4a76604640 1 -- 172.21.15.50:0/2078956390 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c027070 con 0x55e0331eb2f0 2024-05-07T13:56:15.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.280+0000 7f4a76604640 1 -- 172.21.15.50:0/2078956390 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c019900 con 0x55e0331eb2f0 2024-05-07T13:56:15.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.280+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0332e4b40 con 0x55e0331eb2f0 2024-05-07T13:56:15.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.280+0000 7f4a76604640 1 -- 172.21.15.50:0/2078956390 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c019c60 con 0x55e0331eb2f0 2024-05-07T13:56:15.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.280+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0332e77f0 con 0x55e0331eb2f0 2024-05-07T13:56:15.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.281+0000 7f4a76604640 1 -- 172.21.15.50:0/2078956390 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4b7c02a070 con 0x55e0331eb2f0 2024-05-07T13:56:15.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.281+0000 7f4a76604640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a70036900 0x7f4a70038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.281+0000 7f4a76604640 1 -- 172.21.15.50:0/2078956390 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4b7c01f070 con 0x55e0331eb2f0 2024-05-07T13:56:15.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.281+0000 7f4b8979d640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a70036900 0x7f4a70038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.281+0000 7f4b8c498800 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e0331ef720 0x55e0332eb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.281+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0332ebb80 con 0x55e0331ef720 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.282+0000 7f4b8a79f640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e0331ef720 0x55e0332eb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.282+0000 7f4b8979d640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a70036900 0x7f4a70038dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4b74054000 tx=0x7f4b7404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.282+0000 7f4b8a79f640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e0331ef720 0x55e0332eb5b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.282+0000 7f4b8a79f640 1 -- 172.21.15.50:0/2078956390 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e0331ef720 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.282+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0332e8b80 con 0x55e0331ef720 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.282+0000 7f4b8a79f640 1 -- 172.21.15.50:0/2078956390 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e0331ef720 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.282+0000 7f4b8c498800 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e0332ede90 0x55e0332f0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.283+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0332f0920 con 0x55e0332ede90 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.283+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e0332ede90 0x55e0332f0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.283+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e0332ede90 0x55e0332f0280 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.283+0000 7f4b89f9e640 1 -- 172.21.15.50:0/2078956390 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4b7c029030 con 0x55e0332ede90 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.283+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0332ece40 con 0x55e0331ef720 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.283+0000 7f4b8a79f640 1 -- 172.21.15.50:0/2078956390 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e0331ef720 2024-05-07T13:56:15.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.283+0000 7f4b8c498800 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e0332f1dd0 0x55e0332f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.283+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0332f4980 con 0x55e0332f1dd0 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.284+0000 7f4b8979d640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e0332f1dd0 0x55e0332f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.284+0000 7f4b8979d640 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e0332f1dd0 0x55e0332f4220 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.284+0000 7f4b8979d640 1 -- 172.21.15.50:0/2078956390 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4b7405a040 con 0x55e0332f1dd0 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.285+0000 7f4b8c498800 1 Processor -- start 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.285+0000 7f4b8c498800 1 -- start start 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.285+0000 7f4b8c498800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e033302de0 0x55e033303200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.285+0000 7f4b8c498800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e0330dacf0 con 0x55e033302de0 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.285+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e033302de0 0x55e033303200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.285+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e033302de0 0x55e033303200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50714/0 (socket says 172.21.15.50:50714) 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.285+0000 7f4b89f9e640 1 -- 172.21.15.50:0/3449150587 learned_addr learned my addr 172.21.15.50:0/3449150587 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.285+0000 7f4b89f9e640 1 -- 172.21.15.50:0/3449150587 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e033303740 con 0x55e033302de0 2024-05-07T13:56:15.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.285+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/3449150587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e033302de0 0x55e033303200 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c016fd0 tx=0x7f4b7c0177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.286+0000 7f4a6f7fe640 1 -- 172.21.15.50:0/3449150587 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c04c3b0 con 0x55e033302de0 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.286+0000 7f4a6f7fe640 1 -- 172.21.15.50:0/3449150587 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c04c550 con 0x55e033302de0 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.286+0000 7f4b8c498800 1 -- 172.21.15.50:0/3449150587 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0333041b0 con 0x55e033302de0 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.286+0000 7f4a6f7fe640 1 -- 172.21.15.50:0/3449150587 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c0442b0 con 0x55e033302de0 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.286+0000 7f4b8c498800 1 -- 172.21.15.50:0/3449150587 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0333046b0 con 0x55e033302de0 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.286+0000 7f4a6f7fe640 1 -- 172.21.15.50:0/3449150587 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4b7c033070 con 0x55e033302de0 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.286+0000 7f4a6f7fe640 1 --2- 172.21.15.50:0/3449150587 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a64036900 0x7f4a64038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4a6f7fe640 1 -- 172.21.15.50:0/3449150587 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4b7c014070 con 0x55e033302de0 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4b8979d640 1 --2- 172.21.15.50:0/3449150587 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a64036900 0x7f4a64038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4b8c498800 1 Processor -- start 2024-05-07T13:56:15.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4b8c498800 1 -- start start 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4b8979d640 1 --2- 172.21.15.50:0/3449150587 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a64036900 0x7f4a64038dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55e0332e8aa0 tx=0x7f4b74005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4b8c498800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e033310360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4b8c498800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e0332dd150 con 0x55e03330ff40 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e033310360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e033310360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50720/0 (socket says 172.21.15.50:50720) 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.287+0000 7f4b89f9e640 1 -- 172.21.15.50:0/71446275 learned_addr learned my addr 172.21.15.50:0/71446275 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4b89f9e640 1 -- 172.21.15.50:0/71446275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e033310930 con 0x55e03330ff40 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/71446275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e033310360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c025040 tx=0x7f4b7c049220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df469f1cadd94ae6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4a6d7fa640 1 -- 172.21.15.50:0/71446275 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c053040 con 0x55e03330ff40 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4a6d7fa640 1 -- 172.21.15.50:0/71446275 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c04ce00 con 0x55e03330ff40 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4a6d7fa640 1 -- 172.21.15.50:0/71446275 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c036db0 con 0x55e03330ff40 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4b8c498800 1 -- 172.21.15.50:0/71446275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 msgr2=0x55e033310360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4b8c498800 1 --2- 172.21.15.50:0/71446275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e033310360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c025040 tx=0x7f4b7c049220 comp rx=0 tx=0).stop 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4b8c498800 1 -- 172.21.15.50:0/71446275 shutdown_connections 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4b8c498800 1 --2- 172.21.15.50:0/71446275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e033310360 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4b8c498800 1 -- 172.21.15.50:0/71446275 >> 172.21.15.50:0/71446275 conn(0x55e03330c260 msgr2=0x55e03330a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4b8c498800 1 -- 172.21.15.50:0/71446275 shutdown_connections 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.288+0000 7f4b8c498800 1 -- 172.21.15.50:0/71446275 wait complete. 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.289+0000 7f4b8c498800 1 Processor -- start 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.289+0000 7f4b8c498800 1 -- start start 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.289+0000 7f4b8c498800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e0333173c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.289+0000 7f4b8c498800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e033311050 con 0x55e03330ff40 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.289+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e0333173c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.289+0000 7f4b89f9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e0333173c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50732/0 (socket says 172.21.15.50:50732) 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.289+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 learned_addr learned my addr 172.21.15.50:0/4000726261 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.289+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e033317900 con 0x55e03330ff40 2024-05-07T13:56:15.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.290+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e0333173c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c021b90 tx=0x7f4b7c013920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.290+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/4000726261 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c021370 con 0x55e03330ff40 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.290+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/4000726261 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c067030 con 0x55e03330ff40 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.290+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e033317900 con 0x55e03330ff40 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.290+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/4000726261 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7c013a70 con 0x55e03330ff40 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.290+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e033317900 con 0x55e03330ff40 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.290+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/4000726261 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4b7c016070 con 0x55e03330ff40 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.291+0000 7f4a5b7fe640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a54036900 0x7f4a54038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.291+0000 7f4a5b7fe640 1 -- 172.21.15.50:0/4000726261 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4b7c070170 con 0x55e03330ff40 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.291+0000 7f4b8979d640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a54036900 0x7f4a54038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.291+0000 7f4b8979d640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a54036900 0x7f4a54038dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55e0332f4d80 tx=0x7f4b7404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e033322a80 0x55e033324f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e033325690 con 0x55e033322a80 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8a79f640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e033322a80 0x55e033324f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8a79f640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e033322a80 0x55e033324f40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e033322a80 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8c498800 20 realm 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e033325aa0 con 0x55e033322a80 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e033322a80 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.292+0000 7f4b8c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e033326370 con 0x55e033322a80 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e033322a80 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x55e033322a80 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e033322a80 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e033327470 0x55e033329860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e033329e70 con 0x55e033327470 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e033327470 0x55e033329860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.293+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e033327470 0x55e033329860 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.294+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.294+0000 7f4b8c498800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.294+0000 7f4b8c498800 20 searching for the correct realm 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.294+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e03332b7a0 con 0x55e033327470 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.294+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.294+0000 7f4b89f9e640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4b7c062050 0x7f4b7c00c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.294+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e03332b7a0 con 0x7f4b7c062050 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.294+0000 7f4b8979d640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4b7c062050 0x7f4b7c00c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.295+0000 7f4b8979d640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4b7c062050 0x7f4b7c00c590 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.295+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.295+0000 7f4b8979d640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4b74074040 0x7f4b74081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.295+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e03332b7a0 con 0x7f4b74074040 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.295+0000 7f4b8a79f640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4b74074040 0x7f4b74081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.296+0000 7f4b8a79f640 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4b74074040 0x7f4b74081410 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.296+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8400a4a0 con 0x7f4b74074040 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.296+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x55e033322a80 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.296+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e033322a80 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.296+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x55e033322a80 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.296+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e033322a80 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.296+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x7f4b74074040 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.297+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8400a4a0 con 0x7f4b74074040 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.297+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x7f4b74074040 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.297+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4b8400a4a0 con 0x7f4b74074040 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.297+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x7f4b7c062050 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.297+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.297+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x55e033327470 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.297+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.297+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x55e033322a80 2024-05-07T13:56:15.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.297+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e033322a80 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.298+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x7f4b74074040 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.298+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8400a4a0 con 0x7f4b74074040 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.298+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x55e033322a80 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.298+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e033322a80 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.298+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e033326710 con 0x7f4b7c062050 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.298+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.298+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033327470 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.299+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.299+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033327470 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.299+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.299+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x7f4b74074040 2024-05-07T13:56:15.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.299+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8400a4a0 con 0x7f4b74074040 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.299+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033327470 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.299+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.299+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033327470 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.300+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.300+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033322a80 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.300+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8400a4a0 con 0x55e033322a80 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.300+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033322a80 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.300+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.300+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x7f4b74074040 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.300+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.300+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033327470 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.301+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.301+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x7f4b7c062050 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.301+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.301+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033322a80 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.301+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.301+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x7f4b74074040 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.302+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.302+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033327470 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.302+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.302+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x7f4b74074040 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.302+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.302+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x7f4b7c062050 2024-05-07T13:56:15.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.303+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.303+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033327470 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.303+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.303+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x7f4b74074040 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.303+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.303+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x55e033322a80 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.303+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.303+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b7408e060 con 0x7f4b7c062050 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:15.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03332a730 con 0x55e033322a80 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03332ab20 con 0x55e033322a80 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.304+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03332ab20 con 0x7f4b74074040 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 20 zone default found 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 4 Realm: () 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 20 zonegroup default 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03332bc20 con 0x7f4b74074040 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03332d600 con 0x55e033327470 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03332d9a0 con 0x55e033327470 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.305+0000 7f4b8c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.306+0000 7f4b8c498800 20 started sync module instance, tier type = 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.306+0000 7f4b8c498800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.306+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e03332caa0 con 0x7f4b7c062050 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.307+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.307+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94421420000752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e03332dd40 con 0x7f4b7c062050 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.307+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e03332e590 con 0x55e033322a80 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.308+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94421420000752] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.308+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.308+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94421420007648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e03332e500 con 0x55e033322a80 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.308+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e03332f480 con 0x55e033327470 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.309+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94421420007648] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.309+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.309+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94421420011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e03332f820 con 0x55e033327470 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.309+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033330240 con 0x7f4b7c062050 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.310+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94421420011472] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.310+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.310+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94421420009904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033330ae0 con 0x7f4b7c062050 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.310+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0333314a0 con 0x55e033322a80 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.311+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.311+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94421420020176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033331c40 con 0x55e033322a80 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.311+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94421420009904] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.311+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033330630 con 0x7f4b74074040 2024-05-07T13:56:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.312+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.312+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94421420024368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033330630 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.312+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033333160 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.313+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94421420020176] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.313+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94421420024368] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.313+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.313+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94421420025424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033332c70 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.313+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033333630 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94421420025424] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94421420021392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033333630 con 0x7f4b74074040 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8c498800 20 add_watcher() i=0 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8c498800 20 add_watcher() i=1 2024-05-07T13:56:15.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8c498800 20 add_watcher() i=2 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8c498800 20 add_watcher() i=3 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8c498800 20 add_watcher() i=4 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8c498800 20 add_watcher() i=5 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.314+0000 7f4b8c498800 20 add_watcher() i=6 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.315+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94421420021392] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.315+0000 7f4b8c498800 20 add_watcher() i=7 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.315+0000 7f4b8c498800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.315+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e033336950 con 0x55e033322a80 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.316+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.316+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94421420028656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033333bc0 con 0x55e033322a80 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.317+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94421420028656] v27'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.317+0000 7f4a3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.317+0000 7f4b8c498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.317+0000 7f4b8c498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.317+0000 7f4b8c498800 5 note: GC not initialized 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.317+0000 7f4a3a7fc640 20 reqs_thread_entry: start 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.317+0000 7f4b8c498800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.317+0000 7f4b8c498800 20 Filter name: none 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f49abfff640 20 reqs_thread_entry: start 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e033369ed0 con 0x55e033322a80 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03336c800 con 0x7f4b7c062050 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 20 disabling bucket name=myfoo 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.318+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03336a7e0 con 0x7f4b7c062050 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 : miss 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03336d020 con 0x7f4b7c062050 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.319+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033374c70 con 0x7f4b7c062050 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.320+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(66 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.320+0000 7f4b8c498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.320+0000 7f4b8c498800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.320+0000 7f4b8c498800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.320+0000 7f4b8c498800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1, ofs0, ns] 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.320+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94421420267232 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e033370320 con 0x7f4b7c062050 2024-05-07T13:56:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== watch-notify(notify (1) cookie 94421420000752 notify 115964117017 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55e03336d410 con 0x7f4b7c062050 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4a6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117017 cookie 94421420000752 notifier 4586 bl.length()=752 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(67 notify.0 [notify cookie 94421420267232 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4a6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4a6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4a6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4a6d7fa640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4a4c003ea0 con 0x7f4b7c062050 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== watch-notify(notify_complete (2) cookie 94421420267232 notify 115964117017 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e03336c510 con 0x7f4b7c062050 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4b8c498800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_sources= new_sources= 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4b8c498800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential sources added=[] removed=[] 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4b8c498800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_dests= new_dests= 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4b8c498800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential dests added=[] removed=[] 2024-05-07T13:56:15.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.321+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e03336fe30 con 0x55e033322a80 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.322+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v27'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.322+0000 7f4b8c498800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.322+0000 7f4b8c498800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.322+0000 7f4b8c498800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.322+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94421420246576 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e03336fe30 con 0x55e033322a80 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.323+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94421420020176 notify 115964117006 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f4b8401e040 con 0x55e033322a80 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.323+0000 7f4a6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117006 cookie 94421420020176 notifier 4586 bl.length()=567 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.323+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(70 notify.4 [notify cookie 94421420246576 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.323+0000 7f4a6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.323+0000 7f4a6d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.323+0000 7f4a6d7fa640 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4a4c003ea0 con 0x55e033322a80 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.323+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94421420246576 notify 115964117006 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4b84027c90 con 0x55e033322a80 2024-05-07T13:56:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.323+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.327 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.324+0000 7f4a3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.324+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94421420028656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e033372960 con 0x55e033322a80 2024-05-07T13:56:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.325+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94421420028656] v27'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.325+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94421420000752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0333332f0 con 0x7f4b7c062050 2024-05-07T13:56:15.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.326+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94421420000752] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.326+0000 7f4b8c498800 20 remove_watcher() i=0 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.326+0000 7f4b8c498800 2 removed watcher, disabling cache 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.326+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94421420007648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0333332f0 con 0x55e033322a80 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.327+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94421420007648] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.327+0000 7f4b8c498800 20 remove_watcher() i=1 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.327+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94421420011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0333332f0 con 0x55e033327470 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.328+0000 7f4b89f9e640 1 -- 172.21.15.50:0/4000726261 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94421420011472] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7c03b020 con 0x55e033327470 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.328+0000 7f4b8c498800 20 remove_watcher() i=2 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.328+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94421420009904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e03332efd0 con 0x7f4b7c062050 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.329+0000 7f4b8979d640 1 -- 172.21.15.50:0/4000726261 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94421420009904] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b7407f070 con 0x7f4b7c062050 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.329+0000 7f4b8c498800 20 remove_watcher() i=3 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.329+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94421420020176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0333332f0 con 0x55e033322a80 2024-05-07T13:56:15.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.330+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94421420020176] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x55e033322a80 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.330+0000 7f4b8c498800 20 remove_watcher() i=4 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.330+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94421420024368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e03332e9b0 con 0x7f4b74074040 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.332+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94421420024368] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.332+0000 7f4b8c498800 20 remove_watcher() i=5 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.332+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94421420025424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0333311d0 con 0x7f4b74074040 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.333+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94421420025424] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.333+0000 7f4b8c498800 20 remove_watcher() i=6 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.333+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94421420021392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0333332f0 con 0x7f4b74074040 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94421420021392] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8402f060 con 0x7f4b74074040 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 20 remove_watcher() i=7 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4b74074040 msgr2=0x7f4b74081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4b74074040 0x7f4b74081410 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e033322a80 msgr2=0x55e033324f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e033322a80 0x55e033324f40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4b7c062050 msgr2=0x7f4b7c00c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4b7c062050 0x7f4b7c00c590 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e033327470 msgr2=0x55e033329860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e033327470 0x55e033329860 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a54036900 msgr2=0x7f4a54038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a54036900 0x7f4a54038dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55e0332f4d80 tx=0x7f4b7404f000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 msgr2=0x55e0333173c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e0333173c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c021b90 tx=0x7f4b7c013920 comp rx=0 tx=0).stop 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8a79f640 1 -- 172.21.15.50:0/4000726261 reap_dead start 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 shutdown_connections 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 --2- 172.21.15.50:0/4000726261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e03330ff40 0x55e0333173c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 >> 172.21.15.50:0/4000726261 conn(0x55e03330c260 msgr2=0x55e0333098c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 shutdown_connections 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.334+0000 7f4b8c498800 1 -- 172.21.15.50:0/4000726261 wait complete. 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/3449150587 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a64036900 msgr2=0x7f4a64038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 --2- 172.21.15.50:0/3449150587 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a64036900 0x7f4a64038dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55e0332e8aa0 tx=0x7f4b74005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/3449150587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e033302de0 msgr2=0x55e033303200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 --2- 172.21.15.50:0/3449150587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e033302de0 0x55e033303200 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c016fd0 tx=0x7f4b7c0177a0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/3449150587 shutdown_connections 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 --2- 172.21.15.50:0/3449150587 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a64036900 0x7f4a64038dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 --2- 172.21.15.50:0/3449150587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e033302de0 0x55e033303200 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/3449150587 >> 172.21.15.50:0/3449150587 conn(0x55e0332f6e80 msgr2=0x55e0332f7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/3449150587 shutdown_connections 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/3449150587 wait complete. 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e0332f1dd0 msgr2=0x55e0332f4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e0332f1dd0 0x55e0332f4220 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e0331ef720 msgr2=0x55e0332eb5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e0331ef720 0x55e0332eb5b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e0332ede90 msgr2=0x55e0332f0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55e0332ede90 0x55e0332f0280 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a70036900 msgr2=0x7f4a70038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4a70036900 0x7f4a70038dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4b74054000 tx=0x7f4b7404e000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 msgr2=0x55e0332e4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 --2- 172.21.15.50:0/2078956390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e0331eb2f0 0x55e0332e4370 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c004000 tx=0x7f4b7c000bc0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8a79f640 1 -- 172.21.15.50:0/2078956390 reap_dead start 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 shutdown_connections 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 >> 172.21.15.50:0/2078956390 conn(0x55e03315e970 msgr2=0x55e0332d6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 shutdown_connections 2024-05-07T13:56:15.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.335+0000 7f4b8c498800 1 -- 172.21.15.50:0/2078956390 wait complete. 2024-05-07T13:56:15.338 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:15.340 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-07T13:56:15.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-07T13:56:15.341 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-07T13:56:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:15.386 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.398+0000 7fdce7e87800 1 Processor -- start 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.398+0000 7fdce7e87800 1 -- start start 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.399+0000 7fdce7e87800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556acb49b730 0x556acb49bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.399+0000 7fdce7e87800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556acb4989c0 con 0x556acb49c090 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.399+0000 7fdce7e87800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x556acb32b050 con 0x556acb49b730 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.399+0000 7fdce5986640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556acb49b730 0x556acb49bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.399+0000 7fdce5986640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556acb49b730 0x556acb49bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50738/0 (socket says 172.21.15.50:50738) 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.399+0000 7fdce5986640 1 -- 172.21.15.50:0/3800835858 learned_addr learned my addr 172.21.15.50:0/3800835858 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.399+0000 7fdce5185640 1 --1- 172.21.15.50:0/3800835858 >> v1:172.21.15.22:6789/0 conn(0x556acb49c090 0x556acb498170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:40796/0 (socket says 172.21.15.50:40796) 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.399+0000 7fdce5986640 1 -- 172.21.15.50:0/3800835858 >> v1:172.21.15.22:6789/0 conn(0x556acb49c090 legacy=0x556acb498170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.399+0000 7fdce5986640 1 -- 172.21.15.50:0/3800835858 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acb498be0 con 0x556acb49b730 2024-05-07T13:56:15.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.401+0000 7fdce5986640 1 --2- 172.21.15.50:0/3800835858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb49bb50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800a520 tx=0x7fdcd801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528d9ca45418d054 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.401+0000 7fdce4984640 1 -- 172.21.15.50:0/3800835858 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8057070 con 0x556acb49b730 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.401+0000 7fdce4984640 1 -- 172.21.15.50:0/3800835858 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd8052570 con 0x556acb49b730 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.401+0000 7fdce4984640 1 -- 172.21.15.50:0/3800835858 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8052870 con 0x556acb49b730 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.402+0000 7fdce7e87800 1 -- 172.21.15.50:0/3800835858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 msgr2=0x556acb49bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.402+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3800835858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb49bb50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800a520 tx=0x7fdcd801d010 comp rx=0 tx=0).stop 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.402+0000 7fdce7e87800 1 -- 172.21.15.50:0/3800835858 shutdown_connections 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.402+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3800835858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb49bb50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.402+0000 7fdce7e87800 1 -- 172.21.15.50:0/3800835858 >> 172.21.15.50:0/3800835858 conn(0x556acb493d30 msgr2=0x556acb496150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.402+0000 7fdce7e87800 1 -- 172.21.15.50:0/3800835858 shutdown_connections 2024-05-07T13:56:15.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.402+0000 7fdce7e87800 1 -- 172.21.15.50:0/3800835858 wait complete. 2024-05-07T13:56:15.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.417+0000 7fdce7e87800 1 Processor -- start 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.417+0000 7fdce7e87800 1 -- start start 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.417+0000 7fdce7e87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb49add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.417+0000 7fdce7e87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556acb3e51d0 con 0x556acb49b730 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.417+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb49add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.418+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb49add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50748/0 (socket says 172.21.15.50:50748) 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.418+0000 7fdce5986640 1 -- 172.21.15.50:0/1681194123 learned_addr learned my addr 172.21.15.50:0/1681194123 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.418+0000 7fdce5986640 1 -- 172.21.15.50:0/1681194123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acb499390 con 0x556acb49b730 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.418+0000 7fdce5986640 1 --2- 172.21.15.50:0/1681194123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb49add0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8055040 tx=0x7fdcd804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a029115b4fc3ca2 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.418+0000 7fdbd3e07640 1 -- 172.21.15.50:0/1681194123 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8057040 con 0x556acb49b730 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.418+0000 7fdbd3e07640 1 -- 172.21.15.50:0/1681194123 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd8052850 con 0x556acb49b730 2024-05-07T13:56:15.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.418+0000 7fdbd3e07640 1 -- 172.21.15.50:0/1681194123 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8052b50 con 0x556acb49b730 2024-05-07T13:56:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 -- 172.21.15.50:0/1681194123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 msgr2=0x556acb49add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 --2- 172.21.15.50:0/1681194123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb49add0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8055040 tx=0x7fdcd804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 -- 172.21.15.50:0/1681194123 shutdown_connections 2024-05-07T13:56:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 --2- 172.21.15.50:0/1681194123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb49add0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 -- 172.21.15.50:0/1681194123 >> 172.21.15.50:0/1681194123 conn(0x556acb493d30 msgr2=0x556acb587360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 -- 172.21.15.50:0/1681194123 shutdown_connections 2024-05-07T13:56:15.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 -- 172.21.15.50:0/1681194123 wait complete. 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 Processor -- start 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 -- start start 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb5956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.419+0000 7fdce7e87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556acb4a3990 con 0x556acb49b730 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb5956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb5956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50756/0 (socket says 172.21.15.50:50756) 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdce5986640 1 -- 172.21.15.50:0/3925897365 learned_addr learned my addr 172.21.15.50:0/3925897365 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdce5986640 1 -- 172.21.15.50:0/3925897365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acb595c30 con 0x556acb49b730 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdce5986640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb5956f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8052540 tx=0x7fdcd8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdbd2604640 1 -- 172.21.15.50:0/3925897365 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8073070 con 0x556acb49b730 2024-05-07T13:56:15.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdbd2604640 1 -- 172.21.15.50:0/3925897365 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd805d440 con 0x556acb49b730 2024-05-07T13:56:15.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556acb595ec0 con 0x556acb49b730 2024-05-07T13:56:15.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdbd2604640 1 -- 172.21.15.50:0/3925897365 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8057070 con 0x556acb49b730 2024-05-07T13:56:15.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.420+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556acb598b70 con 0x556acb49b730 2024-05-07T13:56:15.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.421+0000 7fdbd2604640 1 -- 172.21.15.50:0/3925897365 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdcd8076070 con 0x556acb49b730 2024-05-07T13:56:15.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.421+0000 7fdbd2604640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbcc036950 0x7fdbcc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.421+0000 7fdbd2604640 1 -- 172.21.15.50:0/3925897365 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdcd808dbf0 con 0x556acb49b730 2024-05-07T13:56:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.421+0000 7fdce5185640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbcc036950 0x7fdbcc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.421+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb49c090 0x556acb59c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.421+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb59ce70 con 0x556acb49c090 2024-05-07T13:56:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.422+0000 7fdce6187640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb49c090 0x556acb59c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.422+0000 7fdce5185640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbcc036950 0x7fdbcc038e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc000f60 tx=0x7fdcdc001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.422+0000 7fdce6187640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb49c090 0x556acb59c930 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.422+0000 7fdce6187640 1 -- 172.21.15.50:0/3925897365 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb49c090 2024-05-07T13:56:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.422+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb599f00 con 0x556acb49c090 2024-05-07T13:56:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.422+0000 7fdce6187640 1 -- 172.21.15.50:0/3925897365 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb49c090 2024-05-07T13:56:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.422+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb59f1b0 0x556acb5a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.422+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5a1c90 con 0x556acb59f1b0 2024-05-07T13:56:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.423+0000 7fdce5986640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb59f1b0 0x556acb5a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.423+0000 7fdce5986640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb59f1b0 0x556acb5a15a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.423+0000 7fdce5986640 1 -- 172.21.15.50:0/3925897365 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdcd8075030 con 0x556acb59f1b0 2024-05-07T13:56:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.423+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb59e160 con 0x556acb49c090 2024-05-07T13:56:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.423+0000 7fdce6187640 1 -- 172.21.15.50:0/3925897365 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb49c090 2024-05-07T13:56:15.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.424+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556acb5a3140 0x556acb5a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.424+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5a5cf0 con 0x556acb5a3140 2024-05-07T13:56:15.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.424+0000 7fdce5185640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556acb5a3140 0x556acb5a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.424+0000 7fdce5185640 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556acb5a3140 0x556acb5a5590 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.425+0000 7fdce5185640 1 -- 172.21.15.50:0/3925897365 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdcdc00f690 con 0x556acb5a3140 2024-05-07T13:56:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.425+0000 7fdce7e87800 1 Processor -- start 2024-05-07T13:56:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.425+0000 7fdce7e87800 1 -- start start 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.425+0000 7fdce7e87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5b4150 0x556acb5b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.425+0000 7fdce7e87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556acb38bcf0 con 0x556acb5b4150 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5b4150 0x556acb5b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5b4150 0x556acb5b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50760/0 (socket says 172.21.15.50:50760) 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdce5986640 1 -- 172.21.15.50:0/254779609 learned_addr learned my addr 172.21.15.50:0/254779609 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdce5986640 1 -- 172.21.15.50:0/254779609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acb5b4ab0 con 0x556acb5b4150 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdce5986640 1 --2- 172.21.15.50:0/254779609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5b4150 0x556acb5b4570 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8006b30 tx=0x7fdcd8079e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdbcb7fe640 1 -- 172.21.15.50:0/254779609 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8077d90 con 0x556acb5b4150 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdbcb7fe640 1 -- 172.21.15.50:0/254779609 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd805d720 con 0x556acb5b4150 2024-05-07T13:56:15.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdbcb7fe640 1 -- 172.21.15.50:0/254779609 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd805da00 con 0x556acb5b4150 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdce7e87800 1 -- 172.21.15.50:0/254779609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556acb5b5520 con 0x556acb5b4150 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.426+0000 7fdce7e87800 1 -- 172.21.15.50:0/254779609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556acb5b5a20 con 0x556acb5b4150 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.427+0000 7fdbcb7fe640 1 -- 172.21.15.50:0/254779609 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdcd80773b0 con 0x556acb5b4150 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.427+0000 7fdbcb7fe640 1 --2- 172.21.15.50:0/254779609 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbc0036950 0x7fdbc0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.427+0000 7fdbcb7fe640 1 -- 172.21.15.50:0/254779609 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdcd808f0c0 con 0x556acb5b4150 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.427+0000 7fdce5185640 1 --2- 172.21.15.50:0/254779609 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbc0036950 0x7fdbc0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce7e87800 1 Processor -- start 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce7e87800 1 -- start start 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce5185640 1 --2- 172.21.15.50:0/254779609 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbc0036950 0x7fdbc0038e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00c010 tx=0x7fdcdc00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce7e87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce7e87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556acb499650 con 0x556acb5c1360 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50764/0 (socket says 172.21.15.50:50764) 2024-05-07T13:56:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce5986640 1 -- 172.21.15.50:0/2379863447 learned_addr learned my addr 172.21.15.50:0/2379863447 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce5986640 1 -- 172.21.15.50:0/2379863447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acb5c1d50 con 0x556acb5c1360 2024-05-07T13:56:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.428+0000 7fdce5986640 1 --2- 172.21.15.50:0/2379863447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c1780 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdcd807b040 tx=0x7fdcd805dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16027f50a3df56ff server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdbc97fa640 1 -- 172.21.15.50:0/2379863447 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8089480 con 0x556acb5c1360 2024-05-07T13:56:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdbc97fa640 1 -- 172.21.15.50:0/2379863447 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd8078c60 con 0x556acb5c1360 2024-05-07T13:56:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdbc97fa640 1 -- 172.21.15.50:0/2379863447 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd808d9d0 con 0x556acb5c1360 2024-05-07T13:56:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdce7e87800 1 -- 172.21.15.50:0/2379863447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 msgr2=0x556acb5c1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2379863447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c1780 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdcd807b040 tx=0x7fdcd805dcc0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdce7e87800 1 -- 172.21.15.50:0/2379863447 shutdown_connections 2024-05-07T13:56:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2379863447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c1780 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdce7e87800 1 -- 172.21.15.50:0/2379863447 >> 172.21.15.50:0/2379863447 conn(0x556acb5bd670 msgr2=0x556acb5bb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdce7e87800 1 -- 172.21.15.50:0/2379863447 shutdown_connections 2024-05-07T13:56:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdce7e87800 1 -- 172.21.15.50:0/2379863447 wait complete. 2024-05-07T13:56:15.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.429+0000 7fdce7e87800 1 Processor -- start 2024-05-07T13:56:15.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdce7e87800 1 -- start start 2024-05-07T13:56:15.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdce7e87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdce7e87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556acb5c23e0 con 0x556acb5c1360 2024-05-07T13:56:15.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdce5986640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:50772/0 (socket says 172.21.15.50:50772) 2024-05-07T13:56:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 learned_addr learned my addr 172.21.15.50:0/2875392224 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556acb5c8c60 con 0x556acb5c1360 2024-05-07T13:56:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdce5986640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c8720 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdcd807b040 tx=0x7fdcd805afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdbb77fe640 1 -- 172.21.15.50:0/2875392224 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd80ba070 con 0x556acb5c1360 2024-05-07T13:56:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdbb77fe640 1 -- 172.21.15.50:0/2875392224 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd80776a0 con 0x556acb5c1360 2024-05-07T13:56:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdbb77fe640 1 -- 172.21.15.50:0/2875392224 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8077870 con 0x556acb5c1360 2024-05-07T13:56:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.430+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556acb5c8c60 con 0x556acb5c1360 2024-05-07T13:56:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.431+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556acb5c8c60 con 0x556acb5c1360 2024-05-07T13:56:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.431+0000 7fdbb77fe640 1 -- 172.21.15.50:0/2875392224 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdcd80bd070 con 0x556acb5c1360 2024-05-07T13:56:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.431+0000 7fdbb77fe640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbb00368b0 0x7fdbb0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.431+0000 7fdbb77fe640 1 -- 172.21.15.50:0/2875392224 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fdcd80b1030 con 0x556acb5c1360 2024-05-07T13:56:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.432+0000 7fdce5185640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbb00368b0 0x7fdbb0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.432+0000 7fdce5185640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbb00368b0 0x7fdbb0038d70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x556acb59d760 tx=0x7fdcdc010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.432+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.432+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb5d3e90 0x556acb5d6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.432+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d6aa0 con 0x556acb5d3e90 2024-05-07T13:56:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.432+0000 7fdce6187640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb5d3e90 0x556acb5d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce6187640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb5d3e90 0x556acb5d6350 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb5d3e90 2024-05-07T13:56:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce7e87800 20 realm 2024-05-07T13:56:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d6eb0 con 0x556acb5d3e90 2024-05-07T13:56:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb5d3e90 2024-05-07T13:56:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce7e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7780 con 0x556acb5d3e90 2024-05-07T13:56:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.433+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb5d3e90 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d3e90 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb5d3e90 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce7e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb5d8880 0x556acb5dac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5db280 con 0x556acb5d8880 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce5986640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb5d8880 0x556acb5dac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce5986640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb5d8880 0x556acb5dac70 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce7e87800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:15.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.434+0000 7fdce7e87800 20 searching for the correct realm 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.435+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dcb90 con 0x556acb5d8880 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.435+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.435+0000 7fdce5986640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdcd80bf060 0x7fdcd80aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.435+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dcb90 con 0x7fdcd80bf060 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.435+0000 7fdce5185640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdcd80bf060 0x7fdcd80aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.435+0000 7fdce5185640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdcd80bf060 0x7fdcd80aa840 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.436+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.436+0000 7fdce5185640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdcdc00f070 0x7fdcdc02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.436+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dcb90 con 0x7fdcdc00f070 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.436+0000 7fdce6187640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdcdc00f070 0x7fdcdc02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.436+0000 7fdce6187640 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdcdc00f070 0x7fdcdc02e910 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.437+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce000a4a0 con 0x7fdcdc00f070 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.437+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d3e90 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.437+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb5d3e90 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.437+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d3e90 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.437+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb5d3e90 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.437+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcdc00f070 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.437+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce000a4a0 con 0x7fdcdc00f070 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.437+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcdc00f070 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.437+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdce000a4a0 con 0x7fdcdc00f070 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.438+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcd80bf060 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.438+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.438+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d8880 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.438+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.438+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d3e90 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.438+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb5d3e90 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.438+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcdc00f070 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.439+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce000a4a0 con 0x7fdcdc00f070 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.439+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d3e90 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.439+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb5d3e90 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.439+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcd80bf060 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.439+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.439+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d8880 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.439+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.439+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d8880 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.440+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.440+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcdc00f070 2024-05-07T13:56:15.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.440+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce000a4a0 con 0x7fdcdc00f070 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.440+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d8880 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.440+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.440+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d8880 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.441+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.441+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d3e90 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.441+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce000a4a0 con 0x556acb5d3e90 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.441+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d3e90 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.441+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.441+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcdc00f070 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.441+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.441+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d8880 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.442+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.442+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcd80bf060 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.442+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.442+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d3e90 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.442+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.442+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcdc00f070 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.443+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.443+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d8880 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.443+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.443+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcdc00f070 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.443+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.443+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcd80bf060 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.443+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.443+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d8880 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.444+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.444+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcdc00f070 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.444+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.444+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x556acb5d3e90 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.444+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.444+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556acb5d7b20 con 0x7fdcd80bf060 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dbb40 con 0x556acb5d3e90 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dbf30 con 0x556acb5d3e90 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dbf30 con 0x7fdcdc00f070 2024-05-07T13:56:15.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.445+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 zone default found 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 4 Realm: () 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 zonegroup default 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dd010 con 0x7fdcdc00f070 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5de9f0 con 0x556acb5d8880 2024-05-07T13:56:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5ded90 con 0x556acb5d8880 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 started sync module instance, tier type = 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.446+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dde90 con 0x7fdcd80bf060 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.447+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.447+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93917166819808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5df130 con 0x7fdcd80bf060 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.447+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5df9c0 con 0x556acb5d3e90 2024-05-07T13:56:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.449+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93917166819808] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.449+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.449+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93917166822064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dfdb0 con 0x556acb5d3e90 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.449+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e0810 con 0x556acb5d8880 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.450+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.450+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93917166830320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e10b0 con 0x556acb5d8880 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.450+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e1b50 con 0x7fdcd80bf060 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.450+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93917166822064] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.451+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93917166830320] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.451+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.451+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93917166826704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e10b0 con 0x7fdcd80bf060 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.451+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e2430 con 0x556acb5d3e90 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.452+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.452+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93917166837568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e2cd0 con 0x556acb5d3e90 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.452+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e37b0 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.452+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93917166826704] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.453+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93917166837568] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.453+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.453+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93917166842560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e2750 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.453+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e4050 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.454+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.454+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93917166844832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e2750 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.454+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e4bc0 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.454+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93917166842560] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93917166844832] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93917166845888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e0c00 con 0x7fdcdc00f070 2024-05-07T13:56:15.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce7e87800 20 add_watcher() i=0 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce7e87800 20 add_watcher() i=1 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce7e87800 20 add_watcher() i=2 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce7e87800 20 add_watcher() i=3 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce7e87800 20 add_watcher() i=4 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce7e87800 20 add_watcher() i=5 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.455+0000 7fdce7e87800 20 add_watcher() i=6 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.456+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93917166845888] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.456+0000 7fdce7e87800 20 add_watcher() i=7 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.456+0000 7fdce7e87800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.456+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e7bb0 con 0x556acb5d3e90 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.456+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.456+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93917166847632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e5030 con 0x556acb5d3e90 2024-05-07T13:56:15.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.457+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93917166847632] v27'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.457+0000 7fdb97fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.457+0000 7fdce7e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.457+0000 7fdce7e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.457+0000 7fdce7e87800 5 note: GC not initialized 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdb96ffd640 20 reqs_thread_entry: start 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 20 Filter name: none 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdb94ff9640 20 reqs_thread_entry: start 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb61af80 con 0x556acb5d3e90 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.458+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb61d8b0 con 0x7fdcd80bf060 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 20 enabling bucket name=myfoo 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb61b890 con 0x7fdcd80bf060 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 : miss 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 20 rados->read ofs=0 len=0 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.459+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb61e030 con 0x7fdcd80bf060 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.460+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.460+0000 7fdce7e87800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.460+0000 7fdce7e87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.460+0000 7fdce7e87800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.460+0000 7fdce7e87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.460+0000 7fdce7e87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.460+0000 7fdce7e87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 2024-05-07T13:56:15.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.460+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 8.1f 8:f82f06f3:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb625c60 con 0x7fdcd80bf060 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(66 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdce7e87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdce7e87800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdce7e87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdce7e87800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1, ofs0, ns] 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93917167085296 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb621310 con 0x7fdcd80bf060 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== watch-notify(notify (1) cookie 93917166819808 notify 115964117018 ret 0) ==== 794+0+0 (crc 0 0 0) 0x556acb61e420 con 0x7fdcd80bf060 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdbc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117018 cookie 93917166819808 notifier 4593 bl.length()=752 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdbc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 info.flags=0x17 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdbc97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1 to cache LRU end 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdbc97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdbc97fa640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdba8003ea0 con 0x7fdcd80bf060 2024-05-07T13:56:15.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.461+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(67 notify.0 [notify cookie 93917167085296 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.462+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.462+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== watch-notify(notify_complete (2) cookie 93917167085296 notify 115964117018 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556acb61d570 con 0x7fdcd80bf060 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.462+0000 7fdce7e87800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_sources= new_sources= 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.462+0000 7fdce7e87800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential sources added=[] removed=[] 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.462+0000 7fdce7e87800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): orig_dests= new_dests= 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.462+0000 7fdce7e87800 20 handle_bi_update(): bucket=:myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1]): potential dests added=[] removed=[] 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.462+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb620e20 con 0x556acb5d3e90 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v27'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdce7e87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdce7e87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdce7e87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:15.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93917167064800 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556acb620e20 con 0x556acb5d3e90 2024-05-07T13:56:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 93917166837568 notify 115964117007 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fdce001e040 con 0x556acb5d3e90 2024-05-07T13:56:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(70 notify.4 [notify cookie 93917167064800 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdbc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117007 cookie 93917166837568 notifier 4593 bl.length()=567 2024-05-07T13:56:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdbc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdbc8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.463+0000 7fdbc8ff9640 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdb0c003430 con 0x556acb5d3e90 2024-05-07T13:56:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.464+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 93917167064800 notify 115964117007 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdce0027c90 con 0x556acb5d3e90 2024-05-07T13:56:15.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.464+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.495 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:15.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.464+0000 7fdb97fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:15.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.465+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93917166847632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb619fa0 con 0x556acb5d3e90 2024-05-07T13:56:15.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.466+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93917166847632] v27'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.466+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93917166819808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5e4690 con 0x7fdcd80bf060 2024-05-07T13:56:15.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.467+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93917166819808] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.467+0000 7fdce7e87800 20 remove_watcher() i=0 2024-05-07T13:56:15.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.467+0000 7fdce7e87800 2 removed watcher, disabling cache 2024-05-07T13:56:15.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.467+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93917166822064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dd9e0 con 0x556acb5d3e90 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.468+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93917166822064] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.468+0000 7fdce7e87800 20 remove_watcher() i=1 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.468+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93917166830320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dd9e0 con 0x556acb5d8880 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.469+0000 7fdce5986640 1 -- 172.21.15.50:0/2875392224 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93917166830320] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd80bc030 con 0x556acb5d8880 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.469+0000 7fdce7e87800 20 remove_watcher() i=2 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.469+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93917166826704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dd9e0 con 0x7fdcd80bf060 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.470+0000 7fdce5185640 1 -- 172.21.15.50:0/2875392224 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93917166826704] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc037040 con 0x7fdcd80bf060 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.470+0000 7fdce7e87800 20 remove_watcher() i=3 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.470+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93917166837568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dd9e0 con 0x556acb5d3e90 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.471+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93917166837568] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x556acb5d3e90 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.471+0000 7fdce7e87800 20 remove_watcher() i=4 2024-05-07T13:56:15.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.471+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93917166842560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dd9e0 con 0x7fdcdc00f070 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.472+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93917166842560] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.472+0000 7fdce7e87800 20 remove_watcher() i=5 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.472+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93917166844832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dd9e0 con 0x7fdcdc00f070 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.473+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93917166844832] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.473+0000 7fdce7e87800 20 remove_watcher() i=6 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.473+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93917166845888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556acb5dd9e0 con 0x7fdcdc00f070 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93917166845888] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce002f060 con 0x7fdcdc00f070 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 20 remove_watcher() i=7 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdcdc00f070 msgr2=0x7fdcdc02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdcdc00f070 0x7fdcdc02e910 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb5d3e90 msgr2=0x556acb5d6350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb5d3e90 0x556acb5d6350 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdcd80bf060 msgr2=0x7fdcd80aa840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdcd80bf060 0x7fdcd80aa840 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb5d8880 msgr2=0x556acb5dac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb5d8880 0x556acb5dac70 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbb00368b0 msgr2=0x7fdbb0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbb00368b0 0x7fdbb0038d70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x556acb59d760 tx=0x7fdcdc010000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce6187640 1 -- 172.21.15.50:0/2875392224 reap_dead start 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 msgr2=0x556acb5c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c8720 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdcd807b040 tx=0x7fdcd805afa0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 shutdown_connections 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/2875392224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5c1360 0x556acb5c8720 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 >> 172.21.15.50:0/2875392224 conn(0x556acb5bd670 msgr2=0x556acb5bacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 shutdown_connections 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/2875392224 wait complete. 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/254779609 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbc0036950 msgr2=0x7fdbc0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/254779609 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbc0036950 0x7fdbc0038e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00c010 tx=0x7fdcdc00f000 comp rx=0 tx=0).stop 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/254779609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5b4150 msgr2=0x556acb5b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/254779609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5b4150 0x556acb5b4570 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8006b30 tx=0x7fdcd8079e10 comp rx=0 tx=0).stop 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/254779609 shutdown_connections 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/254779609 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbc0036950 0x7fdbc0038e10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 --2- 172.21.15.50:0/254779609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb5b4150 0x556acb5b4570 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/254779609 >> 172.21.15.50:0/254779609 conn(0x556acb5a81f0 msgr2=0x556acb5a85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/254779609 shutdown_connections 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.475+0000 7fdce7e87800 1 -- 172.21.15.50:0/254779609 wait complete. 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556acb5a3140 msgr2=0x556acb5a5590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556acb5a3140 0x556acb5a5590 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb49c090 msgr2=0x556acb59c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556acb49c090 0x556acb59c930 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb59f1b0 msgr2=0x556acb5a15a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556acb59f1b0 0x556acb5a15a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbcc036950 msgr2=0x7fdbcc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fdbcc036950 0x7fdbcc038e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc000f60 tx=0x7fdcdc001370 comp rx=0 tx=0).stop 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 msgr2=0x556acb5956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 --2- 172.21.15.50:0/3925897365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556acb49b730 0x556acb5956f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8052540 tx=0x7fdcd8003020 comp rx=0 tx=0).stop 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce6187640 1 -- 172.21.15.50:0/3925897365 reap_dead start 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 shutdown_connections 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 >> 172.21.15.50:0/3925897365 conn(0x556acb493d30 msgr2=0x556acb499bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 shutdown_connections 2024-05-07T13:56:15.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:15.476+0000 7fdce7e87800 1 -- 172.21.15.50:0/3925897365 wait complete. 2024-05-07T13:56:15.507 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:15.514 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-07T13:56:15.757 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-05-07T13:56:15.764 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:30.765 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-07T13:56:30.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-07T13:56:30.766 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-07T13:56:30.819 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:30.819 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.832+0000 7fc5eef46800 1 Processor -- start 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.832+0000 7fc5eef46800 1 -- start start 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.832+0000 7fc5eef46800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562708ff92f0 0x562708ff9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.832+0000 7fc5eef46800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562708ff9d90 con 0x562708ffa4f0 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.832+0000 7fc5eef46800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x562708e88050 con 0x562708ff92f0 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.833+0000 7fc5eca4c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562708ff92f0 0x562708ff9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.833+0000 7fc5eca4c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562708ff92f0 0x562708ff9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44886/0 (socket says 172.21.15.50:44886) 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.833+0000 7fc5ec24b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x562708ffa4f0 0x562708ffa970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:43988/0 (socket says 172.21.15.50:43988) 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.833+0000 7fc5eca4c640 1 -- 172.21.15.50:0/3396641955 learned_addr learned my addr 172.21.15.50:0/3396641955 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:30.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.833+0000 7fc5eca4c640 1 -- 172.21.15.50:0/3396641955 >> v1:172.21.15.22:6789/0 conn(0x562708ffa4f0 legacy=0x562708ffa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.833+0000 7fc5eba4a640 1 -- 172.21.15.50:0/3396641955 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138958407 0 0) 0x562708ff9d90 con 0x562708ffa4f0 2024-05-07T13:56:30.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.833+0000 7fc5eca4c640 1 -- 172.21.15.50:0/3396641955 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562708ffb0b0 con 0x562708ff92f0 2024-05-07T13:56:30.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.835+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/3396641955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x562708ff9710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc005fd0 tx=0x7fc5dc01cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680033e62a9f23d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eba4a640 1 -- 172.21.15.50:0/3396641955 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc052540 con 0x562708ff92f0 2024-05-07T13:56:30.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eba4a640 1 -- 172.21.15.50:0/3396641955 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc04e070 con 0x562708ff92f0 2024-05-07T13:56:30.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eba4a640 1 -- 172.21.15.50:0/3396641955 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc052850 con 0x562708ff92f0 2024-05-07T13:56:30.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eef46800 1 -- 172.21.15.50:0/3396641955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 msgr2=0x562708ff9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eef46800 1 --2- 172.21.15.50:0/3396641955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x562708ff9710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc005fd0 tx=0x7fc5dc01cd80 comp rx=0 tx=0).stop 2024-05-07T13:56:30.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eef46800 1 -- 172.21.15.50:0/3396641955 shutdown_connections 2024-05-07T13:56:30.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eef46800 1 --2- 172.21.15.50:0/3396641955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x562708ff9710 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eef46800 1 -- 172.21.15.50:0/3396641955 >> 172.21.15.50:0/3396641955 conn(0x562708f6c970 msgr2=0x562708ff7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:30.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eef46800 1 -- 172.21.15.50:0/3396641955 shutdown_connections 2024-05-07T13:56:30.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.836+0000 7fc5eef46800 1 -- 172.21.15.50:0/3396641955 wait complete. 2024-05-07T13:56:30.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.854+0000 7fc5eef46800 1 Processor -- start 2024-05-07T13:56:30.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.854+0000 7fc5eef46800 1 -- start start 2024-05-07T13:56:30.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.854+0000 7fc5eef46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090ea710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.854+0000 7fc5eef46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562708f421d0 con 0x562708ff92f0 2024-05-07T13:56:30.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.854+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090ea710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.854+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090ea710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44900/0 (socket says 172.21.15.50:44900) 2024-05-07T13:56:30.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.854+0000 7fc5eca4c640 1 -- 172.21.15.50:0/3220592607 learned_addr learned my addr 172.21.15.50:0/3220592607 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:30.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.855+0000 7fc5eca4c640 1 -- 172.21.15.50:0/3220592607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627090eace0 con 0x562708ff92f0 2024-05-07T13:56:30.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.855+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/3220592607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090ea710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00a190 tx=0x7fc5dc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d728e37a1e4240c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.855+0000 7fc4dae0d640 1 -- 172.21.15.50:0/3220592607 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc052410 con 0x562708ff92f0 2024-05-07T13:56:30.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.855+0000 7fc4dae0d640 1 -- 172.21.15.50:0/3220592607 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc062070 con 0x562708ff92f0 2024-05-07T13:56:30.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.855+0000 7fc4dae0d640 1 -- 172.21.15.50:0/3220592607 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc052700 con 0x562708ff92f0 2024-05-07T13:56:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.856+0000 7fc5eef46800 1 -- 172.21.15.50:0/3220592607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 msgr2=0x5627090ea710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.856+0000 7fc5eef46800 1 --2- 172.21.15.50:0/3220592607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090ea710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00a190 tx=0x7fc5dc04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.856+0000 7fc5eef46800 1 -- 172.21.15.50:0/3220592607 shutdown_connections 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.856+0000 7fc5eef46800 1 --2- 172.21.15.50:0/3220592607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090ea710 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.856+0000 7fc5eef46800 1 -- 172.21.15.50:0/3220592607 >> 172.21.15.50:0/3220592607 conn(0x562708f6c970 msgr2=0x5627090e6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.856+0000 7fc5eef46800 1 -- 172.21.15.50:0/3220592607 shutdown_connections 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.856+0000 7fc5eef46800 1 -- 172.21.15.50:0/3220592607 wait complete. 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.856+0000 7fc5eef46800 1 Processor -- start 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.857+0000 7fc5eef46800 1 -- start start 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.857+0000 7fc5eef46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.857+0000 7fc5eef46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5627090029c0 con 0x562708ff92f0 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.857+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.857+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090f21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44902/0 (socket says 172.21.15.50:44902) 2024-05-07T13:56:30.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.857+0000 7fc5eca4c640 1 -- 172.21.15.50:0/2538196331 learned_addr learned my addr 172.21.15.50:0/2538196331 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.858+0000 7fc5eca4c640 1 -- 172.21.15.50:0/2538196331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627090f26e0 con 0x562708ff92f0 2024-05-07T13:56:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.858+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090f21a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc05f040 tx=0x7fc5dc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.858+0000 7fc4d960a640 1 -- 172.21.15.50:0/2538196331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc05d630 con 0x562708ff92f0 2024-05-07T13:56:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.858+0000 7fc4d960a640 1 -- 172.21.15.50:0/2538196331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc058040 con 0x562708ff92f0 2024-05-07T13:56:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.858+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627090f2970 con 0x562708ff92f0 2024-05-07T13:56:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.858+0000 7fc4d960a640 1 -- 172.21.15.50:0/2538196331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc05d920 con 0x562708ff92f0 2024-05-07T13:56:30.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.858+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627090f5620 con 0x562708ff92f0 2024-05-07T13:56:30.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.859+0000 7fc4d960a640 1 -- 172.21.15.50:0/2538196331 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc5dc050070 con 0x562708ff92f0 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.859+0000 7fc4d960a640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4d4036950 0x7fc4d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.859+0000 7fc4d960a640 1 -- 172.21.15.50:0/2538196331 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc5dc08e5a0 con 0x562708ff92f0 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.859+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4d4036950 0x7fc4d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.859+0000 7fc5eef46800 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562708ffa4f0 0x5627090f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.859+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5627090f99b0 con 0x562708ffa4f0 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.860+0000 7fc5ed24d640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562708ffa4f0 0x5627090f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.860+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4d4036950 0x7fc4d4038e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0000c00 tx=0x7fc5e00013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.860+0000 7fc5ed24d640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562708ffa4f0 0x5627090f93e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.860+0000 7fc5ed24d640 1 -- 172.21.15.50:0/2538196331 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562708ffa4f0 2024-05-07T13:56:30.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.860+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5627090f6970 con 0x562708ffa4f0 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.861+0000 7fc5ed24d640 1 -- 172.21.15.50:0/2538196331 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5e40083e0 con 0x562708ffa4f0 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.861+0000 7fc5eef46800 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5627090fbd30 0x5627090fe120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.861+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5627090fe7c0 con 0x5627090fbd30 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.861+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5627090fbd30 0x5627090fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.861+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5627090fbd30 0x5627090fe120 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.862+0000 7fc5eca4c640 1 -- 172.21.15.50:0/2538196331 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc5dc077020 con 0x5627090fbd30 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.862+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5627090face0 con 0x562708ffa4f0 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.862+0000 7fc5ed24d640 1 -- 172.21.15.50:0/2538196331 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5e40083e0 con 0x562708ffa4f0 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.862+0000 7fc5eef46800 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5627090ffc20 0x5627091020b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.862+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709102810 con 0x5627090ffc20 2024-05-07T13:56:30.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.862+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5627090ffc20 0x5627091020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.863+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5627090ffc20 0x5627091020b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.863+0000 7fc5ec24b640 1 -- 172.21.15.50:0/2538196331 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc5e000f670 con 0x5627090ffc20 2024-05-07T13:56:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.863+0000 7fc5eef46800 1 Processor -- start 2024-05-07T13:56:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.863+0000 7fc5eef46800 1 -- start start 2024-05-07T13:56:30.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.864+0000 7fc5eef46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562709110c40 0x562709111060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.864+0000 7fc5eef46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562708ee8cf0 con 0x562709110c40 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.864+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562709110c40 0x562709111060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.864+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562709110c40 0x562709111060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44914/0 (socket says 172.21.15.50:44914) 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.864+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1175109910 learned_addr learned my addr 172.21.15.50:0/1175109910 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.864+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1175109910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627091115a0 con 0x562709110c40 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.864+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/1175109910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562709110c40 0x562709111060 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc08c9b0 tx=0x7fc5dc0513b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.865+0000 7fc4d27fc640 1 -- 172.21.15.50:0/1175109910 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc093070 con 0x562709110c40 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.865+0000 7fc4d27fc640 1 -- 172.21.15.50:0/1175109910 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc08b2d0 con 0x562709110c40 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.865+0000 7fc5eef46800 1 -- 172.21.15.50:0/1175109910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562709112010 con 0x562709110c40 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.865+0000 7fc4d27fc640 1 -- 172.21.15.50:0/1175109910 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc08b5b0 con 0x562709110c40 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.865+0000 7fc5eef46800 1 -- 172.21.15.50:0/1175109910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562709112010 con 0x562709110c40 2024-05-07T13:56:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.865+0000 7fc4d27fc640 1 -- 172.21.15.50:0/1175109910 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc5dc096070 con 0x562709110c40 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.866+0000 7fc4d27fc640 1 --2- 172.21.15.50:0/1175109910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4c4036b60 0x7fc4c4039020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.866+0000 7fc4d27fc640 1 -- 172.21.15.50:0/1175109910 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc5dc08a030 con 0x562709110c40 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.866+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/1175109910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4c4036b60 0x7fc4c4039020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.866+0000 7fc5eef46800 1 Processor -- start 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.866+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/1175109910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4c4036b60 0x7fc4c4039020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x5627090fa2e0 tx=0x7fc5e0006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.866+0000 7fc5eef46800 1 -- start start 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.866+0000 7fc5eef46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x56270911dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.866+0000 7fc5eef46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5627090eafa0 con 0x56270911dba0 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.867+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x56270911dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.867+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x56270911dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44920/0 (socket says 172.21.15.50:44920) 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.867+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1172361138 learned_addr learned my addr 172.21.15.50:0/1172361138 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.867+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1172361138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56270911e590 con 0x56270911dba0 2024-05-07T13:56:30.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.867+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/1172361138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x56270911dfc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0516c0 tx=0x7fc5dc08ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64081cef91289a95 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.867+0000 7fc4c3fff640 1 -- 172.21.15.50:0/1172361138 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc071d10 con 0x56270911dba0 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.867+0000 7fc4c3fff640 1 -- 172.21.15.50:0/1172361138 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc082890 con 0x56270911dba0 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.867+0000 7fc4c3fff640 1 -- 172.21.15.50:0/1172361138 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc054e70 con 0x56270911dba0 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.868+0000 7fc5eef46800 1 -- 172.21.15.50:0/1172361138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 msgr2=0x56270911dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.868+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1172361138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x56270911dfc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0516c0 tx=0x7fc5dc08ef80 comp rx=0 tx=0).stop 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.868+0000 7fc5eef46800 1 -- 172.21.15.50:0/1172361138 shutdown_connections 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.868+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1172361138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x56270911dfc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.868+0000 7fc5eef46800 1 -- 172.21.15.50:0/1172361138 >> 172.21.15.50:0/1172361138 conn(0x562709119f50 msgr2=0x562709117fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.868+0000 7fc5eef46800 1 -- 172.21.15.50:0/1172361138 shutdown_connections 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.868+0000 7fc5eef46800 1 -- 172.21.15.50:0/1172361138 wait complete. 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.869+0000 7fc5eef46800 1 Processor -- start 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.869+0000 7fc5eef46800 1 -- start start 2024-05-07T13:56:30.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.869+0000 7fc5eef46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x562709124ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.869+0000 7fc5eef46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56270911ec90 con 0x56270911dba0 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.869+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x562709124ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.869+0000 7fc5eca4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x562709124ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44934/0 (socket says 172.21.15.50:44934) 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.869+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 learned_addr learned my addr 172.21.15.50:0/1876458068 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.870+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562709125530 con 0x56270911dba0 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.870+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x562709124ff0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc061000 tx=0x7fc5dc07ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.870+0000 7fc4c27fc640 1 -- 172.21.15.50:0/1876458068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc0826d0 con 0x56270911dba0 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.870+0000 7fc4c27fc640 1 -- 172.21.15.50:0/1876458068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc066850 con 0x56270911dba0 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.870+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562709125530 con 0x56270911dba0 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.870+0000 7fc4c27fc640 1 -- 172.21.15.50:0/1876458068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc071440 con 0x56270911dba0 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.870+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562709125530 con 0x56270911dba0 2024-05-07T13:56:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.871+0000 7fc4c27fc640 1 -- 172.21.15.50:0/1876458068 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc5dc0730c0 con 0x56270911dba0 2024-05-07T13:56:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.871+0000 7fc4c27fc640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4b8036950 0x7fc4b8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.871+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.871+0000 7fc4c27fc640 1 -- 172.21.15.50:0/1876458068 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc5dc0a3070 con 0x56270911dba0 2024-05-07T13:56:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4b8036950 0x7fc4b8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562709130680 0x562709132b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709133290 con 0x562709130680 2024-05-07T13:56:30.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5ed24d640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562709130680 0x562709132b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4b8036950 0x7fc4b8038e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5627090feb60 tx=0x7fc5e0023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5ed24d640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562709130680 0x562709132b40 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5eef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5eef46800 20 realm 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.872+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709133710 con 0x562709130680 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:30.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709130680 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709134350 con 0x562709130680 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562709134d10 0x562709137100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.873+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709137640 con 0x562709134d10 2024-05-07T13:56:30.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.874+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562709134d10 0x562709137100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.874+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562709134d10 0x562709137100 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.874+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.874+0000 7fc5eef46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.874+0000 7fc5eef46800 20 searching for the correct realm 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.874+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709139060 con 0x562709134d10 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.875+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.875+0000 7fc5eca4c640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc5dc0b1040 0x7fc5dc098440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.875+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709139060 con 0x7fc5dc0b1040 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.875+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc5dc0b1040 0x7fc5dc098440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.875+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc5dc0b1040 0x7fc5dc098440 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.875+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.875+0000 7fc5ec24b640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc5e003a3c0 0x7fc5e003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.875+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709139060 con 0x7fc5e003a3c0 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.876+0000 7fc5ed24d640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc5e003a3c0 0x7fc5e003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.876+0000 7fc5ed24d640 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc5e003a3c0 0x7fc5e003a810 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.876+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.876+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709130680 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.877+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.877+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709130680 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.877+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.877+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.877+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.877+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.878+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.878+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5dc0b1040 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.878+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.878+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709134d10 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.878+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.878+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709130680 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.878+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.878+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.879+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.879+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709130680 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.879+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.879+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5dc0b1040 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.879+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.879+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709134d10 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.880+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.880+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709134d10 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.880+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.880+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.880+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.880+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709134d10 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.880+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.880+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709134d10 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.881+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.881+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709130680 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.881+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.881+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709130680 2024-05-07T13:56:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.881+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.881+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.882+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.882+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709134d10 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.882+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.882+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5dc0b1040 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.882+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.882+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709130680 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.882+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.882+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.883+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.883+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709134d10 2024-05-07T13:56:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.883+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.883+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.883+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.884+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5dc0b1040 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.884+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.884+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709134d10 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.884+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.884+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.884+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.884+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x562709130680 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562709133fb0 con 0x7fc5dc0b1040 2024-05-07T13:56:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709137ff0 con 0x562709130680 2024-05-07T13:56:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.885+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5627091383e0 con 0x562709130680 2024-05-07T13:56:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5627091383e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 20 zone default found 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 4 Realm: () 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 20 zonegroup default 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709138800 con 0x7fc5e003a3c0 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.886+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709138800 con 0x562709134d10 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.887+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.887+0000 7fc5eef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.887+0000 7fc5eef46800 20 rados->read ofs=0 len=0 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.887+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270913af10 con 0x562709134d10 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.887+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.887+0000 7fc5eef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.887+0000 7fc5eef46800 20 started sync module instance, tier type = 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.887+0000 7fc5eef46800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.887+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913a3b0 con 0x7fc5dc0b1040 2024-05-07T13:56:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.888+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.888+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725655996320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913a010 con 0x7fc5dc0b1040 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.888+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913bdc0 con 0x562709130680 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.889+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725655996320] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.890+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.890+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725655999152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913c1e0 con 0x562709130680 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.890+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913cc30 con 0x562709134d10 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.891+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725655999152] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.891+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.891+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725656004384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913d020 con 0x562709134d10 2024-05-07T13:56:30.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.891+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913da60 con 0x7fc5dc0b1040 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.892+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.892+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725656004384] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.892+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725656010320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913e720 con 0x7fc5dc0b1040 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.892+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913b910 con 0x562709130680 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.893+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.893+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725656013872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913f500 con 0x562709130680 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.893+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725656010320] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.893+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913ff70 con 0x7fc5e003a3c0 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.894+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725656013872] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.895+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.895+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725656017472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913f050 con 0x7fc5e003a3c0 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.895+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562709140810 con 0x7fc5e003a3c0 2024-05-07T13:56:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.896+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.896+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725656019664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562709140ba0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.896+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5627091413f0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.896+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725656017472] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725656019664] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725656020720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562709140fc0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5eef46800 20 add_watcher() i=0 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5eef46800 20 add_watcher() i=1 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5eef46800 20 add_watcher() i=2 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5eef46800 20 add_watcher() i=3 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5eef46800 20 add_watcher() i=4 2024-05-07T13:56:30.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5eef46800 20 add_watcher() i=5 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.897+0000 7fc5eef46800 20 add_watcher() i=6 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.898+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725656020720] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.898+0000 7fc5eef46800 20 add_watcher() i=7 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.898+0000 7fc5eef46800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.898+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562709144170 con 0x562709130680 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.898+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.898+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725656021776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5627091413e0 con 0x562709130680 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.899+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725656021776] v27'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.900+0000 7fc4a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.900+0000 7fc5eef46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.900+0000 7fc5eef46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.900+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914c8a0 con 0x562709130680 2024-05-07T13:56:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.901+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.901+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ce10 con 0x7fc5e003a3c0 2024-05-07T13:56:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.902+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.902+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914d380 con 0x562709134d10 2024-05-07T13:56:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.903+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'20 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.903+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914d720 con 0x562709130680 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.904+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'153 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.904+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914dae0 con 0x7fc5dc0b1040 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.905+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.905+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914df90 con 0x562709134d10 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.906+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.906+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914df90 con 0x562709130680 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.907+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.907+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914e020 con 0x7fc5e003a3c0 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.909+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.909+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914e100 con 0x7fc5dc0b1040 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.910+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.910+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914e800 con 0x562709134d10 2024-05-07T13:56:30.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.911+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.911+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914e800 con 0x7fc5dc0b1040 2024-05-07T13:56:30.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.912+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.912+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed70 con 0x7fc5e003a3c0 2024-05-07T13:56:30.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.913+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.913+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed70 con 0x7fc5dc0b1040 2024-05-07T13:56:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.914+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.914+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ec70 con 0x7fc5e003a3c0 2024-05-07T13:56:30.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.915+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'35 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.915+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ec70 con 0x562709130680 2024-05-07T13:56:30.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.916+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.916+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ec70 con 0x562709134d10 2024-05-07T13:56:30.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.918+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.918+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ec70 con 0x7fc5dc0b1040 2024-05-07T13:56:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.919+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.919+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed30 con 0x562709134d10 2024-05-07T13:56:30.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.920+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.920+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed30 con 0x562709130680 2024-05-07T13:56:30.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.921+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.921+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x562709130680 2024-05-07T13:56:30.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.922+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.922+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed30 con 0x562709134d10 2024-05-07T13:56:30.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.923+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.923+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed30 con 0x7fc5dc0b1040 2024-05-07T13:56:30.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.924+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.924+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x562709134d10 2024-05-07T13:56:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.925+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.925+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x562709134d10 2024-05-07T13:56:30.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.926+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.927+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x562709134d10 2024-05-07T13:56:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.927+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.927+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x562709134d10 2024-05-07T13:56:30.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.929+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.929+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x7fc5e003a3c0 2024-05-07T13:56:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.930+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.930+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x562709134d10 2024-05-07T13:56:30.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.931+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.931+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x7fc5e003a3c0 2024-05-07T13:56:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.932+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.932+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x562709134d10 2024-05-07T13:56:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.933+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.933+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x7fc5e003a3c0 2024-05-07T13:56:30.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.935+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.935+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270914ed00 con 0x7fc5dc0b1040 2024-05-07T13:56:30.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.936+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.936+0000 7fc4a1fe3640 20 reqs_thread_entry: start 2024-05-07T13:56:30.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.936+0000 7fc5eef46800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.936+0000 7fc5eef46800 20 Filter name: none 2024-05-07T13:56:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.936+0000 7fc4137fe640 20 reqs_thread_entry: start 2024-05-07T13:56:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.936+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a7b0 con 0x562709130680 2024-05-07T13:56:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.937+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.937+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5627091797a0 con 0x562709130680 2024-05-07T13:56:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.937+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.937+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a7b0 con 0x562709130680 2024-05-07T13:56:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.937+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.937+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a7b0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.938+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.938+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5627091797a0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.938+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.938+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a7b0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.938+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.938+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a7b0 con 0x562709134d10 2024-05-07T13:56:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.939+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv19 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.939+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5627091797a0 con 0x562709134d10 2024-05-07T13:56:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.939+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv19 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.939+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a7b0 con 0x562709134d10 2024-05-07T13:56:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.939+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(102 gc.2 [call out=1701b] v0'0 uv19 ondisk = 0) ==== 148+0+1701 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.939+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b190 con 0x562709130680 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.939+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.939+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709130680 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.940+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.940+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709130680 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.940+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.940+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5dc0b1040 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.940+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.940+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5dc0b1040 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.941+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.941+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5dc0b1040 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.941+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.941+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.941+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.941+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.941+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.941+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.942+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.942+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709130680 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.942+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.942+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709130680 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.942+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.942+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709130680 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.942+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.943+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.943+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.943+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5e003a3c0 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.943+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.943+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.943+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.943+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.944+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.944+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5dc0b1040 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.944+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.944+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.944+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.944+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.945+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.945+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.945+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.945+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.945+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.945+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.945+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.945+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5dc0b1040 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.946+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.946+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.946+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.946+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.947+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.947+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5e003a3c0 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.947+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.947+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.947+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.947+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.947+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.947+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5dc0b1040 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.948+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.948+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.948+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.948+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.948+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.948+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5e003a3c0 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.949+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.949+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.949+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.949+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709130680 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.949+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.949+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709130680 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.950+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.950+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709130680 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.950+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.950+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.950+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.950+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.951+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.951+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.951+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.951+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.951+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.951+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5dc0b1040 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.951+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.951+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.952+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.952+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.952+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.952+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.952+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.952+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.953+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.953+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709130680 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.953+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.953+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709130680 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.953+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.953+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709130680 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.953+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.953+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709130680 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.954+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.954+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709130680 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.954+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.954+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709130680 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.954+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.954+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.954+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.954+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.955+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.955+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.955+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.955+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.955+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.955+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5dc0b1040 2024-05-07T13:56:30.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.956+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.956+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.956+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.956+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.956+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.956+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.956+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.956+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.957+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.957+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.957+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.957+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.957+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.957+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.957+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.957+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.958+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.958+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.958+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.958+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.958+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.958+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.958+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.959+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.959+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.959+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.959+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.959+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.960+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.960+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5e003a3c0 2024-05-07T13:56:30.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.960+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.960+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.960+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.960+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.961+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.961+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.961+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.961+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.961+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.961+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.962+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.962+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5e003a3c0 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.962+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.962+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.962+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.962+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.963+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.963+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x562709134d10 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.963+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.963+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x562709134d10 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.963+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.963+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.964+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.964+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5e003a3c0 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.964+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.964+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5e003a3c0 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.964+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.964+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.965+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.965+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917a140 con 0x7fc5dc0b1040 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.965+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.965+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56270917b150 con 0x7fc5dc0b1040 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.965+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.966+0000 7fc4a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.966+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725656021776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562709179ab0 con 0x562709130680 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.967+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94725656021776] v27'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.967+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725655996320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562709140b10 con 0x7fc5dc0b1040 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.968+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94725655996320] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.968+0000 7fc5eef46800 20 remove_watcher() i=0 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.968+0000 7fc5eef46800 2 removed watcher, disabling cache 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.968+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725655999152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562709140b10 con 0x562709130680 2024-05-07T13:56:30.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.969+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94725655999152] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.969+0000 7fc5eef46800 20 remove_watcher() i=1 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.969+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725656004384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913b2b0 con 0x562709134d10 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.970+0000 7fc5eca4c640 1 -- 172.21.15.50:0/1876458068 <== osd.3 v2:172.21.15.50:6814/3553060046 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94725656004384] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc095030 con 0x562709134d10 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.970+0000 7fc5eef46800 20 remove_watcher() i=2 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.970+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725656010320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562709140b10 con 0x7fc5dc0b1040 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.971+0000 7fc5ec24b640 1 -- 172.21.15.50:0/1876458068 <== osd.2 v2:172.21.15.50:6808/2034796854 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94725656010320] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0037040 con 0x7fc5dc0b1040 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.971+0000 7fc5eef46800 20 remove_watcher() i=3 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.971+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725656013872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913c720 con 0x562709130680 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.972+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.1 v2:172.21.15.50:6800/3441257969 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94725656013872] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x562709130680 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.972+0000 7fc5eef46800 20 remove_watcher() i=4 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.972+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725656017472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913b2b0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.973+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94725656017472] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.973+0000 7fc5eef46800 20 remove_watcher() i=5 2024-05-07T13:56:30.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.973+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725656019664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56270913de50 con 0x7fc5e003a3c0 2024-05-07T13:56:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.975+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94725656019664] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.975+0000 7fc5eef46800 20 remove_watcher() i=6 2024-05-07T13:56:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.975+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725656020720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562709140b10 con 0x7fc5e003a3c0 2024-05-07T13:56:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 <== osd.0 v2:172.21.15.22:6800/2215278347 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94725656020720] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e40083e0 con 0x7fc5e003a3c0 2024-05-07T13:56:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 20 remove_watcher() i=7 2024-05-07T13:56:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc5e003a3c0 msgr2=0x7fc5e003a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc5e003a3c0 0x7fc5e003a810 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562709130680 msgr2=0x562709132b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562709130680 0x562709132b40 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc5dc0b1040 msgr2=0x7fc5dc098440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc5dc0b1040 0x7fc5dc098440 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562709134d10 msgr2=0x562709137100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562709134d10 0x562709137100 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4b8036950 msgr2=0x7fc4b8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4b8036950 0x7fc4b8038e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5627090feb60 tx=0x7fc5e0023040 comp rx=0 tx=0).stop 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5ed24d640 1 -- 172.21.15.50:0/1876458068 reap_dead start 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 msgr2=0x562709124ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x562709124ff0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc061000 tx=0x7fc5dc07ff30 comp rx=0 tx=0).stop 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 shutdown_connections 2024-05-07T13:56:30.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1876458068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56270911dba0 0x562709124ff0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 >> 172.21.15.50:0/1876458068 conn(0x562709119f50 msgr2=0x5627091175b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 shutdown_connections 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.976+0000 7fc5eef46800 1 -- 172.21.15.50:0/1876458068 wait complete. 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/1175109910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4c4036b60 msgr2=0x7fc4c4039020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1175109910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4c4036b60 0x7fc4c4039020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x5627090fa2e0 tx=0x7fc5e0006000 comp rx=0 tx=0).stop 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/1175109910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562709110c40 msgr2=0x562709111060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1175109910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562709110c40 0x562709111060 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc08c9b0 tx=0x7fc5dc0513b0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/1175109910 shutdown_connections 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1175109910 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4c4036b60 0x7fc4c4039020 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 --2- 172.21.15.50:0/1175109910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562709110c40 0x562709111060 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/1175109910 >> 172.21.15.50:0/1175109910 conn(0x562709104ce0 msgr2=0x5627091050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/1175109910 shutdown_connections 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/1175109910 wait complete. 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5627090ffc20 msgr2=0x5627091020b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5627090ffc20 0x5627091020b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562708ffa4f0 msgr2=0x5627090f93e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562708ffa4f0 0x5627090f93e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5627090fbd30 msgr2=0x5627090fe120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5627090fbd30 0x5627090fe120 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4d4036950 msgr2=0x7fc4d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4d4036950 0x7fc4d4038e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0000c00 tx=0x7fc5e00013b0 comp rx=0 tx=0).stop 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 msgr2=0x5627090f21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:30.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 --2- 172.21.15.50:0/2538196331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562708ff92f0 0x5627090f21a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc05f040 tx=0x7fc5dc003330 comp rx=0 tx=0).stop 2024-05-07T13:56:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5ed24d640 1 -- 172.21.15.50:0/2538196331 reap_dead start 2024-05-07T13:56:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 shutdown_connections 2024-05-07T13:56:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 >> 172.21.15.50:0/2538196331 conn(0x562708f6c970 msgr2=0x5627090e4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 shutdown_connections 2024-05-07T13:56:30.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:30.977+0000 7fc5eef46800 1 -- 172.21.15.50:0/2538196331 wait complete. 2024-05-07T13:56:30.974 INFO:teuthology.orchestra.run.smithi050.stdout:[{"tag":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.6873624326850858278\u0000","time":"2024-05-07T13:56:30.775968+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_7","key":"","instance":""}]}] 2024-05-07T13:56:30.974 DEBUG:tasks.util.rgw: json result: [{'tag': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.6873624326850858278\x00', 'time': '2024-05-07T13:56:30.775968+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_7', 'key': '', 'instance': ''}]}] 2024-05-07T13:56:30.974 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-05-07T13:56:30.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-05-07T13:56:30.975 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-05-07T13:56:31.018 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:31.019 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.032+0000 7fc81af23800 1 Processor -- start 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.032+0000 7fc81af23800 1 -- start start 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.032+0000 7fc81af23800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x557a56f69740 0x557a56f69b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.032+0000 7fc81af23800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557a56f6a1e0 con 0x557a56f6a9a0 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.032+0000 7fc81af23800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x557a56dfc050 con 0x557a56f69740 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.032+0000 7fc816c59640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x557a56f69740 0x557a56f69b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.032+0000 7fc80ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x557a56f6a9a0 0x557a56f6ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:43998/0 (socket says 172.21.15.50:43998) 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.032+0000 7fc80ffff640 1 -- 172.21.15.50:0/4044748092 learned_addr learned my addr 172.21.15.50:0/4044748092 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.033+0000 7fc816c59640 1 -- 172.21.15.50:0/4044748092 >> v1:172.21.15.22:6789/0 conn(0x557a56f6a9a0 legacy=0x557a56f6ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.033+0000 7fc816c59640 1 -- 172.21.15.50:0/4044748092 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a56f6b560 con 0x557a56f69740 2024-05-07T13:56:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc816c59640 1 --2- 172.21.15.50:0/4044748092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a56f69b60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc80800a470 tx=0x7fc80801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa2ebd6b1c9abb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc816458640 1 -- 172.21.15.50:0/4044748092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808057070 con 0x557a56f69740 2024-05-07T13:56:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc816458640 1 -- 172.21.15.50:0/4044748092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80804ad40 con 0x557a56f69740 2024-05-07T13:56:31.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc816458640 1 -- 172.21.15.50:0/4044748092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808052590 con 0x557a56f69740 2024-05-07T13:56:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc81af23800 1 -- 172.21.15.50:0/4044748092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 msgr2=0x557a56f69b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc81af23800 1 --2- 172.21.15.50:0/4044748092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a56f69b60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc80800a470 tx=0x7fc80801ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc81af23800 1 -- 172.21.15.50:0/4044748092 shutdown_connections 2024-05-07T13:56:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc81af23800 1 --2- 172.21.15.50:0/4044748092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a56f69b60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc81af23800 1 -- 172.21.15.50:0/4044748092 >> 172.21.15.50:0/4044748092 conn(0x557a56f64d20 msgr2=0x557a56f67140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc81af23800 1 -- 172.21.15.50:0/4044748092 shutdown_connections 2024-05-07T13:56:31.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.035+0000 7fc81af23800 1 -- 172.21.15.50:0/4044748092 wait complete. 2024-05-07T13:56:31.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.050+0000 7fc81af23800 1 Processor -- start 2024-05-07T13:56:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.051+0000 7fc81af23800 1 -- start start 2024-05-07T13:56:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.051+0000 7fc81af23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a56f72740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.051+0000 7fc81af23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a56eb61c0 con 0x557a56f69740 2024-05-07T13:56:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.051+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a56f72740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.051+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a56f72740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44952/0 (socket says 172.21.15.50:44952) 2024-05-07T13:56:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.051+0000 7fc816c59640 1 -- 172.21.15.50:0/4121721344 learned_addr learned my addr 172.21.15.50:0/4121721344 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.051+0000 7fc816c59640 1 -- 172.21.15.50:0/4121721344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a5705f520 con 0x557a56f69740 2024-05-07T13:56:31.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.052+0000 7fc816c59640 1 --2- 172.21.15.50:0/4121721344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a56f72740 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc80801ced0 tx=0x7fc80804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3bfc89a5940ab8 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.052+0000 7fc704e09640 1 -- 172.21.15.50:0/4121721344 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808057040 con 0x557a56f69740 2024-05-07T13:56:31.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.052+0000 7fc704e09640 1 -- 172.21.15.50:0/4121721344 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc808063070 con 0x557a56f69740 2024-05-07T13:56:31.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.052+0000 7fc704e09640 1 -- 172.21.15.50:0/4121721344 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808052830 con 0x557a56f69740 2024-05-07T13:56:31.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.052+0000 7fc81af23800 1 -- 172.21.15.50:0/4121721344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 msgr2=0x557a56f72740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.052+0000 7fc81af23800 1 --2- 172.21.15.50:0/4121721344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a56f72740 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc80801ced0 tx=0x7fc80804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.052+0000 7fc81af23800 1 -- 172.21.15.50:0/4121721344 shutdown_connections 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.052+0000 7fc81af23800 1 --2- 172.21.15.50:0/4121721344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a56f72740 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.052+0000 7fc81af23800 1 -- 172.21.15.50:0/4121721344 >> 172.21.15.50:0/4121721344 conn(0x557a56f64d20 msgr2=0x557a57057010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc81af23800 1 -- 172.21.15.50:0/4121721344 shutdown_connections 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc81af23800 1 -- 172.21.15.50:0/4121721344 wait complete. 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc81af23800 1 Processor -- start 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc81af23800 1 -- start start 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc81af23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a57064130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc81af23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a56ece090 con 0x557a56f69740 2024-05-07T13:56:31.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a57064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a57064130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44956/0 (socket says 172.21.15.50:44956) 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc816c59640 1 -- 172.21.15.50:0/1808241649 learned_addr learned my addr 172.21.15.50:0/1808241649 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.053+0000 7fc816c59640 1 -- 172.21.15.50:0/1808241649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a57064670 con 0x557a56f69740 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.054+0000 7fc816c59640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a57064130 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc808052460 tx=0x7fc808002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.054+0000 7fc703606640 1 -- 172.21.15.50:0/1808241649 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80806d070 con 0x557a56f69740 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.054+0000 7fc703606640 1 -- 172.21.15.50:0/1808241649 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80805d470 con 0x557a56f69740 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.054+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a57064900 con 0x557a56f69740 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.054+0000 7fc703606640 1 -- 172.21.15.50:0/1808241649 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808057050 con 0x557a56f69740 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.054+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a57067560 con 0x557a56f69740 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.055+0000 7fc703606640 1 -- 172.21.15.50:0/1808241649 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc80805d790 con 0x557a56f69740 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.055+0000 7fc703606640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6fc036950 0x7fc6fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.055+0000 7fc703606640 1 -- 172.21.15.50:0/1808241649 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc80808d950 con 0x557a56f69740 2024-05-07T13:56:31.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.055+0000 7fc80ffff640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6fc036950 0x7fc6fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.055+0000 7fc81af23800 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a56f6a9a0 0x557a5706b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.055+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a5706b900 con 0x557a56f6a9a0 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.055+0000 7fc81745a640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a56f6a9a0 0x557a5706b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.056+0000 7fc80ffff640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6fc036950 0x7fc6fc038e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc800000f60 tx=0x7fc8000012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.056+0000 7fc81745a640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a56f6a9a0 0x557a5706b320 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.056+0000 7fc81745a640 1 -- 172.21.15.50:0/1808241649 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a56f6a9a0 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.056+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570688f0 con 0x557a56f6a9a0 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.056+0000 7fc81745a640 1 -- 172.21.15.50:0/1808241649 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a56f6a9a0 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.056+0000 7fc81af23800 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a5706dc50 0x557a57070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.056+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570706e0 con 0x557a5706dc50 2024-05-07T13:56:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.057+0000 7fc816c59640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a5706dc50 0x557a57070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.057+0000 7fc816c59640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a5706dc50 0x557a57070040 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.057+0000 7fc816c59640 1 -- 172.21.15.50:0/1808241649 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc80805a040 con 0x557a5706dc50 2024-05-07T13:56:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.057+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a5706cc00 con 0x557a56f6a9a0 2024-05-07T13:56:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.058+0000 7fc81745a640 1 -- 172.21.15.50:0/1808241649 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a56f6a9a0 2024-05-07T13:56:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.058+0000 7fc81af23800 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557a57071b90 0x557a57073fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.058+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a57074740 con 0x557a57071b90 2024-05-07T13:56:31.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.058+0000 7fc80ffff640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557a57071b90 0x557a57073fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.058+0000 7fc80ffff640 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557a57071b90 0x557a57073fe0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.059+0000 7fc80ffff640 1 -- 172.21.15.50:0/1808241649 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc800009050 con 0x557a57071b90 2024-05-07T13:56:31.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.059+0000 7fc81af23800 1 Processor -- start 2024-05-07T13:56:31.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.059+0000 7fc81af23800 1 -- start start 2024-05-07T13:56:31.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.059+0000 7fc81af23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a5705d0d0 0x557a5705b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.059+0000 7fc81af23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a56e5ccf0 con 0x557a5705d0d0 2024-05-07T13:56:31.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.059+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a5705d0d0 0x557a5705b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.059+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a5705d0d0 0x557a5705b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44962/0 (socket says 172.21.15.50:44962) 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.059+0000 7fc816c59640 1 -- 172.21.15.50:0/473839416 learned_addr learned my addr 172.21.15.50:0/473839416 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.060+0000 7fc816c59640 1 -- 172.21.15.50:0/473839416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a5705ba80 con 0x557a5705d0d0 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.060+0000 7fc816c59640 1 --2- 172.21.15.50:0/473839416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a5705d0d0 0x557a5705b540 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc80808bd40 tx=0x7fc808067a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.060+0000 7fc700e01640 1 -- 172.21.15.50:0/473839416 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808085a90 con 0x557a5705d0d0 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.060+0000 7fc700e01640 1 -- 172.21.15.50:0/473839416 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc808085c30 con 0x557a5705d0d0 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.060+0000 7fc700e01640 1 -- 172.21.15.50:0/473839416 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80805da80 con 0x557a5705d0d0 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.060+0000 7fc81af23800 1 -- 172.21.15.50:0/473839416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a5705bd10 con 0x557a5705d0d0 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.060+0000 7fc81af23800 1 -- 172.21.15.50:0/473839416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a5705c210 con 0x557a5705d0d0 2024-05-07T13:56:31.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.061+0000 7fc700e01640 1 -- 172.21.15.50:0/473839416 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc80805dc20 con 0x557a5705d0d0 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.061+0000 7fc700e01640 1 --2- 172.21.15.50:0/473839416 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6f0036950 0x7fc6f0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.061+0000 7fc700e01640 1 -- 172.21.15.50:0/473839416 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc80807b040 con 0x557a5705d0d0 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.061+0000 7fc80ffff640 1 --2- 172.21.15.50:0/473839416 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6f0036950 0x7fc6f0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.061+0000 7fc81af23800 1 Processor -- start 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.062+0000 7fc81af23800 1 -- start start 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.062+0000 7fc80ffff640 1 --2- 172.21.15.50:0/473839416 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6f0036950 0x7fc6f0038e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc80000bf50 tx=0x7fc80000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.062+0000 7fc81af23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57092300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.062+0000 7fc81af23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a5705f7b0 con 0x557a57091ee0 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.062+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57092300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.062+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57092300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44978/0 (socket says 172.21.15.50:44978) 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.062+0000 7fc816c59640 1 -- 172.21.15.50:0/180766036 learned_addr learned my addr 172.21.15.50:0/180766036 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.062+0000 7fc816c59640 1 -- 172.21.15.50:0/180766036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a570928d0 con 0x557a57091ee0 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.062+0000 7fc816c59640 1 --2- 172.21.15.50:0/180766036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57092300 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc80808ffd0 tx=0x7fc808066910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fe6de7a1caddec server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc6fa7fc640 1 -- 172.21.15.50:0/180766036 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8080a6070 con 0x557a57091ee0 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc6fa7fc640 1 -- 172.21.15.50:0/180766036 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc808054e60 con 0x557a57091ee0 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc6fa7fc640 1 -- 172.21.15.50:0/180766036 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc808007ef0 con 0x557a57091ee0 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc81af23800 1 -- 172.21.15.50:0/180766036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 msgr2=0x557a57092300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc81af23800 1 --2- 172.21.15.50:0/180766036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57092300 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc80808ffd0 tx=0x7fc808066910 comp rx=0 tx=0).stop 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc81af23800 1 -- 172.21.15.50:0/180766036 shutdown_connections 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc81af23800 1 --2- 172.21.15.50:0/180766036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57092300 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc81af23800 1 -- 172.21.15.50:0/180766036 >> 172.21.15.50:0/180766036 conn(0x557a5708e240 msgr2=0x557a5708c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc81af23800 1 -- 172.21.15.50:0/180766036 shutdown_connections 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc81af23800 1 -- 172.21.15.50:0/180766036 wait complete. 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.063+0000 7fc81af23800 1 Processor -- start 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.064+0000 7fc81af23800 1 -- start start 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.064+0000 7fc81af23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57099350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.064+0000 7fc81af23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a57092f80 con 0x557a57091ee0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.064+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57099350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.064+0000 7fc816c59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57099350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:44988/0 (socket says 172.21.15.50:44988) 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.064+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 learned_addr learned my addr 172.21.15.50:0/3492152369 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.064+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a57099890 con 0x557a57091ee0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.065+0000 7fc816c59640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57099350 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc808055010 tx=0x7fc80806aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.065+0000 7fc6f8ff9640 1 -- 172.21.15.50:0/3492152369 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8080af020 con 0x557a57091ee0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.065+0000 7fc6f8ff9640 1 -- 172.21.15.50:0/3492152369 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8080a7040 con 0x557a57091ee0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.065+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a57099890 con 0x557a57091ee0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.065+0000 7fc6f8ff9640 1 -- 172.21.15.50:0/3492152369 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8080a6050 con 0x557a57091ee0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.065+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a57099890 con 0x557a57091ee0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.066+0000 7fc6f8ff9640 1 -- 172.21.15.50:0/3492152369 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc8080b2020 con 0x557a57091ee0 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.066+0000 7fc6f8ff9640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6e0036900 0x7fc6e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.066+0000 7fc6f8ff9640 1 -- 172.21.15.50:0/3492152369 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc80809d030 con 0x557a57091ee0 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.066+0000 7fc80ffff640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6e0036900 0x7fc6e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.066+0000 7fc80ffff640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6e0036900 0x7fc6e0038dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc800001b60 tx=0x7fc800010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.066+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a570a4a90 0x557a570a6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570a76a0 con 0x557a570a4a90 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81745a640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a570a4a90 0x557a570a6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81745a640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a570a4a90 0x557a570a6f50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a570a4a90 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 20 realm 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570a7ab0 con 0x557a570a4a90 2024-05-07T13:56:31.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a570a4a90 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.067+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8380 con 0x557a570a4a90 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a570a4a90 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc81af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a4a90 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a570a4a90 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc81af23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc81af23800 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a570a9480 0x557a570ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570abe80 con 0x557a570a9480 2024-05-07T13:56:31.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc816c59640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a570a9480 0x557a570ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.068+0000 7fc816c59640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a570a9480 0x557a570ab870 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.069+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.069+0000 7fc81af23800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.069+0000 7fc81af23800 20 searching for the correct realm 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.069+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570ad7b0 con 0x557a570a9480 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.069+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.069+0000 7fc816c59640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc8080b4020 0x7fc808078660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.069+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570ad7b0 con 0x7fc8080b4020 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.069+0000 7fc80ffff640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc8080b4020 0x7fc808078660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.070+0000 7fc80ffff640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc8080b4020 0x7fc808078660 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.070+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800009050 con 0x7fc8080b4020 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.070+0000 7fc80ffff640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc800038040 0x7fc80001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.070+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570ad7b0 con 0x7fc800038040 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.070+0000 7fc81745a640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc800038040 0x7fc80001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.071+0000 7fc81745a640 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc800038040 0x7fc80001bab0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.071+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81000a4a0 con 0x7fc800038040 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.071+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a4a90 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.071+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a570a4a90 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.071+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a4a90 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.071+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a570a4a90 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.071+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc800038040 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.072+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81000a4a0 con 0x7fc800038040 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.072+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc800038040 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.072+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc81000a4a0 con 0x7fc800038040 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.072+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc8080b4020 2024-05-07T13:56:31.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.072+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800009050 con 0x7fc8080b4020 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.072+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a9480 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.072+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.072+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a4a90 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.073+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a570a4a90 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.073+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc800038040 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.073+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81000a4a0 con 0x7fc800038040 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.073+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a4a90 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.073+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a570a4a90 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.073+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc8080b4020 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.074+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc800009050 con 0x7fc8080b4020 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.074+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a9480 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.074+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.074+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a9480 2024-05-07T13:56:31.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.074+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.074+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc800038040 2024-05-07T13:56:31.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.074+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81000a4a0 con 0x7fc800038040 2024-05-07T13:56:31.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.074+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a9480 2024-05-07T13:56:31.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.075+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.075+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a9480 2024-05-07T13:56:31.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.075+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.075+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a4a90 2024-05-07T13:56:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.075+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81000a4a0 con 0x557a570a4a90 2024-05-07T13:56:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.075+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a4a90 2024-05-07T13:56:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.075+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.075+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc800038040 2024-05-07T13:56:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.076+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.076+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a9480 2024-05-07T13:56:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.076+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.076+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc8080b4020 2024-05-07T13:56:31.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.076+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800009050 con 0x7fc8080b4020 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.076+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a4a90 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.076+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.076+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc800038040 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.077+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.077+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a9480 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.077+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.077+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc800038040 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.077+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.077+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc8080b4020 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.078+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800009050 con 0x7fc8080b4020 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.078+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a9480 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.078+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.078+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc800038040 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.078+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.078+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x557a570a4a90 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557a570a8720 con 0x7fc8080b4020 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ac740 con 0x557a570a4a90 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570acb30 con 0x557a570a4a90 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.079+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570acb30 con 0x7fc800038040 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 20 zone default found 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 4 Realm: () 2024-05-07T13:56:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 20 zonegroup default 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570adc30 con 0x7fc800038040 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570af610 con 0x557a570a9480 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.080+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.081+0000 7fc81af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.081+0000 7fc81af23800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.081+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570af9b0 con 0x557a570a9480 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.081+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.081+0000 7fc81af23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.081+0000 7fc81af23800 20 started sync module instance, tier type = 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.081+0000 7fc81af23800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.081+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570aeab0 con 0x7fc8080b4020 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.082+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.082+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93983934703104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570afd50 con 0x7fc8080b4020 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.082+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b0640 con 0x557a570a4a90 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.083+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93983934703104] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.083+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.083+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93983934710000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b0a30 con 0x557a570a4a90 2024-05-07T13:56:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.083+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b1490 con 0x557a570a9480 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.084+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.084+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93983934713712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b1490 con 0x557a570a9480 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.084+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b2450 con 0x7fc8080b4020 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.084+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93983934710000] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.085+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93983934713712] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.086+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.086+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93983934716032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570aeed0 con 0x7fc8080b4020 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.086+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b2cf0 con 0x557a570a4a90 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.087+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93983934716032] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.087+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.087+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93983934720064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b2c60 con 0x557a570a4a90 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.087+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b3be0 con 0x7fc800038040 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.088+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93983934720064] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.088+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.088+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93983934722176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b3be0 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.088+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b45a0 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.089+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93983934722176] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.089+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.089+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93983934723888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b45a0 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.089+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b4fa0 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93983934723888] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93983934728880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b45a0 con 0x7fc800038040 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81af23800 20 add_watcher() i=0 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81af23800 20 add_watcher() i=1 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81af23800 20 add_watcher() i=2 2024-05-07T13:56:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81af23800 20 add_watcher() i=3 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81af23800 20 add_watcher() i=4 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81af23800 20 add_watcher() i=5 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.090+0000 7fc81af23800 20 add_watcher() i=6 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.092+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93983934728880] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.092+0000 7fc81af23800 20 add_watcher() i=7 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.092+0000 7fc81af23800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.092+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570b83c0 con 0x557a570a4a90 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.092+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.092+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93983934726848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b5890 con 0x557a570a4a90 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.093+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93983934726848] v27'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.093+0000 7fc6cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.093+0000 7fc81af23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:31.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.093+0000 7fc81af23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:31.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.093+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b8080 con 0x557a570a4a90 2024-05-07T13:56:31.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.094+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.094+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c1410 con 0x7fc800038040 2024-05-07T13:56:31.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.096+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.096+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c1410 con 0x557a570a9480 2024-05-07T13:56:31.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.097+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'21 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.097+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c18c0 con 0x557a570a4a90 2024-05-07T13:56:31.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.098+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'158 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.098+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c1e30 con 0x7fc8080b4020 2024-05-07T13:56:31.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.099+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.099+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c26a0 con 0x557a570a9480 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.100+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.100+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c26a0 con 0x557a570a4a90 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.101+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.101+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c26a0 con 0x7fc800038040 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.102+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.102+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c2730 con 0x7fc8080b4020 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.103+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.103+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c2d00 con 0x557a570a9480 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.104+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.104+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c2d00 con 0x7fc8080b4020 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.105+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.105+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3270 con 0x7fc800038040 2024-05-07T13:56:31.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.106+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.106+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3270 con 0x7fc8080b4020 2024-05-07T13:56:31.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.107+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.107+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3500 con 0x7fc800038040 2024-05-07T13:56:31.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.109+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'37 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.109+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3500 con 0x557a570a4a90 2024-05-07T13:56:31.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.110+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.110+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3500 con 0x557a570a9480 2024-05-07T13:56:31.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.111+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.111+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3500 con 0x7fc8080b4020 2024-05-07T13:56:31.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.112+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.112+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a9480 2024-05-07T13:56:31.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.113+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.113+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a4a90 2024-05-07T13:56:31.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.114+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.114+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a4a90 2024-05-07T13:56:31.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.115+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.115+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a9480 2024-05-07T13:56:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.116+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.116+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x7fc8080b4020 2024-05-07T13:56:31.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.117+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.117+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a9480 2024-05-07T13:56:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.118+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.118+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a9480 2024-05-07T13:56:31.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.119+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.119+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a9480 2024-05-07T13:56:31.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.120+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.120+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a9480 2024-05-07T13:56:31.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.121+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.121+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x7fc800038040 2024-05-07T13:56:31.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.122+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.122+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a9480 2024-05-07T13:56:31.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.124+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.124+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x7fc800038040 2024-05-07T13:56:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.125+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.125+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x557a570a9480 2024-05-07T13:56:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.126+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.126+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x7fc800038040 2024-05-07T13:56:31.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.127+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.127+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570c3590 con 0x7fc8080b4020 2024-05-07T13:56:31.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.128+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.128+0000 7fc647fff640 20 reqs_thread_entry: start 2024-05-07T13:56:31.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.128+0000 7fc81af23800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:31.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.128+0000 7fc81af23800 20 Filter name: none 2024-05-07T13:56:31.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.129+0000 7fc645ffb640 20 reqs_thread_entry: start 2024-05-07T13:56:31.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.129+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-05-07T13:56:31.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.129+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:94 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.130+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(94 gc.27 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.130+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:95 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.130+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(95 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.130+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.130+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:96 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ee890 con 0x557a570a9480 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.130+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(96 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.130+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.131+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== osd_op_reply(97 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.131+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.131+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.131+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(98 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.131+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.131+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:99 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.132+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 32 ==== osd_op_reply(99 gc.27 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.132+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-05-07T13:56:31.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.132+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.133+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(100 gc.28 [call] v27'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.133+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.133+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(101 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.133+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.133+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ee890 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.133+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(102 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.133+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.134+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(103 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.134+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.134+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:104 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.134+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(104 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.134+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.134+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:105 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.135+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(105 gc.28 [call] v27'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.135+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.135+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:106 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.136+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 33 ==== osd_op_reply(106 gc.29 [call] v27'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.136+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:107 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.136+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 34 ==== osd_op_reply(107 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.136+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.136+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:108 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ee890 con 0x557a570a9480 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.137+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 35 ==== osd_op_reply(108 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.137+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:109 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.137+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 36 ==== osd_op_reply(109 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.137+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.137+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:110 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.137+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 37 ==== osd_op_reply(110 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.137+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.137+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:111 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.138+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 38 ==== osd_op_reply(111 gc.29 [call] v27'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.138+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-05-07T13:56:31.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.138+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:112 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.139+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== osd_op_reply(112 gc.30 [call] v27'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.139+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:113 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.140+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== osd_op_reply(113 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.140+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.140+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:114 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ee890 con 0x7fc800038040 2024-05-07T13:56:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.140+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== osd_op_reply(114 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.140+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:115 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.141+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== osd_op_reply(115 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.141+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.141+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:116 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.141+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(116 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.141+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.141+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:117 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.142+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== osd_op_reply(117 gc.30 [call] v27'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.142+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-05-07T13:56:31.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.142+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:118 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc8080b4020 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.143+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(118 gc.31 [call] v27'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.143+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:119 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc8080b4020 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(119 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:120 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ee890 con 0x7fc8080b4020 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(120 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:121 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc8080b4020 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(121 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:122 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc8080b4020 2024-05-07T13:56:31.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(122 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.144+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:123 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc8080b4020 2024-05-07T13:56:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.145+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(123 gc.31 [call] v27'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.145+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-05-07T13:56:31.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.145+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:124 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a4a90 2024-05-07T13:56:31.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.146+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(124 gc.0 [call] v27'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.147+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:125 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a4a90 2024-05-07T13:56:31.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.147+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(125 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.147+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.147+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:126 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ee890 con 0x557a570a4a90 2024-05-07T13:56:31.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.147+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(126 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.147+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:127 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a4a90 2024-05-07T13:56:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.148+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(127 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.148+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.148+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:128 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a4a90 2024-05-07T13:56:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.148+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(128 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.148+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.148+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:129 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a4a90 2024-05-07T13:56:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.149+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(129 gc.0 [call] v27'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.149+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-05-07T13:56:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.149+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:130 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.150+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== osd_op_reply(130 gc.1 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.150+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:131 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.151+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 38 ==== osd_op_reply(131 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.151+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.151+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:132 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ee890 con 0x7fc800038040 2024-05-07T13:56:31.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.151+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 39 ==== osd_op_reply(132 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.151+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:133 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.151+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 40 ==== osd_op_reply(133 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.151+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.151+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:134 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.152+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 41 ==== osd_op_reply(134 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.152+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.152+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:135 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x7fc800038040 2024-05-07T13:56:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.153+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 42 ==== osd_op_reply(135 gc.1 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.153+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-05-07T13:56:31.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.153+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:136 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.154+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 39 ==== osd_op_reply(136 gc.2 [call] v27'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.154+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:137 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 40 ==== osd_op_reply(137 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:138 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ee890 con 0x557a570a9480 2024-05-07T13:56:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 41 ==== osd_op_reply(138 gc.2 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:139 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 42 ==== osd_op_reply(139 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:140 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570ef8a0 con 0x557a570a9480 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 43 ==== osd_op_reply(140 gc.2 [call out=1701b] v0'0 uv22 ondisk = 0) ==== 148+0+1701 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 20 garbage collection: RGWGC::process iterating over entry tag='2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.6873624326850858278', time=2024-05-07T13:56:30.775968+0000, chain.objs.size()=7 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_1 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:141 3.38s0 3:1e292254:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570edb90 con 0x7fc800038040 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_2 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:142 3.es0 3:7310c138:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570edb90 con 0x7fc8080b4020 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.155+0000 7fc81af23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_3 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.156+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:143 3.16s0 3:68efc846:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f5260 con 0x7fc8080b4020 2024-05-07T13:56:31.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.156+0000 7fc81af23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_4 2024-05-07T13:56:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.156+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:144 3.37s0 3:efbf26a5:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f5260 con 0x557a570a4a90 2024-05-07T13:56:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.156+0000 7fc81af23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_5 2024-05-07T13:56:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.156+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:145 3.29s0 3:9746e264:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570fa0e0 con 0x7fc800038040 2024-05-07T13:56:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.156+0000 7fc81af23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_6 2024-05-07T13:56:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.156+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:146 3.19s0 3:9af31207:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570fc950 con 0x557a570a4a90 2024-05-07T13:56:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.156+0000 7fc81af23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_7 2024-05-07T13:56:31.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.156+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:147 3.22s0 3:461b9f40:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570fee20 con 0x557a570a9480 2024-05-07T13:56:31.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.158+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 43 ==== osd_op_reply(141 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_1 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.158+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 44 ==== osd_op_reply(145 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_5 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.158+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 44 ==== osd_op_reply(147 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_7 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.160+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== osd_op_reply(143 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_3 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.160+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== osd_op_reply(142 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_2 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.160+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(146 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_6 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.160+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(144 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.1__shadow_.R-8RdlhwmAC43gyyUp9OsC1_Q4zOc4M_4 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.160+0000 7fc81af23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-07T13:56:31.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.160+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:148 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f76a0 con 0x557a570a9480 2024-05-07T13:56:31.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.162+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 45 ==== osd_op_reply(148 gc.2 [call] v27'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.162+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:149 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f76a0 con 0x557a570a9480 2024-05-07T13:56:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.163+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 46 ==== osd_op_reply(149 gc.2 [call] v27'24 uv24 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.163+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-05-07T13:56:31.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.163+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:150 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f76a0 con 0x557a570a4a90 2024-05-07T13:56:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.164+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 35 ==== osd_op_reply(150 gc.3 [call] v27'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.164+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:151 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75e0 con 0x557a570a4a90 2024-05-07T13:56:31.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.164+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 36 ==== osd_op_reply(151 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.164+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.164+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:152 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f65d0 con 0x557a570a4a90 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.164+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 37 ==== osd_op_reply(152 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.165+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:153 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75e0 con 0x557a570a4a90 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.165+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 38 ==== osd_op_reply(153 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.165+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.165+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:154 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75e0 con 0x557a570a4a90 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.165+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 39 ==== osd_op_reply(154 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.165+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.165+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:155 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75e0 con 0x557a570a4a90 2024-05-07T13:56:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.166+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 40 ==== osd_op_reply(155 gc.3 [call] v27'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.166+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-05-07T13:56:31.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.166+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:156 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.167+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 26 ==== osd_op_reply(156 gc.4 [call] v27'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.167+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:157 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.167+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 27 ==== osd_op_reply(157 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.167+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.167+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:158 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc8080b4020 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.168+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 28 ==== osd_op_reply(158 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.168+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:159 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.168+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 29 ==== osd_op_reply(159 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.168+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.168+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:160 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.168+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 30 ==== osd_op_reply(160 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.168+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.168+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:161 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.169+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 31 ==== osd_op_reply(161 gc.4 [call] v27'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.169+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.169+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:162 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.170+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 47 ==== osd_op_reply(162 gc.5 [call] v27'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.170+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:163 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.170+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 48 ==== osd_op_reply(163 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.170+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.170+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:164 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a9480 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.170+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 49 ==== osd_op_reply(164 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.171+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:165 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.171+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 50 ==== osd_op_reply(165 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.171+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.171+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:166 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.171+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 51 ==== osd_op_reply(166 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.171+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.171+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:167 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.172+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 52 ==== osd_op_reply(167 gc.5 [call] v27'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.172+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-05-07T13:56:31.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.172+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:168 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.173+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 41 ==== osd_op_reply(168 gc.6 [call] v27'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.173+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:169 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 42 ==== osd_op_reply(169 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:170 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a4a90 2024-05-07T13:56:31.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 43 ==== osd_op_reply(170 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:171 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 44 ==== osd_op_reply(171 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:172 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 45 ==== osd_op_reply(172 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.174+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:173 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.175+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 46 ==== osd_op_reply(173 gc.6 [call] v27'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.175+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-05-07T13:56:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.175+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:174 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 45 ==== osd_op_reply(174 gc.7 [call] v27'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:175 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 46 ==== osd_op_reply(175 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:176 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc800038040 2024-05-07T13:56:31.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 47 ==== osd_op_reply(176 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:177 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 48 ==== osd_op_reply(177 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.177+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:178 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.178+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 49 ==== osd_op_reply(178 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.178+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.178+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:179 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.179+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 50 ==== osd_op_reply(179 gc.7 [call] v27'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.179+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-05-07T13:56:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.179+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:180 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 32 ==== osd_op_reply(180 gc.8 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:181 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 33 ==== osd_op_reply(181 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:182 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc8080b4020 2024-05-07T13:56:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 34 ==== osd_op_reply(182 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:183 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 35 ==== osd_op_reply(183 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.180+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:184 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.181+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 36 ==== osd_op_reply(184 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.181+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.181+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:185 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.182+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 37 ==== osd_op_reply(185 gc.8 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.182+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-05-07T13:56:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.182+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:186 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 53 ==== osd_op_reply(186 gc.9 [call] v27'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:187 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 54 ==== osd_op_reply(187 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:188 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a9480 2024-05-07T13:56:31.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 55 ==== osd_op_reply(188 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:189 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 56 ==== osd_op_reply(189 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.183+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:190 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.184+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 57 ==== osd_op_reply(190 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.184+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.184+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:191 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.184+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 58 ==== osd_op_reply(191 gc.9 [call] v27'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.185+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-05-07T13:56:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.185+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:192 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 38 ==== osd_op_reply(192 gc.10 [call] v27'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:193 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 39 ==== osd_op_reply(193 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:194 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc8080b4020 2024-05-07T13:56:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 40 ==== osd_op_reply(194 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:195 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 41 ==== osd_op_reply(195 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.186+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:196 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.187+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 42 ==== osd_op_reply(196 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.187+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.187+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:197 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.187+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 43 ==== osd_op_reply(197 gc.10 [call] v27'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.188+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-05-07T13:56:31.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.188+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:198 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.189+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 51 ==== osd_op_reply(198 gc.11 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.189+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:199 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.189+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 52 ==== osd_op_reply(199 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.189+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.189+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:200 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc800038040 2024-05-07T13:56:31.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.190+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 53 ==== osd_op_reply(200 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.190+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:201 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.190+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 54 ==== osd_op_reply(201 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.190+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.190+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:202 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.191+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 55 ==== osd_op_reply(202 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.191+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.191+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:203 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.192+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 56 ==== osd_op_reply(203 gc.11 [call] v27'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.192+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-05-07T13:56:31.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.192+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:204 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 44 ==== osd_op_reply(204 gc.12 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:205 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 45 ==== osd_op_reply(205 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:206 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc8080b4020 2024-05-07T13:56:31.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 46 ==== osd_op_reply(206 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:207 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 47 ==== osd_op_reply(207 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.193+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:208 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.194+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 48 ==== osd_op_reply(208 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.194+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.194+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:209 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.194+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 49 ==== osd_op_reply(209 gc.12 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.195+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-05-07T13:56:31.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.195+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:210 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.196+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 57 ==== osd_op_reply(210 gc.13 [call] v27'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.196+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:211 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.196+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 58 ==== osd_op_reply(211 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.196+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.196+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:212 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc800038040 2024-05-07T13:56:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.196+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 59 ==== osd_op_reply(212 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.196+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:213 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.197+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 60 ==== osd_op_reply(213 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.197+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.197+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:214 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.197+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 61 ==== osd_op_reply(214 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.197+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.197+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:215 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.198+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 62 ==== osd_op_reply(215 gc.13 [call] v27'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.198+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-05-07T13:56:31.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.198+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:216 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.199+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 47 ==== osd_op_reply(216 gc.14 [call] v27'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.199+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:217 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.199+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 48 ==== osd_op_reply(217 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.199+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.199+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:218 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a4a90 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.199+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 49 ==== osd_op_reply(218 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.199+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:219 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.200+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 50 ==== osd_op_reply(219 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.200+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.200+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:220 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.200+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 51 ==== osd_op_reply(220 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.200+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.200+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:221 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.201+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 52 ==== osd_op_reply(221 gc.14 [call] v27'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.201+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-05-07T13:56:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.201+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:222 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.202+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 59 ==== osd_op_reply(222 gc.15 [call] v27'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.202+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:223 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.202+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 60 ==== osd_op_reply(223 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.202+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.202+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:224 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a9480 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.202+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 61 ==== osd_op_reply(224 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.202+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:225 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.202+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 62 ==== osd_op_reply(225 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.203+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.203+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:226 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.203+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 63 ==== osd_op_reply(226 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.203+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.203+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:227 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.204+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 64 ==== osd_op_reply(227 gc.15 [call] v27'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.204+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-05-07T13:56:31.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.204+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:228 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 50 ==== osd_op_reply(228 gc.16 [call] v27'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:229 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 51 ==== osd_op_reply(229 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:230 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc8080b4020 2024-05-07T13:56:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 52 ==== osd_op_reply(230 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:231 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 53 ==== osd_op_reply(231 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.205+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:232 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.206+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 54 ==== osd_op_reply(232 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.206+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.206+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:233 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.207+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 55 ==== osd_op_reply(233 gc.16 [call] v27'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.207+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-05-07T13:56:31.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.207+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:234 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 65 ==== osd_op_reply(234 gc.17 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:235 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 66 ==== osd_op_reply(235 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:236 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a9480 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 67 ==== osd_op_reply(236 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:237 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 68 ==== osd_op_reply(237 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.208+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:238 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.209+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 69 ==== osd_op_reply(238 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.209+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.209+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:239 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.210+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 70 ==== osd_op_reply(239 gc.17 [call] v27'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.210+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.210+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:240 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 53 ==== osd_op_reply(240 gc.18 [call] v27'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:241 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 54 ==== osd_op_reply(241 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:242 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a4a90 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 55 ==== osd_op_reply(242 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:243 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 56 ==== osd_op_reply(243 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.211+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:244 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.212+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 57 ==== osd_op_reply(244 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.212+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.212+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:245 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.213+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 58 ==== osd_op_reply(245 gc.18 [call] v27'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.213+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-05-07T13:56:31.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.213+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:246 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.214+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 59 ==== osd_op_reply(246 gc.19 [call] v27'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.214+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:247 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.214+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 60 ==== osd_op_reply(247 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.214+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.214+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:248 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a4a90 2024-05-07T13:56:31.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.214+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 61 ==== osd_op_reply(248 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.214+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:249 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.215+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 62 ==== osd_op_reply(249 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.215+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.215+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:250 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.215+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 63 ==== osd_op_reply(250 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.215+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.215+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:251 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a4a90 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.216+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 64 ==== osd_op_reply(251 gc.19 [call] v27'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.216+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-05-07T13:56:31.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.216+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:252 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.217+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 71 ==== osd_op_reply(252 gc.20 [call] v27'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.217+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:253 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.217+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 72 ==== osd_op_reply(253 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:254 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a9480 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 73 ==== osd_op_reply(254 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:255 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 74 ==== osd_op_reply(255 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:256 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 75 ==== osd_op_reply(256 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.218+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:257 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.219+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 76 ==== osd_op_reply(257 gc.20 [call] v27'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.219+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-05-07T13:56:31.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.219+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:258 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.220+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 56 ==== osd_op_reply(258 gc.21 [call] v27'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.220+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:259 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.221+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 57 ==== osd_op_reply(259 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.221+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.221+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:260 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc8080b4020 2024-05-07T13:56:31.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.221+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 58 ==== osd_op_reply(260 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.221+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:261 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.221+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 59 ==== osd_op_reply(261 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.221+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.221+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:262 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.222+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 60 ==== osd_op_reply(262 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.222+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.222+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:263 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc8080b4020 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.223+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 61 ==== osd_op_reply(263 gc.21 [call] v27'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.223+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.223+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:264 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.224+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 77 ==== osd_op_reply(264 gc.22 [call] v27'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.224+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:265 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.224+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 78 ==== osd_op_reply(265 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.224+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.224+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:266 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a9480 2024-05-07T13:56:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.224+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 79 ==== osd_op_reply(266 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.224+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:267 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.225+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 80 ==== osd_op_reply(267 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.225+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.225+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:268 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.225+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 81 ==== osd_op_reply(268 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.225+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.225+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:269 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.226+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 82 ==== osd_op_reply(269 gc.22 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.226+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-05-07T13:56:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.226+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:270 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.227+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 83 ==== osd_op_reply(270 gc.23 [call] v27'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.227+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:271 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.227+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 84 ==== osd_op_reply(271 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.227+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.227+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:272 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a9480 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.227+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 85 ==== osd_op_reply(272 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.227+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:273 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.228+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 86 ==== osd_op_reply(273 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.228+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.228+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:274 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.228+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 87 ==== osd_op_reply(274 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.228+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.228+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:275 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.229+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 88 ==== osd_op_reply(275 gc.23 [call] v27'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.229+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-05-07T13:56:31.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.229+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:276 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 89 ==== osd_op_reply(276 gc.24 [call] v27'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:277 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 90 ==== osd_op_reply(277 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:278 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a9480 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 91 ==== osd_op_reply(278 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:279 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 92 ==== osd_op_reply(279 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.230+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:280 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.231+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 93 ==== osd_op_reply(280 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.231+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.231+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:281 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.232+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 94 ==== osd_op_reply(281 gc.24 [call] v27'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.232+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-05-07T13:56:31.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.232+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:282 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 95 ==== osd_op_reply(282 gc.25 [call] v27'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:283 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 96 ==== osd_op_reply(283 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:284 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x557a570a9480 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 97 ==== osd_op_reply(284 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:285 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 98 ==== osd_op_reply(285 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.233+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:286 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.234+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 99 ==== osd_op_reply(286 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.234+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.234+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:287 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x557a570a9480 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.234+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 100 ==== osd_op_reply(287 gc.25 [call] v27'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.234+0000 7fc81af23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-05-07T13:56:31.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.234+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:288 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 63 ==== osd_op_reply(288 gc.26 [call] v27'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:289 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 64 ==== osd_op_reply(289 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:290 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f6590 con 0x7fc800038040 2024-05-07T13:56:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 65 ==== osd_op_reply(290 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:291 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 66 ==== osd_op_reply(291 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:56:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.236+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:292 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.237+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 67 ==== osd_op_reply(292 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.237+0000 7fc81af23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:56:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.237+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:293 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570f75a0 con 0x7fc800038040 2024-05-07T13:56:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.238+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 68 ==== osd_op_reply(293 gc.26 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.238+0000 7fc6cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:31.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.238+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93983934726848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ecdc0 con 0x557a570a4a90 2024-05-07T13:56:31.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.240+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93983934726848] v27'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.240+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93983934703104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b4290 con 0x7fc8080b4020 2024-05-07T13:56:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.241+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93983934703104] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.241+0000 7fc81af23800 20 remove_watcher() i=0 2024-05-07T13:56:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.241+0000 7fc81af23800 2 removed watcher, disabling cache 2024-05-07T13:56:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.241+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93983934710000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ae600 con 0x557a570a4a90 2024-05-07T13:56:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.242+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93983934710000] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.242+0000 7fc81af23800 20 remove_watcher() i=1 2024-05-07T13:56:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.242+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93983934713712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ae600 con 0x557a570a9480 2024-05-07T13:56:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.243+0000 7fc816c59640 1 -- 172.21.15.50:0/3492152369 <== osd.3 v2:172.21.15.50:6814/3553060046 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93983934713712] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8080a9070 con 0x557a570a9480 2024-05-07T13:56:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.243+0000 7fc81af23800 20 remove_watcher() i=2 2024-05-07T13:56:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.243+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93983934716032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b0f70 con 0x7fc8080b4020 2024-05-07T13:56:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.244+0000 7fc80ffff640 1 -- 172.21.15.50:0/3492152369 <== osd.2 v2:172.21.15.50:6808/2034796854 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93983934716032] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800045040 con 0x7fc8080b4020 2024-05-07T13:56:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.244+0000 7fc81af23800 20 remove_watcher() i=3 2024-05-07T13:56:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.244+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93983934720064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570ae600 con 0x557a570a4a90 2024-05-07T13:56:31.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.245+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.1 v2:172.21.15.50:6800/3441257969 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93983934720064] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x557a570a4a90 2024-05-07T13:56:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.245+0000 7fc81af23800 20 remove_watcher() i=4 2024-05-07T13:56:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.245+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93983934722176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b1880 con 0x7fc800038040 2024-05-07T13:56:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.246+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93983934722176] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.246+0000 7fc81af23800 20 remove_watcher() i=5 2024-05-07T13:56:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.246+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93983934723888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b0f70 con 0x7fc800038040 2024-05-07T13:56:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.247+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93983934723888] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.247+0000 7fc81af23800 20 remove_watcher() i=6 2024-05-07T13:56:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.247+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93983934728880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557a570b2840 con 0x7fc800038040 2024-05-07T13:56:31.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 <== osd.0 v2:172.21.15.22:6800/2215278347 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93983934728880] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81002f060 con 0x7fc800038040 2024-05-07T13:56:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 20 remove_watcher() i=7 2024-05-07T13:56:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc800038040 msgr2=0x7fc80001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc800038040 0x7fc80001bab0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a570a4a90 msgr2=0x557a570a6f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a570a4a90 0x557a570a6f50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc8080b4020 msgr2=0x7fc808078660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc8080b4020 0x7fc808078660 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a570a9480 msgr2=0x557a570ab870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a570a9480 0x557a570ab870 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6e0036900 msgr2=0x7fc6e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6e0036900 0x7fc6e0038dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc800001b60 tx=0x7fc800010000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 msgr2=0x557a57099350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81745a640 1 -- 172.21.15.50:0/3492152369 reap_dead start 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57099350 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc808055010 tx=0x7fc80806aec0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 shutdown_connections 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/3492152369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a57091ee0 0x557a57099350 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 >> 172.21.15.50:0/3492152369 conn(0x557a5708e240 msgr2=0x557a5708b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 shutdown_connections 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/3492152369 wait complete. 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/473839416 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6f0036950 msgr2=0x7fc6f0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/473839416 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6f0036950 0x7fc6f0038e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc80000bf50 tx=0x7fc80000f000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/473839416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a5705d0d0 msgr2=0x557a5705b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/473839416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a5705d0d0 0x557a5705b540 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc80808bd40 tx=0x7fc808067a40 comp rx=0 tx=0).stop 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/473839416 shutdown_connections 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/473839416 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6f0036950 0x7fc6f0038e10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 --2- 172.21.15.50:0/473839416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a5705d0d0 0x557a5705b540 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.249+0000 7fc81af23800 1 -- 172.21.15.50:0/473839416 >> 172.21.15.50:0/473839416 conn(0x557a57076c40 msgr2=0x557a57077040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/473839416 shutdown_connections 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/473839416 wait complete. 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557a57071b90 msgr2=0x557a57073fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557a57071b90 0x557a57073fe0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a56f6a9a0 msgr2=0x557a5706b320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557a56f6a9a0 0x557a5706b320 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a5706dc50 msgr2=0x557a57070040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557a5706dc50 0x557a57070040 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6fc036950 msgr2=0x7fc6fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6fc036950 0x7fc6fc038e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc800000f60 tx=0x7fc8000012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 msgr2=0x557a57064130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 --2- 172.21.15.50:0/1808241649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a56f69740 0x557a57064130 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc808052460 tx=0x7fc808002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81745a640 1 -- 172.21.15.50:0/1808241649 reap_dead start 2024-05-07T13:56:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 shutdown_connections 2024-05-07T13:56:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 >> 172.21.15.50:0/1808241649 conn(0x557a56f64d20 msgr2=0x557a57055810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 shutdown_connections 2024-05-07T13:56:31.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.250+0000 7fc81af23800 1 -- 172.21.15.50:0/1808241649 wait complete. 2024-05-07T13:56:31.247 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-07T13:56:31.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-07T13:56:31.247 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-07T13:56:31.332 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:31.333 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:31.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.346+0000 7f451ed38800 1 Processor -- start 2024-05-07T13:56:31.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.346+0000 7f451ed38800 1 -- start start 2024-05-07T13:56:31.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.346+0000 7f451ed38800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55dbd14e1a00 0x55dbd14e1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.346+0000 7f451ed38800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dbd1456a40 con 0x55dbd14e2360 2024-05-07T13:56:31.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.346+0000 7f451ed38800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55dbd1374050 con 0x55dbd14e1a00 2024-05-07T13:56:31.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.346+0000 7f451aa96640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55dbd14e1a00 0x55dbd14e1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.346+0000 7f4513fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55dbd14e2360 0x55dbd14e2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:44012/0 (socket says 172.21.15.50:44012) 2024-05-07T13:56:31.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.346+0000 7f4513fff640 1 -- 172.21.15.50:0/1377751202 learned_addr learned my addr 172.21.15.50:0/1377751202 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:31.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.347+0000 7f451aa96640 1 -- 172.21.15.50:0/1377751202 >> v1:172.21.15.22:6789/0 conn(0x55dbd14e2360 legacy=0x55dbd14e2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.347+0000 7f451aa96640 1 -- 172.21.15.50:0/1377751202 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd14e2f20 con 0x55dbd14e1a00 2024-05-07T13:56:31.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.349+0000 7f451aa96640 1 --2- 172.21.15.50:0/1377751202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd14e1e20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f450c00a470 tx=0x7f450c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daeda7d8e59a00c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.350+0000 7f451a295640 1 -- 172.21.15.50:0/1377751202 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c057070 con 0x55dbd14e1a00 2024-05-07T13:56:31.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.350+0000 7f451a295640 1 -- 172.21.15.50:0/1377751202 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c052570 con 0x55dbd14e1a00 2024-05-07T13:56:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.350+0000 7f451a295640 1 -- 172.21.15.50:0/1377751202 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c052870 con 0x55dbd14e1a00 2024-05-07T13:56:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.351+0000 7f451ed38800 1 -- 172.21.15.50:0/1377751202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 msgr2=0x55dbd14e1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.351+0000 7f451ed38800 1 --2- 172.21.15.50:0/1377751202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd14e1e20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f450c00a470 tx=0x7f450c01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.351+0000 7f451ed38800 1 -- 172.21.15.50:0/1377751202 shutdown_connections 2024-05-07T13:56:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.351+0000 7f451ed38800 1 --2- 172.21.15.50:0/1377751202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd14e1e20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.351+0000 7f451ed38800 1 -- 172.21.15.50:0/1377751202 >> 172.21.15.50:0/1377751202 conn(0x55dbd14dd5a0 msgr2=0x55dbd14df9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.351+0000 7f451ed38800 1 -- 172.21.15.50:0/1377751202 shutdown_connections 2024-05-07T13:56:31.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.351+0000 7f451ed38800 1 -- 172.21.15.50:0/1377751202 wait complete. 2024-05-07T13:56:31.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.366+0000 7f451ed38800 1 Processor -- start 2024-05-07T13:56:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.366+0000 7f451ed38800 1 -- start start 2024-05-07T13:56:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.366+0000 7f451ed38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.366+0000 7f451ed38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dbd142e1d0 con 0x55dbd14e1a00 2024-05-07T13:56:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.366+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15d6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.366+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15d6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45006/0 (socket says 172.21.15.50:45006) 2024-05-07T13:56:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.366+0000 7f451aa96640 1 -- 172.21.15.50:0/1326678944 learned_addr learned my addr 172.21.15.50:0/1326678944 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.366+0000 7f451aa96640 1 -- 172.21.15.50:0/1326678944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd15d70f0 con 0x55dbd14e1a00 2024-05-07T13:56:31.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.367+0000 7f451aa96640 1 --2- 172.21.15.50:0/1326678944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15d6b20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f450c055040 tx=0x7f450c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c1e77adb833b9c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.367+0000 7f4408e09640 1 -- 172.21.15.50:0/1326678944 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c057040 con 0x55dbd14e1a00 2024-05-07T13:56:31.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.367+0000 7f4408e09640 1 -- 172.21.15.50:0/1326678944 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c052990 con 0x55dbd14e1a00 2024-05-07T13:56:31.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.367+0000 7f4408e09640 1 -- 172.21.15.50:0/1326678944 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c052c70 con 0x55dbd14e1a00 2024-05-07T13:56:31.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.367+0000 7f451ed38800 1 -- 172.21.15.50:0/1326678944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 msgr2=0x55dbd15d6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.367+0000 7f451ed38800 1 --2- 172.21.15.50:0/1326678944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15d6b20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f450c055040 tx=0x7f450c04c000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451ed38800 1 -- 172.21.15.50:0/1326678944 shutdown_connections 2024-05-07T13:56:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451ed38800 1 --2- 172.21.15.50:0/1326678944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15d6b20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451ed38800 1 -- 172.21.15.50:0/1326678944 >> 172.21.15.50:0/1326678944 conn(0x55dbd14dd5a0 msgr2=0x55dbd15d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451ed38800 1 -- 172.21.15.50:0/1326678944 shutdown_connections 2024-05-07T13:56:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451ed38800 1 -- 172.21.15.50:0/1326678944 wait complete. 2024-05-07T13:56:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451ed38800 1 Processor -- start 2024-05-07T13:56:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451ed38800 1 -- start start 2024-05-07T13:56:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451ed38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15de5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451ed38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dbd14e3450 con 0x55dbd14e1a00 2024-05-07T13:56:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15de5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15de5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45018/0 (socket says 172.21.15.50:45018) 2024-05-07T13:56:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.368+0000 7f451aa96640 1 -- 172.21.15.50:0/852238573 learned_addr learned my addr 172.21.15.50:0/852238573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.369+0000 7f451aa96640 1 -- 172.21.15.50:0/852238573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd15deae0 con 0x55dbd14e1a00 2024-05-07T13:56:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.369+0000 7f451aa96640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15de5a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f450c00a470 tx=0x7f450c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.369+0000 7f4407606640 1 -- 172.21.15.50:0/852238573 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c073070 con 0x55dbd14e1a00 2024-05-07T13:56:31.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.369+0000 7f4407606640 1 -- 172.21.15.50:0/852238573 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c05d780 con 0x55dbd14e1a00 2024-05-07T13:56:31.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.369+0000 7f4407606640 1 -- 172.21.15.50:0/852238573 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c057070 con 0x55dbd14e1a00 2024-05-07T13:56:31.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.369+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbd15ded70 con 0x55dbd14e1a00 2024-05-07T13:56:31.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.369+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd15e19d0 con 0x55dbd14e1a00 2024-05-07T13:56:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.370+0000 7f4407606640 1 -- 172.21.15.50:0/852238573 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f450c076070 con 0x55dbd14e1a00 2024-05-07T13:56:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.370+0000 7f4407606640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4400036900 0x7f4400038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.370+0000 7f4407606640 1 -- 172.21.15.50:0/852238573 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f450c08e0b0 con 0x55dbd14e1a00 2024-05-07T13:56:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.370+0000 7f4513fff640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4400036900 0x7f4400038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.370+0000 7f451ed38800 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd14e2360 0x55dbd15e5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.370+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd15e5d20 con 0x55dbd14e2360 2024-05-07T13:56:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.370+0000 7f451b297640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd14e2360 0x55dbd15e5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.371+0000 7f4513fff640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4400036900 0x7f4400038dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4504000f60 tx=0x7f45040012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.371+0000 7f451b297640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd14e2360 0x55dbd15e5790 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.371+0000 7f451b297640 1 -- 172.21.15.50:0/852238573 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd14e2360 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.371+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd15e2d60 con 0x55dbd14e2360 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.371+0000 7f451b297640 1 -- 172.21.15.50:0/852238573 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd14e2360 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.371+0000 7f451ed38800 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd15e8070 0x55dbd15ea460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.371+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd15eab50 con 0x55dbd15e8070 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.371+0000 7f451aa96640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd15e8070 0x55dbd15ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.372+0000 7f451aa96640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd15e8070 0x55dbd15ea460 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.372+0000 7f451aa96640 1 -- 172.21.15.50:0/852238573 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f450c075030 con 0x55dbd15e8070 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.372+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd15e7020 con 0x55dbd14e2360 2024-05-07T13:56:31.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.372+0000 7f451b297640 1 -- 172.21.15.50:0/852238573 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd14e2360 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.372+0000 7f451ed38800 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55dbd15ec000 0x55dbd15ee450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.372+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd15eebb0 con 0x55dbd15ec000 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.373+0000 7f4513fff640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55dbd15ec000 0x55dbd15ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.373+0000 7f4513fff640 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55dbd15ec000 0x55dbd15ee450 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.373+0000 7f4513fff640 1 -- 172.21.15.50:0/852238573 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4504009050 con 0x55dbd15ec000 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.374+0000 7f451ed38800 1 Processor -- start 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.374+0000 7f451ed38800 1 -- start start 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.374+0000 7f451ed38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd15fd010 0x55dbd15fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.374+0000 7f451ed38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dbd13d4cf0 con 0x55dbd15fd010 2024-05-07T13:56:31.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.374+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd15fd010 0x55dbd15fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.374+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd15fd010 0x55dbd15fd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45026/0 (socket says 172.21.15.50:45026) 2024-05-07T13:56:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.374+0000 7f451aa96640 1 -- 172.21.15.50:0/1332582490 learned_addr learned my addr 172.21.15.50:0/1332582490 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.374+0000 7f451aa96640 1 -- 172.21.15.50:0/1332582490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd15fd970 con 0x55dbd15fd010 2024-05-07T13:56:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.375+0000 7f451aa96640 1 --2- 172.21.15.50:0/1332582490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd15fd010 0x55dbd15fd430 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f450c05b450 tx=0x7f450c066ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.375+0000 7f4404e01640 1 -- 172.21.15.50:0/1332582490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c006700 con 0x55dbd15fd010 2024-05-07T13:56:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.375+0000 7f4404e01640 1 -- 172.21.15.50:0/1332582490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c0068a0 con 0x55dbd15fd010 2024-05-07T13:56:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.375+0000 7f451ed38800 1 -- 172.21.15.50:0/1332582490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbd15fe3e0 con 0x55dbd15fd010 2024-05-07T13:56:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.375+0000 7f4404e01640 1 -- 172.21.15.50:0/1332582490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c0773b0 con 0x55dbd15fd010 2024-05-07T13:56:31.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.375+0000 7f451ed38800 1 -- 172.21.15.50:0/1332582490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd15fe8e0 con 0x55dbd15fd010 2024-05-07T13:56:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.376+0000 7f4404e01640 1 -- 172.21.15.50:0/1332582490 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f450c077550 con 0x55dbd15fd010 2024-05-07T13:56:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.376+0000 7f4404e01640 1 --2- 172.21.15.50:0/1332582490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43f4036950 0x7f43f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.376+0000 7f4404e01640 1 -- 172.21.15.50:0/1332582490 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f450c090c90 con 0x55dbd15fd010 2024-05-07T13:56:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.376+0000 7f4513fff640 1 --2- 172.21.15.50:0/1332582490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43f4036950 0x7f43f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.376+0000 7f451ed38800 1 Processor -- start 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.376+0000 7f451ed38800 1 -- start start 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.376+0000 7f4513fff640 1 --2- 172.21.15.50:0/1332582490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43f4036950 0x7f43f4038e10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f450400bf50 tx=0x7f450400f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.376+0000 7f451ed38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd160a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.376+0000 7f451ed38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dbd15d73b0 con 0x55dbd160a100 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.377+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd160a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.377+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd160a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45042/0 (socket says 172.21.15.50:45042) 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.377+0000 7f451aa96640 1 -- 172.21.15.50:0/1900609919 learned_addr learned my addr 172.21.15.50:0/1900609919 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.377+0000 7f451aa96640 1 -- 172.21.15.50:0/1900609919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd160aaf0 con 0x55dbd160a100 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.377+0000 7f451aa96640 1 --2- 172.21.15.50:0/1900609919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd160a520 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f450c006ba0 tx=0x7f450c084640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369f9a65f6258ed0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.377+0000 7f43fe7fc640 1 -- 172.21.15.50:0/1900609919 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c0a5020 con 0x55dbd160a100 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.377+0000 7f43fe7fc640 1 -- 172.21.15.50:0/1900609919 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c078cc0 con 0x55dbd160a100 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.377+0000 7f43fe7fc640 1 -- 172.21.15.50:0/1900609919 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c082d20 con 0x55dbd160a100 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 -- 172.21.15.50:0/1900609919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 msgr2=0x55dbd160a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 --2- 172.21.15.50:0/1900609919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd160a520 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f450c006ba0 tx=0x7f450c084640 comp rx=0 tx=0).stop 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 -- 172.21.15.50:0/1900609919 shutdown_connections 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 --2- 172.21.15.50:0/1900609919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd160a520 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 -- 172.21.15.50:0/1900609919 >> 172.21.15.50:0/1900609919 conn(0x55dbd1606460 msgr2=0x55dbd16044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 -- 172.21.15.50:0/1900609919 shutdown_connections 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 -- 172.21.15.50:0/1900609919 wait complete. 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 Processor -- start 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 -- start start 2024-05-07T13:56:31.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd16114a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451ed38800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dbd160b1a0 con 0x55dbd160a100 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.378+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd16114a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.379+0000 7f451aa96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd16114a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45058/0 (socket says 172.21.15.50:45058) 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.379+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 learned_addr learned my addr 172.21.15.50:0/1887619173 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.379+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd16119e0 con 0x55dbd160a100 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.379+0000 7f451aa96640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd16114a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f450c084800 tx=0x7f450c06ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.379+0000 7f43fcff9640 1 -- 172.21.15.50:0/1887619173 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c0ba070 con 0x55dbd160a100 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.379+0000 7f43fcff9640 1 -- 172.21.15.50:0/1887619173 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c06c430 con 0x55dbd160a100 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.379+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbd16119e0 con 0x55dbd160a100 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.379+0000 7f43fcff9640 1 -- 172.21.15.50:0/1887619173 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c069b80 con 0x55dbd160a100 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.379+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd16119e0 con 0x55dbd160a100 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.380+0000 7f43fcff9640 1 -- 172.21.15.50:0/1887619173 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f450c0bd070 con 0x55dbd160a100 2024-05-07T13:56:31.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.380+0000 7f43fcff9640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43e4036950 0x7f43e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.380+0000 7f43fcff9640 1 -- 172.21.15.50:0/1887619173 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f450c0b1030 con 0x55dbd160a100 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.380+0000 7f4513fff640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43e4036950 0x7f43e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451ed38800 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd161c980 0x55dbd161ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd161f590 con 0x55dbd161c980 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451b297640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd161c980 0x55dbd161ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f4513fff640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43e4036950 0x7f43e4038e10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4504001b60 tx=0x7f4504010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451b297640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd161c980 0x55dbd161ee40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451ed38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451ed38800 20 realm 2024-05-07T13:56:31.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.381+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd161f9a0 con 0x55dbd161c980 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620270 con 0x55dbd161c980 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd161c980 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd1621100 0x55dbd16234f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1623c50 con 0x55dbd1621100 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451aa96640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd1621100 0x55dbd16234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.382+0000 7f451aa96640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd1621100 0x55dbd16234f0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.383+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.383+0000 7f451ed38800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.383+0000 7f451ed38800 20 searching for the correct realm 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.383+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1625630 con 0x55dbd1621100 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.383+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.383+0000 7f451aa96640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f450c0bf060 0x7f450c051560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.383+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1625630 con 0x7f450c0bf060 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.383+0000 7f4513fff640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f450c0bf060 0x7f450c051560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.384+0000 7f4513fff640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f450c0bf060 0x7f450c051560 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.384+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4504009050 con 0x7f450c0bf060 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.384+0000 7f4513fff640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4504038040 0x7f450401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.384+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1625630 con 0x7f4504038040 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.384+0000 7f451b297640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4504038040 0x7f450401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.385+0000 7f451b297640 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4504038040 0x7f450401bab0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.385+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.385+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd161c980 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.385+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.385+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd161c980 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.385+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.385+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f4504038040 2024-05-07T13:56:31.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.386+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.386+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f4504038040 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.386+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.386+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f450c0bf060 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.386+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4504009050 con 0x7f450c0bf060 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.386+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd1621100 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.386+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.386+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd161c980 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.387+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.387+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f4504038040 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.387+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.387+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd161c980 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.387+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.387+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f450c0bf060 2024-05-07T13:56:31.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.388+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4504009050 con 0x7f450c0bf060 2024-05-07T13:56:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.388+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd1621100 2024-05-07T13:56:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.388+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.388+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd1621100 2024-05-07T13:56:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.388+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.388+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f4504038040 2024-05-07T13:56:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.388+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.388+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd1621100 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.389+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.389+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd1621100 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.389+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.389+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd161c980 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.389+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.389+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd161c980 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.389+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.389+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f4504038040 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.390+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.390+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd1621100 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.390+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.390+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f450c0bf060 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.390+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4504009050 con 0x7f450c0bf060 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.390+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd161c980 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.390+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.390+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f4504038040 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.391+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.391+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd1621100 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.391+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.391+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f4504038040 2024-05-07T13:56:31.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.391+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.391+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f450c0bf060 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.391+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4504009050 con 0x7f450c0bf060 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.392+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd1621100 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.392+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.392+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f4504038040 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.392+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.392+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x55dbd161c980 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.392+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.392+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1620610 con 0x7f450c0bf060 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:31.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1624600 con 0x55dbd161c980 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd16249f0 con 0x55dbd161c980 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.393+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd16249f0 con 0x7f4504038040 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 zone default found 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 4 Realm: () 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 zonegroup default 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1624e10 con 0x7f4504038040 2024-05-07T13:56:31.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1624e10 con 0x55dbd1621100 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd16274e0 con 0x55dbd1621100 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 started sync module instance, tier type = 2024-05-07T13:56:31.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.394+0000 7f451ed38800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.395+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1626980 con 0x7f450c0bf060 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.396+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.396+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94402599087472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd16265e0 con 0x7f450c0bf060 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.396+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1628390 con 0x55dbd161c980 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.397+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94402599087472] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.397+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.397+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94402599090304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1628780 con 0x55dbd161c980 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.397+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd16291e0 con 0x55dbd1621100 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.398+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.398+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94402599095488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1629a80 con 0x55dbd1621100 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.398+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94402599090304] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.398+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162a350 con 0x7f450c0bf060 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.399+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94402599095488] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.399+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.399+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94402599100064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162a6f0 con 0x7f450c0bf060 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.399+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162b1e0 con 0x55dbd161c980 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.400+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.400+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94402599100064] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.400+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94402599103664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162ba80 con 0x55dbd161c980 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.400+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162c070 con 0x7f4504038040 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.401+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94402599103664] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.402+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.402+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94402599097808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162ba30 con 0x7f4504038040 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.402+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162cab0 con 0x7f4504038040 2024-05-07T13:56:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.403+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94402599097808] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.403+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.403+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94402599106400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162cab0 con 0x7f4504038040 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.403+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162d470 con 0x7f4504038040 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94402599106400] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94402599110624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162d470 con 0x7f4504038040 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451ed38800 20 add_watcher() i=0 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451ed38800 20 add_watcher() i=1 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451ed38800 20 add_watcher() i=2 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451ed38800 20 add_watcher() i=3 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451ed38800 20 add_watcher() i=4 2024-05-07T13:56:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451ed38800 20 add_watcher() i=5 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.404+0000 7f451ed38800 20 add_watcher() i=6 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.405+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94402599110624] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.405+0000 7f451ed38800 20 add_watcher() i=7 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.405+0000 7f451ed38800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.405+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1630780 con 0x55dbd161c980 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.405+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.405+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94402599113008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162da00 con 0x55dbd161c980 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.406+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94402599113008] v27'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.406+0000 7f43d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.406+0000 7f451ed38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.406+0000 7f451ed38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.406+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1638eb0 con 0x55dbd161c980 2024-05-07T13:56:31.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.407+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.407+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1639420 con 0x7f4504038040 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.408+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.408+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd16397e0 con 0x55dbd1621100 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.409+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.410+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1639800 con 0x55dbd161c980 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.411+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.411+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1639e50 con 0x7f450c0bf060 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.412+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.412+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163a6a0 con 0x55dbd1621100 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.413+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.413+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163a6a0 con 0x55dbd161c980 2024-05-07T13:56:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.414+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.414+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163a6a0 con 0x7f4504038040 2024-05-07T13:56:31.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.415+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.415+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1636e30 con 0x7f450c0bf060 2024-05-07T13:56:31.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.416+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.416+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1637480 con 0x55dbd1621100 2024-05-07T13:56:31.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.417+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.417+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b250 con 0x7f450c0bf060 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.418+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.418+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b250 con 0x7f4504038040 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.419+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.419+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b2e0 con 0x7f450c0bf060 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.420+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.420+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b370 con 0x7f4504038040 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.421+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.421+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b370 con 0x55dbd161c980 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.422+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.422+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b370 con 0x55dbd1621100 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.423+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'50 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.423+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b400 con 0x7f450c0bf060 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.424+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.424+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd1621100 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.425+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.425+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd161c980 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.426+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'31 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.426+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd161c980 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.427+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.427+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd1621100 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.428+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'51 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.428+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x7f450c0bf060 2024-05-07T13:56:31.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.429+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.429+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd1621100 2024-05-07T13:56:31.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.430+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.430+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd1621100 2024-05-07T13:56:31.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.431+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.431+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd1621100 2024-05-07T13:56:31.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.432+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.432+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd1621100 2024-05-07T13:56:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.433+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.433+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x7f4504038040 2024-05-07T13:56:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.435+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.435+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd1621100 2024-05-07T13:56:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.435+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.435+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x7f4504038040 2024-05-07T13:56:31.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.436+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.436+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x55dbd1621100 2024-05-07T13:56:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.437+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'52 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.437+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x7f4504038040 2024-05-07T13:56:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.439+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.439+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd163b490 con 0x7f450c0bf060 2024-05-07T13:56:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.440+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.440+0000 7f434bfff640 20 reqs_thread_entry: start 2024-05-07T13:56:31.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.440+0000 7f451ed38800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:31.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.440+0000 7f451ed38800 20 Filter name: none 2024-05-07T13:56:31.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.440+0000 7f4349ffb640 20 reqs_thread_entry: start 2024-05-07T13:56:31.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.440+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.440+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.440+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd161c980 2024-05-07T13:56:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.441+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.441+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.441+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.441+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.441+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.441+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f4504038040 2024-05-07T13:56:31.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.442+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.442+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.442+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.442+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.442+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.442+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.442+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv24 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.442+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.443+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.443+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.443+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.443+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd161c980 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.443+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.443+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.443+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.444+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.444+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.444+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f450c0bf060 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.444+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.444+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.444+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.444+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.445+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.445+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.445+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.445+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.445+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.445+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.445+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.445+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd161c980 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.446+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.446+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.446+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.446+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.446+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.446+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f4504038040 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.447+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.447+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.447+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.447+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.447+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.447+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f450c0bf060 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.447+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.447+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.448+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.448+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.448+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.448+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.448+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.448+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.448+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.449+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.449+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.449+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f450c0bf060 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.449+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.449+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.449+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.449+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.450+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.450+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f4504038040 2024-05-07T13:56:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.450+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.450+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.450+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.451+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.451+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.451+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f450c0bf060 2024-05-07T13:56:31.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.451+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.451+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.451+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.451+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.452+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.452+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f4504038040 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.452+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.452+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.452+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.452+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.452+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.452+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd161c980 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.453+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.453+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.453+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.453+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.453+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.453+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.453+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.453+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.454+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.454+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.454+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.454+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f450c0bf060 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.454+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.454+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.454+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.454+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.455+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.455+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.455+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.455+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.455+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.455+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.456+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.456+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd161c980 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.456+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.456+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.456+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.456+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.456+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.456+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd161c980 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.457+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.457+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd161c980 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.457+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.457+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.457+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.457+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.457+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.457+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.458+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.458+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.458+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.458+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f450c0bf060 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.458+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.458+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.458+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.458+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.459+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.459+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.459+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.459+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.459+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.459+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.459+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.459+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.460+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.460+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.460+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.460+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.460+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.460+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.460+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.460+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.461+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.461+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.461+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.461+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.461+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.461+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.461+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.461+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.462+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.462+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f4504038040 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.462+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.462+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.463+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.463+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.463+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.463+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.463+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.463+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.463+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.463+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.464+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.464+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f4504038040 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.464+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.464+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.464+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.464+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.465+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.465+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x55dbd1621100 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.465+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.465+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x55dbd1621100 2024-05-07T13:56:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.465+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.465+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.466+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.466+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f4504038040 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.466+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.466+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f4504038040 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.466+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.466+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.466+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.466+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1666020 con 0x7f450c0bf060 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.467+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.467+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1667030 con 0x7f450c0bf060 2024-05-07T13:56:31.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.467+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.468+0000 7f43d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.468+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94402599113008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162f5c0 con 0x55dbd161c980 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.469+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94402599113008] v27'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.469+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94402599087472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162d130 con 0x7f450c0bf060 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.470+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94402599087472] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.470+0000 7f451ed38800 20 remove_watcher() i=0 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.470+0000 7f451ed38800 2 removed watcher, disabling cache 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.470+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94402599090304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162d130 con 0x55dbd161c980 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.471+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94402599090304] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.471+0000 7f451ed38800 20 remove_watcher() i=1 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.471+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94402599095488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1627880 con 0x55dbd1621100 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.472+0000 7f451aa96640 1 -- 172.21.15.50:0/1887619173 <== osd.3 v2:172.21.15.50:6814/3553060046 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94402599095488] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c0bc030 con 0x55dbd1621100 2024-05-07T13:56:31.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.472+0000 7f451ed38800 20 remove_watcher() i=2 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.472+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94402599100064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162d130 con 0x7f450c0bf060 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.473+0000 7f4513fff640 1 -- 172.21.15.50:0/1887619173 <== osd.2 v2:172.21.15.50:6808/2034796854 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94402599100064] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4504045040 con 0x7f450c0bf060 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.473+0000 7f451ed38800 20 remove_watcher() i=3 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.473+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94402599103664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1628cc0 con 0x55dbd161c980 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.474+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.1 v2:172.21.15.50:6800/3441257969 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94402599103664] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55dbd161c980 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.474+0000 7f451ed38800 20 remove_watcher() i=4 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.474+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94402599097808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1627880 con 0x7f4504038040 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.475+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94402599097808] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.475+0000 7f451ed38800 20 remove_watcher() i=5 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.475+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94402599106400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd1629ea0 con 0x7f4504038040 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.476+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94402599106400] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.476+0000 7f451ed38800 20 remove_watcher() i=6 2024-05-07T13:56:31.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.476+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94402599110624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dbd162d130 con 0x7f4504038040 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 <== osd.0 v2:172.21.15.22:6800/2215278347 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94402599110624] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x7f4504038040 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451ed38800 20 remove_watcher() i=7 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4504038040 msgr2=0x7f450401bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451ed38800 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4504038040 0x7f450401bab0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd161c980 msgr2=0x55dbd161ee40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451ed38800 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd161c980 0x55dbd161ee40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f450c0bf060 msgr2=0x7f450c051560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451ed38800 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f450c0bf060 0x7f450c051560 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd1621100 msgr2=0x55dbd16234f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.477+0000 7f451ed38800 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd1621100 0x55dbd16234f0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43e4036950 msgr2=0x7f43e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43e4036950 0x7f43e4038e10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4504001b60 tx=0x7f4504010000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 msgr2=0x55dbd16114a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd16114a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f450c084800 tx=0x7f450c06ce20 comp rx=0 tx=0).stop 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451b297640 1 -- 172.21.15.50:0/1887619173 reap_dead start 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 shutdown_connections 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 --2- 172.21.15.50:0/1887619173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd160a100 0x55dbd16114a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 >> 172.21.15.50:0/1887619173 conn(0x55dbd1606460 msgr2=0x55dbd1603ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 shutdown_connections 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1887619173 wait complete. 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1332582490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43f4036950 msgr2=0x7f43f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 --2- 172.21.15.50:0/1332582490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43f4036950 0x7f43f4038e10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f450400bf50 tx=0x7f450400f000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1332582490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd15fd010 msgr2=0x55dbd15fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 --2- 172.21.15.50:0/1332582490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd15fd010 0x55dbd15fd430 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f450c05b450 tx=0x7f450c066ac0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1332582490 shutdown_connections 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 --2- 172.21.15.50:0/1332582490 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f43f4036950 0x7f43f4038e10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 --2- 172.21.15.50:0/1332582490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd15fd010 0x55dbd15fd430 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1332582490 >> 172.21.15.50:0/1332582490 conn(0x55dbd15f10b0 msgr2=0x55dbd15f14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1332582490 shutdown_connections 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.478+0000 7f451ed38800 1 -- 172.21.15.50:0/1332582490 wait complete. 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55dbd15ec000 msgr2=0x55dbd15ee450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55dbd15ec000 0x55dbd15ee450 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd14e2360 msgr2=0x55dbd15e5790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55dbd14e2360 0x55dbd15e5790 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd15e8070 msgr2=0x55dbd15ea460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55dbd15e8070 0x55dbd15ea460 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4400036900 msgr2=0x7f4400038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4400036900 0x7f4400038dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4504000f60 tx=0x7f45040012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 msgr2=0x55dbd15de5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 --2- 172.21.15.50:0/852238573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbd14e1a00 0x55dbd15de5a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f450c00a470 tx=0x7f450c003020 comp rx=0 tx=0).stop 2024-05-07T13:56:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451b297640 1 -- 172.21.15.50:0/852238573 reap_dead start 2024-05-07T13:56:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 shutdown_connections 2024-05-07T13:56:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 >> 172.21.15.50:0/852238573 conn(0x55dbd14dd5a0 msgr2=0x55dbd15d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 shutdown_connections 2024-05-07T13:56:31.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.479+0000 7f451ed38800 1 -- 172.21.15.50:0/852238573 wait complete. 2024-05-07T13:56:31.476 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-05-07T13:56:31.476 DEBUG:tasks.util.rgw: json result: [] 2024-05-07T13:56:31.476 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-07T13:56:31.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-07T13:56:31.477 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-07T13:56:31.522 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:31.522 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.536+0000 7f9436a2f800 1 Processor -- start 2024-05-07T13:56:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.536+0000 7f9436a2f800 1 -- start start 2024-05-07T13:56:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.536+0000 7f9436a2f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5601a42553c0 0x5601a42557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.536+0000 7f9436a2f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601a4255e10 con 0x5601a42583b0 2024-05-07T13:56:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.536+0000 7f9436a2f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5601a40e8050 con 0x5601a42553c0 2024-05-07T13:56:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.536+0000 7f9431bca640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5601a42553c0 0x5601a42557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.536+0000 7f94313c9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5601a42583b0 0x5601a4258860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:44028/0 (socket says 172.21.15.50:44028) 2024-05-07T13:56:31.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.536+0000 7f94313c9640 1 -- 172.21.15.50:0/1555431728 learned_addr learned my addr 172.21.15.50:0/1555431728 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:31.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.537+0000 7f9431bca640 1 -- 172.21.15.50:0/1555431728 >> v1:172.21.15.22:6789/0 conn(0x5601a42583b0 legacy=0x5601a4258860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.537+0000 7f9431bca640 1 -- 172.21.15.50:0/1555431728 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a4258f70 con 0x5601a42553c0 2024-05-07T13:56:31.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.538+0000 7f9431bca640 1 --2- 172.21.15.50:0/1555431728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a42557e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f942400a470 tx=0x7f942401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14599bc3bcd5d8d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9430bc8640 1 -- 172.21.15.50:0/1555431728 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9424057070 con 0x5601a42553c0 2024-05-07T13:56:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9430bc8640 1 -- 172.21.15.50:0/1555431728 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942404adc0 con 0x5601a42553c0 2024-05-07T13:56:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9430bc8640 1 -- 172.21.15.50:0/1555431728 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9424052590 con 0x5601a42553c0 2024-05-07T13:56:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9436a2f800 1 -- 172.21.15.50:0/1555431728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 msgr2=0x5601a42557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9436a2f800 1 --2- 172.21.15.50:0/1555431728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a42557e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f942400a470 tx=0x7f942401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9436a2f800 1 -- 172.21.15.50:0/1555431728 shutdown_connections 2024-05-07T13:56:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9436a2f800 1 --2- 172.21.15.50:0/1555431728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a42557e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9436a2f800 1 -- 172.21.15.50:0/1555431728 >> 172.21.15.50:0/1555431728 conn(0x5601a4250d30 msgr2=0x5601a4253150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9436a2f800 1 -- 172.21.15.50:0/1555431728 shutdown_connections 2024-05-07T13:56:31.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.539+0000 7f9436a2f800 1 -- 172.21.15.50:0/1555431728 wait complete. 2024-05-07T13:56:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.554+0000 7f9436a2f800 1 Processor -- start 2024-05-07T13:56:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.554+0000 7f9436a2f800 1 -- start start 2024-05-07T13:56:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.554+0000 7f9436a2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4257cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.554+0000 7f9436a2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5601a41a21d0 con 0x5601a42553c0 2024-05-07T13:56:31.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.555+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4257cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.555+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4257cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45082/0 (socket says 172.21.15.50:45082) 2024-05-07T13:56:31.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.555+0000 7f9431bca640 1 -- 172.21.15.50:0/1452039845 learned_addr learned my addr 172.21.15.50:0/1452039845 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.555+0000 7f9431bca640 1 -- 172.21.15.50:0/1452039845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a42562b0 con 0x5601a42553c0 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.555+0000 7f9431bca640 1 --2- 172.21.15.50:0/1452039845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4257cf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9424055040 tx=0x7f942404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92b3014a01a76cb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.555+0000 7f931fe07640 1 -- 172.21.15.50:0/1452039845 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9424057040 con 0x5601a42553c0 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.555+0000 7f931fe07640 1 -- 172.21.15.50:0/1452039845 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9424063070 con 0x5601a42553c0 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.555+0000 7f931fe07640 1 -- 172.21.15.50:0/1452039845 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f942405d790 con 0x5601a42553c0 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.556+0000 7f9436a2f800 1 -- 172.21.15.50:0/1452039845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 msgr2=0x5601a4257cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.556+0000 7f9436a2f800 1 --2- 172.21.15.50:0/1452039845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4257cf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9424055040 tx=0x7f942404c000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.556+0000 7f9436a2f800 1 -- 172.21.15.50:0/1452039845 shutdown_connections 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.556+0000 7f9436a2f800 1 --2- 172.21.15.50:0/1452039845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4257cf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.556+0000 7f9436a2f800 1 -- 172.21.15.50:0/1452039845 >> 172.21.15.50:0/1452039845 conn(0x5601a4250d30 msgr2=0x5601a4344110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.556+0000 7f9436a2f800 1 -- 172.21.15.50:0/1452039845 shutdown_connections 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.556+0000 7f9436a2f800 1 -- 172.21.15.50:0/1452039845 wait complete. 2024-05-07T13:56:31.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.556+0000 7f9436a2f800 1 Processor -- start 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.557+0000 7f9436a2f800 1 -- start start 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.557+0000 7f9436a2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4352480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.557+0000 7f9436a2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5601a4260880 con 0x5601a42553c0 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.557+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4352480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.557+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4352480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45096/0 (socket says 172.21.15.50:45096) 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.557+0000 7f9431bca640 1 -- 172.21.15.50:0/363371868 learned_addr learned my addr 172.21.15.50:0/363371868 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.557+0000 7f9431bca640 1 -- 172.21.15.50:0/363371868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a43529c0 con 0x5601a42553c0 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.557+0000 7f9431bca640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4352480 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f942400a470 tx=0x7f9424002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.557+0000 7f931e604640 1 -- 172.21.15.50:0/363371868 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9424057050 con 0x5601a42553c0 2024-05-07T13:56:31.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.558+0000 7f931e604640 1 -- 172.21.15.50:0/363371868 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942405dc90 con 0x5601a42553c0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.558+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601a4352c50 con 0x5601a42553c0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.558+0000 7f931e604640 1 -- 172.21.15.50:0/363371868 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9424052440 con 0x5601a42553c0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.558+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a4355900 con 0x5601a42553c0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.558+0000 7f931e604640 1 -- 172.21.15.50:0/363371868 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94240525e0 con 0x5601a42553c0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.559+0000 7f931e604640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9318036950 0x7f9318038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.559+0000 7f931e604640 1 -- 172.21.15.50:0/363371868 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f942408dc60 con 0x5601a42553c0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.559+0000 7f94313c9640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9318036950 0x7f9318038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.559+0000 7f9436a2f800 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a42583b0 0x5601a43596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.559+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4359c40 con 0x5601a42583b0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.559+0000 7f94323cb640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a42583b0 0x5601a43596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.559+0000 7f94313c9640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9318036950 0x7f9318038e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9428000f60 tx=0x7f94280012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.559+0000 7f94323cb640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a42583b0 0x5601a43596c0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.560+0000 7f94323cb640 1 -- 172.21.15.50:0/363371868 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a42583b0 2024-05-07T13:56:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.560+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4356c90 con 0x5601a42583b0 2024-05-07T13:56:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.560+0000 7f94323cb640 1 -- 172.21.15.50:0/363371868 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a42583b0 2024-05-07T13:56:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.560+0000 7f9436a2f800 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a435bf50 0x5601a435e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.560+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a435ea30 con 0x5601a435bf50 2024-05-07T13:56:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.560+0000 7f9431bca640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a435bf50 0x5601a435e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.560+0000 7f9431bca640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a435bf50 0x5601a435e340 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.561+0000 7f9431bca640 1 -- 172.21.15.50:0/363371868 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9424078070 con 0x5601a435bf50 2024-05-07T13:56:31.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.561+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a435af00 con 0x5601a42583b0 2024-05-07T13:56:31.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.561+0000 7f94323cb640 1 -- 172.21.15.50:0/363371868 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a42583b0 2024-05-07T13:56:31.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.561+0000 7f9436a2f800 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5601a435fee0 0x5601a4362330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.561+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4362a90 con 0x5601a435fee0 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.561+0000 7f94313c9640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5601a435fee0 0x5601a4362330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.562+0000 7f94313c9640 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5601a435fee0 0x5601a4362330 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.562+0000 7f94313c9640 1 -- 172.21.15.50:0/363371868 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9428009050 con 0x5601a435fee0 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.562+0000 7f9436a2f800 1 Processor -- start 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.562+0000 7f9436a2f800 1 -- start start 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.562+0000 7f9436a2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a4370ef0 0x5601a4371310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.562+0000 7f9436a2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5601a4148cf0 con 0x5601a4370ef0 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a4370ef0 0x5601a4371310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a4370ef0 0x5601a4371310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45106/0 (socket says 172.21.15.50:45106) 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f9431bca640 1 -- 172.21.15.50:0/4001017916 learned_addr learned my addr 172.21.15.50:0/4001017916 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f9431bca640 1 -- 172.21.15.50:0/4001017916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a4371850 con 0x5601a4370ef0 2024-05-07T13:56:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f9431bca640 1 --2- 172.21.15.50:0/4001017916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a4370ef0 0x5601a4371310 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f942405cb40 tx=0x7f942405b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f93177fe640 1 -- 172.21.15.50:0/4001017916 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9424076040 con 0x5601a4370ef0 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f93177fe640 1 -- 172.21.15.50:0/4001017916 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942405ba40 con 0x5601a4370ef0 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f9436a2f800 1 -- 172.21.15.50:0/4001017916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601a43722c0 con 0x5601a4370ef0 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f93177fe640 1 -- 172.21.15.50:0/4001017916 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9424007fa0 con 0x5601a4370ef0 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.563+0000 7f9436a2f800 1 -- 172.21.15.50:0/4001017916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a43727c0 con 0x5601a4370ef0 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.564+0000 7f93177fe640 1 -- 172.21.15.50:0/4001017916 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9424066a20 con 0x5601a4370ef0 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.564+0000 7f93177fe640 1 --2- 172.21.15.50:0/4001017916 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f930c036950 0x7f930c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.564+0000 7f93177fe640 1 -- 172.21.15.50:0/4001017916 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9424002000 con 0x5601a4370ef0 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.564+0000 7f94313c9640 1 --2- 172.21.15.50:0/4001017916 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f930c036950 0x7f930c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.564+0000 7f9436a2f800 1 Processor -- start 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.565+0000 7f9436a2f800 1 -- start start 2024-05-07T13:56:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.565+0000 7f94313c9640 1 --2- 172.21.15.50:0/4001017916 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f930c036950 0x7f930c038e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f942800bf50 tx=0x7f942800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.565+0000 7f9436a2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a437e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.565+0000 7f9436a2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5601a4256570 con 0x5601a437df80 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.565+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a437e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.565+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a437e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45118/0 (socket says 172.21.15.50:45118) 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.565+0000 7f9431bca640 1 -- 172.21.15.50:0/2658677389 learned_addr learned my addr 172.21.15.50:0/2658677389 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.565+0000 7f9431bca640 1 -- 172.21.15.50:0/2658677389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a437e970 con 0x5601a437df80 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.565+0000 7f9431bca640 1 --2- 172.21.15.50:0/2658677389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a437e3a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f942405d820 tx=0x7f942407b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddf4adba5de0e24 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f93157fa640 1 -- 172.21.15.50:0/2658677389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f942409f070 con 0x5601a437df80 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f93157fa640 1 -- 172.21.15.50:0/2658677389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9424008140 con 0x5601a437df80 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f93157fa640 1 -- 172.21.15.50:0/2658677389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f942408a5e0 con 0x5601a437df80 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f9436a2f800 1 -- 172.21.15.50:0/2658677389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 msgr2=0x5601a437e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f9436a2f800 1 --2- 172.21.15.50:0/2658677389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a437e3a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f942405d820 tx=0x7f942407b5d0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f9436a2f800 1 -- 172.21.15.50:0/2658677389 shutdown_connections 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f9436a2f800 1 --2- 172.21.15.50:0/2658677389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a437e3a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f9436a2f800 1 -- 172.21.15.50:0/2658677389 >> 172.21.15.50:0/2658677389 conn(0x5601a437a2e0 msgr2=0x5601a4378340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f9436a2f800 1 -- 172.21.15.50:0/2658677389 shutdown_connections 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f9436a2f800 1 -- 172.21.15.50:0/2658677389 wait complete. 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f9436a2f800 1 Processor -- start 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.566+0000 7f9436a2f800 1 -- start start 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.567+0000 7f9436a2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a43853a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.567+0000 7f9436a2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5601a437f020 con 0x5601a437df80 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.567+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a43853a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.567+0000 7f9431bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a43853a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45130/0 (socket says 172.21.15.50:45130) 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.567+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 learned_addr learned my addr 172.21.15.50:0/3948701528 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.567+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a43858e0 con 0x5601a437df80 2024-05-07T13:56:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.567+0000 7f9431bca640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a43853a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f94240669b0 tx=0x7f9424079e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.568+0000 7f93037fe640 1 -- 172.21.15.50:0/3948701528 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94240b4070 con 0x5601a437df80 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.568+0000 7f93037fe640 1 -- 172.21.15.50:0/3948701528 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942408a6b0 con 0x5601a437df80 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.568+0000 7f93037fe640 1 -- 172.21.15.50:0/3948701528 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f942409f040 con 0x5601a437df80 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.568+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601a43858e0 con 0x5601a437df80 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.568+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a4385d80 con 0x5601a437df80 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.568+0000 7f93037fe640 1 -- 172.21.15.50:0/3948701528 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94240b7070 con 0x5601a437df80 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.569+0000 7f93037fe640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f92fc036860 0x7f92fc038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.569+0000 7f93037fe640 1 -- 172.21.15.50:0/3948701528 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f94240ab030 con 0x5601a437df80 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.569+0000 7f94313c9640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f92fc036860 0x7f92fc038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.569+0000 7f94313c9640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f92fc036860 0x7f92fc038d20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9428001b60 tx=0x7f9428010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.569+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.569+0000 7f9436a2f800 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a4390b00 0x5601a4392fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.569+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4393710 con 0x5601a4390b00 2024-05-07T13:56:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.569+0000 7f94323cb640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a4390b00 0x5601a4392fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f94323cb640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a4390b00 0x5601a4392fc0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a4390b00 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f9436a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f9436a2f800 20 realm 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4393b20 con 0x5601a4390b00 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a4390b00 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f9436a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f9436a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.570+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a43943f0 con 0x5601a4390b00 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a4390b00 2024-05-07T13:56:31.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9436a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a4390b00 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a4390b00 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9436a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9436a2f800 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a43954f0 0x5601a43978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4397ef0 con 0x5601a43954f0 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9431bca640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a43954f0 0x5601a43978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9431bca640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a43954f0 0x5601a43978e0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.571+0000 7f9436a2f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.572+0000 7f9436a2f800 20 searching for the correct realm 2024-05-07T13:56:31.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.572+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4399820 con 0x5601a43954f0 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.572+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.572+0000 7f9431bca640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94240b9060 0x7f942407e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.572+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4399820 con 0x7f94240b9060 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.572+0000 7f94313c9640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94240b9060 0x7f942407e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.573+0000 7f94313c9640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94240b9060 0x7f942407e110 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.573+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428009050 con 0x7f94240b9060 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.573+0000 7f94313c9640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9428038040 0x7f942801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.573+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4399820 con 0x7f9428038040 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.573+0000 7f94323cb640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9428038040 0x7f942801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.573+0000 7f94323cb640 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9428038040 0x7f942801bab0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.574+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c00a4a0 con 0x7f9428038040 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.574+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a4390b00 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.574+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a4390b00 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.574+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a4390b00 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.574+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a4390b00 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.574+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f9428038040 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.575+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c00a4a0 con 0x7f9428038040 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.575+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f9428038040 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.575+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f942c00a4a0 con 0x7f9428038040 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.575+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f94240b9060 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.575+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428009050 con 0x7f94240b9060 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.575+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a43954f0 2024-05-07T13:56:31.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.575+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.575+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a4390b00 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.576+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a4390b00 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.576+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f9428038040 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.576+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c00a4a0 con 0x7f9428038040 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.576+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a4390b00 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.576+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a4390b00 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.576+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f94240b9060 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.576+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9428009050 con 0x7f94240b9060 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.577+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a43954f0 2024-05-07T13:56:31.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.577+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.577+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a43954f0 2024-05-07T13:56:31.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.577+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.577+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f9428038040 2024-05-07T13:56:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.577+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c00a4a0 con 0x7f9428038040 2024-05-07T13:56:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.577+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a43954f0 2024-05-07T13:56:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.578+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.578+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a43954f0 2024-05-07T13:56:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.578+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.578+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a4390b00 2024-05-07T13:56:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.578+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c00a4a0 con 0x5601a4390b00 2024-05-07T13:56:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.578+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a4390b00 2024-05-07T13:56:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.578+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.578+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f9428038040 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.579+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.579+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a43954f0 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.579+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.579+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f94240b9060 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.579+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428009050 con 0x7f94240b9060 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.579+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a4390b00 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.579+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.579+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f9428038040 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.580+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.580+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a43954f0 2024-05-07T13:56:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.580+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.580+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f9428038040 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.580+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.580+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f94240b9060 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.580+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428009050 con 0x7f94240b9060 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.580+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a43954f0 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.581+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.581+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f9428038040 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.581+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.581+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x5601a4390b00 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.581+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.581+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5601a4394790 con 0x7f94240b9060 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a43987b0 con 0x5601a4390b00 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4398ba0 con 0x5601a4390b00 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4398ba0 con 0x7f9428038040 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.582+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 zone default found 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 4 Realm: () 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 zonegroup default 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a4399ca0 con 0x7f9428038040 2024-05-07T13:56:31.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a439b680 con 0x5601a43954f0 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a439ba20 con 0x5601a43954f0 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 started sync module instance, tier type = 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.583+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439ab20 con 0x7f94240b9060 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.584+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.584+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94565050197616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439bdc0 con 0x7f94240b9060 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.584+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439c610 con 0x5601a4390b00 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.585+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94565050197616] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.586+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.586+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94565050204512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439c580 con 0x5601a4390b00 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.586+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439d4d0 con 0x5601a43954f0 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.587+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94565050204512] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.587+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.587+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94565050206720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439d4d0 con 0x5601a43954f0 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.587+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439df30 con 0x7f94240b9060 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.588+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94565050206720] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.588+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.588+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94565050208288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439d440 con 0x7f94240b9060 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.589+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439edf0 con 0x5601a4390b00 2024-05-07T13:56:31.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.590+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94565050208288] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.590+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.590+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94565050214720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439ed60 con 0x5601a4390b00 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.590+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439fcb0 con 0x7f9428038040 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.591+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.591+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94565050218496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43a00d0 con 0x7f9428038040 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.591+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94565050214720] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.591+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439f200 con 0x7f9428038040 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.592+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94565050218496] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.592+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.592+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94565050219552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43a0040 con 0x7f9428038040 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.592+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43a1160 con 0x7f9428038040 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94565050219552] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94565050222224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43a1160 con 0x7f9428038040 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f9436a2f800 20 add_watcher() i=0 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f9436a2f800 20 add_watcher() i=1 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f9436a2f800 20 add_watcher() i=2 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f9436a2f800 20 add_watcher() i=3 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f9436a2f800 20 add_watcher() i=4 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f9436a2f800 20 add_watcher() i=5 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.593+0000 7f9436a2f800 20 add_watcher() i=6 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.594+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94565050222224] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.594+0000 7f9436a2f800 20 add_watcher() i=7 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.594+0000 7f9436a2f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.594+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a43a4440 con 0x5601a4390b00 2024-05-07T13:56:31.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.595+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.595+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94565050224160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43a16f0 con 0x5601a4390b00 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.596+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94565050224160] v27'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.596+0000 7f92e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.596+0000 7f9436a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.596+0000 7f9436a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.596+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43acde0 con 0x5601a4390b00 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.597+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.597+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43ad430 con 0x7f9428038040 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.598+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.598+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43ad890 con 0x5601a43954f0 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.599+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.599+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43ad800 con 0x5601a4390b00 2024-05-07T13:56:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.600+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.600+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43addf0 con 0x7f94240b9060 2024-05-07T13:56:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.601+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.601+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43ae810 con 0x5601a43954f0 2024-05-07T13:56:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.602+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.602+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43ae810 con 0x5601a4390b00 2024-05-07T13:56:31.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.603+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.603+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43ae810 con 0x7f9428038040 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.604+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.604+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43ae810 con 0x7f94240b9060 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.605+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.606+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43aed80 con 0x5601a43954f0 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.606+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.607+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43aee10 con 0x7f94240b9060 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.607+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.607+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af380 con 0x7f9428038040 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.609+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.609+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af380 con 0x7f94240b9060 2024-05-07T13:56:31.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.610+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.610+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af660 con 0x7f9428038040 2024-05-07T13:56:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.611+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.611+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a4390b00 2024-05-07T13:56:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.612+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.612+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af5a0 con 0x5601a43954f0 2024-05-07T13:56:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.614+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'53 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.614+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af5a0 con 0x7f94240b9060 2024-05-07T13:56:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.615+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.615+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a43954f0 2024-05-07T13:56:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.616+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.616+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a4390b00 2024-05-07T13:56:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.617+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'32 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.617+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a4390b00 2024-05-07T13:56:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.618+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.618+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a43954f0 2024-05-07T13:56:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.619+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'54 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.619+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x7f94240b9060 2024-05-07T13:56:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.620+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.620+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a43954f0 2024-05-07T13:56:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.621+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.621+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a43954f0 2024-05-07T13:56:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.622+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.622+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a43954f0 2024-05-07T13:56:31.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.623+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.623+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a43954f0 2024-05-07T13:56:31.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.624+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.624+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x7f9428038040 2024-05-07T13:56:31.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.625+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.625+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a43954f0 2024-05-07T13:56:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.626+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.626+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x7f9428038040 2024-05-07T13:56:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.627+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.627+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x5601a43954f0 2024-05-07T13:56:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.628+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'55 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.628+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x7f9428038040 2024-05-07T13:56:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.630+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.630+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43af630 con 0x7f94240b9060 2024-05-07T13:56:31.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.631+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.631+0000 7f92e27fc640 20 reqs_thread_entry: start 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.631+0000 7f9436a2f800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.631+0000 7f9436a2f800 20 Filter name: none 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.631+0000 7f9253fff640 20 reqs_thread_entry: start 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.631+0000 7f9436a2f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.631+0000 7f9436a2f800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.631+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a43da620 con 0x5601a4390b00 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.632+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.632+0000 7f9436a2f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.632+0000 7f9436a2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.632+0000 7f9436a2f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.632+0000 7f9436a2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.632+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5601a43da120 con 0x7f94240b9060 2024-05-07T13:56:31.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.632+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-07T13:56:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.633+0000 7f92e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.633+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94565050224160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43abc10 con 0x5601a4390b00 2024-05-07T13:56:31.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.634+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94565050224160] v27'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.634+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94565050197616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a43abc10 con 0x7f94240b9060 2024-05-07T13:56:31.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.635+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94565050197616] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.635+0000 7f9436a2f800 20 remove_watcher() i=0 2024-05-07T13:56:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.635+0000 7f9436a2f800 2 removed watcher, disabling cache 2024-05-07T13:56:31.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.635+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94565050204512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439a670 con 0x5601a4390b00 2024-05-07T13:56:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.636+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94565050204512] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.636+0000 7f9436a2f800 20 remove_watcher() i=1 2024-05-07T13:56:31.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.636+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94565050206720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439a670 con 0x5601a43954f0 2024-05-07T13:56:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.637+0000 7f9431bca640 1 -- 172.21.15.50:0/3948701528 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94565050206720] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94240b6030 con 0x5601a43954f0 2024-05-07T13:56:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.637+0000 7f9436a2f800 20 remove_watcher() i=2 2024-05-07T13:56:31.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.637+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94565050208288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439ca00 con 0x7f94240b9060 2024-05-07T13:56:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.638+0000 7f94313c9640 1 -- 172.21.15.50:0/3948701528 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94565050208288] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9428045040 con 0x7f94240b9060 2024-05-07T13:56:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.638+0000 7f9436a2f800 20 remove_watcher() i=3 2024-05-07T13:56:31.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.638+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94565050214720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439d020 con 0x5601a4390b00 2024-05-07T13:56:31.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.639+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94565050214720] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x5601a4390b00 2024-05-07T13:56:31.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.639+0000 7f9436a2f800 20 remove_watcher() i=4 2024-05-07T13:56:31.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.639+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94565050218496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439ca00 con 0x7f9428038040 2024-05-07T13:56:31.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.640+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94565050218496] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.640+0000 7f9436a2f800 20 remove_watcher() i=5 2024-05-07T13:56:31.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.640+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94565050219552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439e940 con 0x7f9428038040 2024-05-07T13:56:31.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.642+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94565050219552] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.642+0000 7f9436a2f800 20 remove_watcher() i=6 2024-05-07T13:56:31.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.642+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94565050222224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5601a439fcb0 con 0x7f9428038040 2024-05-07T13:56:31.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94565050222224] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942c02f060 con 0x7f9428038040 2024-05-07T13:56:31.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 20 remove_watcher() i=7 2024-05-07T13:56:31.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9428038040 msgr2=0x7f942801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f9428038040 0x7f942801bab0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a4390b00 msgr2=0x5601a4392fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a4390b00 0x5601a4392fc0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94240b9060 msgr2=0x7f942407e110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f94240b9060 0x7f942407e110 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a43954f0 msgr2=0x5601a43978e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a43954f0 0x5601a43978e0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f92fc036860 msgr2=0x7f92fc038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f92fc036860 0x7f92fc038d20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9428001b60 tx=0x7f9428010000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 msgr2=0x5601a43853a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/3948701528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a437df80 0x5601a43853a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f94240669b0 tx=0x7f9424079e70 comp rx=0 tx=0).stop 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 reap_dead start 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f94323cb640 1 -- 172.21.15.50:0/3948701528 reap_dead start 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 shutdown_connections 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 >> 172.21.15.50:0/3948701528 conn(0x5601a437a2e0 msgr2=0x5601a4377940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 shutdown_connections 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/3948701528 wait complete. 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/4001017916 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f930c036950 msgr2=0x7f930c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/4001017916 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f930c036950 0x7f930c038e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f942800bf50 tx=0x7f942800f000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/4001017916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a4370ef0 msgr2=0x5601a4371310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/4001017916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a4370ef0 0x5601a4371310 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f942405cb40 tx=0x7f942405b660 comp rx=0 tx=0).stop 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/4001017916 shutdown_connections 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/4001017916 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f930c036950 0x7f930c038e10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 --2- 172.21.15.50:0/4001017916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a4370ef0 0x5601a4371310 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.643+0000 7f9436a2f800 1 -- 172.21.15.50:0/4001017916 >> 172.21.15.50:0/4001017916 conn(0x5601a4364f90 msgr2=0x5601a4365390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/4001017916 shutdown_connections 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/4001017916 wait complete. 2024-05-07T13:56:31.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5601a435fee0 msgr2=0x5601a4362330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5601a435fee0 0x5601a4362330 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a42583b0 msgr2=0x5601a43596c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5601a42583b0 0x5601a43596c0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a435bf50 msgr2=0x5601a435e340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5601a435bf50 0x5601a435e340 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9318036950 msgr2=0x7f9318038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9318036950 0x7f9318038e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9428000f60 tx=0x7f94280012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 msgr2=0x5601a4352480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 --2- 172.21.15.50:0/363371868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601a42553c0 0x5601a4352480 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f942400a470 tx=0x7f9424002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f94323cb640 1 -- 172.21.15.50:0/363371868 reap_dead start 2024-05-07T13:56:31.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 shutdown_connections 2024-05-07T13:56:31.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 >> 172.21.15.50:0/363371868 conn(0x5601a4250d30 msgr2=0x5601a4256ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 shutdown_connections 2024-05-07T13:56:31.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.644+0000 7f9436a2f800 1 -- 172.21.15.50:0/363371868 wait complete. 2024-05-07T13:56:31.640 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-07T13:56:31.649 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-05-07T13:56:31.654 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:31.680 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:31.689 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:31.735 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-07T13:56:31.740 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:31.740 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-07T13:56:31.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-07T13:56:31.740 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-07T13:56:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.800+0000 7f27e8146800 1 Processor -- start 2024-05-07T13:56:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.800+0000 7f27e8146800 1 -- start start 2024-05-07T13:56:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.800+0000 7f27e8146800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5605e37403e0 0x5605e37428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.801+0000 7f27e8146800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5605e3742f50 con 0x5605e36af8b0 2024-05-07T13:56:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.801+0000 7f27e8146800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5605e35cd050 con 0x5605e37403e0 2024-05-07T13:56:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.801+0000 7f27e544b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5605e37403e0 0x5605e37428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.801+0000 7f27e5c4c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5605e36af8b0 0x5605e373ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:44038/0 (socket says 172.21.15.50:44038) 2024-05-07T13:56:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.801+0000 7f27e5c4c640 1 -- 172.21.15.50:0/1176532975 learned_addr learned my addr 172.21.15.50:0/1176532975 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.801+0000 7f27e544b640 1 -- 172.21.15.50:0/1176532975 >> v1:172.21.15.22:6789/0 conn(0x5605e36af8b0 legacy=0x5605e373ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.801+0000 7f27e544b640 1 -- 172.21.15.50:0/1176532975 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e3744180 con 0x5605e37403e0 2024-05-07T13:56:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.803+0000 7f27e544b640 1 --2- 172.21.15.50:0/1176532975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e37403e0 0x5605e37428a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00a470 tx=0x7f27dc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7aaca73bcfb4f3e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.803+0000 7f27e4c4a640 1 -- 172.21.15.50:0/1176532975 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27dc057070 con 0x5605e37403e0 2024-05-07T13:56:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.803+0000 7f27e4c4a640 1 -- 172.21.15.50:0/1176532975 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27dc052570 con 0x5605e37403e0 2024-05-07T13:56:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.803+0000 7f27e4c4a640 1 -- 172.21.15.50:0/1176532975 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27dc052870 con 0x5605e37403e0 2024-05-07T13:56:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.804+0000 7f27e8146800 1 -- 172.21.15.50:0/1176532975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e37403e0 msgr2=0x5605e37428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.804+0000 7f27e8146800 1 --2- 172.21.15.50:0/1176532975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e37403e0 0x5605e37428a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00a470 tx=0x7f27dc01ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.804+0000 7f27e8146800 1 -- 172.21.15.50:0/1176532975 shutdown_connections 2024-05-07T13:56:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.804+0000 7f27e8146800 1 --2- 172.21.15.50:0/1176532975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e37403e0 0x5605e37428a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.804+0000 7f27e8146800 1 -- 172.21.15.50:0/1176532975 >> 172.21.15.50:0/1176532975 conn(0x5605e3736570 msgr2=0x5605e3738990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.804+0000 7f27e8146800 1 -- 172.21.15.50:0/1176532975 shutdown_connections 2024-05-07T13:56:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.804+0000 7f27e8146800 1 -- 172.21.15.50:0/1176532975 wait complete. 2024-05-07T13:56:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.819+0000 7f27e8146800 1 Processor -- start 2024-05-07T13:56:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.819+0000 7f27e8146800 1 -- start start 2024-05-07T13:56:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.819+0000 7f27e8146800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e373c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.819+0000 7f27e8146800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5605e36871c0 con 0x5605e36af8b0 2024-05-07T13:56:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.820+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e373c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.820+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e373c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45146/0 (socket says 172.21.15.50:45146) 2024-05-07T13:56:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.820+0000 7f27e5c4c640 1 -- 172.21.15.50:0/1771860387 learned_addr learned my addr 172.21.15.50:0/1771860387 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.820+0000 7f27e5c4c640 1 -- 172.21.15.50:0/1771860387 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e373ab80 con 0x5605e36af8b0 2024-05-07T13:56:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.820+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/1771860387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e373c5c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f27d8001de0 tx=0x7f27d800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4571b9eb456b64 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.820+0000 7f26d3e07640 1 -- 172.21.15.50:0/1771860387 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d8012020 con 0x5605e36af8b0 2024-05-07T13:56:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.820+0000 7f26d3e07640 1 -- 172.21.15.50:0/1771860387 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d800e5a0 con 0x5605e36af8b0 2024-05-07T13:56:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.820+0000 7f26d3e07640 1 -- 172.21.15.50:0/1771860387 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d800e8c0 con 0x5605e36af8b0 2024-05-07T13:56:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.821+0000 7f27e8146800 1 -- 172.21.15.50:0/1771860387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 msgr2=0x5605e373c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.821+0000 7f27e8146800 1 --2- 172.21.15.50:0/1771860387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e373c5c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f27d8001de0 tx=0x7f27d800b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.821+0000 7f27e8146800 1 -- 172.21.15.50:0/1771860387 shutdown_connections 2024-05-07T13:56:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.821+0000 7f27e8146800 1 --2- 172.21.15.50:0/1771860387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e373c5c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.821+0000 7f27e8146800 1 -- 172.21.15.50:0/1771860387 >> 172.21.15.50:0/1771860387 conn(0x5605e3736570 msgr2=0x5605e3829070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.821+0000 7f27e8146800 1 -- 172.21.15.50:0/1771860387 shutdown_connections 2024-05-07T13:56:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.821+0000 7f27e8146800 1 -- 172.21.15.50:0/1771860387 wait complete. 2024-05-07T13:56:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.821+0000 7f27e8146800 1 Processor -- start 2024-05-07T13:56:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.821+0000 7f27e8146800 1 -- start start 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f27e8146800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e3837460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f27e8146800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5605e3743420 con 0x5605e36af8b0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e3837460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e3837460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45158/0 (socket says 172.21.15.50:45158) 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f27e5c4c640 1 -- 172.21.15.50:0/102430774 learned_addr learned my addr 172.21.15.50:0/102430774 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f27e5c4c640 1 -- 172.21.15.50:0/102430774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e38379a0 con 0x5605e36af8b0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e3837460 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c010 tx=0x7f27d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f26d2604640 1 -- 172.21.15.50:0/102430774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d8012070 con 0x5605e36af8b0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f26d2604640 1 -- 172.21.15.50:0/102430774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d801a7a0 con 0x5605e36af8b0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605e3837c30 con 0x5605e36af8b0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f26d2604640 1 -- 172.21.15.50:0/102430774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d801aa80 con 0x5605e36af8b0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.822+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605e383a8e0 con 0x5605e36af8b0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.823+0000 7f26d2604640 1 -- 172.21.15.50:0/102430774 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f27d8015020 con 0x5605e36af8b0 2024-05-07T13:56:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.823+0000 7f26d2604640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26cc036950 0x7f26cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.823+0000 7f26d2604640 1 -- 172.21.15.50:0/102430774 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f27d8020070 con 0x5605e36af8b0 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.824+0000 7f27e544b640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26cc036950 0x7f26cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.824+0000 7f27e8146800 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e37403e0 0x5605e383e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.824+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e383ebe0 con 0x5605e37403e0 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.824+0000 7f27e644d640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e37403e0 0x5605e383e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.824+0000 7f27e544b640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26cc036950 0x7f26cc038e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27dc054000 tx=0x7f27dc04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.824+0000 7f27e644d640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e37403e0 0x5605e383e6a0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.824+0000 7f27e644d640 1 -- 172.21.15.50:0/102430774 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e37403e0 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.824+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e383bc70 con 0x5605e37403e0 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.825+0000 7f27e644d640 1 -- 172.21.15.50:0/102430774 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e37403e0 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.825+0000 7f27e8146800 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e3840f30 0x5605e3843320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.825+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e3843a10 con 0x5605e3840f30 2024-05-07T13:56:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.825+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e3840f30 0x5605e3843320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.825+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e3840f30 0x5605e3843320 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.826+0000 7f27e5c4c640 1 -- 172.21.15.50:0/102430774 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f27d802b070 con 0x5605e3840f30 2024-05-07T13:56:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.826+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e383fee0 con 0x5605e37403e0 2024-05-07T13:56:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.826+0000 7f27e644d640 1 -- 172.21.15.50:0/102430774 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e37403e0 2024-05-07T13:56:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.826+0000 7f27e8146800 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5605e3844ec0 0x5605e3847310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.826+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e3847a70 con 0x5605e3844ec0 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.826+0000 7f27e544b640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5605e3844ec0 0x5605e3847310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.827+0000 7f27e544b640 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5605e3844ec0 0x5605e3847310 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.827+0000 7f27e544b640 1 -- 172.21.15.50:0/102430774 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f27dc05a040 con 0x5605e3844ec0 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.827+0000 7f27e8146800 1 Processor -- start 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.827+0000 7f27e8146800 1 -- start start 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f27e8146800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3855ed0 0x5605e38562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f27e8146800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5605e362dcf0 con 0x5605e3855ed0 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3855ed0 0x5605e38562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3855ed0 0x5605e38562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45170/0 (socket says 172.21.15.50:45170) 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3081431624 learned_addr learned my addr 172.21.15.50:0/3081431624 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3081431624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e3856830 con 0x5605e3855ed0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/3081431624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3855ed0 0x5605e38562f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f27d804aa00 tx=0x7f27d800df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f26cb7fe640 1 -- 172.21.15.50:0/3081431624 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80490e0 con 0x5605e3855ed0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f26cb7fe640 1 -- 172.21.15.50:0/3081431624 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d8049280 con 0x5605e3855ed0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f27e8146800 1 -- 172.21.15.50:0/3081431624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605e38572a0 con 0x5605e3855ed0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f26cb7fe640 1 -- 172.21.15.50:0/3081431624 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d8049580 con 0x5605e3855ed0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.828+0000 7f27e8146800 1 -- 172.21.15.50:0/3081431624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605e38577a0 con 0x5605e3855ed0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.829+0000 7f26cb7fe640 1 -- 172.21.15.50:0/3081431624 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f27d8044060 con 0x5605e3855ed0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.829+0000 7f26cb7fe640 1 --2- 172.21.15.50:0/3081431624 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26c0036950 0x7f26c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.829+0000 7f26cb7fe640 1 -- 172.21.15.50:0/3081431624 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f27d8025030 con 0x5605e3855ed0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.829+0000 7f27e544b640 1 --2- 172.21.15.50:0/3081431624 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26c0036950 0x7f26c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.830+0000 7f27e8146800 1 Processor -- start 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.830+0000 7f27e8146800 1 -- start start 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.830+0000 7f27e544b640 1 --2- 172.21.15.50:0/3081431624 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26c0036950 0x7f26c0038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5605e383f4e0 tx=0x7f27dc005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.830+0000 7f27e8146800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e3863410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.830+0000 7f27e8146800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5605e373af00 con 0x5605e3862ff0 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.830+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e3863410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.830+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e3863410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45174/0 (socket says 172.21.15.50:45174) 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.830+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3737490526 learned_addr learned my addr 172.21.15.50:0/3737490526 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3737490526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e38639e0 con 0x5605e3862ff0 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/3737490526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e3863410 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f27d802ffd0 tx=0x7f27d804c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1384f1ceac62ce4 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f26c97fa640 1 -- 172.21.15.50:0/3737490526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d803d070 con 0x5605e3862ff0 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f26c97fa640 1 -- 172.21.15.50:0/3737490526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d802e450 con 0x5605e3862ff0 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f26c97fa640 1 -- 172.21.15.50:0/3737490526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d8024460 con 0x5605e3862ff0 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f27e8146800 1 -- 172.21.15.50:0/3737490526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 msgr2=0x5605e3863410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f27e8146800 1 --2- 172.21.15.50:0/3737490526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e3863410 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f27d802ffd0 tx=0x7f27d804c5d0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f27e8146800 1 -- 172.21.15.50:0/3737490526 shutdown_connections 2024-05-07T13:56:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f27e8146800 1 --2- 172.21.15.50:0/3737490526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e3863410 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f27e8146800 1 -- 172.21.15.50:0/3737490526 >> 172.21.15.50:0/3737490526 conn(0x5605e385f350 msgr2=0x5605e385d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f27e8146800 1 -- 172.21.15.50:0/3737490526 shutdown_connections 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.831+0000 7f27e8146800 1 -- 172.21.15.50:0/3737490526 wait complete. 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.832+0000 7f27e8146800 1 Processor -- start 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.832+0000 7f27e8146800 1 -- start start 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.832+0000 7f27e8146800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e386a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.832+0000 7f27e8146800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5605e3864090 con 0x5605e3862ff0 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.832+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e386a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.832+0000 7f27e5c4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e386a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45190/0 (socket says 172.21.15.50:45190) 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.832+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 learned_addr learned my addr 172.21.15.50:0/3934830532 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.832+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e386a900 con 0x5605e3862ff0 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.833+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e386a3c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f27d801a6a0 tx=0x7f27d804eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.833+0000 7f26b77fe640 1 -- 172.21.15.50:0/3934830532 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d8019330 con 0x5605e3862ff0 2024-05-07T13:56:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.833+0000 7f26b77fe640 1 -- 172.21.15.50:0/3934830532 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d8068030 con 0x5605e3862ff0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.833+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605e386a900 con 0x5605e3862ff0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.833+0000 7f26b77fe640 1 -- 172.21.15.50:0/3934830532 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d8024b30 con 0x5605e3862ff0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.833+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605e386a900 con 0x5605e3862ff0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.834+0000 7f26b77fe640 1 -- 172.21.15.50:0/3934830532 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f27d805f040 con 0x5605e3862ff0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.834+0000 7f26b77fe640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26b0036af0 0x7f26b0038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.834+0000 7f26b77fe640 1 -- 172.21.15.50:0/3934830532 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f27d806ec80 con 0x5605e3862ff0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.834+0000 7f27e544b640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26b0036af0 0x7f26b0038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.834+0000 7f27e544b640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26b0036af0 0x7f26b0038fb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5605e3847e70 tx=0x7f27dc04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.835+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.835+0000 7f27e8146800 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e3875b30 0x5605e3877ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.835+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e3878740 con 0x5605e3875b30 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.835+0000 7f27e644d640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e3875b30 0x5605e3877ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.835+0000 7f27e644d640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e3875b30 0x5605e3877ff0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.835+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e3875b30 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 20 realm 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e3878b50 con 0x5605e3875b30 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e3875b30 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e3879420 con 0x5605e3875b30 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e3875b30 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x5605e3875b30 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e3875b30 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e387a520 0x5605e387c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e387cf20 con 0x5605e387a520 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.836+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e387a520 0x5605e387c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.837+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e387a520 0x5605e387c910 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.837+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.837+0000 7f27e8146800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.837+0000 7f27e8146800 20 searching for the correct realm 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.837+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e387e850 con 0x5605e387a520 2024-05-07T13:56:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.837+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.837+0000 7f27e5c4c640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f27d8017050 0x7f27d8019670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.837+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e387e850 con 0x7f27d8017050 2024-05-07T13:56:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.838+0000 7f27e544b640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f27d8017050 0x7f27d8019670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.838+0000 7f27e544b640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f27d8017050 0x7f27d8019670 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.838+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.838+0000 7f27e544b640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f27dc074040 0x7f27dc081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.838+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e387e850 con 0x7f27dc074040 2024-05-07T13:56:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.839+0000 7f27e644d640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f27dc074040 0x7f27dc081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.839+0000 7f27e644d640 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f27dc074040 0x7f27dc081410 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.839+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e000a4a0 con 0x7f27dc074040 2024-05-07T13:56:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.839+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x5605e3875b30 2024-05-07T13:56:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.839+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e3875b30 2024-05-07T13:56:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.839+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x5605e3875b30 2024-05-07T13:56:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.840+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e3875b30 2024-05-07T13:56:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.840+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x7f27dc074040 2024-05-07T13:56:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.840+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e000a4a0 con 0x7f27dc074040 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.840+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x7f27dc074040 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.840+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f27e000a4a0 con 0x7f27dc074040 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.840+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x7f27d8017050 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.841+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.841+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x5605e387a520 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.841+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.841+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x5605e3875b30 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.841+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e3875b30 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.841+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x7f27dc074040 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.842+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e000a4a0 con 0x7f27dc074040 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.842+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x5605e3875b30 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.842+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e3875b30 2024-05-07T13:56:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.842+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5605e38797c0 con 0x7f27d8017050 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.842+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.842+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27dc08e060 con 0x5605e387a520 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.842+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.842+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27dc08e060 con 0x5605e387a520 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.843+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.843+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x7f27dc074040 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.843+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e000a4a0 con 0x7f27dc074040 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.843+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x5605e387a520 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.843+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.843+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x5605e387a520 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.844+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.844+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x5605e3875b30 2024-05-07T13:56:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.844+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e000a4a0 con 0x5605e3875b30 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.844+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x5605e3875b30 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.844+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.844+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x7f27dc074040 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.844+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.845+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x5605e387a520 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.845+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.845+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x7f27d8017050 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.845+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.845+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x5605e3875b30 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.845+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.845+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x7f27dc074040 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.846+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.846+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x5605e387a520 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.846+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.846+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x7f27dc074040 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.846+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.846+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x7f27d8017050 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.847+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.847+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x5605e387a520 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.847+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.847+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x7f27dc074040 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.847+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.847+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x5605e3875b30 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.847+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.847+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f27d8084080 con 0x7f27d8017050 2024-05-07T13:56:31.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e387d7e0 con 0x5605e3875b30 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e387dbd0 con 0x5605e3875b30 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.848+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e387dbd0 con 0x7f27dc074040 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 zone default found 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 4 Realm: () 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 zonegroup default 2024-05-07T13:56:31.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e387ecd0 con 0x7f27dc074040 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e38806b0 con 0x5605e387a520 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e3880a50 con 0x5605e387a520 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 started sync module instance, tier type = 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.849+0000 7f27e8146800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:31.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.850+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e387fb50 con 0x7f27d8017050 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.850+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.851+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94583292163744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3880df0 con 0x7f27d8017050 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.851+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3881680 con 0x5605e3875b30 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.851+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94583292163744] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.852+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.852+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94583292166000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3881aa0 con 0x5605e3875b30 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.852+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38824e0 con 0x5605e387a520 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.853+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.853+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94583292174256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3882d80 con 0x5605e387a520 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.853+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3883860 con 0x7f27d8017050 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.853+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94583292166000] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.854+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94583292174256] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.854+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.854+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94583292170640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3882d80 con 0x7f27d8017050 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.854+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3884140 con 0x5605e3875b30 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.855+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.855+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94583292181584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38849e0 con 0x5605e3875b30 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.855+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3885480 con 0x7f27dc074040 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.855+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94583292170640] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.856+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94583292181584] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.856+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.856+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94583292186448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38844e0 con 0x7f27dc074040 2024-05-07T13:56:31.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.856+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3885d20 con 0x7f27dc074040 2024-05-07T13:56:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.857+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94583292186448] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.857+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.857+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94583292183648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3885870 con 0x7f27dc074040 2024-05-07T13:56:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.857+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38862f0 con 0x7f27dc074040 2024-05-07T13:56:31.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94583292183648] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94583292190176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38862b0 con 0x7f27dc074040 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e8146800 20 add_watcher() i=0 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e8146800 20 add_watcher() i=1 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e8146800 20 add_watcher() i=2 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e8146800 20 add_watcher() i=3 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e8146800 20 add_watcher() i=4 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e8146800 20 add_watcher() i=5 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.858+0000 7f27e8146800 20 add_watcher() i=6 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.859+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94583292190176] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.859+0000 7f27e8146800 20 add_watcher() i=7 2024-05-07T13:56:31.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.859+0000 7f27e8146800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.859+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e3889710 con 0x5605e3875b30 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.859+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.860+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94583292176592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e3886c00 con 0x5605e3875b30 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94583292176592] v27'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f26977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f27e8146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f27e8146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f27e8146800 5 note: GC not initialized 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f26967fc640 20 reqs_thread_entry: start 2024-05-07T13:56:31.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f27e8146800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f27e8146800 20 Filter name: none 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f2607fff640 20 reqs_thread_entry: start 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f27e8146800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.861+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e38bd230 con 0x7f27d8017050 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 : miss 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.1 8:81cb16aa:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e38beca0 con 0x7f27dc074040 2024-05-07T13:56:31.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 info.flags=0x17 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 to cache LRU end 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 20 get_obj_state: octx=0x7f27e000aad0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5605e38c1368 s->prefetch_data=0 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.862+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 3.18s0 3:181ca4bd:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x5605e387a520 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.863+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.863+0000 7f27e8146800 10 manifest: total_size = 5 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.863+0000 7f27e8146800 20 get_obj_state: setting s->obj_tag to _fyZZWRmaENIr7YGZ638Ll_u56bY0HY4 2024-05-07T13:56:31.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.864+0000 7f26977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.864+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94583292176592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x5605e3875b30 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.865+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94583292176592] v27'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.865+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94583292163744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x7f27d8017050 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.866+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94583292163744] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.866+0000 7f27e8146800 20 remove_watcher() i=0 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.866+0000 7f27e8146800 2 removed watcher, disabling cache 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.866+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94583292166000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x5605e3875b30 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.867+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94583292166000] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.867+0000 7f27e8146800 20 remove_watcher() i=1 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.867+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94583292174256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x5605e387a520 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.868+0000 7f27e5c4c640 1 -- 172.21.15.50:0/3934830532 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94583292174256] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d802b070 con 0x5605e387a520 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.868+0000 7f27e8146800 20 remove_watcher() i=2 2024-05-07T13:56:31.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.868+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94583292170640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x7f27d8017050 2024-05-07T13:56:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.869+0000 7f27e544b640 1 -- 172.21.15.50:0/3934830532 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94583292170640] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27dc07f070 con 0x7f27d8017050 2024-05-07T13:56:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.869+0000 7f27e8146800 20 remove_watcher() i=3 2024-05-07T13:56:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.869+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94583292181584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x5605e3875b30 2024-05-07T13:56:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.870+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94583292181584] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x5605e3875b30 2024-05-07T13:56:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.870+0000 7f27e8146800 20 remove_watcher() i=4 2024-05-07T13:56:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.870+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94583292186448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x7f27dc074040 2024-05-07T13:56:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.871+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94583292186448] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.871+0000 7f27e8146800 20 remove_watcher() i=5 2024-05-07T13:56:31.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.871+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94583292183648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x7f27dc074040 2024-05-07T13:56:31.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.872+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94583292183648] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.873+0000 7f27e8146800 20 remove_watcher() i=6 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.873+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94583292190176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5605e38c24a0 con 0x7f27dc074040 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94583292190176] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27e002f060 con 0x7f27dc074040 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 20 remove_watcher() i=7 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f27dc074040 msgr2=0x7f27dc081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f27dc074040 0x7f27dc081410 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e3875b30 msgr2=0x5605e3877ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e3875b30 0x5605e3877ff0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f27d8017050 msgr2=0x7f27d8019670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f27d8017050 0x7f27d8019670 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e387a520 msgr2=0x5605e387c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e387a520 0x5605e387c910 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26b0036af0 msgr2=0x7f26b0038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26b0036af0 0x7f26b0038fb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5605e3847e70 tx=0x7f27dc04f000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 msgr2=0x5605e386a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e386a3c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f27d801a6a0 tx=0x7f27d804eea0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e644d640 1 -- 172.21.15.50:0/3934830532 reap_dead start 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 shutdown_connections 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 --2- 172.21.15.50:0/3934830532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3862ff0 0x5605e386a3c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 >> 172.21.15.50:0/3934830532 conn(0x5605e385f350 msgr2=0x5605e385c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 shutdown_connections 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3934830532 wait complete. 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3081431624 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26c0036950 msgr2=0x7f26c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 --2- 172.21.15.50:0/3081431624 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26c0036950 0x7f26c0038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5605e383f4e0 tx=0x7f27dc005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 -- 172.21.15.50:0/3081431624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3855ed0 msgr2=0x5605e38562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.874+0000 7f27e8146800 1 --2- 172.21.15.50:0/3081431624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3855ed0 0x5605e38562f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f27d804aa00 tx=0x7f27d800df30 comp rx=0 tx=0).stop 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/3081431624 shutdown_connections 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 --2- 172.21.15.50:0/3081431624 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26c0036950 0x7f26c0038e10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 --2- 172.21.15.50:0/3081431624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e3855ed0 0x5605e38562f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/3081431624 >> 172.21.15.50:0/3081431624 conn(0x5605e3849f70 msgr2=0x5605e384a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/3081431624 shutdown_connections 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/3081431624 wait complete. 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5605e3844ec0 msgr2=0x5605e3847310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5605e3844ec0 0x5605e3847310 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e37403e0 msgr2=0x5605e383e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5605e37403e0 0x5605e383e6a0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e3840f30 msgr2=0x5605e3843320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5605e3840f30 0x5605e3843320 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26cc036950 msgr2=0x7f26cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f26cc036950 0x7f26cc038e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27dc054000 tx=0x7f27dc04e000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 msgr2=0x5605e3837460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 --2- 172.21.15.50:0/102430774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5605e36af8b0 0x5605e3837460 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f27d800c010 tx=0x7f27d8000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e644d640 1 -- 172.21.15.50:0/102430774 reap_dead start 2024-05-07T13:56:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 shutdown_connections 2024-05-07T13:56:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 >> 172.21.15.50:0/102430774 conn(0x5605e3736570 msgr2=0x5605e373b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 shutdown_connections 2024-05-07T13:56:31.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.875+0000 7f27e8146800 1 -- 172.21.15.50:0/102430774 wait complete. 2024-05-07T13:56:31.873 INFO:teuthology.orchestra.run.smithi050.stdout:fooFoofooFooFULL_CONTROL 2024-05-07T13:56:31.873 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-05-07T13:56:31.876 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-05-07T13:56:31.880 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:31.880 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-07T13:56:31.880 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-07T13:56:31.881 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-07T13:56:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:31.927 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.940+0000 7f5569325800 1 Processor -- start 2024-05-07T13:56:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.940+0000 7f5569325800 1 -- start start 2024-05-07T13:56:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.940+0000 7f5569325800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556d9731db70 0x556d9731ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.940+0000 7f5569325800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556d97323fb0 con 0x556d973204a0 2024-05-07T13:56:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.940+0000 7f5569325800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x556d971ae050 con 0x556d9731db70 2024-05-07T13:56:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.941+0000 7f55650b7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556d9731db70 0x556d9731ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.941+0000 7f55648b6640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x556d973204a0 0x556d97322890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:44040/0 (socket says 172.21.15.50:44040) 2024-05-07T13:56:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.941+0000 7f55650b7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556d9731db70 0x556d9731ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45192/0 (socket says 172.21.15.50:45192) 2024-05-07T13:56:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.941+0000 7f55648b6640 1 -- 172.21.15.50:0/3950881928 learned_addr learned my addr 172.21.15.50:0/3950881928 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.941+0000 7f55650b7640 1 -- 172.21.15.50:0/3950881928 >> v1:172.21.15.22:6789/0 conn(0x556d973204a0 legacy=0x556d97322890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.941+0000 7f55650b7640 1 -- 172.21.15.50:0/3950881928 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d97325190 con 0x556d9731db70 2024-05-07T13:56:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.943+0000 7f55650b7640 1 --2- 172.21.15.50:0/3950881928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d9731ff60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5558005fd0 tx=0x7f555801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa98c8977ed23e79 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.943+0000 7f5557fff640 1 -- 172.21.15.50:0/3950881928 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5558052560 con 0x556d9731db70 2024-05-07T13:56:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.943+0000 7f5557fff640 1 -- 172.21.15.50:0/3950881928 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5558052700 con 0x556d9731db70 2024-05-07T13:56:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.943+0000 7f5557fff640 1 -- 172.21.15.50:0/3950881928 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5558052a60 con 0x556d9731db70 2024-05-07T13:56:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.944+0000 7f5569325800 1 -- 172.21.15.50:0/3950881928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 msgr2=0x556d9731ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.944+0000 7f5569325800 1 --2- 172.21.15.50:0/3950881928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d9731ff60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5558005fd0 tx=0x7f555801ccc0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.944+0000 7f5569325800 1 -- 172.21.15.50:0/3950881928 shutdown_connections 2024-05-07T13:56:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.944+0000 7f5569325800 1 --2- 172.21.15.50:0/3950881928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d9731ff60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.944+0000 7f5569325800 1 -- 172.21.15.50:0/3950881928 >> 172.21.15.50:0/3950881928 conn(0x556d973175c0 msgr2=0x556d973199e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.944+0000 7f5569325800 1 -- 172.21.15.50:0/3950881928 shutdown_connections 2024-05-07T13:56:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.944+0000 7f5569325800 1 -- 172.21.15.50:0/3950881928 wait complete. 2024-05-07T13:56:31.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.959+0000 7f5569325800 1 Processor -- start 2024-05-07T13:56:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.959+0000 7f5569325800 1 -- start start 2024-05-07T13:56:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.959+0000 7f5569325800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d9731d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.959+0000 7f5569325800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556d972681c0 con 0x556d9731db70 2024-05-07T13:56:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.959+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d9731d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.959+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d9731d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45196/0 (socket says 172.21.15.50:45196) 2024-05-07T13:56:31.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.959+0000 7f55650b7640 1 -- 172.21.15.50:0/2445023482 learned_addr learned my addr 172.21.15.50:0/2445023482 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.960+0000 7f55650b7640 1 -- 172.21.15.50:0/2445023482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d9731ba70 con 0x556d9731db70 2024-05-07T13:56:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.960+0000 7f55650b7640 1 --2- 172.21.15.50:0/2445023482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d9731d4b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5558007000 tx=0x7f555804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68deb3a0464f524 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.960+0000 7f5453606640 1 -- 172.21.15.50:0/2445023482 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55580529e0 con 0x556d9731db70 2024-05-07T13:56:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.960+0000 7f5453606640 1 -- 172.21.15.50:0/2445023482 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5558052b80 con 0x556d9731db70 2024-05-07T13:56:31.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.960+0000 7f5453606640 1 -- 172.21.15.50:0/2445023482 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f555805c430 con 0x556d9731db70 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 -- 172.21.15.50:0/2445023482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 msgr2=0x556d9731d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 --2- 172.21.15.50:0/2445023482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d9731d4b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5558007000 tx=0x7f555804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 -- 172.21.15.50:0/2445023482 shutdown_connections 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 --2- 172.21.15.50:0/2445023482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d9731d4b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 -- 172.21.15.50:0/2445023482 >> 172.21.15.50:0/2445023482 conn(0x556d973175c0 msgr2=0x556d9740a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 -- 172.21.15.50:0/2445023482 shutdown_connections 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 -- 172.21.15.50:0/2445023482 wait complete. 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 Processor -- start 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 -- start start 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d97418410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.961+0000 7f5569325800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556d97324420 con 0x556d9731db70 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d97418410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d97418410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45210/0 (socket says 172.21.15.50:45210) 2024-05-07T13:56:31.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f55650b7640 1 -- 172.21.15.50:0/2914994500 learned_addr learned my addr 172.21.15.50:0/2914994500 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f55650b7640 1 -- 172.21.15.50:0/2914994500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d97418950 con 0x556d9731db70 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f55650b7640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d97418410 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f55580526d0 tx=0x7f5558003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f5451e03640 1 -- 172.21.15.50:0/2914994500 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5558075070 con 0x556d9731db70 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f5451e03640 1 -- 172.21.15.50:0/2914994500 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5558070410 con 0x556d9731db70 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d97418be0 con 0x556d9731db70 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f5451e03640 1 -- 172.21.15.50:0/2914994500 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55580529e0 con 0x556d9731db70 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.962+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d9741b890 con 0x556d9731db70 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.963+0000 7f5451e03640 1 -- 172.21.15.50:0/2914994500 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5558078070 con 0x556d9731db70 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.963+0000 7f5451e03640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f544c036950 0x7f544c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.963+0000 7f5451e03640 1 -- 172.21.15.50:0/2914994500 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f555806d070 con 0x556d9731db70 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.963+0000 7f55648b6640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f544c036950 0x7f544c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.963+0000 7f5569325800 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d973204a0 0x556d9741f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.963+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9741fbd0 con 0x556d973204a0 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.964+0000 7f55658b8640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d973204a0 0x556d9741f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.964+0000 7f55648b6640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f544c036950 0x7f544c038e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f555c000f60 tx=0x7f555c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.964+0000 7f55658b8640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d973204a0 0x556d9741f650 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.964+0000 7f55658b8640 1 -- 172.21.15.50:0/2914994500 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d973204a0 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.964+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9741cc00 con 0x556d973204a0 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.964+0000 7f55658b8640 1 -- 172.21.15.50:0/2914994500 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55600083e0 con 0x556d973204a0 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.965+0000 7f5569325800 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d97421f30 0x556d97424320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.965+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d97424a10 con 0x556d97421f30 2024-05-07T13:56:31.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.965+0000 7f55650b7640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d97421f30 0x556d97424320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.965+0000 7f55650b7640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d97421f30 0x556d97424320 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.965+0000 7f55650b7640 1 -- 172.21.15.50:0/2914994500 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5558077030 con 0x556d97421f30 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.965+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d97420ee0 con 0x556d973204a0 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.966+0000 7f55658b8640 1 -- 172.21.15.50:0/2914994500 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55600083e0 con 0x556d973204a0 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.966+0000 7f5569325800 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556d97425ec0 0x556d974282f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.966+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d97428a80 con 0x556d97425ec0 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.966+0000 7f55648b6640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556d97425ec0 0x556d974282f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.966+0000 7f55648b6640 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556d97425ec0 0x556d974282f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.966+0000 7f55648b6640 1 -- 172.21.15.50:0/2914994500 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f555c009050 con 0x556d97425ec0 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.967+0000 7f5569325800 1 Processor -- start 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.967+0000 7f5569325800 1 -- start start 2024-05-07T13:56:31.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.967+0000 7f5569325800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97436ee0 0x556d97437300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.967+0000 7f5569325800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556d9720ecf0 con 0x556d97436ee0 2024-05-07T13:56:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.967+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97436ee0 0x556d97437300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.967+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97436ee0 0x556d97437300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45226/0 (socket says 172.21.15.50:45226) 2024-05-07T13:56:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.967+0000 7f55650b7640 1 -- 172.21.15.50:0/3803479235 learned_addr learned my addr 172.21.15.50:0/3803479235 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.967+0000 7f55650b7640 1 -- 172.21.15.50:0/3803479235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d97437840 con 0x556d97436ee0 2024-05-07T13:56:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.968+0000 7f55650b7640 1 --2- 172.21.15.50:0/3803479235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97436ee0 0x556d97437300 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5558067fd0 tx=0x7f555806fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.968+0000 7f544affd640 1 -- 172.21.15.50:0/3803479235 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5558078970 con 0x556d97436ee0 2024-05-07T13:56:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.968+0000 7f544affd640 1 -- 172.21.15.50:0/3803479235 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5558078b10 con 0x556d97436ee0 2024-05-07T13:56:31.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.968+0000 7f544affd640 1 -- 172.21.15.50:0/3803479235 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5558078df0 con 0x556d97436ee0 2024-05-07T13:56:31.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.968+0000 7f5569325800 1 -- 172.21.15.50:0/3803479235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d974382b0 con 0x556d97436ee0 2024-05-07T13:56:31.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.968+0000 7f5569325800 1 -- 172.21.15.50:0/3803479235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d974387b0 con 0x556d97436ee0 2024-05-07T13:56:31.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.968+0000 7f544affd640 1 -- 172.21.15.50:0/3803479235 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5558088040 con 0x556d97436ee0 2024-05-07T13:56:31.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.969+0000 7f544affd640 1 --2- 172.21.15.50:0/3803479235 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f543c036950 0x7f543c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.969+0000 7f544affd640 1 -- 172.21.15.50:0/3803479235 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5558085040 con 0x556d97436ee0 2024-05-07T13:56:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.969+0000 7f55648b6640 1 --2- 172.21.15.50:0/3803479235 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f543c036950 0x7f543c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.969+0000 7f5569325800 1 Processor -- start 2024-05-07T13:56:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.969+0000 7f5569325800 1 -- start start 2024-05-07T13:56:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.969+0000 7f55648b6640 1 --2- 172.21.15.50:0/3803479235 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f543c036950 0x7f543c038e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f555c00bf50 tx=0x7f555c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.969+0000 7f5569325800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d97444550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.969+0000 7f5569325800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556d9731bd90 con 0x556d97444130 2024-05-07T13:56:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.970+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d97444550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.970+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d97444550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45238/0 (socket says 172.21.15.50:45238) 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.970+0000 7f55650b7640 1 -- 172.21.15.50:0/1197173896 learned_addr learned my addr 172.21.15.50:0/1197173896 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.970+0000 7f55650b7640 1 -- 172.21.15.50:0/1197173896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d97444b20 con 0x556d97444130 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.970+0000 7f55650b7640 1 --2- 172.21.15.50:0/1197173896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d97444550 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5558078ff0 tx=0x7f555805ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fe5a45a1b9ae97 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.970+0000 7f5448ff9640 1 -- 172.21.15.50:0/1197173896 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f555805a320 con 0x556d97444130 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.970+0000 7f5448ff9640 1 -- 172.21.15.50:0/1197173896 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555807ac60 con 0x556d97444130 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.970+0000 7f5448ff9640 1 -- 172.21.15.50:0/1197173896 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f555808a470 con 0x556d97444130 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 -- 172.21.15.50:0/1197173896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 msgr2=0x556d97444550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 --2- 172.21.15.50:0/1197173896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d97444550 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5558078ff0 tx=0x7f555805ae10 comp rx=0 tx=0).stop 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 -- 172.21.15.50:0/1197173896 shutdown_connections 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 --2- 172.21.15.50:0/1197173896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d97444550 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 -- 172.21.15.50:0/1197173896 >> 172.21.15.50:0/1197173896 conn(0x556d97440400 msgr2=0x556d9743e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 -- 172.21.15.50:0/1197173896 shutdown_connections 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 -- 172.21.15.50:0/1197173896 wait complete. 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 Processor -- start 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 -- start start 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d9744b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f5569325800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556d97445180 con 0x556d97444130 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d9744b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f55650b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d9744b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45246/0 (socket says 172.21.15.50:45246) 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.971+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 learned_addr learned my addr 172.21.15.50:0/3982529855 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.972+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d9744b9f0 con 0x556d97444130 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.972+0000 7f55650b7640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d9744b4b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f555804ffc0 tx=0x7f5558089ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.972+0000 7f543affd640 1 -- 172.21.15.50:0/3982529855 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f555808a470 con 0x556d97444130 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.972+0000 7f543affd640 1 -- 172.21.15.50:0/3982529855 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555808ab00 con 0x556d97444130 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.972+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d9744b9f0 con 0x556d97444130 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.972+0000 7f543affd640 1 -- 172.21.15.50:0/3982529855 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f555805a320 con 0x556d97444130 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.972+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d9744b9f0 con 0x556d97444130 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.973+0000 7f543affd640 1 -- 172.21.15.50:0/3982529855 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5558070900 con 0x556d97444130 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.973+0000 7f543affd640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5430036950 0x7f5430038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.973+0000 7f543affd640 1 -- 172.21.15.50:0/3982529855 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f55580b12b0 con 0x556d97444130 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.973+0000 7f55648b6640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5430036950 0x7f5430038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.974+0000 7f55648b6640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5430036950 0x7f5430038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f555c001b60 tx=0x7f555c010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.974+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.974+0000 7f5569325800 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d97456ba0 0x556d97459060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.974+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d974597b0 con 0x556d97456ba0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.974+0000 7f55658b8640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d97456ba0 0x556d97459060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.974+0000 7f55658b8640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d97456ba0 0x556d97459060 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 20 realm 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d97459bc0 con 0x556d97456ba0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d97456ba0 2024-05-07T13:56:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a830 con 0x556d97456ba0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d9745b1f0 0x556d9745d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9745dc30 con 0x556d9745b1f0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.975+0000 7f55650b7640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d9745b1f0 0x556d9745d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.976+0000 7f55650b7640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d9745b1f0 0x556d9745d5e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.976+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.976+0000 7f5569325800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:31.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.976+0000 7f5569325800 20 searching for the correct realm 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.976+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745f540 con 0x556d9745b1f0 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.977+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.977+0000 7f55650b7640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f555807a060 0x7f5558094670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.977+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745f540 con 0x7f555807a060 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.977+0000 7f55648b6640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f555807a060 0x7f5558094670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.977+0000 7f55648b6640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f555807a060 0x7f5558094670 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.977+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.977+0000 7f55648b6640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f555c037040 0x7f555c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.977+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745f540 con 0x7f555c037040 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.977+0000 7f55658b8640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f555c037040 0x7f555c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.978+0000 7f55658b8640 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f555c037040 0x7f555c036410 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.978+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.978+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d97456ba0 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.978+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.978+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d97456ba0 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.979+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.979+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555c037040 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.979+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.979+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555c037040 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.979+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.979+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555807a060 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.979+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.980+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d9745b1f0 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.980+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.980+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d97456ba0 2024-05-07T13:56:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.980+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.980+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555c037040 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.980+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.980+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d97456ba0 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.981+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.981+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555807a060 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.981+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.981+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d9745b1f0 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.981+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.981+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d9745b1f0 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.981+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.981+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555c037040 2024-05-07T13:56:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.982+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.982+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d9745b1f0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.982+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.982+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d9745b1f0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.982+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.982+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d97456ba0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.983+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.983+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d97456ba0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.983+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.983+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555c037040 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.983+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.983+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d9745b1f0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.984+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.984+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555807a060 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.984+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.984+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d97456ba0 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.984+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.984+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555c037040 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.985+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.985+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d9745b1f0 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.985+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.985+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555c037040 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.985+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.985+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555807a060 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.985+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:31.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.985+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d9745b1f0 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555c037040 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x556d97456ba0 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556d9745a490 con 0x7f555807a060 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f5569325800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f5569325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f5569325800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f5569325800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:31.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f5569325800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f5569325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.986+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9745dfd0 con 0x556d97456ba0 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9745e3c0 con 0x556d97456ba0 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9745e3c0 con 0x7f555c037040 2024-05-07T13:56:31.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 20 zone default found 2024-05-07T13:56:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 4 Realm: () 2024-05-07T13:56:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 20 zonegroup default 2024-05-07T13:56:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:31.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.987+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9745f9c0 con 0x7f555c037040 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d974613a0 con 0x556d9745b1f0 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d97461740 con 0x556d9745b1f0 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:32.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 20 started sync module instance, tier type = 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.988+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97460840 con 0x7f555807a060 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.989+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.989+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93929177744272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97461ae0 con 0x7f555807a060 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.989+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97462370 con 0x556d97456ba0 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.990+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93929177744272] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.990+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.991+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93929177746528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97462760 con 0x556d97456ba0 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.991+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d974631a0 con 0x556d9745b1f0 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.992+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.992+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93929177754736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97463160 con 0x556d9745b1f0 2024-05-07T13:56:32.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.992+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97464180 con 0x7f555807a060 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.992+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93929177746528] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.993+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93929177754736] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.993+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.993+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93929177758864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97461e80 con 0x7f555807a060 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.993+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97464a60 con 0x556d97456ba0 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.994+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.994+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93929177761136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97465300 con 0x556d97456ba0 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.994+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97465df0 con 0x7f555c037040 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.994+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93929177758864] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.995+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.995+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93929177766080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97465db0 con 0x7f555c037040 2024-05-07T13:56:32.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.995+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93929177761136] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.995+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97464e50 con 0x7f555c037040 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.996+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93929177766080] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.996+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.996+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93929177763408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97466380 con 0x7f555c037040 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.996+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97466d40 con 0x7f555c037040 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93929177770128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d97467160 con 0x7f555c037040 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f5569325800 20 add_watcher() i=0 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f5569325800 20 add_watcher() i=1 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f5569325800 20 add_watcher() i=2 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f5569325800 20 add_watcher() i=3 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f5569325800 20 add_watcher() i=4 2024-05-07T13:56:32.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f5569325800 20 add_watcher() i=5 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93929177763408] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.997+0000 7f5569325800 20 add_watcher() i=6 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.998+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93929177770128] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.998+0000 7f5569325800 20 add_watcher() i=7 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.998+0000 7f5569325800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.998+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d97467160 con 0x556d97456ba0 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.998+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.998+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93929177771184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d974670d0 con 0x556d97456ba0 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.999+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93929177771184] v27'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.999+0000 7f541b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.999+0000 7f5569325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:31.999+0000 7f5569325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:32.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.000+0000 7f5569325800 5 note: GC not initialized 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.000+0000 7f541a7e4640 20 reqs_thread_entry: start 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.000+0000 7f5569325800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.000+0000 7f5569325800 20 Filter name: none 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.000+0000 7f538bfff640 20 reqs_thread_entry: start 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.000+0000 7f5569325800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.000+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.000+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9749dbc0 con 0x7f555807a060 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.000+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 : miss 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.1 8:81cb16aa:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d9749fa30 con 0x7f555c037040 2024-05-07T13:56:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 info.flags=0x17 2024-05-07T13:56:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 to cache LRU end 2024-05-07T13:56:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:32.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 2024-05-07T13:56:32.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 20 get_obj_state: octx=0x7f5560008ce0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x556d974a20f8 s->prefetch_data=0 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 3.18s0 3:181ca4bd:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556d974a3190 con 0x556d9745b1f0 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 10 manifest: total_size = 5 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.001+0000 7f5569325800 20 get_obj_state: setting s->obj_tag to _v4Bxj4o1R-tDxLifyDtpHoRK8K1d7K_ 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.002+0000 7f541b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.002+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93929177771184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d974a3190 con 0x556d97456ba0 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.003+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93929177771184] v27'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.003+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93929177744272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d974a3190 con 0x7f555807a060 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.004+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93929177744272] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.004+0000 7f5569325800 20 remove_watcher() i=0 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.004+0000 7f5569325800 2 removed watcher, disabling cache 2024-05-07T13:56:32.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.004+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93929177746528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d974a3190 con 0x556d97456ba0 2024-05-07T13:56:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.005+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93929177746528] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.005+0000 7f5569325800 20 remove_watcher() i=1 2024-05-07T13:56:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.005+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93929177754736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d9749f370 con 0x556d9745b1f0 2024-05-07T13:56:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.007+0000 7f55650b7640 1 -- 172.21.15.50:0/3982529855 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93929177754736] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5558077030 con 0x556d9745b1f0 2024-05-07T13:56:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.007+0000 7f5569325800 20 remove_watcher() i=2 2024-05-07T13:56:32.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.007+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93929177758864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d974a3190 con 0x7f555807a060 2024-05-07T13:56:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.008+0000 7f55648b6640 1 -- 172.21.15.50:0/3982529855 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93929177758864] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f555c009050 con 0x7f555807a060 2024-05-07T13:56:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.008+0000 7f5569325800 20 remove_watcher() i=3 2024-05-07T13:56:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.008+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93929177761136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d9749f370 con 0x556d97456ba0 2024-05-07T13:56:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.009+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93929177761136] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x556d97456ba0 2024-05-07T13:56:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.009+0000 7f5569325800 20 remove_watcher() i=4 2024-05-07T13:56:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.009+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93929177766080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d974a3190 con 0x7f555c037040 2024-05-07T13:56:32.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.010+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93929177766080] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.010+0000 7f5569325800 20 remove_watcher() i=5 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.010+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93929177763408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d9749f370 con 0x7f555c037040 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.011+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93929177763408] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.011+0000 7f5569325800 20 remove_watcher() i=6 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.011+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93929177770128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556d974a3190 con 0x7f555c037040 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93929177770128] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55600083e0 con 0x7f555c037040 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 20 remove_watcher() i=7 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f555c037040 msgr2=0x7f555c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f555c037040 0x7f555c036410 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d97456ba0 msgr2=0x556d97459060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d97456ba0 0x556d97459060 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f555807a060 msgr2=0x7f5558094670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f555807a060 0x7f5558094670 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d9745b1f0 msgr2=0x556d9745d5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d9745b1f0 0x556d9745d5e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5430036950 msgr2=0x7f5430038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5430036950 0x7f5430038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f555c001b60 tx=0x7f555c010000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 msgr2=0x556d9744b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f55658b8640 1 -- 172.21.15.50:0/3982529855 reap_dead start 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d9744b4b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f555804ffc0 tx=0x7f5558089ee0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 shutdown_connections 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3982529855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97444130 0x556d9744b4b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 >> 172.21.15.50:0/3982529855 conn(0x556d97440400 msgr2=0x556d9743da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 shutdown_connections 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3982529855 wait complete. 2024-05-07T13:56:32.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3803479235 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f543c036950 msgr2=0x7f543c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3803479235 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f543c036950 0x7f543c038e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f555c00bf50 tx=0x7f555c00f000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3803479235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97436ee0 msgr2=0x556d97437300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3803479235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97436ee0 0x556d97437300 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5558067fd0 tx=0x7f555806fe90 comp rx=0 tx=0).stop 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3803479235 shutdown_connections 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3803479235 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f543c036950 0x7f543c038e10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 --2- 172.21.15.50:0/3803479235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d97436ee0 0x556d97437300 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.012+0000 7f5569325800 1 -- 172.21.15.50:0/3803479235 >> 172.21.15.50:0/3803479235 conn(0x556d9742af80 msgr2=0x556d9742b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/3803479235 shutdown_connections 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/3803479235 wait complete. 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556d97425ec0 msgr2=0x556d974282f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556d97425ec0 0x556d974282f0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d973204a0 msgr2=0x556d9741f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556d973204a0 0x556d9741f650 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d97421f30 msgr2=0x556d97424320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556d97421f30 0x556d97424320 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f544c036950 msgr2=0x7f544c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f544c036950 0x7f544c038e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f555c000f60 tx=0x7f555c0012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 msgr2=0x556d97418410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 --2- 172.21.15.50:0/2914994500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d9731db70 0x556d97418410 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f55580526d0 tx=0x7f5558003330 comp rx=0 tx=0).stop 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f55658b8640 1 -- 172.21.15.50:0/2914994500 reap_dead start 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 shutdown_connections 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 >> 172.21.15.50:0/2914994500 conn(0x556d973175c0 msgr2=0x556d9731c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 shutdown_connections 2024-05-07T13:56:32.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.013+0000 7f5569325800 1 -- 172.21.15.50:0/2914994500 wait complete. 2024-05-07T13:56:32.020 INFO:teuthology.orchestra.run.smithi050.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-07T13:56:32.021 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-07T13:56:32.023 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-05-07T13:56:32.038 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:32.135 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-07T13:56:32.135 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-07T13:56:32.135 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-07T13:56:32.135 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-07T13:56:32.135 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-07T13:56:32.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-07T13:56:32.136 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-05-07T13:56:32.182 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:32.182 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.196+0000 7f7232b2e800 1 Processor -- start 2024-05-07T13:56:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.196+0000 7f7232b2e800 1 -- start start 2024-05-07T13:56:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.196+0000 7f7232b2e800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b2352b8550 0x55b2352c1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.196+0000 7f7232b2e800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b23522b910 con 0x55b2352b6a10 2024-05-07T13:56:32.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.196+0000 7f7232b2e800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55b235149050 con 0x55b2352b8550 2024-05-07T13:56:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.196+0000 7f722e066640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b2352b8550 0x55b2352c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.196+0000 7f722e867640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55b2352b6a10 0x55b2352b6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:44056/0 (socket says 172.21.15.50:44056) 2024-05-07T13:56:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.196+0000 7f722e867640 1 -- 172.21.15.50:0/2555902665 learned_addr learned my addr 172.21.15.50:0/2555902665 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.197+0000 7f722e066640 1 -- 172.21.15.50:0/2555902665 >> v1:172.21.15.22:6789/0 conn(0x55b2352b6a10 legacy=0x55b2352b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.197+0000 7f722e066640 1 -- 172.21.15.50:0/2555902665 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23522bae0 con 0x55b2352b8550 2024-05-07T13:56:32.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f722e066640 1 --2- 172.21.15.50:0/2555902665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b8550 0x55b2352c1050 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f722400a470 tx=0x7f722401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f93c9ece14605f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f722d865640 1 -- 172.21.15.50:0/2555902665 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7224057070 con 0x55b2352b8550 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f722d865640 1 -- 172.21.15.50:0/2555902665 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7224052570 con 0x55b2352b8550 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f722d865640 1 -- 172.21.15.50:0/2555902665 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7224052870 con 0x55b2352b8550 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f7232b2e800 1 -- 172.21.15.50:0/2555902665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b8550 msgr2=0x55b2352c1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2555902665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b8550 0x55b2352c1050 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f722400a470 tx=0x7f722401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f7232b2e800 1 -- 172.21.15.50:0/2555902665 shutdown_connections 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2555902665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b8550 0x55b2352c1050 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f7232b2e800 1 -- 172.21.15.50:0/2555902665 >> 172.21.15.50:0/2555902665 conn(0x55b2352b2570 msgr2=0x55b2352b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f7232b2e800 1 -- 172.21.15.50:0/2555902665 shutdown_connections 2024-05-07T13:56:32.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.199+0000 7f7232b2e800 1 -- 172.21.15.50:0/2555902665 wait complete. 2024-05-07T13:56:32.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.214+0000 7f7232b2e800 1 Processor -- start 2024-05-07T13:56:32.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.214+0000 7f7232b2e800 1 -- start start 2024-05-07T13:56:32.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.215+0000 7f7232b2e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.215+0000 7f7232b2e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b2352031c0 con 0x55b2352b6a10 2024-05-07T13:56:32.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.215+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.215+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45266/0 (socket says 172.21.15.50:45266) 2024-05-07T13:56:32.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.215+0000 7f722e867640 1 -- 172.21.15.50:0/901198189 learned_addr learned my addr 172.21.15.50:0/901198189 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.215+0000 7f722e867640 1 -- 172.21.15.50:0/901198189 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2353abec0 con 0x55b2352b6a10 2024-05-07T13:56:32.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.215+0000 7f722e867640 1 --2- 172.21.15.50:0/901198189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353ab8f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7220001de0 tx=0x7f722000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff04a51997d7df3d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.215+0000 7f711ce09640 1 -- 172.21.15.50:0/901198189 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220012020 con 0x55b2352b6a10 2024-05-07T13:56:32.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.216+0000 7f711ce09640 1 -- 172.21.15.50:0/901198189 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722000e5a0 con 0x55b2352b6a10 2024-05-07T13:56:32.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.216+0000 7f711ce09640 1 -- 172.21.15.50:0/901198189 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722000e8c0 con 0x55b2352b6a10 2024-05-07T13:56:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.216+0000 7f7232b2e800 1 -- 172.21.15.50:0/901198189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 msgr2=0x55b2353ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.216+0000 7f7232b2e800 1 --2- 172.21.15.50:0/901198189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353ab8f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7220001de0 tx=0x7f722000b6c0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.216+0000 7f7232b2e800 1 -- 172.21.15.50:0/901198189 shutdown_connections 2024-05-07T13:56:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.216+0000 7f7232b2e800 1 --2- 172.21.15.50:0/901198189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353ab8f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.216+0000 7f7232b2e800 1 -- 172.21.15.50:0/901198189 >> 172.21.15.50:0/901198189 conn(0x55b2352b2570 msgr2=0x55b2353a7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.216+0000 7f7232b2e800 1 -- 172.21.15.50:0/901198189 shutdown_connections 2024-05-07T13:56:32.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.216+0000 7f7232b2e800 1 -- 172.21.15.50:0/901198189 wait complete. 2024-05-07T13:56:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.217+0000 7f7232b2e800 1 Processor -- start 2024-05-07T13:56:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.217+0000 7f7232b2e800 1 -- start start 2024-05-07T13:56:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.217+0000 7f7232b2e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.217+0000 7f7232b2e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b2352c1860 con 0x55b2352b6a10 2024-05-07T13:56:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.217+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.217+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45268/0 (socket says 172.21.15.50:45268) 2024-05-07T13:56:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.217+0000 7f722e867640 1 -- 172.21.15.50:0/2265310752 learned_addr learned my addr 172.21.15.50:0/2265310752 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.217+0000 7f722e867640 1 -- 172.21.15.50:0/2265310752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2353b39a0 con 0x55b2352b6a10 2024-05-07T13:56:32.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.218+0000 7f722e867640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353b3460 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7220001de0 tx=0x7f7220000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.218+0000 7f711b606640 1 -- 172.21.15.50:0/2265310752 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220012030 con 0x55b2352b6a10 2024-05-07T13:56:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.218+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2353b3c30 con 0x55b2352b6a10 2024-05-07T13:56:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.218+0000 7f711b606640 1 -- 172.21.15.50:0/2265310752 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722001a7a0 con 0x55b2352b6a10 2024-05-07T13:56:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.218+0000 7f711b606640 1 -- 172.21.15.50:0/2265310752 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722001aa80 con 0x55b2352b6a10 2024-05-07T13:56:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.218+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2353b68e0 con 0x55b2352b6a10 2024-05-07T13:56:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.219+0000 7f711b606640 1 -- 172.21.15.50:0/2265310752 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7220015020 con 0x55b2352b6a10 2024-05-07T13:56:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.219+0000 7f711b606640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7114036900 0x7f7114038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.219+0000 7f711b606640 1 -- 172.21.15.50:0/2265310752 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7220020070 con 0x55b2352b6a10 2024-05-07T13:56:32.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.219+0000 7f722e066640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7114036900 0x7f7114038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.219+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2352b8550 0x55b2353ba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.219+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353babe0 con 0x55b2352b8550 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.219+0000 7f722f068640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2352b8550 0x55b2353ba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.219+0000 7f722e066640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7114036900 0x7f7114038dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7224054000 tx=0x7f722404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.220+0000 7f722f068640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2352b8550 0x55b2353ba6a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.220+0000 7f722f068640 1 -- 172.21.15.50:0/2265310752 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2352b8550 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.220+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353b7c50 con 0x55b2352b8550 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.220+0000 7f722f068640 1 -- 172.21.15.50:0/2265310752 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2352b8550 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.220+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353bceb0 0x55b2353bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.220+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353bf970 con 0x55b2353bceb0 2024-05-07T13:56:32.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.220+0000 7f722e867640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353bceb0 0x55b2353bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.221+0000 7f722e867640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353bceb0 0x55b2353bf2a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.221+0000 7f722e867640 1 -- 172.21.15.50:0/2265310752 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f722002dcf0 con 0x55b2353bceb0 2024-05-07T13:56:32.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.221+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353bbe30 con 0x55b2352b8550 2024-05-07T13:56:32.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.221+0000 7f722f068640 1 -- 172.21.15.50:0/2265310752 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2352b8550 2024-05-07T13:56:32.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.221+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b2353c0db0 0x55b2353c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.221+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353c39d0 con 0x55b2353c0db0 2024-05-07T13:56:32.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.222+0000 7f722e066640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b2353c0db0 0x55b2353c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.222+0000 7f722e066640 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b2353c0db0 0x55b2353c3240 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.222+0000 7f722e066640 1 -- 172.21.15.50:0/2265310752 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f722405a040 con 0x55b2353c0db0 2024-05-07T13:56:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.223+0000 7f7232b2e800 1 Processor -- start 2024-05-07T13:56:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.223+0000 7f7232b2e800 1 -- start start 2024-05-07T13:56:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.223+0000 7f7232b2e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353d1e30 0x55b2353d2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.223+0000 7f7232b2e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b2351a9cf0 con 0x55b2353d1e30 2024-05-07T13:56:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.223+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353d1e30 0x55b2353d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.223+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353d1e30 0x55b2353d2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45284/0 (socket says 172.21.15.50:45284) 2024-05-07T13:56:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.223+0000 7f722e867640 1 -- 172.21.15.50:0/698306859 learned_addr learned my addr 172.21.15.50:0/698306859 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.224+0000 7f722e867640 1 -- 172.21.15.50:0/698306859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2353d2790 con 0x55b2353d1e30 2024-05-07T13:56:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.224+0000 7f722e867640 1 --2- 172.21.15.50:0/698306859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353d1e30 0x55b2353d2250 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f722000b6e0 tx=0x7f7220024720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.224+0000 7f7118e01640 1 -- 172.21.15.50:0/698306859 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722000d960 con 0x55b2353d1e30 2024-05-07T13:56:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.224+0000 7f7118e01640 1 -- 172.21.15.50:0/698306859 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722004c040 con 0x55b2353d1e30 2024-05-07T13:56:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.224+0000 7f7118e01640 1 -- 172.21.15.50:0/698306859 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220017560 con 0x55b2353d1e30 2024-05-07T13:56:32.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.224+0000 7f7232b2e800 1 -- 172.21.15.50:0/698306859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2353d3200 con 0x55b2353d1e30 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.224+0000 7f7232b2e800 1 -- 172.21.15.50:0/698306859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2353d3700 con 0x55b2353d1e30 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.225+0000 7f7118e01640 1 -- 172.21.15.50:0/698306859 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7220017700 con 0x55b2353d1e30 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.225+0000 7f7118e01640 1 --2- 172.21.15.50:0/698306859 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7108036950 0x7f7108038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.225+0000 7f7118e01640 1 -- 172.21.15.50:0/698306859 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f722001b040 con 0x55b2353d1e30 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.225+0000 7f722e066640 1 --2- 172.21.15.50:0/698306859 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7108036950 0x7f7108038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.225+0000 7f7232b2e800 1 Processor -- start 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.225+0000 7f722e066640 1 --2- 172.21.15.50:0/698306859 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7108036950 0x7f7108038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55b2353bb050 tx=0x7f7224005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.225+0000 7f7232b2e800 1 -- start start 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.225+0000 7f7232b2e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353df420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.225+0000 7f7232b2e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b2353ac240 con 0x55b2353df000 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.226+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353df420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.226+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353df420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45298/0 (socket says 172.21.15.50:45298) 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.226+0000 7f722e867640 1 -- 172.21.15.50:0/1352148950 learned_addr learned my addr 172.21.15.50:0/1352148950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.226+0000 7f722e867640 1 -- 172.21.15.50:0/1352148950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2353df9f0 con 0x55b2353df000 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.226+0000 7f722e867640 1 --2- 172.21.15.50:0/1352148950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353df420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f722000dbc0 tx=0x7f722004cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f61f4d432a1964 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.226+0000 7f71127fc640 1 -- 172.21.15.50:0/1352148950 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220051050 con 0x55b2353df000 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.226+0000 7f71127fc640 1 -- 172.21.15.50:0/1352148950 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722004c1f0 con 0x55b2353df000 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.226+0000 7f71127fc640 1 -- 172.21.15.50:0/1352148950 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220044640 con 0x55b2353df000 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 -- 172.21.15.50:0/1352148950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 msgr2=0x55b2353df420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 --2- 172.21.15.50:0/1352148950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353df420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f722000dbc0 tx=0x7f722004cf30 comp rx=0 tx=0).stop 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 -- 172.21.15.50:0/1352148950 shutdown_connections 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 --2- 172.21.15.50:0/1352148950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353df420 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 -- 172.21.15.50:0/1352148950 >> 172.21.15.50:0/1352148950 conn(0x55b2353db280 msgr2=0x55b2353d92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 -- 172.21.15.50:0/1352148950 shutdown_connections 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 -- 172.21.15.50:0/1352148950 wait complete. 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 Processor -- start 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 -- start start 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f7232b2e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b2353e0060 con 0x55b2353df000 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f722e867640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353e6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45306/0 (socket says 172.21.15.50:45306) 2024-05-07T13:56:32.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.227+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 learned_addr learned my addr 172.21.15.50:0/997232676 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.228+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2353e6860 con 0x55b2353df000 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.228+0000 7f722e867640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353e6320 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f722000db20 tx=0x7f7220034f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.228+0000 7f7110ff9640 1 -- 172.21.15.50:0/997232676 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722006f020 con 0x55b2353df000 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.228+0000 7f7110ff9640 1 -- 172.21.15.50:0/997232676 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722002d5c0 con 0x55b2353df000 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.228+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2353e6860 con 0x55b2353df000 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.228+0000 7f7110ff9640 1 -- 172.21.15.50:0/997232676 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220009350 con 0x55b2353df000 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.228+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2353e6d60 con 0x55b2353df000 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.229+0000 7f7110ff9640 1 -- 172.21.15.50:0/997232676 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7220072020 con 0x55b2353df000 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.229+0000 7f7110ff9640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f70f8036950 0x7f70f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.229+0000 7f7110ff9640 1 -- 172.21.15.50:0/997232676 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7220065050 con 0x55b2353df000 2024-05-07T13:56:32.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.229+0000 7f722e066640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f70f8036950 0x7f70f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f722e066640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f70f8036950 0x7f70f8038e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55b2353c3dd0 tx=0x7f722404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f7232b2e800 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2353f1b10 0x55b2353f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f4720 con 0x55b2353f1b10 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f722f068640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2353f1b10 0x55b2353f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f722f068640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2353f1b10 0x55b2353f3fd0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2353f1b10 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f7232b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f7232b2e800 20 realm 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.230+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f4b30 con 0x55b2353f1b10 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2353f1b10 2024-05-07T13:56:32.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f5400 con 0x55b2353f1b10 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2353f1b10 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x55b2353f1b10 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2353f1b10 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353f6500 0x55b2353f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f8eb0 con 0x55b2353f6500 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.231+0000 7f722e867640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353f6500 0x55b2353f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.232+0000 7f722e867640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353f6500 0x55b2353f88f0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.232+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.232+0000 7f7232b2e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.232+0000 7f7232b2e800 20 searching for the correct realm 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.232+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fa7e0 con 0x55b2353f6500 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.232+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.232+0000 7f722e867640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7220074020 0x7f72200568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.233+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fa7e0 con 0x7f7220074020 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.233+0000 7f722e066640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7220074020 0x7f72200568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.233+0000 7f722e066640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7220074020 0x7f72200568d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.233+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.233+0000 7f722e066640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7224074040 0x7f7224081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.233+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fa7e0 con 0x7f7224074040 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.233+0000 7f722f068640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7224074040 0x7f7224081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.234+0000 7f722f068640 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7224074040 0x7f7224081410 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.234+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722800a4a0 con 0x7f7224074040 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.234+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x55b2353f1b10 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.234+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2353f1b10 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.234+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x55b2353f1b10 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.235+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2353f1b10 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.235+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x7f7224074040 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.235+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722800a4a0 con 0x7f7224074040 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.235+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x7f7224074040 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.235+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f722800a4a0 con 0x7f7224074040 2024-05-07T13:56:32.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.235+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x7f7220074020 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.235+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.235+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x55b2353f6500 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.236+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.236+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x55b2353f1b10 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.236+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2353f1b10 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.236+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x7f7224074040 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.236+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722800a4a0 con 0x7f7224074040 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.236+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x55b2353f1b10 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.236+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2353f1b10 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.236+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f57a0 con 0x7f7220074020 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.237+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.237+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f6500 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.237+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.237+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f6500 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.237+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.237+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x7f7224074040 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.237+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722800a4a0 con 0x7f7224074040 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.237+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f6500 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.238+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.238+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f6500 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.238+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.238+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f1b10 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.238+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722800a4a0 con 0x55b2353f1b10 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.238+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f1b10 2024-05-07T13:56:32.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.238+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.238+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x7f7224074040 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.239+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.239+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f6500 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.239+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.239+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x7f7220074020 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.239+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.239+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f1b10 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.240+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.240+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x7f7224074040 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.240+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.240+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f6500 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.241+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.241+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x7f7224074040 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.241+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.241+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x7f7220074020 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.241+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.241+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f6500 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.241+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.241+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x7f7224074040 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x55b2353f1b10 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f722408e060 con 0x7f7220074020 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:32.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f9770 con 0x55b2353f1b10 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.242+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f9b60 con 0x55b2353f1b10 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:32.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f9b60 con 0x7f7224074040 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 20 zone default found 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 4 Realm: () 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 20 zonegroup default 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f93d0 con 0x7f7224074040 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.243+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353f93d0 con 0x55b2353f6500 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.244+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.244+0000 7f7232b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.244+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.244+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fc760 con 0x55b2353f6500 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.244+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.244+0000 7f7232b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.244+0000 7f7232b2e800 20 started sync module instance, tier type = 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.244+0000 7f7232b2e800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.244+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fbae0 con 0x7f7220074020 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.245+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.245+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94223885909712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fb740 con 0x7f7220074020 2024-05-07T13:56:32.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.245+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fd690 con 0x55b2353f1b10 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.246+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94223885909712] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.246+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.246+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94223885914592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fdab0 con 0x55b2353f1b10 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.246+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fe470 con 0x55b2353f6500 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.248+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94223885914592] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.248+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.248+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94223885915648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2353fda20 con 0x55b2353f6500 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.248+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2353ff330 con 0x7f7220074020 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.249+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94223885915648] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.249+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.249+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94223885921920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2353ff720 con 0x7f7220074020 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.249+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235400120 con 0x55b2353f1b10 2024-05-07T13:56:32.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.250+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.250+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94223885925424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354009c0 con 0x55b2353f1b10 2024-05-07T13:56:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.250+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354014c0 con 0x7f7224074040 2024-05-07T13:56:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.250+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94223885921920] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.251+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.251+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94223885925424] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.251+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94223885930416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354004e0 con 0x7f7224074040 2024-05-07T13:56:32.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.251+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235401aa0 con 0x7f7224074040 2024-05-07T13:56:32.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.252+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94223885930416] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.252+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.252+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94223885920352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235401aa0 con 0x7f7224074040 2024-05-07T13:56:32.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.252+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235402350 con 0x7f7224074040 2024-05-07T13:56:32.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94223885920352] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(58 notify.7 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94223885932016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235402530 con 0x7f7224074040 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f7232b2e800 20 add_watcher() i=0 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f7232b2e800 20 add_watcher() i=1 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f7232b2e800 20 add_watcher() i=2 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f7232b2e800 20 add_watcher() i=3 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f7232b2e800 20 add_watcher() i=4 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f7232b2e800 20 add_watcher() i=5 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.253+0000 7f7232b2e800 20 add_watcher() i=6 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.254+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94223885932016] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.254+0000 7f7232b2e800 20 add_watcher() i=7 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.254+0000 7f7232b2e800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:32.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.254+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235405900 con 0x55b2353f1b10 2024-05-07T13:56:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.254+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.254+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94223885935648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235402cf0 con 0x55b2353f1b10 2024-05-07T13:56:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.255+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94223885935648] v27'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.255+0000 7f70e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.256+0000 7f7232b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.256+0000 7f7232b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.256+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540e0c0 con 0x55b2353f1b10 2024-05-07T13:56:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.257+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.257+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540e790 con 0x7f7224074040 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.258+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.258+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540ebb0 con 0x55b2353f6500 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.259+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.259+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540eb90 con 0x55b2353f1b10 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.260+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.260+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540f220 con 0x7f7220074020 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.261+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.261+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540f790 con 0x55b2353f6500 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.262+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.262+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540fc40 con 0x55b2353f1b10 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.263+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.263+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540fc40 con 0x7f7224074040 2024-05-07T13:56:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.264+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.264+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540fc40 con 0x7f7220074020 2024-05-07T13:56:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.265+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.265+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540bf00 con 0x55b2353f6500 2024-05-07T13:56:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.266+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.266+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540bf00 con 0x7f7220074020 2024-05-07T13:56:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.267+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.267+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540bf00 con 0x7f7224074040 2024-05-07T13:56:32.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.268+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.268+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23540c0a0 con 0x7f7220074020 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.269+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.269+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x7f7224074040 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.270+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.270+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x55b2353f1b10 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.271+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.271+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x55b2353f6500 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.273+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'56 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.273+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x7f7220074020 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.274+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.274+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x55b2353f6500 2024-05-07T13:56:32.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.275+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.275+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x55b2353f1b10 2024-05-07T13:56:32.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.276+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'33 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.276+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x55b2353f1b10 2024-05-07T13:56:32.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.277+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.277+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x55b2353f6500 2024-05-07T13:56:32.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.278+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'57 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.278+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x7f7220074020 2024-05-07T13:56:32.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.279+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.279+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x55b2353f6500 2024-05-07T13:56:32.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.280+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.280+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354107a0 con 0x55b2353f6500 2024-05-07T13:56:32.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.281+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.281+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235410970 con 0x55b2353f6500 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.282+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.282+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235410970 con 0x55b2353f6500 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.283+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.283+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235410970 con 0x7f7224074040 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.284+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.284+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235410970 con 0x55b2353f6500 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.285+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.285+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235410970 con 0x7f7224074040 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.286+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.286+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235410970 con 0x55b2353f6500 2024-05-07T13:56:32.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.287+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'58 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.287+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235410970 con 0x7f7224074040 2024-05-07T13:56:32.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.289+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.289+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235410970 con 0x7f7220074020 2024-05-07T13:56:32.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.290+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.290+0000 7f705ffff640 20 reqs_thread_entry: start 2024-05-07T13:56:32.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.290+0000 7f7232b2e800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:32.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.290+0000 7f7232b2e800 20 Filter name: none 2024-05-07T13:56:32.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.290+0000 7f705dffb640 20 reqs_thread_entry: start 2024-05-07T13:56:32.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.290+0000 7f7232b2e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:56:32.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.290+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.290+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b23543b6a0 con 0x7f7220074020 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 : miss 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:95 8.1 8:81cb16aa:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b23543d080 con 0x7f7224074040 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(95 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 info.flags=0x17 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 to cache LRU end 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:32.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.291+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:96 4.10 4:0934ba42:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354ba720 con 0x55b2353f6500 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.292+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(96 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.292+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:97 4.34 4:2ce07fd4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354ba720 con 0x7f7220074020 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.292+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(97 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.292+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:98 4.2b 4:d4532d39:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354ba720 con 0x55b2353f1b10 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.292+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(98 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.292+0000 7f7232b2e800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.292+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:99 4.18 4:188f9fe6:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354bace0 con 0x7f7220074020 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.293+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(99 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.293+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:100 4.2e 4:778bd048:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354bace0 con 0x55b2353f6500 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.293+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(100 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.293+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:101 4.2c 4:34c6101b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354bace0 con 0x55b2353f1b10 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.293+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(101 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.293+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:102 4.3c 4:3fd4c708:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354bace0 con 0x55b2353f1b10 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.294+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(102 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.294+0000 7f7232b2e800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.294+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 4.4 4:23ddcfd2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354bace0 con 0x7f7224074040 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.294+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(103 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.294+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:104 4.32 4:4ff45f32:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354bace0 con 0x55b2353f1b10 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.294+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(104 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.294+0000 7f7232b2e800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.294+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:105 4.29 4:968290eb:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354bace0 con 0x55b2353f6500 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.295+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(105 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.295+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:106 4.19 4:9ac945c2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354bace0 con 0x55b2353f6500 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.295+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== osd_op_reply(106 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 [call out=697b] v0'0 uv11 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.295+0000 7f7232b2e800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.295+0000 7f7232b2e800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.295+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.295+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:107 3.22s0 3:464eaa05:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354b80f0 con 0x55b2353f6500 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.295+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(107 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.296+0000 7f7232b2e800 10 manifest: total_size = 6 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.296+0000 7f7232b2e800 20 get_obj_state: setting s->obj_tag to 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5952663644326828749 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.296+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.296+0000 7f7232b2e800 20 prepare_atomic_modification: state is not atomic. state=0x55b2354b9bf8 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.296+0000 7f7232b2e800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2 2024-05-07T13:56:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.296+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:108 4.2b 4:d4532d39:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442120 con 0x55b2353f1b10 2024-05-07T13:56:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.297+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(108 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2 [stat,call,call] v27'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.297+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:109 3.22s0 3:464eaa05:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442180 con 0x55b2353f6500 2024-05-07T13:56:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.298+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 32 ==== osd_op_reply(109 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_9c8454ddf7aa50116496bac348d7550d [call] v27'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.298+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:110 4.2b 4:d4532d39:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235441c60 con 0x55b2353f1b10 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.298+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.298+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:111 3.38s0 3:1d499ff5:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235441c60 con 0x7f7224074040 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.299+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(111 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.299+0000 7f7232b2e800 10 manifest: total_size = 3 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.299+0000 7f7232b2e800 20 get_obj_state: setting s->obj_tag to 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.6077295982772267126 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.299+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.299+0000 7f7232b2e800 20 prepare_atomic_modification: state is not atomic. state=0x55b2354b9bf8 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.299+0000 7f7232b2e800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.299+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:112 4.3c 4:3fd4c708:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235447260 con 0x55b2353f1b10 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.300+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(110 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2 [stat,call,call] v27'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.300+0000 7f71127fc640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.300+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(112 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6 [stat,call,call] v27'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.300+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:113 3.38s0 3:1d499ff5:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235447260 con 0x7f7224074040 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(113 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_b1b9a972ccd8c962a473909b97007eb4 [call] v27'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:114 4.3c 4:3fd4c708:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354431a0 con 0x55b2353f1b10 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:115 3.7s0 3:e2853165:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235443840 con 0x55b2353f6500 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 33 ==== osd_op_reply(115 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f7232b2e800 10 manifest: total_size = 4 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f7232b2e800 20 get_obj_state: setting s->obj_tag to 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.14889149111357471357 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f7232b2e800 20 prepare_atomic_modification: state is not atomic. state=0x55b2354b9bf8 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f7232b2e800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8 2024-05-07T13:56:32.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.302+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:116 4.32 4:4ff45f32:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235446870 con 0x55b2353f1b10 2024-05-07T13:56:32.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.303+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(114 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6 [stat,call,call] v27'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.303+0000 7f7111ffb640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-05-07T13:56:32.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.303+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 35 ==== osd_op_reply(116 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8 [stat,call,call] v27'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.303+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:117 3.7s0 3:e2853165:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442740 con 0x55b2353f6500 2024-05-07T13:56:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.305+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 34 ==== osd_op_reply(117 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.305+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:118 4.32 4:4ff45f32:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354431a0 con 0x55b2353f1b10 2024-05-07T13:56:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.305+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.305+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:119 3.25s0 3:a5096eb9:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354431a0 con 0x55b2353f1b10 2024-05-07T13:56:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.306+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 36 ==== osd_op_reply(119 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.306+0000 7f7232b2e800 10 manifest: total_size = 5 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.306+0000 7f7232b2e800 20 get_obj_state: setting s->obj_tag to 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9388213941854742191 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.306+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.306+0000 7f7232b2e800 20 prepare_atomic_modification: state is not atomic. state=0x55b2354b9bf8 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.306+0000 7f7232b2e800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.306+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:120 4.19 4:9ac945c2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235448710 con 0x55b2353f6500 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.306+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 37 ==== osd_op_reply(118 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8 [stat,call,call] v27'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.306+0000 7f71127fc640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.307+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 35 ==== osd_op_reply(120 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 [stat,call,call] v27'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.307+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:121 3.25s0 3:a5096eb9:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235448710 con 0x55b2353f1b10 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.308+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 38 ==== osd_op_reply(121 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_24d27c169c2c881eb09a065116f2aa5c [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.308+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:122 4.19 4:9ac945c2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235448710 con 0x55b2353f6500 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.308+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.308+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:123 3.18s0 3:181ca4bd:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235448710 con 0x55b2353f6500 2024-05-07T13:56:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.309+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 36 ==== osd_op_reply(123 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.309+0000 7f7232b2e800 10 manifest: total_size = 5 2024-05-07T13:56:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.309+0000 7f7232b2e800 20 get_obj_state: setting s->obj_tag to _v4Bxj4o1R-tDxLifyDtpHoRK8K1d7K_ 2024-05-07T13:56:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.309+0000 7f7232b2e800 20 get_obj_state: octx=0x7f722800aaf0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b2354b9bf8 s->prefetch_data=0 2024-05-07T13:56:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.309+0000 7f7232b2e800 20 prepare_atomic_modification: state is not atomic. state=0x55b2354b9bf8 2024-05-07T13:56:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.309+0000 7f7232b2e800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 2024-05-07T13:56:32.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.309+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:124 4.19 4:9ac945c2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235440ef0 con 0x55b2353f6500 2024-05-07T13:56:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.310+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 37 ==== osd_op_reply(122 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 [stat,call,call] v27'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.310+0000 7f7111ffb640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.310+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 38 ==== osd_op_reply(124 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 [stat,call,call] v27'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.310+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:125 3.18s0 3:181ca4bd:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235440ef0 con 0x55b2353f6500 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.311+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 39 ==== osd_op_reply(125 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5_bb3aec0fdcdbc2974890f805c585d432 [call] v27'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.311+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:126 4.19 4:9ac945c2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354414d0 con 0x55b2353f6500 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.311+0000 7f7232b2e800 20 list_objects_ordered: starting attempt 1 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.311+0000 7f7232b2e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.311+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:127 4.10 4:0934ba42:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235441480 con 0x55b2353f6500 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:128 4.34 4:2ce07fd4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235441480 con 0x7f7220074020 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:129 4.2b 4:d4532d39:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b2354b9ec0 con 0x55b2353f1b10 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:130 4.18 4:188f9fe6:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b23544e240 con 0x7f7220074020 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 40 ==== osd_op_reply(127 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:131 4.2e 4:778bd048:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b23544e6d0 con 0x55b2353f6500 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 39 ==== osd_op_reply(129 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:132 4.2c 4:34c6101b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b23544e240 con 0x55b2353f1b10 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(128 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:133 4.3c 4:3fd4c708:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b23544e6d0 con 0x55b2353f1b10 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:134 4.4 4:23ddcfd2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235451250 con 0x7f7224074040 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:135 4.32 4:4ff45f32:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235454050 con 0x55b2353f1b10 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.312+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:136 4.29 4:968290eb:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235456ed0 con 0x55b2353f6500 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:137 4.19 4:9ac945c2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235459d20 con 0x55b2353f6500 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(130 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 40 ==== osd_op_reply(132 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 41 ==== osd_op_reply(126 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 [stat,call,call] v27'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 41 ==== osd_op_reply(133 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7111ffb640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 42 ==== osd_op_reply(131 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 43 ==== osd_op_reply(136 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 44 ==== osd_op_reply(137 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 42 ==== osd_op_reply(135 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(134 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5])"; uploads.size()=0; is_truncated=0 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:138 4.10 4:0934ba42:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235451250 con 0x55b2353f6500 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:139 4.34 4:2ce07fd4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b23544e640 con 0x7f7220074020 2024-05-07T13:56:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:140 4.2b 4:d4532d39:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x55b2353f1b10 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.313+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:141 4.18 4:188f9fe6:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235451250 con 0x7f7220074020 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:142 4.2e 4:778bd048:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235459540 con 0x55b2353f6500 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:143 4.2c 4:34c6101b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235451250 con 0x55b2353f1b10 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:144 4.3c 4:3fd4c708:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x55b2353f1b10 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:145 4.4 4:23ddcfd2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235456590 con 0x7f7224074040 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:146 4.32 4:4ff45f32:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235456e80 con 0x55b2353f1b10 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:147 4.29 4:968290eb:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b23545a240 con 0x55b2353f6500 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:148 4.19 4:9ac945c2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b23545cfa0 con 0x55b2353f6500 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 43 ==== osd_op_reply(140 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(141 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== osd_op_reply(139 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 45 ==== osd_op_reply(138 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 46 ==== osd_op_reply(142 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 47 ==== osd_op_reply(147 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 44 ==== osd_op_reply(144 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 45 ==== osd_op_reply(146 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(145 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 46 ==== osd_op_reply(143 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 48 ==== osd_op_reply(148 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.314+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7220074020 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.316+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== osd_op_reply(149 foo.buckets [call] v27'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.316+0000 7f7232b2e800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-05-07T13:56:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.316+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7220074020 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 26 ==== osd_op_reply(150 myfoo [call,call,delete] v27'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f7232b2e800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f7232b2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94223886258768 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7224074040 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== watch-notify(notify (1) cookie 94223885920352 notify 115964117006 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55b23543c5f0 con 0x7f7224074040 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f7111ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117006 cookie 94223885920352 notifier 4642 bl.length()=149 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== osd_op_reply(151 notify.6 [notify cookie 94223886258768 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f7111ffb640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f7064003320 con 0x7f7224074040 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.317+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== watch-notify(notify_complete (2) cookie 94223886258768 notify 115964117006 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b2353d3200 con 0x7f7224074040 2024-05-07T13:56:32.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.318+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:153 8.1 8:81cb16aa:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7224074040 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(153 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 [call,call,delete] v27'8 uv8 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f7232b2e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 from cache 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f7232b2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5, ofs0, ns] 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94223886258768 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7220074020 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 27 ==== watch-notify(notify (1) cookie 94223885909712 notify 115964117023 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55b23540f1a0 con 0x7f7220074020 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f71127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117023 cookie 94223885909712 notifier 4642 bl.length()=206 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f71127fc640 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:155 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f70f4003d60 con 0x7f7220074020 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 28 ==== osd_op_reply(154 notify.0 [notify cookie 94223886258768 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 29 ==== osd_op_reply(155 notify.0 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 30 ==== watch-notify(notify_complete (2) cookie 94223886258768 notify 115964117023 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b23540f3f0 con 0x7f7220074020 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:156 4.10 4:0934ba42:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x55b2353f6500 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:157 4.34 4:2ce07fd4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235451250 con 0x7f7220074020 2024-05-07T13:56:32.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:158 4.2b 4:d4532d39:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354b9a10 con 0x55b2353f1b10 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.319+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:159 4.18 4:188f9fe6:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7220074020 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.320+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:160 4.2e 4:778bd048:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354b9df0 con 0x55b2353f6500 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.320+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:161 4.2c 4:34c6101b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23543a1e0 con 0x55b2353f1b10 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.320+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:162 4.3c 4:3fd4c708:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354b9a10 con 0x55b2353f1b10 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.320+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:163 4.4 4:23ddcfd2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354b9df0 con 0x7f7224074040 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.320+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:164 4.32 4:4ff45f32:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23543a1e0 con 0x55b2353f1b10 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.320+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:165 4.29 4:968290eb:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354b9a10 con 0x55b2353f6500 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.320+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:166 4.19 4:9ac945c2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b2354b9df0 con 0x55b2353f6500 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.321+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 47 ==== osd_op_reply(161 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.5 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.322+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 31 ==== osd_op_reply(159 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.3 [delete] v27'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.322+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 49 ==== osd_op_reply(156 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.0 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.322+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== osd_op_reply(163 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.7 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.322+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 48 ==== osd_op_reply(162 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.6 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.322+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 49 ==== osd_op_reply(164 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.8 [delete] v27'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.322+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 50 ==== osd_op_reply(160 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.4 [delete] v27'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 50 ==== osd_op_reply(158 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.2 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 51 ==== osd_op_reply(166 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.10 [delete] v27'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 32 ==== osd_op_reply(157 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.1 [delete] v27'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 52 ==== osd_op_reply(165 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5.9 [delete] v27'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f7232b2e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 : miss 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f7232b2e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:167 6.c 6:3146219e:::pubsub..bucket.myfoo%2f2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x55b2353f6500 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 53 ==== osd_op_reply(167 pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f7232b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f7232b2e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 info.flags=0x0 2024-05-07T13:56:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f7232b2e800 10 adding default.rgw.log++pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 to cache LRU end 2024-05-07T13:56:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.323+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:168 6.c 6:3146219e:::pubsub..bucket.myfoo%2f2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b23543a1e0 con 0x55b2353f6500 2024-05-07T13:56:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.324+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 54 ==== osd_op_reply(168 pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.5 [delete] v27'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.324+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235451250 con 0x7f7220074020 2024-05-07T13:56:32.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.325+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 33 ==== osd_op_reply(169 foo.buckets [call] v27'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.326+0000 7f70e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.326+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94223885935648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x55b2353f1b10 2024-05-07T13:56:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.327+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 51 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94223885935648] v27'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.327+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94223885909712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7220074020 2024-05-07T13:56:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.328+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 34 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94223885909712] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.328+0000 7f7232b2e800 20 remove_watcher() i=0 2024-05-07T13:56:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.328+0000 7f7232b2e800 2 removed watcher, disabling cache 2024-05-07T13:56:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.328+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94223885914592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x55b2353f1b10 2024-05-07T13:56:32.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.330+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 52 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94223885914592] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.330+0000 7f7232b2e800 20 remove_watcher() i=1 2024-05-07T13:56:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.330+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94223885915648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x55b2353f6500 2024-05-07T13:56:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.331+0000 7f722e867640 1 -- 172.21.15.50:0/997232676 <== osd.3 v2:172.21.15.50:6814/3553060046 55 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94223885915648] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220053070 con 0x55b2353f6500 2024-05-07T13:56:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.331+0000 7f7232b2e800 20 remove_watcher() i=2 2024-05-07T13:56:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.331+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94223885921920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7220074020 2024-05-07T13:56:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.332+0000 7f722e066640 1 -- 172.21.15.50:0/997232676 <== osd.2 v2:172.21.15.50:6808/2034796854 35 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94223885921920] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722407f070 con 0x7f7220074020 2024-05-07T13:56:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.332+0000 7f7232b2e800 20 remove_watcher() i=3 2024-05-07T13:56:32.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.332+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94223885925424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x55b2353f1b10 2024-05-07T13:56:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.333+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.1 v2:172.21.15.50:6800/3441257969 53 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94223885925424] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x55b2353f1b10 2024-05-07T13:56:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.333+0000 7f7232b2e800 20 remove_watcher() i=4 2024-05-07T13:56:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.333+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94223885930416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7224074040 2024-05-07T13:56:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.334+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94223885930416] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.334+0000 7f7232b2e800 20 remove_watcher() i=5 2024-05-07T13:56:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.334+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94223885920352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7224074040 2024-05-07T13:56:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.335+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 38 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94223885920352] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.335+0000 7f7232b2e800 20 remove_watcher() i=6 2024-05-07T13:56:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.335+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94223885932016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b235442c70 con 0x7f7224074040 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 <== osd.0 v2:172.21.15.22:6800/2215278347 39 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94223885932016] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722802f060 con 0x7f7224074040 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 20 remove_watcher() i=7 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7224074040 msgr2=0x7f7224081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7224074040 0x7f7224081410 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2353f1b10 msgr2=0x55b2353f3fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2353f1b10 0x55b2353f3fd0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7220074020 msgr2=0x7f72200568d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7220074020 0x7f72200568d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353f6500 msgr2=0x55b2353f88f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353f6500 0x55b2353f88f0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f70f8036950 msgr2=0x7f70f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f70f8036950 0x7f70f8038e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55b2353c3dd0 tx=0x7f722404f000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 msgr2=0x55b2353e6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f722f068640 1 -- 172.21.15.50:0/997232676 reap_dead start 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353e6320 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f722000db20 tx=0x7f7220034f90 comp rx=0 tx=0).stop 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 shutdown_connections 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 --2- 172.21.15.50:0/997232676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353df000 0x55b2353e6320 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 >> 172.21.15.50:0/997232676 conn(0x55b2353db280 msgr2=0x55b2353d88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 shutdown_connections 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.336+0000 7f7232b2e800 1 -- 172.21.15.50:0/997232676 wait complete. 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/698306859 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7108036950 msgr2=0x7f7108038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 --2- 172.21.15.50:0/698306859 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7108036950 0x7f7108038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55b2353bb050 tx=0x7f7224005a00 comp rx=0 tx=0).stop 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/698306859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353d1e30 msgr2=0x55b2353d2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 --2- 172.21.15.50:0/698306859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353d1e30 0x55b2353d2250 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f722000b6e0 tx=0x7f7220024720 comp rx=0 tx=0).stop 2024-05-07T13:56:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/698306859 shutdown_connections 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 --2- 172.21.15.50:0/698306859 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7108036950 0x7f7108038e10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 --2- 172.21.15.50:0/698306859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2353d1e30 0x55b2353d2250 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/698306859 >> 172.21.15.50:0/698306859 conn(0x55b2353c5ed0 msgr2=0x55b2353c62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/698306859 shutdown_connections 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/698306859 wait complete. 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b2353c0db0 msgr2=0x55b2353c3240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b2353c0db0 0x55b2353c3240 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2352b8550 msgr2=0x55b2353ba6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b2352b8550 0x55b2353ba6a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353bceb0 msgr2=0x55b2353bf2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b2353bceb0 0x55b2353bf2a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7114036900 msgr2=0x7f7114038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7114036900 0x7f7114038dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7224054000 tx=0x7f722404e000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 msgr2=0x55b2353b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 --2- 172.21.15.50:0/2265310752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2352b6a10 0x55b2353b3460 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7220001de0 tx=0x7f7220000ed0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f722f068640 1 -- 172.21.15.50:0/2265310752 reap_dead start 2024-05-07T13:56:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 shutdown_connections 2024-05-07T13:56:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.337+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 >> 172.21.15.50:0/2265310752 conn(0x55b2352b2570 msgr2=0x55b2353a5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.338+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 shutdown_connections 2024-05-07T13:56:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.338+0000 7f7232b2e800 1 -- 172.21.15.50:0/2265310752 wait complete. 2024-05-07T13:56:32.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-07T13:56:32.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-07T13:56:32.335 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-05-07T13:56:32.382 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:32.382 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.395+0000 7f015570c800 1 Processor -- start 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.395+0000 7f015570c800 1 -- start start 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.396+0000 7f015570c800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a4a26439c0 0x55a4a2641ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.396+0000 7f015570c800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4a2642930 con 0x55a4a2642410 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.396+0000 7f015570c800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55a4a255f050 con 0x55a4a26439c0 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.396+0000 7f015320b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a4a26439c0 0x55a4a2641ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.396+0000 7f015320b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a4a26439c0 0x55a4a2641ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45318/0 (socket says 172.21.15.50:45318) 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.396+0000 7f015320b640 1 -- 172.21.15.50:0/1738181843 learned_addr learned my addr 172.21.15.50:0/1738181843 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.396+0000 7f0152a0a640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55a4a2642410 0x55a4a26d5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:44064/0 (socket says 172.21.15.50:44064) 2024-05-07T13:56:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.396+0000 7f015320b640 1 -- 172.21.15.50:0/1738181843 >> v1:172.21.15.22:6789/0 conn(0x55a4a2642410 legacy=0x55a4a26d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.396+0000 7f015320b640 1 -- 172.21.15.50:0/1738181843 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a2642b50 con 0x55a4a26439c0 2024-05-07T13:56:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.398+0000 7f015320b640 1 --2- 172.21.15.50:0/1738181843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a26439c0 0x55a4a2641ed0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f014400a520 tx=0x7f014401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2a293d2b4d8698 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f0152209640 1 -- 172.21.15.50:0/1738181843 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144057070 con 0x55a4a26439c0 2024-05-07T13:56:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f0152209640 1 -- 172.21.15.50:0/1738181843 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0144052570 con 0x55a4a26439c0 2024-05-07T13:56:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f0152209640 1 -- 172.21.15.50:0/1738181843 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f014404ae60 con 0x55a4a26439c0 2024-05-07T13:56:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f015570c800 1 -- 172.21.15.50:0/1738181843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a26439c0 msgr2=0x55a4a2641ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f015570c800 1 --2- 172.21.15.50:0/1738181843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a26439c0 0x55a4a2641ed0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f014400a520 tx=0x7f014401d010 comp rx=0 tx=0).stop 2024-05-07T13:56:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f015570c800 1 -- 172.21.15.50:0/1738181843 shutdown_connections 2024-05-07T13:56:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f015570c800 1 --2- 172.21.15.50:0/1738181843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a26439c0 0x55a4a2641ed0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f015570c800 1 -- 172.21.15.50:0/1738181843 >> 172.21.15.50:0/1738181843 conn(0x55a4a26c9790 msgr2=0x55a4a26cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f015570c800 1 -- 172.21.15.50:0/1738181843 shutdown_connections 2024-05-07T13:56:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.399+0000 7f015570c800 1 -- 172.21.15.50:0/1738181843 wait complete. 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.414+0000 7f015570c800 1 Processor -- start 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.414+0000 7f015570c800 1 -- start start 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.414+0000 7f015570c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.414+0000 7f015570c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a4a26191c0 con 0x55a4a2642410 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.415+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.415+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45320/0 (socket says 172.21.15.50:45320) 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.415+0000 7f015320b640 1 -- 172.21.15.50:0/2152553893 learned_addr learned my addr 172.21.15.50:0/2152553893 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.415+0000 7f015320b640 1 -- 172.21.15.50:0/2152553893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a27c1e80 con 0x55a4a2642410 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.415+0000 7f015320b640 1 --2- 172.21.15.50:0/2152553893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c18b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0144055040 tx=0x7f014404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c2b2ec21d9e6f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.415+0000 7f004160a640 1 -- 172.21.15.50:0/2152553893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144057040 con 0x55a4a2642410 2024-05-07T13:56:32.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.415+0000 7f004160a640 1 -- 172.21.15.50:0/2152553893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0144052720 con 0x55a4a2642410 2024-05-07T13:56:32.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.415+0000 7f004160a640 1 -- 172.21.15.50:0/2152553893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144052a20 con 0x55a4a2642410 2024-05-07T13:56:32.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.416+0000 7f015570c800 1 -- 172.21.15.50:0/2152553893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 msgr2=0x55a4a27c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.416+0000 7f015570c800 1 --2- 172.21.15.50:0/2152553893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c18b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0144055040 tx=0x7f014404c000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.416+0000 7f015570c800 1 -- 172.21.15.50:0/2152553893 shutdown_connections 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.416+0000 7f015570c800 1 --2- 172.21.15.50:0/2152553893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c18b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.416+0000 7f015570c800 1 -- 172.21.15.50:0/2152553893 >> 172.21.15.50:0/2152553893 conn(0x55a4a26c9790 msgr2=0x55a4a27bd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.416+0000 7f015570c800 1 -- 172.21.15.50:0/2152553893 shutdown_connections 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.416+0000 7f015570c800 1 -- 172.21.15.50:0/2152553893 wait complete. 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.416+0000 7f015570c800 1 Processor -- start 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.416+0000 7f015570c800 1 -- start start 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.417+0000 7f015570c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.417+0000 7f015570c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a4a26d9920 con 0x55a4a2642410 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.417+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.417+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45336/0 (socket says 172.21.15.50:45336) 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.417+0000 7f015320b640 1 -- 172.21.15.50:0/2912242067 learned_addr learned my addr 172.21.15.50:0/2912242067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.417+0000 7f015320b640 1 -- 172.21.15.50:0/2912242067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a27c9870 con 0x55a4a2642410 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.417+0000 7f015320b640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c9330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f014400a520 tx=0x7f0144003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.418+0000 7f003fe07640 1 -- 172.21.15.50:0/2912242067 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144073070 con 0x55a4a2642410 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.418+0000 7f003fe07640 1 -- 172.21.15.50:0/2912242067 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014405d440 con 0x55a4a2642410 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.418+0000 7f003fe07640 1 -- 172.21.15.50:0/2912242067 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144057070 con 0x55a4a2642410 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.418+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4a27c9b00 con 0x55a4a2642410 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.418+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a27cc7b0 con 0x55a4a2642410 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.418+0000 7f003fe07640 1 -- 172.21.15.50:0/2912242067 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0144076070 con 0x55a4a2642410 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.419+0000 7f003fe07640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0038036900 0x7f0038038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.419+0000 7f003fe07640 1 -- 172.21.15.50:0/2912242067 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f014408dcf0 con 0x55a4a2642410 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.419+0000 7f0152a0a640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0038036900 0x7f0038038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.419+0000 7f015570c800 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a26439c0 0x55a4a27d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.419+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a27d0ab0 con 0x55a4a26439c0 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.419+0000 7f0153a0c640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a26439c0 0x55a4a27d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.419+0000 7f0152a0a640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0038036900 0x7f0038038dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0148000f60 tx=0x7f0148001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.419+0000 7f0153a0c640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a26439c0 0x55a4a27d0570 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.419+0000 7f0153a0c640 1 -- 172.21.15.50:0/2912242067 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a26439c0 2024-05-07T13:56:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.420+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a27cdb40 con 0x55a4a26439c0 2024-05-07T13:56:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.420+0000 7f0153a0c640 1 -- 172.21.15.50:0/2912242067 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a26439c0 2024-05-07T13:56:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.420+0000 7f015570c800 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a27d2e50 0x55a4a27d5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.420+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a27d58e0 con 0x55a4a27d2e50 2024-05-07T13:56:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.420+0000 7f015320b640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a27d2e50 0x55a4a27d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.420+0000 7f015320b640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a27d2e50 0x55a4a27d5240 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.420+0000 7f015320b640 1 -- 172.21.15.50:0/2912242067 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0144075030 con 0x55a4a27d2e50 2024-05-07T13:56:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.420+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a27d1e00 con 0x55a4a26439c0 2024-05-07T13:56:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.421+0000 7f0153a0c640 1 -- 172.21.15.50:0/2912242067 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a26439c0 2024-05-07T13:56:32.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.421+0000 7f015570c800 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a4a27d6d90 0x55a4a27d91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.421+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a27d9940 con 0x55a4a27d6d90 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.421+0000 7f0152a0a640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a4a27d6d90 0x55a4a27d91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.421+0000 7f0152a0a640 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a4a27d6d90 0x55a4a27d91e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.422+0000 7f0152a0a640 1 -- 172.21.15.50:0/2912242067 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f014800f690 con 0x55a4a27d6d90 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.422+0000 7f015570c800 1 Processor -- start 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.422+0000 7f015570c800 1 -- start start 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.422+0000 7f015570c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27e7da0 0x55a4a27e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.422+0000 7f015570c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a4a25bfcf0 con 0x55a4a27e7da0 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.422+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27e7da0 0x55a4a27e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.422+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27e7da0 0x55a4a27e81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45340/0 (socket says 172.21.15.50:45340) 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.422+0000 7f015320b640 1 -- 172.21.15.50:0/2629728904 learned_addr learned my addr 172.21.15.50:0/2629728904 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.423+0000 7f015320b640 1 -- 172.21.15.50:0/2629728904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a27e8700 con 0x55a4a27e7da0 2024-05-07T13:56:32.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.423+0000 7f015320b640 1 --2- 172.21.15.50:0/2629728904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27e7da0 0x55a4a27e81c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0144006490 tx=0x7f014406e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.423+0000 7f003d602640 1 -- 172.21.15.50:0/2629728904 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f014407a0b0 con 0x55a4a27e7da0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.423+0000 7f003d602640 1 -- 172.21.15.50:0/2629728904 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014407a250 con 0x55a4a27e7da0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.423+0000 7f015570c800 1 -- 172.21.15.50:0/2629728904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4a27e9170 con 0x55a4a27e7da0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.423+0000 7f003d602640 1 -- 172.21.15.50:0/2629728904 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144077b80 con 0x55a4a27e7da0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.423+0000 7f015570c800 1 -- 172.21.15.50:0/2629728904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a27e9670 con 0x55a4a27e7da0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.424+0000 7f003d602640 1 -- 172.21.15.50:0/2629728904 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0144007e30 con 0x55a4a27e7da0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.424+0000 7f003d602640 1 --2- 172.21.15.50:0/2629728904 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f002c036950 0x7f002c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.424+0000 7f003d602640 1 -- 172.21.15.50:0/2629728904 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0144098c90 con 0x55a4a27e7da0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.424+0000 7f0152a0a640 1 --2- 172.21.15.50:0/2629728904 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f002c036950 0x7f002c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.424+0000 7f015570c800 1 Processor -- start 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.424+0000 7f015570c800 1 -- start start 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.424+0000 7f0152a0a640 1 --2- 172.21.15.50:0/2629728904 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f002c036950 0x7f002c038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55a4a27cda60 tx=0x7f014800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.424+0000 7f015570c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27f5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.424+0000 7f015570c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a4a27c2140 con 0x55a4a27f4f10 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.425+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.425+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27f5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45346/0 (socket says 172.21.15.50:45346) 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.425+0000 7f015320b640 1 -- 172.21.15.50:0/1032624081 learned_addr learned my addr 172.21.15.50:0/1032624081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.425+0000 7f015320b640 1 -- 172.21.15.50:0/1032624081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a27f5900 con 0x55a4a27f4f10 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.425+0000 7f015320b640 1 --2- 172.21.15.50:0/1032624081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27f5330 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f01440774c0 tx=0x7f014408acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4cb2f7f7c4fd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.425+0000 7f0036ffd640 1 -- 172.21.15.50:0/1032624081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144077d20 con 0x55a4a27f4f10 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.425+0000 7f0036ffd640 1 -- 172.21.15.50:0/1032624081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01440a9070 con 0x55a4a27f4f10 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.425+0000 7f0036ffd640 1 -- 172.21.15.50:0/1032624081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144086cb0 con 0x55a4a27f4f10 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 -- 172.21.15.50:0/1032624081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 msgr2=0x55a4a27f5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 --2- 172.21.15.50:0/1032624081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27f5330 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f01440774c0 tx=0x7f014408acc0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 -- 172.21.15.50:0/1032624081 shutdown_connections 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 --2- 172.21.15.50:0/1032624081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27f5330 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 -- 172.21.15.50:0/1032624081 >> 172.21.15.50:0/1032624081 conn(0x55a4a27f1220 msgr2=0x55a4a27ef280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 -- 172.21.15.50:0/1032624081 shutdown_connections 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 -- 172.21.15.50:0/1032624081 wait complete. 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 Processor -- start 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 -- start start 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015570c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a4a27f5f90 con 0x55a4a27f4f10 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015320b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27fc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45360/0 (socket says 172.21.15.50:45360) 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.426+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 learned_addr learned my addr 172.21.15.50:0/1449014096 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.427+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a27fc810 con 0x55a4a27f4f10 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.427+0000 7f015320b640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27fc2d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f01440774c0 tx=0x7f01440a1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.427+0000 7f00357fa640 1 -- 172.21.15.50:0/1449014096 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144007a50 con 0x55a4a27f4f10 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.427+0000 7f00357fa640 1 -- 172.21.15.50:0/1449014096 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01440766f0 con 0x55a4a27f4f10 2024-05-07T13:56:32.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.427+0000 7f00357fa640 1 -- 172.21.15.50:0/1449014096 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0144076a10 con 0x55a4a27f4f10 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.427+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4a27fc810 con 0x55a4a27f4f10 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.427+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a27fc810 con 0x55a4a27f4f10 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.428+0000 7f00357fa640 1 -- 172.21.15.50:0/1449014096 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f01440bf060 con 0x55a4a27f4f10 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.428+0000 7f00357fa640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f001c036950 0x7f001c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.428+0000 7f00357fa640 1 -- 172.21.15.50:0/1449014096 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f01440c2c60 con 0x55a4a27f4f10 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.428+0000 7f0152a0a640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f001c036950 0x7f001c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.429+0000 7f0152a0a640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f001c036950 0x7f001c038e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55a4a27d9d40 tx=0x7f0148010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.429+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.429+0000 7f015570c800 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a2807890 0x55a4a2809d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.429+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.429+0000 7f0153a0c640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a2807890 0x55a4a2809d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.429+0000 7f0153a0c640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a2807890 0x55a4a2809d50 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 20 realm 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280a8b0 con 0x55a4a2807890 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b180 con 0x55a4a2807890 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a2807890 2024-05-07T13:56:32.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a280c280 0x55a4a280e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.430+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280ec80 con 0x55a4a280c280 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.431+0000 7f015320b640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a280c280 0x55a4a280e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.431+0000 7f015320b640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a280c280 0x55a4a280e670 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.431+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.431+0000 7f015570c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.431+0000 7f015570c800 20 searching for the correct realm 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.431+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28105b0 con 0x55a4a280c280 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.432+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.432+0000 7f015320b640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0144078060 0x7f014404e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.432+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28105b0 con 0x7f0144078060 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.432+0000 7f0152a0a640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0144078060 0x7f014404e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.432+0000 7f0152a0a640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0144078060 0x7f014404e580 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.432+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.432+0000 7f0152a0a640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f014800f070 0x7f014802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.432+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28105b0 con 0x7f014800f070 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.433+0000 7f0153a0c640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f014800f070 0x7f014802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.433+0000 7f0153a0c640 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f014800f070 0x7f014802e910 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.433+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c00a4a0 con 0x7f014800f070 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.433+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a2807890 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.433+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.433+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a2807890 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.434+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.434+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f014800f070 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.434+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c00a4a0 con 0x7f014800f070 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.434+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f014800f070 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.434+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f014c00a4a0 con 0x7f014800f070 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.434+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f0144078060 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.434+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.434+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a280c280 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.435+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.435+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a2807890 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.435+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.435+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f014800f070 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.435+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c00a4a0 con 0x7f014800f070 2024-05-07T13:56:32.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.435+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a2807890 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.435+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.435+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f0144078060 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.436+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.436+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a280c280 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.436+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.436+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a280c280 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.436+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.436+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f014800f070 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.436+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c00a4a0 con 0x7f014800f070 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.437+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a280c280 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.437+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.437+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a280c280 2024-05-07T13:56:32.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.437+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.437+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a2807890 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.437+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c00a4a0 con 0x55a4a2807890 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.437+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a2807890 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.437+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.437+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f014800f070 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.438+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.438+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a280c280 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.438+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.438+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f0144078060 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.438+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.438+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a2807890 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.438+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.438+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f014800f070 2024-05-07T13:56:32.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.439+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.439+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a280c280 2024-05-07T13:56:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.439+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.439+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f014800f070 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.440+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.440+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f0144078060 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.440+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.440+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a280c280 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.440+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.440+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f014800f070 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.440+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.440+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x55a4a2807890 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280b520 con 0x7f0144078060 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280f540 con 0x55a4a2807890 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.441+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280f930 con 0x55a4a2807890 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280f930 con 0x7f014800f070 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 20 zone default found 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 4 Realm: () 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 20 zonegroup default 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.442+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280f0c0 con 0x7f014800f070 2024-05-07T13:56:32.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a280f0c0 con 0x55a4a280c280 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2812590 con 0x55a4a280c280 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 20 started sync module instance, tier type = 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.443+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28118b0 con 0x7f0144078060 2024-05-07T13:56:32.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.444+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.444+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94165589367968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2811510 con 0x7f0144078060 2024-05-07T13:56:32.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.444+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28134c0 con 0x55a4a2807890 2024-05-07T13:56:32.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.446+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94165589367968] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.446+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.446+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94165589372944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2813430 con 0x55a4a2807890 2024-05-07T13:56:32.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.446+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2814380 con 0x55a4a280c280 2024-05-07T13:56:32.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.447+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94165589372944] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.447+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.447+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94165589376720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2814770 con 0x55a4a280c280 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.447+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28151b0 con 0x7f0144078060 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.448+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94165589376720] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.448+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.448+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94165589375152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2815a50 con 0x7f0144078060 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.448+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2816410 con 0x55a4a2807890 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.449+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.449+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94165589375152] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.449+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94165589385056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2816830 con 0x55a4a2807890 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.449+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28171f0 con 0x7f014800f070 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.450+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94165589385056] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.450+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.450+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94165589386624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28171f0 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.450+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2817bb0 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.451+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94165589386624] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.452+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.452+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94165589389088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2817bb0 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.452+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2817bb0 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94165589389088] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94165589393600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2818990 con 0x7f014800f070 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 20 add_watcher() i=0 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 20 add_watcher() i=1 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 20 add_watcher() i=2 2024-05-07T13:56:32.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 20 add_watcher() i=3 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 20 add_watcher() i=4 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 20 add_watcher() i=5 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 20 add_watcher() i=6 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94165589393600] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 20 add_watcher() i=7 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.453+0000 7f015570c800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.454+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2818990 con 0x55a4a2807890 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.454+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.454+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94165589394656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2819260 con 0x55a4a2807890 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.455+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94165589394656] v27'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.455+0000 7f0009fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.455+0000 7f015570c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:32.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.455+0000 7f015570c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.455+0000 7f015570c800 5 note: GC not initialized 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.455+0000 7f0008fe1640 20 reqs_thread_entry: start 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 20 Filter name: none 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7eff827fc640 20 reqs_thread_entry: start 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a284eda0 con 0x55a4a2807890 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:32.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.456+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2854cb0 con 0x55a4a2807890 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.457+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v27'16 uv16 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.457+0000 7f015570c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.457+0000 7f015570c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.457+0000 7f015570c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.457+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94165589641120 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28506c0 con 0x55a4a2807890 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.458+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94165589385056 notify 115964117008 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f014c01e040 con 0x55a4a2807890 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.458+0000 7f0036ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117008 cookie 94165589385056 notifier 4649 bl.length()=579 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.458+0000 7f0036ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.458+0000 7f0036ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.458+0000 7f0036ffd640 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f0018003ea0 con 0x55a4a2807890 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.458+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(64 notify.4 [notify cookie 94165589641120 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.458+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.458+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 94165589641120 notify 115964117008 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f014c027c90 con 0x55a4a2807890 2024-05-07T13:56:32.458 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:32.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.459+0000 7f0009fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.459+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94165589394656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28038a0 con 0x55a4a2807890 2024-05-07T13:56:32.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.460+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94165589394656] v27'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.460+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94165589367968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28184e0 con 0x7f0144078060 2024-05-07T13:56:32.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.461+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94165589367968] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.461+0000 7f015570c800 20 remove_watcher() i=0 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.461+0000 7f015570c800 2 removed watcher, disabling cache 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.461+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94165589372944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28184e0 con 0x55a4a2807890 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.462+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94165589372944] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.462+0000 7f015570c800 20 remove_watcher() i=1 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.462+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94165589376720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a28184e0 con 0x55a4a280c280 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.463+0000 7f015320b640 1 -- 172.21.15.50:0/1449014096 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94165589376720] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01440a2030 con 0x55a4a280c280 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.463+0000 7f015570c800 20 remove_watcher() i=2 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.463+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94165589375152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2813010 con 0x7f0144078060 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.464+0000 7f0152a0a640 1 -- 172.21.15.50:0/1449014096 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94165589375152] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148037040 con 0x7f0144078060 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.464+0000 7f015570c800 20 remove_watcher() i=3 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.464+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94165589385056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2813010 con 0x55a4a2807890 2024-05-07T13:56:32.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.465+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94165589385056] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x55a4a2807890 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.465+0000 7f015570c800 20 remove_watcher() i=4 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.465+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94165589386624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2815f60 con 0x7f014800f070 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.466+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94165589386624] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.466+0000 7f015570c800 20 remove_watcher() i=5 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.466+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94165589389088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2815f60 con 0x7f014800f070 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.467+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94165589389088] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.467+0000 7f015570c800 20 remove_watcher() i=6 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.467+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94165589393600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a4a2815f60 con 0x7f014800f070 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94165589393600] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f014c02f060 con 0x7f014800f070 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 20 remove_watcher() i=7 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f014800f070 msgr2=0x7f014802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f014800f070 0x7f014802e910 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a2807890 msgr2=0x55a4a2809d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a2807890 0x55a4a2809d50 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0144078060 msgr2=0x7f014404e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0144078060 0x7f014404e580 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a280c280 msgr2=0x55a4a280e670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a280c280 0x55a4a280e670 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f001c036950 msgr2=0x7f001c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f001c036950 0x7f001c038e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55a4a27d9d40 tx=0x7f0148010000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f0153a0c640 1 -- 172.21.15.50:0/1449014096 reap_dead start 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 msgr2=0x55a4a27fc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27fc2d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f01440774c0 tx=0x7f01440a1000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 shutdown_connections 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 --2- 172.21.15.50:0/1449014096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27f4f10 0x55a4a27fc2d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 >> 172.21.15.50:0/1449014096 conn(0x55a4a27f1220 msgr2=0x55a4a27ee880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 shutdown_connections 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.468+0000 7f015570c800 1 -- 172.21.15.50:0/1449014096 wait complete. 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2629728904 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f002c036950 msgr2=0x7f002c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 --2- 172.21.15.50:0/2629728904 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f002c036950 0x7f002c038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55a4a27cda60 tx=0x7f014800f000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2629728904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27e7da0 msgr2=0x55a4a27e81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 --2- 172.21.15.50:0/2629728904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27e7da0 0x55a4a27e81c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0144006490 tx=0x7f014406e630 comp rx=0 tx=0).stop 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2629728904 shutdown_connections 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 --2- 172.21.15.50:0/2629728904 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f002c036950 0x7f002c038e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 --2- 172.21.15.50:0/2629728904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a27e7da0 0x55a4a27e81c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2629728904 >> 172.21.15.50:0/2629728904 conn(0x55a4a27dbe40 msgr2=0x55a4a27dc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2629728904 shutdown_connections 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2629728904 wait complete. 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a4a27d6d90 msgr2=0x55a4a27d91e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a4a27d6d90 0x55a4a27d91e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a26439c0 msgr2=0x55a4a27d0570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a4a26439c0 0x55a4a27d0570 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a27d2e50 msgr2=0x55a4a27d5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a4a27d2e50 0x55a4a27d5240 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0038036900 msgr2=0x7f0038038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0038036900 0x7f0038038dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0148000f60 tx=0x7f0148001370 comp rx=0 tx=0).stop 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 msgr2=0x55a4a27c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 --2- 172.21.15.50:0/2912242067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a2642410 0x55a4a27c9330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f014400a520 tx=0x7f0144003020 comp rx=0 tx=0).stop 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f0153a0c640 1 -- 172.21.15.50:0/2912242067 reap_dead start 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 shutdown_connections 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 >> 172.21.15.50:0/2912242067 conn(0x55a4a26c9790 msgr2=0x55a4a27bb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 shutdown_connections 2024-05-07T13:56:32.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.469+0000 7f015570c800 1 -- 172.21.15.50:0/2912242067 wait complete. 2024-05-07T13:56:32.469 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:32.469 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-07T13:56:32.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-07T13:56:32.470 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-05-07T13:56:32.517 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:32.518 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.531+0000 7f0244c0e800 1 Processor -- start 2024-05-07T13:56:32.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.531+0000 7f0244c0e800 1 -- start start 2024-05-07T13:56:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.531+0000 7f0244c0e800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562ab2ed9c00 0x562ab2edbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.531+0000 7f0244c0e800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562ab2ee0040 con 0x562ab2edc530 2024-05-07T13:56:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.531+0000 7f0244c0e800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x562ab2d6a050 con 0x562ab2ed9c00 2024-05-07T13:56:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.531+0000 7f024270d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562ab2ed9c00 0x562ab2edbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.531+0000 7f0241f0c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x562ab2edc530 0x562ab2ede920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:44070/0 (socket says 172.21.15.50:44070) 2024-05-07T13:56:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.531+0000 7f0241f0c640 1 -- 172.21.15.50:0/3096891210 learned_addr learned my addr 172.21.15.50:0/3096891210 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.532+0000 7f024270d640 1 -- 172.21.15.50:0/3096891210 >> v1:172.21.15.22:6789/0 conn(0x562ab2edc530 legacy=0x562ab2ede920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.532+0000 7f024170b640 1 -- 172.21.15.50:0/3096891210 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2767955976 0 0) 0x562ab2ee0040 con 0x562ab2edc530 2024-05-07T13:56:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.532+0000 7f024270d640 1 -- 172.21.15.50:0/3096891210 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab2ee1220 con 0x562ab2ed9c00 2024-05-07T13:56:32.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f024270d640 1 --2- 172.21.15.50:0/3096891210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2edbff0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f023400a470 tx=0x7f023401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112205c1dcc8434e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f024170b640 1 -- 172.21.15.50:0/3096891210 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234057070 con 0x562ab2ed9c00 2024-05-07T13:56:32.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f024170b640 1 -- 172.21.15.50:0/3096891210 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0234052570 con 0x562ab2ed9c00 2024-05-07T13:56:32.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f024170b640 1 -- 172.21.15.50:0/3096891210 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234052870 con 0x562ab2ed9c00 2024-05-07T13:56:32.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f0244c0e800 1 -- 172.21.15.50:0/3096891210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 msgr2=0x562ab2edbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3096891210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2edbff0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f023400a470 tx=0x7f023401ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:32.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f0244c0e800 1 -- 172.21.15.50:0/3096891210 shutdown_connections 2024-05-07T13:56:32.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3096891210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2edbff0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f0244c0e800 1 -- 172.21.15.50:0/3096891210 >> 172.21.15.50:0/3096891210 conn(0x562ab2ed3570 msgr2=0x562ab2ed5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f0244c0e800 1 -- 172.21.15.50:0/3096891210 shutdown_connections 2024-05-07T13:56:32.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.534+0000 7f0244c0e800 1 -- 172.21.15.50:0/3096891210 wait complete. 2024-05-07T13:56:32.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.550+0000 7f0244c0e800 1 Processor -- start 2024-05-07T13:56:32.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.550+0000 7f0244c0e800 1 -- start start 2024-05-07T13:56:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.550+0000 7f0244c0e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.550+0000 7f0244c0e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562ab2e241c0 con 0x562ab2ed9c00 2024-05-07T13:56:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.550+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.550+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45382/0 (socket says 172.21.15.50:45382) 2024-05-07T13:56:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.550+0000 7f024270d640 1 -- 172.21.15.50:0/1100789429 learned_addr learned my addr 172.21.15.50:0/1100789429 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.550+0000 7f024270d640 1 -- 172.21.15.50:0/1100789429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab2fcaa10 con 0x562ab2ed9c00 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.551+0000 7f024270d640 1 --2- 172.21.15.50:0/1100789429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fca440 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0234055040 tx=0x7f023404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cb7d14e1d53750 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.551+0000 7f0130608640 1 -- 172.21.15.50:0/1100789429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234062070 con 0x562ab2ed9c00 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.551+0000 7f0130608640 1 -- 172.21.15.50:0/1100789429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02340528d0 con 0x562ab2ed9c00 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.551+0000 7f0130608640 1 -- 172.21.15.50:0/1100789429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234057040 con 0x562ab2ed9c00 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.551+0000 7f0244c0e800 1 -- 172.21.15.50:0/1100789429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 msgr2=0x562ab2fca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.551+0000 7f0244c0e800 1 --2- 172.21.15.50:0/1100789429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fca440 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0234055040 tx=0x7f023404c000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.551+0000 7f0244c0e800 1 -- 172.21.15.50:0/1100789429 shutdown_connections 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.551+0000 7f0244c0e800 1 --2- 172.21.15.50:0/1100789429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fca440 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f0244c0e800 1 -- 172.21.15.50:0/1100789429 >> 172.21.15.50:0/1100789429 conn(0x562ab2ed3570 msgr2=0x562ab2fc5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f0244c0e800 1 -- 172.21.15.50:0/1100789429 shutdown_connections 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f0244c0e800 1 -- 172.21.15.50:0/1100789429 wait complete. 2024-05-07T13:56:32.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f0244c0e800 1 Processor -- start 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f0244c0e800 1 -- start start 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f0244c0e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fd1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f0244c0e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562ab2ee0510 con 0x562ab2ed9c00 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fd1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fd1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45388/0 (socket says 172.21.15.50:45388) 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.552+0000 7f024270d640 1 -- 172.21.15.50:0/3462556324 learned_addr learned my addr 172.21.15.50:0/3462556324 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.553+0000 7f024270d640 1 -- 172.21.15.50:0/3462556324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab2fd2400 con 0x562ab2ed9c00 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.553+0000 7f024270d640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fd1ec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0234055040 tx=0x7f0234002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.553+0000 7f012ee05640 1 -- 172.21.15.50:0/3462556324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234057050 con 0x562ab2ed9c00 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.553+0000 7f012ee05640 1 -- 172.21.15.50:0/3462556324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0234067790 con 0x562ab2ed9c00 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.553+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ab2fd2690 con 0x562ab2ed9c00 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.553+0000 7f012ee05640 1 -- 172.21.15.50:0/3462556324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234062040 con 0x562ab2ed9c00 2024-05-07T13:56:32.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.553+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab2fd5340 con 0x562ab2ed9c00 2024-05-07T13:56:32.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.554+0000 7f012ee05640 1 -- 172.21.15.50:0/3462556324 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0234067a70 con 0x562ab2ed9c00 2024-05-07T13:56:32.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.554+0000 7f012ee05640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0128036950 0x7f0128038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.554+0000 7f012ee05640 1 -- 172.21.15.50:0/3462556324 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f023408e670 con 0x562ab2ed9c00 2024-05-07T13:56:32.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.554+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0128036950 0x7f0128038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.554+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab2edc530 0x562ab2fd9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.554+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab2fd9640 con 0x562ab2edc530 2024-05-07T13:56:32.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.554+0000 7f0242f0e640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab2edc530 0x562ab2fd9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.555+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0128036950 0x7f0128038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0238000c00 tx=0x7f02380013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.555+0000 7f0242f0e640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab2edc530 0x562ab2fd9100 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.555+0000 7f0242f0e640 1 -- 172.21.15.50:0/3462556324 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab2edc530 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.555+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab2fd6680 con 0x562ab2edc530 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.555+0000 7f0242f0e640 1 -- 172.21.15.50:0/3462556324 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab2edc530 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.555+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab2fdb900 0x562ab2fddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.555+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab2fde3e0 con 0x562ab2fdb900 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.555+0000 7f024270d640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab2fdb900 0x562ab2fddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.556+0000 7f024270d640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab2fdb900 0x562ab2fddcf0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.556+0000 7f024270d640 1 -- 172.21.15.50:0/3462556324 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0234064070 con 0x562ab2fdb900 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.556+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab2fda8e0 con 0x562ab2edc530 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.556+0000 7f0242f0e640 1 -- 172.21.15.50:0/3462556324 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab2edc530 2024-05-07T13:56:32.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.556+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562ab2fdf840 0x562ab2fe1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.556+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab2fe2410 con 0x562ab2fdf840 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.556+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562ab2fdf840 0x562ab2fe1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.557+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562ab2fdf840 0x562ab2fe1cb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.557+0000 7f0241f0c640 1 -- 172.21.15.50:0/3462556324 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f023800f670 con 0x562ab2fdf840 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.557+0000 7f0244c0e800 1 Processor -- start 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.557+0000 7f0244c0e800 1 -- start start 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f0244c0e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ff0810 0x562ab2ff0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f0244c0e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562ab2dcacf0 con 0x562ab2ff0810 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ff0810 0x562ab2ff0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ff0810 0x562ab2ff0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45392/0 (socket says 172.21.15.50:45392) 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f024270d640 1 -- 172.21.15.50:0/3227262736 learned_addr learned my addr 172.21.15.50:0/3227262736 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f024270d640 1 -- 172.21.15.50:0/3227262736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab2ff1170 con 0x562ab2ff0810 2024-05-07T13:56:32.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f024270d640 1 --2- 172.21.15.50:0/3227262736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ff0810 0x562ab2ff0c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0234007000 tx=0x7f0234067e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f0127fff640 1 -- 172.21.15.50:0/3227262736 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234093070 con 0x562ab2ff0810 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f0127fff640 1 -- 172.21.15.50:0/3227262736 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023405dd70 con 0x562ab2ff0810 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f0244c0e800 1 -- 172.21.15.50:0/3227262736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ab2ff1be0 con 0x562ab2ff0810 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.558+0000 7f0127fff640 1 -- 172.21.15.50:0/3227262736 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023408b070 con 0x562ab2ff0810 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.559+0000 7f0244c0e800 1 -- 172.21.15.50:0/3227262736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab2ff20e0 con 0x562ab2ff0810 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.559+0000 7f0127fff640 1 -- 172.21.15.50:0/3227262736 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0234096070 con 0x562ab2ff0810 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.559+0000 7f0127fff640 1 --2- 172.21.15.50:0/3227262736 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f011c0369a0 0x7f011c038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.559+0000 7f0127fff640 1 -- 172.21.15.50:0/3227262736 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0234099ca0 con 0x562ab2ff0810 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3227262736 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f011c0369a0 0x7f011c038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f0244c0e800 1 Processor -- start 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f0244c0e800 1 -- start start 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3227262736 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f011c0369a0 0x7f011c038e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x562ab2fd6a40 tx=0x7f0238006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f0244c0e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab2ed9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f0244c0e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562ab2fcacd0 con 0x562ab2ed91f0 2024-05-07T13:56:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab2ed9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab2ed9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45398/0 (socket says 172.21.15.50:45398) 2024-05-07T13:56:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f024270d640 1 -- 172.21.15.50:0/4100990535 learned_addr learned my addr 172.21.15.50:0/4100990535 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.560+0000 7f024270d640 1 -- 172.21.15.50:0/4100990535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab2ed79f0 con 0x562ab2ed91f0 2024-05-07T13:56:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f024270d640 1 --2- 172.21.15.50:0/4100990535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab2ed9610 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0234066fd0 tx=0x7f023407de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d6863c3eb41f25 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0125ffb640 1 -- 172.21.15.50:0/4100990535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02340075a0 con 0x562ab2ed91f0 2024-05-07T13:56:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0125ffb640 1 -- 172.21.15.50:0/4100990535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0234007800 con 0x562ab2ed91f0 2024-05-07T13:56:32.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0125ffb640 1 -- 172.21.15.50:0/4100990535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234066af0 con 0x562ab2ed91f0 2024-05-07T13:56:32.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0244c0e800 1 -- 172.21.15.50:0/4100990535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 msgr2=0x562ab2ed9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0244c0e800 1 --2- 172.21.15.50:0/4100990535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab2ed9610 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0234066fd0 tx=0x7f023407de10 comp rx=0 tx=0).stop 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0244c0e800 1 -- 172.21.15.50:0/4100990535 shutdown_connections 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0244c0e800 1 --2- 172.21.15.50:0/4100990535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab2ed9610 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0244c0e800 1 -- 172.21.15.50:0/4100990535 >> 172.21.15.50:0/4100990535 conn(0x562ab2ff9c90 msgr2=0x562ab2ff7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0244c0e800 1 -- 172.21.15.50:0/4100990535 shutdown_connections 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.561+0000 7f0244c0e800 1 -- 172.21.15.50:0/4100990535 wait complete. 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.562+0000 7f0244c0e800 1 Processor -- start 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.562+0000 7f0244c0e800 1 -- start start 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.562+0000 7f0244c0e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab3006f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.562+0000 7f0244c0e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562ab2ed7e00 con 0x562ab2ed91f0 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.562+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab3006f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.562+0000 7f024270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab3006f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45406/0 (socket says 172.21.15.50:45406) 2024-05-07T13:56:32.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.562+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 learned_addr learned my addr 172.21.15.50:0/3066116023 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.562+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab30074b0 con 0x562ab2ed91f0 2024-05-07T13:56:32.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.562+0000 7f024270d640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab3006f70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f023404bcb0 tx=0x7f023408aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.563+0000 7f0113fff640 1 -- 172.21.15.50:0/3066116023 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023408b340 con 0x562ab2ed91f0 2024-05-07T13:56:32.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.563+0000 7f0113fff640 1 -- 172.21.15.50:0/3066116023 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023407d580 con 0x562ab2ed91f0 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.563+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ab30074b0 con 0x562ab2ed91f0 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.563+0000 7f0113fff640 1 -- 172.21.15.50:0/3066116023 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023404bd30 con 0x562ab2ed91f0 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.563+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab30074b0 con 0x562ab2ed91f0 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.563+0000 7f0113fff640 1 -- 172.21.15.50:0/3066116023 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f02340ac040 con 0x562ab2ed91f0 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.564+0000 7f0113fff640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f010c036950 0x7f010c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.564+0000 7f0113fff640 1 -- 172.21.15.50:0/3066116023 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f02340aa020 con 0x562ab2ed91f0 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.564+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f010c036950 0x7f010c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.564+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f010c036950 0x7f010c038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x562ab2fde780 tx=0x7f0238023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.564+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.564+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab3012620 0x562ab3014ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.564+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab3015230 con 0x562ab3012620 2024-05-07T13:56:32.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.564+0000 7f0242f0e640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab3012620 0x562ab3014ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0242f0e640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab3012620 0x562ab3014ae0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab3012620 2024-05-07T13:56:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 20 realm 2024-05-07T13:56:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab3015640 con 0x562ab3012620 2024-05-07T13:56:32.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab3012620 2024-05-07T13:56:32.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:32.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab3015f10 con 0x562ab3012620 2024-05-07T13:56:32.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab3012620 2024-05-07T13:56:32.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.565+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3012620 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.566+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab3012620 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.566+0000 7f0244c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.566+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.566+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab3017010 0x562ab3019400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.566+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab3019a10 con 0x562ab3017010 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.566+0000 7f024270d640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab3017010 0x562ab3019400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.566+0000 7f024270d640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab3017010 0x562ab3019400 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.566+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.566+0000 7f0244c0e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.567+0000 7f0244c0e800 20 searching for the correct realm 2024-05-07T13:56:32.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.567+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab301b340 con 0x562ab3017010 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.567+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.567+0000 7f024270d640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f02340af040 0x7f02340ba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.567+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab301b340 con 0x7f02340af040 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.567+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f02340af040 0x7f02340ba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.568+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f02340af040 0x7f02340ba8e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.568+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.568+0000 7f0241f0c640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f023803a3c0 0x7f023803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.568+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab301b340 con 0x7f023803a3c0 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.568+0000 7f0242f0e640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f023803a3c0 0x7f023803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.568+0000 7f0242f0e640 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f023803a3c0 0x7f023803a810 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.569+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c00a4a0 con 0x7f023803a3c0 2024-05-07T13:56:32.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.569+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3012620 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.569+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab3012620 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.569+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3012620 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.569+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab3012620 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.569+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f023803a3c0 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.569+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c00a4a0 con 0x7f023803a3c0 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.569+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f023803a3c0 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.570+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f023c00a4a0 con 0x7f023803a3c0 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.570+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f02340af040 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.570+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.570+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3017010 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.570+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.570+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3012620 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.570+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab3012620 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.570+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f023803a3c0 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.571+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c00a4a0 con 0x7f023803a3c0 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.571+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3012620 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.571+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab3012620 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.571+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f02340af040 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.571+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.571+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3017010 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.571+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.571+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3017010 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.572+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.572+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f023803a3c0 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.572+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c00a4a0 con 0x7f023803a3c0 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.572+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3017010 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.572+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.572+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3017010 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.572+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.572+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3012620 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.573+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c00a4a0 con 0x562ab3012620 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.573+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3012620 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.573+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.573+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f023803a3c0 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.573+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.573+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3017010 2024-05-07T13:56:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.573+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.573+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f02340af040 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.574+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.574+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3012620 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.574+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.574+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f023803a3c0 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.574+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.574+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3017010 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.575+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.575+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f023803a3c0 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.575+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.575+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f02340af040 2024-05-07T13:56:32.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.575+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.575+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3017010 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.575+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.575+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f023803a3c0 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x562ab3012620 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562ab30162b0 con 0x7f02340af040 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:32.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab301a2d0 con 0x562ab3012620 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.576+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab301a6c0 con 0x562ab3012620 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.577+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.577+0000 7f0244c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.577+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.577+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab301a6c0 con 0x7f023803a3c0 2024-05-07T13:56:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.577+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 zone default found 2024-05-07T13:56:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 4 Realm: () 2024-05-07T13:56:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:32.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 zonegroup default 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab3019e50 con 0x7f023803a3c0 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab3019e50 con 0x562ab3017010 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab301d2b0 con 0x562ab3017010 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 started sync module instance, tier type = 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.578+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301c640 con 0x7f02340af040 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.580+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.580+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94741391854128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301c2a0 con 0x7f02340af040 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.580+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301e1e0 con 0x562ab3012620 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.581+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94741391854128] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.581+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.581+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94741391858992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301e600 con 0x562ab3012620 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.581+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301efc0 con 0x562ab3017010 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.582+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94741391858992] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.582+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.582+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94741391862544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301f360 con 0x562ab3017010 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.582+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301fdb0 con 0x7f02340af040 2024-05-07T13:56:32.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.583+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94741391862544] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.583+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.584+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94741391860048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3020650 con 0x7f02340af040 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.584+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3021010 con 0x562ab3012620 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.585+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94741391860048] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.585+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.585+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94741391870816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3021430 con 0x562ab3012620 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.585+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3021df0 con 0x7f023803a3c0 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.586+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.586+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94741391874368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3022250 con 0x7f023803a3c0 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.586+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3022d60 con 0x7f023803a3c0 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.586+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94741391870816] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.587+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94741391874368] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.587+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(56 notify.6 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.587+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94741391878160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3021d60 con 0x7f023803a3c0 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.587+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3023340 con 0x7f023803a3c0 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94741391879824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3023760 con 0x7f023803a3c0 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 20 add_watcher() i=0 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 20 add_watcher() i=1 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 20 add_watcher() i=2 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 20 add_watcher() i=3 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 20 add_watcher() i=4 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 20 add_watcher() i=5 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94741391878160] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 20 add_watcher() i=6 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94741391879824] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 20 add_watcher() i=7 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.588+0000 7f0244c0e800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.589+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab3023760 con 0x562ab3012620 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.589+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.589+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94741391880880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab30236d0 con 0x562ab3012620 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.590+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94741391880880] v27'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.590+0000 7f00f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.590+0000 7f0244c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.590+0000 7f0244c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.590+0000 7f0244c0e800 5 note: GC not initialized 2024-05-07T13:56:32.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.590+0000 7f00737fe640 20 reqs_thread_entry: start 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 20 Filter name: none 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f00717fa640 20 reqs_thread_entry: start 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab3059c70 con 0x562ab3012620 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv16 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 20 rados_obj.operate() r=0 bl.length=403 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.591+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab305fb30 con 0x562ab3012620 2024-05-07T13:56:32.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'17 uv17 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0244c0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0244c0e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0244c0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94741392127392 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562ab305b590 con 0x562ab3012620 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94741391870816 notify 115964117009 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f023c01e040 con 0x562ab3012620 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0125ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117009 cookie 94741391870816 notifier 4656 bl.length()=567 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(64 notify.4 [notify cookie 94741392127392 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0125ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0125ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0125ffb640 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f0108003ea0 con 0x562ab3012620 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.593+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== watch-notify(notify_complete (2) cookie 94741392127392 notify 115964117009 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f023c027c90 con 0x562ab3012620 2024-05-07T13:56:32.593 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-07T13:56:08.855550Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:56:08.855537Z","tags":[],"group_ids":[]} 2024-05-07T13:56:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.594+0000 7f00f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.594+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94741391880880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab305e4d0 con 0x562ab3012620 2024-05-07T13:56:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.595+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94741391880880] v27'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.595+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94741391854128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab30232b0 con 0x7f02340af040 2024-05-07T13:56:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.596+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94741391854128] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.596+0000 7f0244c0e800 20 remove_watcher() i=0 2024-05-07T13:56:32.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.596+0000 7f0244c0e800 2 removed watcher, disabling cache 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.596+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94741391858992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab30232b0 con 0x562ab3012620 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.597+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94741391858992] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.597+0000 7f0244c0e800 20 remove_watcher() i=1 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.597+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94741391862544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab30232b0 con 0x562ab3017010 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.598+0000 7f024270d640 1 -- 172.21.15.50:0/3066116023 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94741391862544] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02340a3030 con 0x562ab3017010 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.598+0000 7f0244c0e800 20 remove_watcher() i=2 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.598+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94741391860048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301eb10 con 0x7f02340af040 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.599+0000 7f0241f0c640 1 -- 172.21.15.50:0/3066116023 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94741391860048] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0238037040 con 0x7f02340af040 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.599+0000 7f0244c0e800 20 remove_watcher() i=3 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.599+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94741391870816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301eb10 con 0x562ab3012620 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.600+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94741391870816] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x562ab3012620 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.600+0000 7f0244c0e800 20 remove_watcher() i=4 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.600+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94741391874368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3020b60 con 0x7f023803a3c0 2024-05-07T13:56:32.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.602+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94741391874368] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.602+0000 7f0244c0e800 20 remove_watcher() i=5 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.602+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94741391878160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab301eb10 con 0x7f023803a3c0 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.603+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94741391878160] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.603+0000 7f0244c0e800 20 remove_watcher() i=6 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.603+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94741391879824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562ab3021940 con 0x7f023803a3c0 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94741391879824] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c02f060 con 0x7f023803a3c0 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 20 remove_watcher() i=7 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f023803a3c0 msgr2=0x7f023803a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f023803a3c0 0x7f023803a810 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab3012620 msgr2=0x562ab3014ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab3012620 0x562ab3014ae0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f02340af040 msgr2=0x7f02340ba8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f02340af040 0x7f02340ba8e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab3017010 msgr2=0x562ab3019400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab3017010 0x562ab3019400 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f010c036950 msgr2=0x7f010c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f010c036950 0x7f010c038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x562ab2fde780 tx=0x7f0238023040 comp rx=0 tx=0).stop 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 msgr2=0x562ab3006f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0242f0e640 1 -- 172.21.15.50:0/3066116023 reap_dead start 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab3006f70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f023404bcb0 tx=0x7f023408aee0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 shutdown_connections 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3066116023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed91f0 0x562ab3006f70 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 >> 172.21.15.50:0/3066116023 conn(0x562ab2ff9c90 msgr2=0x562ab2ff72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 shutdown_connections 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.604+0000 7f0244c0e800 1 -- 172.21.15.50:0/3066116023 wait complete. 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3227262736 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f011c0369a0 msgr2=0x7f011c038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3227262736 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f011c0369a0 0x7f011c038e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x562ab2fd6a40 tx=0x7f0238006000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3227262736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ff0810 msgr2=0x562ab2ff0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3227262736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ff0810 0x562ab2ff0c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0234007000 tx=0x7f0234067e90 comp rx=0 tx=0).stop 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3227262736 shutdown_connections 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3227262736 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f011c0369a0 0x7f011c038e60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3227262736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ff0810 0x562ab2ff0c30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3227262736 >> 172.21.15.50:0/3227262736 conn(0x562ab2fe48e0 msgr2=0x562ab2fe4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3227262736 shutdown_connections 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3227262736 wait complete. 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562ab2fdf840 msgr2=0x562ab2fe1cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562ab2fdf840 0x562ab2fe1cb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab2edc530 msgr2=0x562ab2fd9100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562ab2edc530 0x562ab2fd9100 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab2fdb900 msgr2=0x562ab2fddcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562ab2fdb900 0x562ab2fddcf0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0128036950 msgr2=0x7f0128038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0128036950 0x7f0128038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0238000c00 tx=0x7f02380013b0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 msgr2=0x562ab2fd1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 --2- 172.21.15.50:0/3462556324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ab2ed9c00 0x562ab2fd1ec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0234055040 tx=0x7f0234002fb0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0242f0e640 1 -- 172.21.15.50:0/3462556324 reap_dead start 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 shutdown_connections 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 >> 172.21.15.50:0/3462556324 conn(0x562ab2ed3570 msgr2=0x562ab2fc4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 shutdown_connections 2024-05-07T13:56:32.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.605+0000 7f0244c0e800 1 -- 172.21.15.50:0/3462556324 wait complete. 2024-05-07T13:56:32.604 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-07T13:56:08.855550Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:56:08.855537Z', 'tags': [], 'group_ids': []} 2024-05-07T13:56:32.614 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:32.614 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-07T13:56:32.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-07T13:56:32.614 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-07T13:56:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:56:32.660 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:56:32.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.673+0000 7f0568d44800 1 Processor -- start 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.673+0000 7f0568d44800 1 -- start start 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.673+0000 7f0568d44800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55da01934b60 0x55da01936f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.674+0000 7f0568d44800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da0193afa0 con 0x55da01937490 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.674+0000 7f0568d44800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55da017c5050 con 0x55da01934b60 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.674+0000 7f0566843640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55da01934b60 0x55da01936f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.674+0000 7f0566042640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55da01937490 0x55da01939880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:44080/0 (socket says 172.21.15.50:44080) 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.674+0000 7f0566042640 1 -- 172.21.15.50:0/3534421296 learned_addr learned my addr 172.21.15.50:0/3534421296 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.674+0000 7f0566843640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55da01934b60 0x55da01936f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45422/0 (socket says 172.21.15.50:45422) 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.674+0000 7f0566843640 1 -- 172.21.15.50:0/3534421296 >> v1:172.21.15.22:6789/0 conn(0x55da01937490 legacy=0x55da01939880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.674+0000 7f0566843640 1 -- 172.21.15.50:0/3534421296 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da0193c180 con 0x55da01934b60 2024-05-07T13:56:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.676+0000 7f0566843640 1 --2- 172.21.15.50:0/3534421296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01936f50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f055800a470 tx=0x7f055801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f4cbac74ff8d37 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.676+0000 7f0565841640 1 -- 172.21.15.50:0/3534421296 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558057070 con 0x55da01934b60 2024-05-07T13:56:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.676+0000 7f0565841640 1 -- 172.21.15.50:0/3534421296 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0558052570 con 0x55da01934b60 2024-05-07T13:56:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.676+0000 7f0565841640 1 -- 172.21.15.50:0/3534421296 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558052870 con 0x55da01934b60 2024-05-07T13:56:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.677+0000 7f0568d44800 1 -- 172.21.15.50:0/3534421296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 msgr2=0x55da01936f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.677+0000 7f0568d44800 1 --2- 172.21.15.50:0/3534421296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01936f50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f055800a470 tx=0x7f055801ce90 comp rx=0 tx=0).stop 2024-05-07T13:56:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.677+0000 7f0568d44800 1 -- 172.21.15.50:0/3534421296 shutdown_connections 2024-05-07T13:56:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.677+0000 7f0568d44800 1 --2- 172.21.15.50:0/3534421296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01936f50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.677+0000 7f0568d44800 1 -- 172.21.15.50:0/3534421296 >> 172.21.15.50:0/3534421296 conn(0x55da0192e5b0 msgr2=0x55da019309d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.677+0000 7f0568d44800 1 -- 172.21.15.50:0/3534421296 shutdown_connections 2024-05-07T13:56:32.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.677+0000 7f0568d44800 1 -- 172.21.15.50:0/3534421296 wait complete. 2024-05-07T13:56:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.692+0000 7f0568d44800 1 Processor -- start 2024-05-07T13:56:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.692+0000 7f0568d44800 1 -- start start 2024-05-07T13:56:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.692+0000 7f0568d44800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a256e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.692+0000 7f0568d44800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55da0187f1d0 con 0x55da01934b60 2024-05-07T13:56:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.693+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a256e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.693+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a256e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45440/0 (socket says 172.21.15.50:45440) 2024-05-07T13:56:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.693+0000 7f0566843640 1 -- 172.21.15.50:0/3920034604 learned_addr learned my addr 172.21.15.50:0/3920034604 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.693+0000 7f0566843640 1 -- 172.21.15.50:0/3920034604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da01a25cb0 con 0x55da01934b60 2024-05-07T13:56:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.693+0000 7f0566843640 1 --2- 172.21.15.50:0/3920034604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a256e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0558055040 tx=0x7f055804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad6148ace688224 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.693+0000 7f0454e09640 1 -- 172.21.15.50:0/3920034604 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558057040 con 0x55da01934b60 2024-05-07T13:56:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.693+0000 7f0454e09640 1 -- 172.21.15.50:0/3920034604 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0558052990 con 0x55da01934b60 2024-05-07T13:56:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.693+0000 7f0454e09640 1 -- 172.21.15.50:0/3920034604 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558052c70 con 0x55da01934b60 2024-05-07T13:56:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.694+0000 7f0568d44800 1 -- 172.21.15.50:0/3920034604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 msgr2=0x55da01a256e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.694+0000 7f0568d44800 1 --2- 172.21.15.50:0/3920034604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a256e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0558055040 tx=0x7f055804c000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.694+0000 7f0568d44800 1 -- 172.21.15.50:0/3920034604 shutdown_connections 2024-05-07T13:56:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.694+0000 7f0568d44800 1 --2- 172.21.15.50:0/3920034604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a256e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.694+0000 7f0568d44800 1 -- 172.21.15.50:0/3920034604 >> 172.21.15.50:0/3920034604 conn(0x55da0192e5b0 msgr2=0x55da01a21000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.694+0000 7f0568d44800 1 -- 172.21.15.50:0/3920034604 shutdown_connections 2024-05-07T13:56:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.694+0000 7f0568d44800 1 -- 172.21.15.50:0/3920034604 wait complete. 2024-05-07T13:56:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.694+0000 7f0568d44800 1 Processor -- start 2024-05-07T13:56:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.694+0000 7f0568d44800 1 -- start start 2024-05-07T13:56:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0568d44800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a2d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0568d44800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55da0193b410 con 0x55da01934b60 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a2d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a2d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45452/0 (socket says 172.21.15.50:45452) 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0566843640 1 -- 172.21.15.50:0/1512437350 learned_addr learned my addr 172.21.15.50:0/1512437350 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0566843640 1 -- 172.21.15.50:0/1512437350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da01a2d6a0 con 0x55da01934b60 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0566843640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a2d160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f055800a470 tx=0x7f0558003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0453606640 1 -- 172.21.15.50:0/1512437350 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558073070 con 0x55da01934b60 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0453606640 1 -- 172.21.15.50:0/1512437350 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055805d650 con 0x55da01934b60 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0453606640 1 -- 172.21.15.50:0/1512437350 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558057070 con 0x55da01934b60 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.695+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da01a2d930 con 0x55da01934b60 2024-05-07T13:56:32.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.696+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da01a305e0 con 0x55da01934b60 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.696+0000 7f0453606640 1 -- 172.21.15.50:0/1512437350 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0558076070 con 0x55da01934b60 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.696+0000 7f0453606640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f044c036950 0x7f044c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.697+0000 7f0453606640 1 -- 172.21.15.50:0/1512437350 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f055808dfc0 con 0x55da01934b60 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.697+0000 7f0566042640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f044c036950 0x7f044c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.697+0000 7f0568d44800 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01937490 0x55da01a343a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.697+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a34920 con 0x55da01937490 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.697+0000 7f0567044640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01937490 0x55da01a343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.697+0000 7f0566042640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f044c036950 0x7f044c038e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f055c000f60 tx=0x7f055c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.697+0000 7f0567044640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01937490 0x55da01a343a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.697+0000 7f0567044640 1 -- 172.21.15.50:0/1512437350 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01937490 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.697+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a31950 con 0x55da01937490 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.698+0000 7f0567044640 1 -- 172.21.15.50:0/1512437350 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01937490 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.698+0000 7f0568d44800 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a36c30 0x55da01a39020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.698+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a39710 con 0x55da01a36c30 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.698+0000 7f0566843640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a36c30 0x55da01a39020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.698+0000 7f0566843640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a36c30 0x55da01a39020 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.698+0000 7f0566843640 1 -- 172.21.15.50:0/1512437350 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0558075030 con 0x55da01a36c30 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.698+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a35be0 con 0x55da01937490 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.699+0000 7f0567044640 1 -- 172.21.15.50:0/1512437350 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01937490 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.699+0000 7f0568d44800 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55da01a3abc0 0x55da01a3d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.699+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a3d770 con 0x55da01a3abc0 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.699+0000 7f0566042640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55da01a3abc0 0x55da01a3d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.699+0000 7f0566042640 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55da01a3abc0 0x55da01a3d010 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.700+0000 7f0566042640 1 -- 172.21.15.50:0/1512437350 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f055c009050 con 0x55da01a3abc0 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.700+0000 7f0568d44800 1 Processor -- start 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.700+0000 7f0568d44800 1 -- start start 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.700+0000 7f0568d44800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a4bbd0 0x55da01a4bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.700+0000 7f0568d44800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55da01825cf0 con 0x55da01a4bbd0 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.700+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a4bbd0 0x55da01a4bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.700+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a4bbd0 0x55da01a4bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45456/0 (socket says 172.21.15.50:45456) 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.700+0000 7f0566843640 1 -- 172.21.15.50:0/1316236331 learned_addr learned my addr 172.21.15.50:0/1316236331 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.701+0000 7f0566843640 1 -- 172.21.15.50:0/1316236331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da01a4c530 con 0x55da01a4bbd0 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.701+0000 7f0566843640 1 --2- 172.21.15.50:0/1316236331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a4bbd0 0x55da01a4bff0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0558006e60 tx=0x7f0558006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.701+0000 7f0450e01640 1 -- 172.21.15.50:0/1316236331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558076db0 con 0x55da01a4bbd0 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.701+0000 7f0450e01640 1 -- 172.21.15.50:0/1316236331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0558088070 con 0x55da01a4bbd0 2024-05-07T13:56:32.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.701+0000 7f0568d44800 1 -- 172.21.15.50:0/1316236331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da01a4cfa0 con 0x55da01a4bbd0 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.701+0000 7f0450e01640 1 -- 172.21.15.50:0/1316236331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f055805cb90 con 0x55da01a4bbd0 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.701+0000 7f0568d44800 1 -- 172.21.15.50:0/1316236331 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da01a4d4a0 con 0x55da01a4bbd0 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.702+0000 7f0450e01640 1 -- 172.21.15.50:0/1316236331 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f055808a020 con 0x55da01a4bbd0 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.702+0000 7f0450e01640 1 --2- 172.21.15.50:0/1316236331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0440036950 0x7f0440038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.702+0000 7f0450e01640 1 -- 172.21.15.50:0/1316236331 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0558093ce0 con 0x55da01a4bbd0 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.702+0000 7f0566042640 1 --2- 172.21.15.50:0/1316236331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0440036950 0x7f0440038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.702+0000 7f0568d44800 1 Processor -- start 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.703+0000 7f0568d44800 1 -- start start 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.703+0000 7f0566042640 1 --2- 172.21.15.50:0/1316236331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0440036950 0x7f0440038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f055c00bf50 tx=0x7f055c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.703+0000 7f0568d44800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da01a59130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.703+0000 7f0568d44800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55da01a25f70 con 0x55da01a58d10 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.703+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da01a59130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.703+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da01a59130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45464/0 (socket says 172.21.15.50:45464) 2024-05-07T13:56:32.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.703+0000 7f0566843640 1 -- 172.21.15.50:0/677815238 learned_addr learned my addr 172.21.15.50:0/677815238 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.703+0000 7f0566843640 1 -- 172.21.15.50:0/677815238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da01a59700 con 0x55da01a58d10 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.703+0000 7f0566843640 1 --2- 172.21.15.50:0/677815238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da01a59130 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0558006b90 tx=0x7f0558079f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e62452571cc07b server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f044a7fc640 1 -- 172.21.15.50:0/677815238 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f055805ce60 con 0x55da01a58d10 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f044a7fc640 1 -- 172.21.15.50:0/677815238 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0558079990 con 0x55da01a58d10 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f044a7fc640 1 -- 172.21.15.50:0/677815238 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558084410 con 0x55da01a58d10 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 -- 172.21.15.50:0/677815238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 msgr2=0x55da01a59130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 --2- 172.21.15.50:0/677815238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da01a59130 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0558006b90 tx=0x7f0558079f70 comp rx=0 tx=0).stop 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 -- 172.21.15.50:0/677815238 shutdown_connections 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 --2- 172.21.15.50:0/677815238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da01a59130 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 -- 172.21.15.50:0/677815238 >> 172.21.15.50:0/677815238 conn(0x55da01a55070 msgr2=0x55da01a530d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 -- 172.21.15.50:0/677815238 shutdown_connections 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 -- 172.21.15.50:0/677815238 wait complete. 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 Processor -- start 2024-05-07T13:56:32.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 -- start start 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.704+0000 7f0568d44800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da019344a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0568d44800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55da01a59db0 con 0x55da01a58d10 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da019344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0566843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da019344a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:45480/0 (socket says 172.21.15.50:45480) 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 learned_addr learned my addr 172.21.15.50:0/1067826013 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da01932b90 con 0x55da01a58d10 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0566843640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da019344a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f055806e5c0 tx=0x7f0558092000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0448ff9640 1 -- 172.21.15.50:0/1067826013 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558079030 con 0x55da01a58d10 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0448ff9640 1 -- 172.21.15.50:0/1067826013 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05580791d0 con 0x55da01a58d10 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da01932b90 con 0x55da01a58d10 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0448ff9640 1 -- 172.21.15.50:0/1067826013 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f055808d8c0 con 0x55da01a58d10 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.705+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da01932b90 con 0x55da01a58d10 2024-05-07T13:56:32.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.706+0000 7f0448ff9640 1 -- 172.21.15.50:0/1067826013 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f055808da60 con 0x55da01a58d10 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.706+0000 7f0448ff9640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0430036950 0x7f0430038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.706+0000 7f0448ff9640 1 -- 172.21.15.50:0/1067826013 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f05580b0070 con 0x55da01a58d10 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.706+0000 7f0566042640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0430036950 0x7f0430038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.707+0000 7f0566042640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0430036950 0x7f0430038e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f055c001b60 tx=0x7f055c010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.707+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.707+0000 7f0568d44800 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01a6dab0 0x55da01a6ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.707+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a706c0 con 0x55da01a6dab0 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.707+0000 7f0567044640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01a6dab0 0x55da01a6ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.707+0000 7f0567044640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01a6dab0 0x55da01a6ff70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01a6dab0 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 20 realm 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a70ad0 con 0x55da01a6dab0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01a6dab0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a713a0 con 0x55da01a6dab0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01a6dab0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a6dab0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01a6dab0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a724a0 0x55da01a74890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.708+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a74ea0 con 0x55da01a724a0 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.709+0000 7f0566843640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a724a0 0x55da01a74890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.709+0000 7f0566843640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a724a0 0x55da01a74890 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.709+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.709+0000 7f0568d44800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.709+0000 7f0568d44800 20 searching for the correct realm 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.709+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a767d0 con 0x55da01a724a0 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.710+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.710+0000 7f0566843640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05580b3030 0x7f055809c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.710+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a767d0 con 0x7f05580b3030 2024-05-07T13:56:32.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.710+0000 7f0566042640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05580b3030 0x7f055809c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.710+0000 7f0566042640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05580b3030 0x7f055809c890 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.710+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f055c009050 con 0x7f05580b3030 2024-05-07T13:56:32.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.710+0000 7f0566042640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f055c038040 0x7f055c01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:56:32.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.710+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a767d0 con 0x7f055c038040 2024-05-07T13:56:32.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.711+0000 7f0567044640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f055c038040 0x7f055c01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.711+0000 7f0567044640 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f055c038040 0x7f055c01bab0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.711+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056000a4a0 con 0x7f055c038040 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.711+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a6dab0 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.711+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01a6dab0 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.711+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a6dab0 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.712+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01a6dab0 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.712+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f055c038040 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.712+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056000a4a0 con 0x7f055c038040 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.712+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f055c038040 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.712+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f056000a4a0 con 0x7f055c038040 2024-05-07T13:56:32.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.712+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f05580b3030 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.712+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f055c009050 con 0x7f05580b3030 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.712+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a724a0 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.712+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.713+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a6dab0 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.713+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01a6dab0 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.713+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f055c038040 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.713+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056000a4a0 con 0x7f055c038040 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.713+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a6dab0 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.713+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01a6dab0 2024-05-07T13:56:32.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.713+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f05580b3030 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.714+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f055c009050 con 0x7f05580b3030 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.714+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a724a0 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.714+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.714+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a724a0 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.714+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.714+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f055c038040 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056000a4a0 con 0x7f055c038040 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a724a0 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a724a0 2024-05-07T13:56:32.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a6dab0 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056000a4a0 con 0x55da01a6dab0 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a6dab0 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.715+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f055c038040 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.716+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.716+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a724a0 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.716+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.716+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f05580b3030 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.716+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f055c009050 con 0x7f05580b3030 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.716+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a6dab0 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.717+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.717+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f055c038040 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.717+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.717+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a724a0 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.717+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.717+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f055c038040 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.717+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.717+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f05580b3030 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.718+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f055c009050 con 0x7f05580b3030 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.718+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a724a0 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.718+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.718+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f055c038040 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.718+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.718+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x55da01a6dab0 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da01a71740 con 0x7f05580b3030 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a75760 con 0x55da01a6dab0 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a75b50 con 0x55da01a6dab0 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.719+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a75b50 con 0x7f055c038040 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 zone default found 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 4 Realm: () 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:56:32.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 zonegroup default 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a753c0 con 0x7f055c038040 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a753c0 con 0x55da01a724a0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.720+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a786b0 con 0x55da01a724a0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.721+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.721+0000 7f0568d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:56:32.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.721+0000 7f0568d44800 20 started sync module instance, tier type = 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.721+0000 7f0568d44800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.721+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a77ad0 con 0x7f05580b3030 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.722+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(44 notify.0 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.722+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94394818985664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a77730 con 0x7f05580b3030 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.722+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a795e0 con 0x55da01a6dab0 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.723+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(46 notify.1 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.723+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94394818990864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a79eb0 con 0x55da01a6dab0 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.723+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94394818985664] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.723+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a78b50 con 0x55da01a724a0 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.724+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(48 notify.2 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.724+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94394818995232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7acf0 con 0x55da01a724a0 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.724+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7b740 con 0x7f05580b3030 2024-05-07T13:56:32.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.724+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94394818990864] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.725+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94394818995232] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.725+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(50 notify.3 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.725+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94394818998832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7bb60 con 0x7f05580b3030 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.725+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7c3b0 con 0x55da01a6dab0 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.726+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94394818998832] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.726+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(52 notify.4 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.726+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94394819002112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7c320 con 0x55da01a6dab0 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.727+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7d270 con 0x7f055c038040 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.728+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94394819002112] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.728+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(54 notify.5 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.728+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94394819004240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7d270 con 0x7f055c038040 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.728+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7dcb0 con 0x7f055c038040 2024-05-07T13:56:32.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.729+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(56 notify.6 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.729+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94394819008512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7e110 con 0x7f055c038040 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.729+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7ec00 con 0x7f055c038040 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.729+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94394819004240] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(58 notify.7 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94394819012304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7ebc0 con 0x7f055c038040 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 20 add_watcher() i=0 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 20 add_watcher() i=1 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 20 add_watcher() i=2 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 20 add_watcher() i=3 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 20 add_watcher() i=4 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 20 add_watcher() i=5 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94394819008512] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 20 add_watcher() i=6 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94394819012304] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 20 add_watcher() i=7 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.730+0000 7f0568d44800 2 all 8 watchers are set, enabling cache 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.731+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7dc20 con 0x55da01a6dab0 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.731+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.731+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94394819005888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a7dc20 con 0x55da01a6dab0 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.732+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94394819005888] v27'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.732+0000 7f041d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.732+0000 7f0568d44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.732+0000 7f0568d44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.732+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8a4f0 con 0x55da01a6dab0 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.733+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.734+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8abc0 con 0x7f055c038040 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.735+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.735+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8afe0 con 0x55da01a724a0 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.736+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.736+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8b380 con 0x55da01a6dab0 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.737+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.737+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8b940 con 0x7f05580b3030 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.738+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.738+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8c360 con 0x55da01a724a0 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.739+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.739+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8c360 con 0x55da01a6dab0 2024-05-07T13:56:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.740+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.740+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8c360 con 0x7f055c038040 2024-05-07T13:56:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.741+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.741+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8c360 con 0x7f05580b3030 2024-05-07T13:56:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.742+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.742+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8c8d0 con 0x55da01a724a0 2024-05-07T13:56:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.743+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.743+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8c8d0 con 0x7f05580b3030 2024-05-07T13:56:32.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.744+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.744+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8ce40 con 0x7f055c038040 2024-05-07T13:56:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.745+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.745+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8ce40 con 0x7f05580b3030 2024-05-07T13:56:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.746+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.746+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8d0a0 con 0x7f055c038040 2024-05-07T13:56:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.747+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.747+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8d070 con 0x55da01a6dab0 2024-05-07T13:56:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.748+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.748+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a724a0 2024-05-07T13:56:32.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.749+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'59 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.749+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x7f05580b3030 2024-05-07T13:56:32.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.750+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.750+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a724a0 2024-05-07T13:56:32.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.751+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.751+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a6dab0 2024-05-07T13:56:32.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.753+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'34 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.753+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a6dab0 2024-05-07T13:56:32.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.753+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.754+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a724a0 2024-05-07T13:56:32.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.755+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'60 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.755+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x7f05580b3030 2024-05-07T13:56:32.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.756+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.756+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a724a0 2024-05-07T13:56:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.756+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.756+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a724a0 2024-05-07T13:56:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.758+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.758+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a724a0 2024-05-07T13:56:32.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.758+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.759+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a724a0 2024-05-07T13:56:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.759+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.759+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x7f055c038040 2024-05-07T13:56:32.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.760+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.760+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a724a0 2024-05-07T13:56:32.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.761+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.761+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x7f055c038040 2024-05-07T13:56:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.762+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.762+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x55da01a724a0 2024-05-07T13:56:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.763+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'61 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.763+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x7f055c038040 2024-05-07T13:56:32.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.764+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.764+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01a8cfe0 con 0x7f05580b3030 2024-05-07T13:56:32.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.765+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0397fff640 20 reqs_thread_entry: start 2024-05-07T13:56:32.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0568d44800 20 init_complete bucket index max shards: 11 2024-05-07T13:56:32.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0568d44800 20 Filter name: none 2024-05-07T13:56:32.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0395ffb640 20 reqs_thread_entry: start 2024-05-07T13:56:32.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0568d44800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:56:32.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0568d44800 20 rados->read ofs=0 len=0 2024-05-07T13:56:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7fe0 con 0x55da01a6dab0 2024-05-07T13:56:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0568d44800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:56:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0568d44800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:56:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0568d44800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:56:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.766+0000 7f0568d44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:56:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.767+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da01aba460 con 0x7f05580b3030 2024-05-07T13:56:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.767+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-07T13:56:32.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.768+0000 7f041d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:56:32.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.768+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94394819005888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7bb0 con 0x55da01a6dab0 2024-05-07T13:56:32.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.769+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94394819005888] v27'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.769+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94394818985664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7bb0 con 0x7f05580b3030 2024-05-07T13:56:32.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.770+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94394818985664] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.770+0000 7f0568d44800 20 remove_watcher() i=0 2024-05-07T13:56:32.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.770+0000 7f0568d44800 2 removed watcher, disabling cache 2024-05-07T13:56:32.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.770+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94394818990864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7bb0 con 0x55da01a6dab0 2024-05-07T13:56:32.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.771+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94394818990864] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.771+0000 7f0568d44800 20 remove_watcher() i=1 2024-05-07T13:56:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.771+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94394818995232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7bb0 con 0x55da01a724a0 2024-05-07T13:56:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.772+0000 7f0566843640 1 -- 172.21.15.50:0/1067826013 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94394818995232] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05580b9020 con 0x55da01a724a0 2024-05-07T13:56:32.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.772+0000 7f0568d44800 20 remove_watcher() i=2 2024-05-07T13:56:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.772+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94394818998832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7bb0 con 0x7f05580b3030 2024-05-07T13:56:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.773+0000 7f0566042640 1 -- 172.21.15.50:0/1067826013 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94394818998832] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f055c045040 con 0x7f05580b3030 2024-05-07T13:56:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.773+0000 7f0568d44800 20 remove_watcher() i=3 2024-05-07T13:56:32.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.773+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94394819002112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7bb0 con 0x55da01a6dab0 2024-05-07T13:56:32.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.774+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94394819002112] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x55da01a6dab0 2024-05-07T13:56:32.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.774+0000 7f0568d44800 20 remove_watcher() i=4 2024-05-07T13:56:32.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.774+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94394819004240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7bb0 con 0x7f055c038040 2024-05-07T13:56:32.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.775+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94394819004240] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.775+0000 7f0568d44800 20 remove_watcher() i=5 2024-05-07T13:56:32.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.775+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94394819008512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7bb0 con 0x7f055c038040 2024-05-07T13:56:32.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.776+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94394819008512] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.776+0000 7f0568d44800 20 remove_watcher() i=6 2024-05-07T13:56:32.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.776+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94394819012304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da01ab7bb0 con 0x7f055c038040 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94394819012304] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f056002f060 con 0x7f055c038040 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 20 remove_watcher() i=7 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f055c038040 msgr2=0x7f055c01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f055c038040 0x7f055c01bab0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01a6dab0 msgr2=0x55da01a6ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01a6dab0 0x55da01a6ff70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05580b3030 msgr2=0x7f055809c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05580b3030 0x7f055809c890 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a724a0 msgr2=0x55da01a74890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a724a0 0x55da01a74890 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0430036950 msgr2=0x7f0430038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0430036950 0x7f0430038e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f055c001b60 tx=0x7f055c010000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 msgr2=0x55da019344a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 --2- 172.21.15.50:0/1067826013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a58d10 0x55da019344a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f055806e5c0 tx=0x7f0558092000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0567044640 1 -- 172.21.15.50:0/1067826013 reap_dead start 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 shutdown_connections 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 >> 172.21.15.50:0/1067826013 conn(0x55da01a55070 msgr2=0x55da01a526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 shutdown_connections 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.777+0000 7f0568d44800 1 -- 172.21.15.50:0/1067826013 wait complete. 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1316236331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0440036950 msgr2=0x7f0440038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 --2- 172.21.15.50:0/1316236331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0440036950 0x7f0440038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f055c00bf50 tx=0x7f055c00f000 comp rx=0 tx=0).stop 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1316236331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a4bbd0 msgr2=0x55da01a4bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 --2- 172.21.15.50:0/1316236331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a4bbd0 0x55da01a4bff0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0558006e60 tx=0x7f0558006650 comp rx=0 tx=0).stop 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1316236331 shutdown_connections 2024-05-07T13:56:32.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 --2- 172.21.15.50:0/1316236331 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0440036950 0x7f0440038e10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 --2- 172.21.15.50:0/1316236331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01a4bbd0 0x55da01a4bff0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1316236331 >> 172.21.15.50:0/1316236331 conn(0x55da01a3fc70 msgr2=0x55da01a40070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1316236331 shutdown_connections 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1316236331 wait complete. 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55da01a3abc0 msgr2=0x55da01a3d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55da01a3abc0 0x55da01a3d010 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01937490 msgr2=0x55da01a343a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55da01937490 0x55da01a343a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a36c30 msgr2=0x55da01a39020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55da01a36c30 0x55da01a39020 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f044c036950 msgr2=0x7f044c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f044c036950 0x7f044c038e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f055c000f60 tx=0x7f055c0012b0 comp rx=0 tx=0).stop 2024-05-07T13:56:32.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 msgr2=0x55da01a2d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:56:32.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 --2- 172.21.15.50:0/1512437350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55da01934b60 0x55da01a2d160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f055800a470 tx=0x7f0558003020 comp rx=0 tx=0).stop 2024-05-07T13:56:32.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0567044640 1 -- 172.21.15.50:0/1512437350 reap_dead start 2024-05-07T13:56:32.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 shutdown_connections 2024-05-07T13:56:32.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 >> 172.21.15.50:0/1512437350 conn(0x55da0192e5b0 msgr2=0x55da01a1f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:56:32.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 shutdown_connections 2024-05-07T13:56:32.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:56:32.778+0000 7f0568d44800 1 -- 172.21.15.50:0/1512437350 wait complete. 2024-05-07T13:56:32.774 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-07T13:56:32.788 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:56:32.793 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-07T13:57:07.793 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-05-07T13:57:07.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-05-07T13:57:07.794 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-05-07T13:57:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:07.848 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:07.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.861+0000 7f715d6df800 1 Processor -- start 2024-05-07T13:57:07.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.861+0000 7f715d6df800 1 -- start start 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.861+0000 7f715d6df800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558e523ed750 0x558e523efb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.861+0000 7f715d6df800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e523f0080 con 0x558e523e9c40 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.861+0000 7f715d6df800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x558e5227a050 con 0x558e523ed750 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.861+0000 7f715a9dd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558e523ed750 0x558e523efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.861+0000 7f715b1de640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x558e523e9c40 0x558e523ec030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:38346/0 (socket says 172.21.15.50:38346) 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.861+0000 7f715b1de640 1 -- 172.21.15.50:0/2720024050 learned_addr learned my addr 172.21.15.50:0/2720024050 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.862+0000 7f715a1dc640 1 -- 172.21.15.50:0/2720024050 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430808396 0 0) 0x558e523f0080 con 0x558e523e9c40 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.862+0000 7f715a1dc640 1 -- 172.21.15.50:0/2720024050 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7144001e10 con 0x558e523e9c40 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.862+0000 7f715a9dd640 1 -- 172.21.15.50:0/2720024050 >> v1:172.21.15.22:6789/0 conn(0x558e523e9c40 legacy=0x558e523ec030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.862+0000 7f715a9dd640 1 -- 172.21.15.50:0/2720024050 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e523f1260 con 0x558e523ed750 2024-05-07T13:57:07.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.864+0000 7f715a9dd640 1 --2- 172.21.15.50:0/2720024050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523ed750 0x558e523efb40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f715000a470 tx=0x7f715001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e679494cb2c9b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.864+0000 7f715a1dc640 1 -- 172.21.15.50:0/2720024050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7150057070 con 0x558e523ed750 2024-05-07T13:57:07.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.864+0000 7f715a1dc640 1 -- 172.21.15.50:0/2720024050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7150052570 con 0x558e523ed750 2024-05-07T13:57:07.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.864+0000 7f715a1dc640 1 -- 172.21.15.50:0/2720024050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7150052850 con 0x558e523ed750 2024-05-07T13:57:07.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.865+0000 7f715d6df800 1 -- 172.21.15.50:0/2720024050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523ed750 msgr2=0x558e523efb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.865+0000 7f715d6df800 1 --2- 172.21.15.50:0/2720024050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523ed750 0x558e523efb40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f715000a470 tx=0x7f715001cdb0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.865+0000 7f715d6df800 1 -- 172.21.15.50:0/2720024050 shutdown_connections 2024-05-07T13:57:07.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.865+0000 7f715d6df800 1 --2- 172.21.15.50:0/2720024050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523ed750 0x558e523efb40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.865+0000 7f715d6df800 1 -- 172.21.15.50:0/2720024050 >> 172.21.15.50:0/2720024050 conn(0x558e523e35b0 msgr2=0x558e523e59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:07.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.865+0000 7f715d6df800 1 -- 172.21.15.50:0/2720024050 shutdown_connections 2024-05-07T13:57:07.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.865+0000 7f715d6df800 1 -- 172.21.15.50:0/2720024050 wait complete. 2024-05-07T13:57:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.882+0000 7f715d6df800 1 Processor -- start 2024-05-07T13:57:07.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.882+0000 7f715d6df800 1 -- start start 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.882+0000 7f715d6df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524da4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.882+0000 7f715d6df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e523341d0 con 0x558e523e9c40 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.882+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524da4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.882+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524da4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46214/0 (socket says 172.21.15.50:46214) 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.882+0000 7f715b1de640 1 -- 172.21.15.50:0/2410412855 learned_addr learned my addr 172.21.15.50:0/2410412855 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.883+0000 7f715b1de640 1 -- 172.21.15.50:0/2410412855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e524daab0 con 0x558e523e9c40 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.883+0000 7f715b1de640 1 --2- 172.21.15.50:0/2410412855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524da4e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f714c001d60 tx=0x7f714c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77e2377169eeece server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.883+0000 7f704960a640 1 -- 172.21.15.50:0/2410412855 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c012020 con 0x558e523e9c40 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.883+0000 7f704960a640 1 -- 172.21.15.50:0/2410412855 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c00e470 con 0x558e523e9c40 2024-05-07T13:57:07.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.883+0000 7f704960a640 1 -- 172.21.15.50:0/2410412855 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c00e810 con 0x558e523e9c40 2024-05-07T13:57:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 -- 172.21.15.50:0/2410412855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 msgr2=0x558e524da4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 --2- 172.21.15.50:0/2410412855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524da4e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f714c001d60 tx=0x7f714c00b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 -- 172.21.15.50:0/2410412855 shutdown_connections 2024-05-07T13:57:07.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 --2- 172.21.15.50:0/2410412855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524da4e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 -- 172.21.15.50:0/2410412855 >> 172.21.15.50:0/2410412855 conn(0x558e523e35b0 msgr2=0x558e524d5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 -- 172.21.15.50:0/2410412855 shutdown_connections 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 -- 172.21.15.50:0/2410412855 wait complete. 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 Processor -- start 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 -- start start 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.884+0000 7f715d6df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524e2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.885+0000 7f715d6df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e523f04f0 con 0x558e523e9c40 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.885+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.885+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524e2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46222/0 (socket says 172.21.15.50:46222) 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.885+0000 7f715b1de640 1 -- 172.21.15.50:0/3417172780 learned_addr learned my addr 172.21.15.50:0/3417172780 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.885+0000 7f715b1de640 1 -- 172.21.15.50:0/3417172780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e524e25a0 con 0x558e523e9c40 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.885+0000 7f715b1de640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524e2060 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b700 tx=0x7f714c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.886+0000 7f7047e07640 1 -- 172.21.15.50:0/3417172780 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c012030 con 0x558e523e9c40 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.886+0000 7f7047e07640 1 -- 172.21.15.50:0/3417172780 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c01a7a0 con 0x558e523e9c40 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.886+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e524e2830 con 0x558e523e9c40 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.886+0000 7f7047e07640 1 -- 172.21.15.50:0/3417172780 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c01aac0 con 0x558e523e9c40 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.886+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e524e54e0 con 0x558e523e9c40 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.887+0000 7f7047e07640 1 -- 172.21.15.50:0/3417172780 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f714c015020 con 0x558e523e9c40 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.887+0000 7f7047e07640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7040036900 0x7f7040038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.887+0000 7f7047e07640 1 -- 172.21.15.50:0/3417172780 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f714c020030 con 0x558e523e9c40 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.887+0000 7f715a9dd640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7040036900 0x7f7040038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.887+0000 7f715d6df800 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e523ed750 0x558e524e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.887+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e524e97e0 con 0x558e523ed750 2024-05-07T13:57:07.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.887+0000 7f715b9df640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e523ed750 0x558e524e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.888+0000 7f715a9dd640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7040036900 0x7f7040038dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7150054000 tx=0x7f715004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.888+0000 7f715b9df640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e523ed750 0x558e524e92a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.888+0000 7f715b9df640 1 -- 172.21.15.50:0/3417172780 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e523ed750 2024-05-07T13:57:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.888+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e524e6870 con 0x558e523ed750 2024-05-07T13:57:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.888+0000 7f715b9df640 1 -- 172.21.15.50:0/3417172780 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f715400a4a0 con 0x558e523ed750 2024-05-07T13:57:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.888+0000 7f715d6df800 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e524ebb10 0x558e524edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.888+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e524ee5a0 con 0x558e524ebb10 2024-05-07T13:57:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.888+0000 7f715b1de640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e524ebb10 0x558e524edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.889+0000 7f715b1de640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e524ebb10 0x558e524edf00 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.889+0000 7f715b1de640 1 -- 172.21.15.50:0/3417172780 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f714c018950 con 0x558e524ebb10 2024-05-07T13:57:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.889+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e524eaac0 con 0x558e523ed750 2024-05-07T13:57:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.890+0000 7f715b9df640 1 -- 172.21.15.50:0/3417172780 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f715400a4a0 con 0x558e523ed750 2024-05-07T13:57:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.890+0000 7f715d6df800 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e524efa00 0x558e524f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.890+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e524f2630 con 0x558e524efa00 2024-05-07T13:57:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.890+0000 7f715a9dd640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e524efa00 0x558e524f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.890+0000 7f715a9dd640 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e524efa00 0x558e524f1ea0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.891+0000 7f715a9dd640 1 -- 172.21.15.50:0/3417172780 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7150052d40 con 0x558e524efa00 2024-05-07T13:57:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.891+0000 7f715d6df800 1 Processor -- start 2024-05-07T13:57:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.891+0000 7f715d6df800 1 -- start start 2024-05-07T13:57:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.891+0000 7f715d6df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e52500a90 0x558e52500eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.891+0000 7f715d6df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e522dacf0 con 0x558e52500a90 2024-05-07T13:57:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e52500a90 0x558e52500eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e52500a90 0x558e52500eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46238/0 (socket says 172.21.15.50:46238) 2024-05-07T13:57:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f715b1de640 1 -- 172.21.15.50:0/346134495 learned_addr learned my addr 172.21.15.50:0/346134495 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:07.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f715b1de640 1 -- 172.21.15.50:0/346134495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e525013f0 con 0x558e52500a90 2024-05-07T13:57:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f715b1de640 1 --2- 172.21.15.50:0/346134495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e52500a90 0x558e52500eb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f714c04c010 tx=0x7f714c00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f7045602640 1 -- 172.21.15.50:0/346134495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c03c070 con 0x558e52500a90 2024-05-07T13:57:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f7045602640 1 -- 172.21.15.50:0/346134495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c0442c0 con 0x558e52500a90 2024-05-07T13:57:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f715d6df800 1 -- 172.21.15.50:0/346134495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e525013f0 con 0x558e52500a90 2024-05-07T13:57:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f7045602640 1 -- 172.21.15.50:0/346134495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c0445e0 con 0x558e52500a90 2024-05-07T13:57:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.892+0000 7f715d6df800 1 -- 172.21.15.50:0/346134495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e525013f0 con 0x558e52500a90 2024-05-07T13:57:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.893+0000 7f7045602640 1 -- 172.21.15.50:0/346134495 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f714c04cac0 con 0x558e52500a90 2024-05-07T13:57:07.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.893+0000 7f7045602640 1 --2- 172.21.15.50:0/346134495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7034036950 0x7f7034038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.893+0000 7f7045602640 1 -- 172.21.15.50:0/346134495 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f714c038d70 con 0x558e52500a90 2024-05-07T13:57:07.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.893+0000 7f715a9dd640 1 --2- 172.21.15.50:0/346134495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7034036950 0x7f7034038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.894+0000 7f715d6df800 1 Processor -- start 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.894+0000 7f715d6df800 1 -- start start 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.894+0000 7f715a9dd640 1 --2- 172.21.15.50:0/346134495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7034036950 0x7f7034038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x558e524e6790 tx=0x7f7150005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.894+0000 7f715d6df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e5250dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.894+0000 7f715d6df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e524dae30 con 0x558e5250d8b0 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.894+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e5250dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.894+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e5250dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46252/0 (socket says 172.21.15.50:46252) 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.894+0000 7f715b1de640 1 -- 172.21.15.50:0/3754300105 learned_addr learned my addr 172.21.15.50:0/3754300105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f715b1de640 1 -- 172.21.15.50:0/3754300105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5250e280 con 0x558e5250d8b0 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f715b1de640 1 --2- 172.21.15.50:0/3754300105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e5250dcb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f714c01a6f0 tx=0x7f714c04c1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff18a51359bcd9b server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f703effd640 1 -- 172.21.15.50:0/3754300105 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c022320 con 0x558e5250d8b0 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f703effd640 1 -- 172.21.15.50:0/3754300105 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c024420 con 0x558e5250d8b0 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f703effd640 1 -- 172.21.15.50:0/3754300105 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c016b00 con 0x558e5250d8b0 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f715d6df800 1 -- 172.21.15.50:0/3754300105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 msgr2=0x558e5250dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f715d6df800 1 --2- 172.21.15.50:0/3754300105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e5250dcb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f714c01a6f0 tx=0x7f714c04c1c0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f715d6df800 1 -- 172.21.15.50:0/3754300105 shutdown_connections 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f715d6df800 1 --2- 172.21.15.50:0/3754300105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e5250dcb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.895+0000 7f715d6df800 1 -- 172.21.15.50:0/3754300105 >> 172.21.15.50:0/3754300105 conn(0x558e52509b30 msgr2=0x558e52507b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.896+0000 7f715d6df800 1 -- 172.21.15.50:0/3754300105 shutdown_connections 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.896+0000 7f715d6df800 1 -- 172.21.15.50:0/3754300105 wait complete. 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.896+0000 7f715d6df800 1 Processor -- start 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.896+0000 7f715d6df800 1 -- start start 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.896+0000 7f715d6df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e523e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.896+0000 7f715d6df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e5250e910 con 0x558e5250d8b0 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.896+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e523e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.896+0000 7f715b1de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e523e94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46268/0 (socket says 172.21.15.50:46268) 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.896+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 learned_addr learned my addr 172.21.15.50:0/785030421 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.897+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e523e9a20 con 0x558e5250d8b0 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.897+0000 7f715b1de640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e523e94e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f714c051040 tx=0x7f714c01df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.897+0000 7f703d7fa640 1 -- 172.21.15.50:0/785030421 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c071070 con 0x558e5250d8b0 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.897+0000 7f703d7fa640 1 -- 172.21.15.50:0/785030421 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c022a70 con 0x558e5250d8b0 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.897+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e523e9a20 con 0x558e5250d8b0 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.897+0000 7f703d7fa640 1 -- 172.21.15.50:0/785030421 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c0224e0 con 0x558e5250d8b0 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.897+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e523e9a20 con 0x558e5250d8b0 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.898+0000 7f703d7fa640 1 -- 172.21.15.50:0/785030421 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f714c074070 con 0x558e5250d8b0 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.898+0000 7f703d7fa640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024036950 0x7f7024038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.898+0000 7f703d7fa640 1 -- 172.21.15.50:0/785030421 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f714c077d60 con 0x558e5250d8b0 2024-05-07T13:57:07.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.898+0000 7f715a9dd640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024036950 0x7f7024038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.899+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.899+0000 7f715d6df800 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e525224f0 0x558e525249b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.899+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e52525100 con 0x558e525224f0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.899+0000 7f715a9dd640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024036950 0x7f7024038e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x558e524f2a30 tx=0x7f715004f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.899+0000 7f715b9df640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e525224f0 0x558e525249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.899+0000 7f715b9df640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e525224f0 0x558e525249b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 20 realm 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e52525510 con 0x558e525224f0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:07.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e52525de0 con 0x558e525224f0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.900+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715d6df800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715d6df800 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e52526cb0 0x558e525290a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e525297e0 con 0x558e52526cb0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715b1de640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e52526cb0 0x558e525290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715b1de640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e52526cb0 0x558e525290a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715d6df800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715d6df800 20 searching for the correct realm 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.901+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e5252b170 con 0x558e52526cb0 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.902+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.902+0000 7f715b1de640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f714c076060 0x7f714c028540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.902+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e5252b170 con 0x7f714c076060 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.902+0000 7f715a9dd640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f714c076060 0x7f714c028540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.902+0000 7f715a9dd640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f714c076060 0x7f714c028540 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.903+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.903+0000 7f715a9dd640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7150085040 0x7f7150086430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.903+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e5252b170 con 0x7f7150085040 2024-05-07T13:57:07.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.903+0000 7f715b9df640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7150085040 0x7f7150086430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.904+0000 7f715b9df640 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7150085040 0x7f7150086430 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.904+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.904+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.904+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.904+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.904+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.904+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.905+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.905+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f7150085040 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.905+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.905+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f714c076060 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.905+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.905+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f714c076060 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.906+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.906+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.906+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.906+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f7150085040 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.906+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.906+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.907+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.907+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f714c076060 2024-05-07T13:57:07.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.907+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.907+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e52526cb0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.907+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.907+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e52526cb0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.908+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.908+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f7150085040 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.908+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.908+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e52526cb0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.908+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.908+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e52526cb0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.908+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.909+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.909+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.909+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.909+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.909+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f7150085040 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.909+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.909+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e52526cb0 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.910+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.910+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f714c076060 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.910+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.910+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.910+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.910+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f7150085040 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.911+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.911+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e52526cb0 2024-05-07T13:57:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.911+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.911+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f7150085040 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.911+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.911+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f714c076060 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.912+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.912+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e52526cb0 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.912+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.912+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f714c076060 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.912+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.912+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x558e525224f0 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.912+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.912+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558e52526180 con 0x7f714c076060 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5252a260 con 0x558e525224f0 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5252ab00 con 0x558e525224f0 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.913+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5252a650 con 0x7f7150085040 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 20 zone default found 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 4 Realm: () 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 20 zonegroup default 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5252a650 con 0x7f7150085040 2024-05-07T13:57:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5252aa80 con 0x558e52526cb0 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.914+0000 7f715d6df800 20 rados->read ofs=0 len=0 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.915+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5252d000 con 0x558e52526cb0 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.915+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.915+0000 7f715d6df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.915+0000 7f715d6df800 20 started sync module instance, tier type = 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.915+0000 7f715d6df800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.915+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252c4a0 con 0x7f714c076060 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.916+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.916+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069754874048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252c100 con 0x7f714c076060 2024-05-07T13:57:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.916+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252de70 con 0x558e525224f0 2024-05-07T13:57:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.917+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94069754874048] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.917+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.917+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94069754878400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252e290 con 0x558e525224f0 2024-05-07T13:57:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.917+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252ec50 con 0x558e52526cb0 2024-05-07T13:57:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.919+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94069754878400] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.919+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.919+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94069754879456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252e200 con 0x558e52526cb0 2024-05-07T13:57:07.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.919+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252f9c0 con 0x7f714c076060 2024-05-07T13:57:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.920+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.920+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94069754887600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52530680 con 0x7f714c076060 2024-05-07T13:57:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.920+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52531170 con 0x558e525224f0 2024-05-07T13:57:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.920+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94069754879456] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.921+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.921+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94069754887600] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.921+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069754891328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252eff0 con 0x558e525224f0 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.921+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52531a10 con 0x7f7150085040 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.922+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.923+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069754893584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52531930 con 0x7f7150085040 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.923+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52532930 con 0x7f7150085040 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.923+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94069754891328] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.924+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94069754893584] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.924+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.924+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94069754895872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e525301d0 con 0x7f7150085040 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.924+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52532da0 con 0x7f7150085040 2024-05-07T13:57:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94069754895872] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069754897440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52532da0 con 0x7f7150085040 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715d6df800 20 add_watcher() i=0 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715d6df800 20 add_watcher() i=1 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715d6df800 20 add_watcher() i=2 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715d6df800 20 add_watcher() i=3 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715d6df800 20 add_watcher() i=4 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715d6df800 20 add_watcher() i=5 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.925+0000 7f715d6df800 20 add_watcher() i=6 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.926+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94069754897440] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.926+0000 7f715d6df800 20 add_watcher() i=7 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.926+0000 7f715d6df800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.926+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e525361d0 con 0x558e525224f0 2024-05-07T13:57:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.927+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.927+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94069754899136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e525336f0 con 0x558e525224f0 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.928+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94069754899136] v29'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.928+0000 7f7011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.928+0000 7f715d6df800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.928+0000 7f715d6df800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.928+0000 7f715d6df800 5 note: GC not initialized 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.928+0000 7f7010fe1640 20 reqs_thread_entry: start 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.928+0000 7f715d6df800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.928+0000 7f715d6df800 20 Filter name: none 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.929+0000 7f6f8a7fc640 20 reqs_thread_entry: start 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.929+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e52569c80 con 0x558e525224f0 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.929+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.929+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e52569c80 con 0x7f714c076060 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.929+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.929+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256a100 con 0x558e525224f0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.929+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.929+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256a100 con 0x558e52526cb0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.930+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.930+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256a550 con 0x558e52526cb0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.930+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.930+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256a550 con 0x558e52526cb0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.930+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.930+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256a550 con 0x558e525224f0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.930+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.930+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256a550 con 0x558e525224f0 2024-05-07T13:57:07.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.931+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.931+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256a4e0 con 0x558e52526cb0 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.931+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.931+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256a4c0 con 0x558e52526cb0 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.931+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.931+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256a4a0 con 0x7f7150085040 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.932+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.932+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bf60 con 0x558e525224f0 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.932+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.932+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bf60 con 0x7f714c076060 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.933+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.933+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bf60 con 0x558e52526cb0 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.933+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.933+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bf10 con 0x7f7150085040 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.933+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.933+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bf10 con 0x7f7150085040 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.934+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.934+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bf10 con 0x558e52526cb0 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.934+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.934+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x7f7150085040 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.934+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.934+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e525224f0 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.934+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.934+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e52526cb0 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.935+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.935+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x7f7150085040 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.935+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.935+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x7f714c076060 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.935+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.935+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x7f7150085040 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.936+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.936+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e525224f0 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.936+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.936+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e525224f0 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.936+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.936+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e52526cb0 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.936+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.936+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e525224f0 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.937+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.937+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e525224f0 2024-05-07T13:57:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.937+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.937+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e52526cb0 2024-05-07T13:57:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.937+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.937+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e52526cb0 2024-05-07T13:57:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.937+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.937+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x558e52526cb0 2024-05-07T13:57:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.938+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.938+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558e5256bef0 con 0x7f7150085040 2024-05-07T13:57:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.938+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.939+0000 7f7011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.939+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94069754899136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52535680 con 0x558e525224f0 2024-05-07T13:57:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.940+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94069754899136] v29'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.940+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94069754874048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52532a90 con 0x7f714c076060 2024-05-07T13:57:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.941+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94069754874048] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.941+0000 7f715d6df800 20 remove_watcher() i=0 2024-05-07T13:57:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.941+0000 7f715d6df800 2 removed watcher, disabling cache 2024-05-07T13:57:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.941+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94069754878400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252c8c0 con 0x558e525224f0 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.942+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94069754878400] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.942+0000 7f715d6df800 20 remove_watcher() i=1 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.942+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94069754879456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252d9c0 con 0x558e52526cb0 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.943+0000 7f715b1de640 1 -- 172.21.15.50:0/785030421 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94069754879456] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f714c073030 con 0x558e52526cb0 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.943+0000 7f715d6df800 20 remove_watcher() i=2 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.943+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94069754887600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52532a90 con 0x7f714c076060 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.944+0000 7f715a9dd640 1 -- 172.21.15.50:0/785030421 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94069754887600] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7150072030 con 0x7f714c076060 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.944+0000 7f715d6df800 20 remove_watcher() i=3 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.944+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94069754891328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252fdb0 con 0x558e525224f0 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.945+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94069754891328] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x558e525224f0 2024-05-07T13:57:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.945+0000 7f715d6df800 20 remove_watcher() i=4 2024-05-07T13:57:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.945+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94069754893584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252fdb0 con 0x7f7150085040 2024-05-07T13:57:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.947+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94069754893584] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.947+0000 7f715d6df800 20 remove_watcher() i=5 2024-05-07T13:57:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.947+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94069754895872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e52531510 con 0x7f7150085040 2024-05-07T13:57:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.948+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94069754895872] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.948+0000 7f715d6df800 20 remove_watcher() i=6 2024-05-07T13:57:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.948+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94069754897440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558e5252fdb0 con 0x7f7150085040 2024-05-07T13:57:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94069754897440] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715400a4a0 con 0x7f7150085040 2024-05-07T13:57:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 20 remove_watcher() i=7 2024-05-07T13:57:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7150085040 msgr2=0x7f7150086430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7150085040 0x7f7150086430 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e525224f0 msgr2=0x558e525249b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e525224f0 0x558e525249b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f714c076060 msgr2=0x7f714c028540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f714c076060 0x7f714c028540 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e52526cb0 msgr2=0x558e525290a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e52526cb0 0x558e525290a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024036950 msgr2=0x7f7024038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7024036950 0x7f7024038e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x558e524f2a30 tx=0x7f715004f000 comp rx=0 tx=0).stop 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 msgr2=0x558e523e94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e523e94e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f714c051040 tx=0x7f714c01df70 comp rx=0 tx=0).stop 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715b9df640 1 -- 172.21.15.50:0/785030421 reap_dead start 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 shutdown_connections 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 --2- 172.21.15.50:0/785030421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e5250d8b0 0x558e523e94e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 >> 172.21.15.50:0/785030421 conn(0x558e52509b30 msgr2=0x558e5250f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 shutdown_connections 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.949+0000 7f715d6df800 1 -- 172.21.15.50:0/785030421 wait complete. 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/346134495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7034036950 msgr2=0x7f7034038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 --2- 172.21.15.50:0/346134495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7034036950 0x7f7034038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x558e524e6790 tx=0x7f7150005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/346134495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e52500a90 msgr2=0x558e52500eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 --2- 172.21.15.50:0/346134495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e52500a90 0x558e52500eb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f714c04c010 tx=0x7f714c00db20 comp rx=0 tx=0).stop 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/346134495 shutdown_connections 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 --2- 172.21.15.50:0/346134495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7034036950 0x7f7034038e10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 --2- 172.21.15.50:0/346134495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e52500a90 0x558e52500eb0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/346134495 >> 172.21.15.50:0/346134495 conn(0x558e524f4b30 msgr2=0x558e524f4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/346134495 shutdown_connections 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/346134495 wait complete. 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e524efa00 msgr2=0x558e524f1ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558e524efa00 0x558e524f1ea0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e523ed750 msgr2=0x558e524e92a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558e523ed750 0x558e524e92a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e524ebb10 msgr2=0x558e524edf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558e524ebb10 0x558e524edf00 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7040036900 msgr2=0x7f7040038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7040036900 0x7f7040038dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7150054000 tx=0x7f715004e000 comp rx=0 tx=0).stop 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 msgr2=0x558e524e2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 --2- 172.21.15.50:0/3417172780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e523e9c40 0x558e524e2060 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b700 tx=0x7f714c000bc0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715b9df640 1 -- 172.21.15.50:0/3417172780 reap_dead start 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 shutdown_connections 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.950+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 >> 172.21.15.50:0/3417172780 conn(0x558e523e35b0 msgr2=0x558e524d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.951+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 shutdown_connections 2024-05-07T13:57:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:07.951+0000 7f715d6df800 1 -- 172.21.15.50:0/3417172780 wait complete. 2024-05-07T13:57:07.949 INFO:teuthology.orchestra.run.smithi050.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-05-07T13:57:07.950 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-05-07T13:57:07.950 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-07T13:57:07.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-07T13:57:07.950 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-07T13:57:07.994 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:07.994 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:07.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a5638800 1 Processor -- start 2024-05-07T13:57:07.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a5638800 1 -- start start 2024-05-07T13:57:07.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a5638800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5580bb29b9f0 0x5580bb29be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:07.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a5638800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580bb210a30 con 0x5580bb29c350 2024-05-07T13:57:07.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a5638800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5580bb12e050 con 0x5580bb29b9f0 2024-05-07T13:57:07.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a3137640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5580bb29b9f0 0x5580bb29be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:07.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a2936640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5580bb29c350 0x5580bb29c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:38360/0 (socket says 172.21.15.50:38360) 2024-05-07T13:57:07.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a3137640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5580bb29b9f0 0x5580bb29be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46280/0 (socket says 172.21.15.50:46280) 2024-05-07T13:57:07.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a2936640 1 -- 172.21.15.50:0/1302066300 learned_addr learned my addr 172.21.15.50:0/1302066300 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:07.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a3137640 1 -- 172.21.15.50:0/1302066300 >> v1:172.21.15.22:6789/0 conn(0x5580bb29c350 legacy=0x5580bb29c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.008+0000 7f76a3137640 1 -- 172.21.15.50:0/1302066300 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580bb29cf10 con 0x5580bb29b9f0 2024-05-07T13:57:07.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.010+0000 7f76a3137640 1 --2- 172.21.15.50:0/1302066300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb29be10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f769400a470 tx=0x7f769401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae98411c617cda6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:07.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a2135640 1 -- 172.21.15.50:0/1302066300 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7694057070 con 0x5580bb29b9f0 2024-05-07T13:57:07.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a2135640 1 -- 172.21.15.50:0/1302066300 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7694052570 con 0x5580bb29b9f0 2024-05-07T13:57:07.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a2135640 1 -- 172.21.15.50:0/1302066300 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7694052870 con 0x5580bb29b9f0 2024-05-07T13:57:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a5638800 1 -- 172.21.15.50:0/1302066300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 msgr2=0x5580bb29be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a5638800 1 --2- 172.21.15.50:0/1302066300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb29be10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f769400a470 tx=0x7f769401ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a5638800 1 -- 172.21.15.50:0/1302066300 shutdown_connections 2024-05-07T13:57:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a5638800 1 --2- 172.21.15.50:0/1302066300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb29be10 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a5638800 1 -- 172.21.15.50:0/1302066300 >> 172.21.15.50:0/1302066300 conn(0x5580bb297550 msgr2=0x5580bb299970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a5638800 1 -- 172.21.15.50:0/1302066300 shutdown_connections 2024-05-07T13:57:07.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.011+0000 7f76a5638800 1 -- 172.21.15.50:0/1302066300 wait complete. 2024-05-07T13:57:08.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.026+0000 7f76a5638800 1 Processor -- start 2024-05-07T13:57:08.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.026+0000 7f76a5638800 1 -- start start 2024-05-07T13:57:08.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.027+0000 7f76a5638800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb390a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.027+0000 7f76a5638800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5580bb1e81c0 con 0x5580bb29b9f0 2024-05-07T13:57:08.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.027+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb390a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.027+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb390a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46292/0 (socket says 172.21.15.50:46292) 2024-05-07T13:57:08.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.027+0000 7f76a3137640 1 -- 172.21.15.50:0/1710932356 learned_addr learned my addr 172.21.15.50:0/1710932356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.027+0000 7f76a3137640 1 -- 172.21.15.50:0/1710932356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580bb391060 con 0x5580bb29b9f0 2024-05-07T13:57:08.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.027+0000 7f76a3137640 1 --2- 172.21.15.50:0/1710932356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb390a90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f769401ced0 tx=0x7f769404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f555e0635ca9950d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.028+0000 7f759160a640 1 -- 172.21.15.50:0/1710932356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7694057040 con 0x5580bb29b9f0 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.028+0000 7f759160a640 1 -- 172.21.15.50:0/1710932356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76940529a0 con 0x5580bb29b9f0 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.028+0000 7f759160a640 1 -- 172.21.15.50:0/1710932356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7694052cc0 con 0x5580bb29b9f0 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.028+0000 7f76a5638800 1 -- 172.21.15.50:0/1710932356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 msgr2=0x5580bb390a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 --2- 172.21.15.50:0/1710932356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb390a90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f769401ced0 tx=0x7f769404c000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 -- 172.21.15.50:0/1710932356 shutdown_connections 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 --2- 172.21.15.50:0/1710932356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb390a90 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 -- 172.21.15.50:0/1710932356 >> 172.21.15.50:0/1710932356 conn(0x5580bb297550 msgr2=0x5580bb38c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 -- 172.21.15.50:0/1710932356 shutdown_connections 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 -- 172.21.15.50:0/1710932356 wait complete. 2024-05-07T13:57:08.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 Processor -- start 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 -- start start 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb398490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a5638800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5580bb29d440 con 0x5580bb29b9f0 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb398490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb398490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46304/0 (socket says 172.21.15.50:46304) 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.029+0000 7f76a3137640 1 -- 172.21.15.50:0/2810711195 learned_addr learned my addr 172.21.15.50:0/2810711195 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.030+0000 7f76a3137640 1 -- 172.21.15.50:0/2810711195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580bb3989d0 con 0x5580bb29b9f0 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.030+0000 7f76a3137640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb398490 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7694052740 tx=0x7f7694003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.030+0000 7f758fe07640 1 -- 172.21.15.50:0/2810711195 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7694073070 con 0x5580bb29b9f0 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.030+0000 7f758fe07640 1 -- 172.21.15.50:0/2810711195 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769405d860 con 0x5580bb29b9f0 2024-05-07T13:57:08.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.030+0000 7f758fe07640 1 -- 172.21.15.50:0/2810711195 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7694057070 con 0x5580bb29b9f0 2024-05-07T13:57:08.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.030+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580bb398c60 con 0x5580bb29b9f0 2024-05-07T13:57:08.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.030+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580bb39b8c0 con 0x5580bb29b9f0 2024-05-07T13:57:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.031+0000 7f758fe07640 1 -- 172.21.15.50:0/2810711195 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7694076070 con 0x5580bb29b9f0 2024-05-07T13:57:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.031+0000 7f758fe07640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7588036900 0x7f7588038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.031+0000 7f758fe07640 1 -- 172.21.15.50:0/2810711195 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f769408e180 con 0x5580bb29b9f0 2024-05-07T13:57:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.031+0000 7f76a2936640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7588036900 0x7f7588038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.031+0000 7f76a5638800 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb29c350 0x5580bb39f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.031+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb39fc60 con 0x5580bb29c350 2024-05-07T13:57:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.032+0000 7f76a3938640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb29c350 0x5580bb39f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.032+0000 7f76a2936640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7588036900 0x7f7588038dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7698000f60 tx=0x7f76980012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.032+0000 7f76a3938640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb29c350 0x5580bb39f680 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.032+0000 7f76a3938640 1 -- 172.21.15.50:0/2810711195 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb29c350 2024-05-07T13:57:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.032+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb39cc50 con 0x5580bb29c350 2024-05-07T13:57:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.032+0000 7f76a3938640 1 -- 172.21.15.50:0/2810711195 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb29c350 2024-05-07T13:57:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.033+0000 7f76a5638800 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3a1fb0 0x5580bb3a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.033+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3a4a90 con 0x5580bb3a1fb0 2024-05-07T13:57:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.033+0000 7f76a3137640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3a1fb0 0x5580bb3a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.033+0000 7f76a3137640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3a1fb0 0x5580bb3a43a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.033+0000 7f76a3137640 1 -- 172.21.15.50:0/2810711195 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7694075030 con 0x5580bb3a1fb0 2024-05-07T13:57:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.033+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3a0f60 con 0x5580bb29c350 2024-05-07T13:57:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.033+0000 7f76a3938640 1 -- 172.21.15.50:0/2810711195 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb29c350 2024-05-07T13:57:08.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.034+0000 7f76a5638800 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580bb3a5ef0 0x5580bb3a8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.034+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3a8ae0 con 0x5580bb3a5ef0 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.034+0000 7f76a2936640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580bb3a5ef0 0x5580bb3a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.034+0000 7f76a2936640 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580bb3a5ef0 0x5580bb3a8380 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.035+0000 7f76a2936640 1 -- 172.21.15.50:0/2810711195 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7698009050 con 0x5580bb3a5ef0 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.035+0000 7f76a5638800 1 Processor -- start 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.035+0000 7f76a5638800 1 -- start start 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.035+0000 7f76a5638800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3b6f90 0x5580bb3b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.035+0000 7f76a5638800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5580bb18ecf0 con 0x5580bb3b6f90 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.035+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3b6f90 0x5580bb3b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.035+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3b6f90 0x5580bb3b73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46306/0 (socket says 172.21.15.50:46306) 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.035+0000 7f76a3137640 1 -- 172.21.15.50:0/1205876359 learned_addr learned my addr 172.21.15.50:0/1205876359 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.036+0000 7f76a3137640 1 -- 172.21.15.50:0/1205876359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580bb3b78f0 con 0x5580bb3b6f90 2024-05-07T13:57:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.036+0000 7f76a3137640 1 --2- 172.21.15.50:0/1205876359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3b6f90 0x5580bb3b73b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f769408c730 tx=0x7f7694076f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.036+0000 7f758d602640 1 -- 172.21.15.50:0/1205876359 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769405dcb0 con 0x5580bb3b6f90 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.036+0000 7f758d602640 1 -- 172.21.15.50:0/1205876359 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769405de50 con 0x5580bb3b6f90 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.036+0000 7f76a5638800 1 -- 172.21.15.50:0/1205876359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580bb3b8360 con 0x5580bb3b6f90 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.036+0000 7f758d602640 1 -- 172.21.15.50:0/1205876359 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7694006830 con 0x5580bb3b6f90 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.036+0000 7f76a5638800 1 -- 172.21.15.50:0/1205876359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580bb3b8860 con 0x5580bb3b6f90 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.037+0000 7f758d602640 1 -- 172.21.15.50:0/1205876359 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f769408c820 con 0x5580bb3b6f90 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.037+0000 7f758d602640 1 --2- 172.21.15.50:0/1205876359 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f757c036950 0x7f757c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.037+0000 7f758d602640 1 -- 172.21.15.50:0/1205876359 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7694098d30 con 0x5580bb3b6f90 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.037+0000 7f76a2936640 1 --2- 172.21.15.50:0/1205876359 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f757c036950 0x7f757c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.037+0000 7f76a5638800 1 Processor -- start 2024-05-07T13:57:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.037+0000 7f76a5638800 1 -- start start 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.038+0000 7f76a2936640 1 --2- 172.21.15.50:0/1205876359 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f757c036950 0x7f757c038e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f769800bf50 tx=0x7f769800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.038+0000 7f76a5638800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3c4150 0x5580bb3c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.038+0000 7f76a5638800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5580bb391320 con 0x5580bb3c4150 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.038+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3c4150 0x5580bb3c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.038+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3c4150 0x5580bb3c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46312/0 (socket says 172.21.15.50:46312) 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.038+0000 7f76a3137640 1 -- 172.21.15.50:0/2033021417 learned_addr learned my addr 172.21.15.50:0/2033021417 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.038+0000 7f76a3137640 1 -- 172.21.15.50:0/2033021417 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580bb3c4b40 con 0x5580bb3c4150 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.038+0000 7f76a3137640 1 --2- 172.21.15.50:0/2033021417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3c4150 0x5580bb3c4570 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7694077bf0 tx=0x7f769408e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da66856197e724d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f7586ffd640 1 -- 172.21.15.50:0/2033021417 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769408cb10 con 0x5580bb3c4150 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f7586ffd640 1 -- 172.21.15.50:0/2033021417 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769404dad0 con 0x5580bb3c4150 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f7586ffd640 1 -- 172.21.15.50:0/2033021417 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769408ccb0 con 0x5580bb3c4150 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f76a5638800 1 -- 172.21.15.50:0/2033021417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3c4150 msgr2=0x5580bb3c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f76a5638800 1 --2- 172.21.15.50:0/2033021417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3c4150 0x5580bb3c4570 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7694077bf0 tx=0x7f769408e610 comp rx=0 tx=0).stop 2024-05-07T13:57:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f76a5638800 1 -- 172.21.15.50:0/2033021417 shutdown_connections 2024-05-07T13:57:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f76a5638800 1 --2- 172.21.15.50:0/2033021417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3c4150 0x5580bb3c4570 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f76a5638800 1 -- 172.21.15.50:0/2033021417 >> 172.21.15.50:0/2033021417 conn(0x5580bb3c0420 msgr2=0x5580bb3be480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f76a5638800 1 -- 172.21.15.50:0/2033021417 shutdown_connections 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f76a5638800 1 -- 172.21.15.50:0/2033021417 wait complete. 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.039+0000 7f76a5638800 1 Processor -- start 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.040+0000 7f76a5638800 1 -- start start 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.040+0000 7f76a5638800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3cb5a0 0x5580bb3cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.040+0000 7f76a5638800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5580bb3c51a0 con 0x5580bb3cb5a0 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.040+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3cb5a0 0x5580bb3cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.040+0000 7f76a3137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3cb5a0 0x5580bb3cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46324/0 (socket says 172.21.15.50:46324) 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.040+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 learned_addr learned my addr 172.21.15.50:0/3290912924 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.040+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580bb3cbf00 con 0x5580bb3cb5a0 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.041+0000 7f76a3137640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3cb5a0 0x5580bb3cb9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7694077bf0 tx=0x7f7694091f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.041+0000 7f75857fa640 1 -- 172.21.15.50:0/3290912924 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769404dc80 con 0x5580bb3cb5a0 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.041+0000 7f75857fa640 1 -- 172.21.15.50:0/3290912924 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7694082860 con 0x5580bb3cb5a0 2024-05-07T13:57:08.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.041+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580bb3cbf00 con 0x5580bb3cb5a0 2024-05-07T13:57:08.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.041+0000 7f75857fa640 1 -- 172.21.15.50:0/3290912924 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7694082b40 con 0x5580bb3cb5a0 2024-05-07T13:57:08.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.041+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580bb3cbf00 con 0x5580bb3cb5a0 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.042+0000 7f75857fa640 1 -- 172.21.15.50:0/3290912924 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7694082ce0 con 0x5580bb3cb5a0 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.042+0000 7f75857fa640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f756c036900 0x7f756c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.042+0000 7f75857fa640 1 -- 172.21.15.50:0/3290912924 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f76940b9d50 con 0x5580bb3cb5a0 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.042+0000 7f76a2936640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f756c036900 0x7f756c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.042+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.042+0000 7f76a5638800 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb3d6fe0 0x5580bb3d94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.042+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3d9bf0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.042+0000 7f76a2936640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f756c036900 0x7f756c038dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7698001b60 tx=0x7f7698010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.042+0000 7f76a3938640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb3d6fe0 0x5580bb3d94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a3938640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb3d6fe0 0x5580bb3d94a0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 20 realm 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3da000 con 0x5580bb3d6fe0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3da8d0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.043+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.044+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.044+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.044+0000 7f76a5638800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.044+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.044+0000 7f76a5638800 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3db760 0x5580bb3ddb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.044+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3de290 con 0x5580bb3db760 2024-05-07T13:57:08.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.044+0000 7f76a3137640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3db760 0x5580bb3ddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.044+0000 7f76a3137640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3db760 0x5580bb3ddb50 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.044+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.045+0000 7f76a5638800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.045+0000 7f76a5638800 20 searching for the correct realm 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.045+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dfc90 con 0x5580bb3db760 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.045+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.045+0000 7f76a3137640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f76940af040 0x7f76940bc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.045+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dfc90 con 0x7f76940af040 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.045+0000 7f76a2936640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f76940af040 0x7f76940bc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.046+0000 7f76a2936640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f76940af040 0x7f76940bc1c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.046+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.046+0000 7f76a2936640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7698037040 0x7f7698036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.046+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dfc90 con 0x7f7698037040 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.046+0000 7f76a3938640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7698037040 0x7f7698036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.046+0000 7f76a3938640 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7698037040 0x7f7698036410 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.047+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.047+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.047+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.047+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.047+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.047+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.047+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.047+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f7698037040 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.048+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.048+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f76940af040 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.048+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.048+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f76940af040 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.048+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.048+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.048+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.049+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f7698037040 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.049+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.049+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.049+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.049+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f76940af040 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.049+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.049+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3db760 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.050+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.050+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3db760 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.050+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.050+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f7698037040 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.050+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.050+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3db760 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.050+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.050+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3db760 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.051+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.051+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.051+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.051+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.051+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.051+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f7698037040 2024-05-07T13:57:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.051+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.051+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3db760 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.052+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.052+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f76940af040 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.052+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.052+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.052+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.052+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f7698037040 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.053+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.053+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3db760 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.053+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.053+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f7698037040 2024-05-07T13:57:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.053+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.053+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f76940af040 2024-05-07T13:57:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.053+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.053+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3db760 2024-05-07T13:57:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f76940af040 2024-05-07T13:57:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dac70 con 0x7f76940af040 2024-05-07T13:57:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a5638800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a5638800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a5638800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a5638800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a5638800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a5638800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.054+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3dec60 con 0x5580bb3d6fe0 2024-05-07T13:57:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3df050 con 0x5580bb3d6fe0 2024-05-07T13:57:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3df050 con 0x7f7698037040 2024-05-07T13:57:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 20 zone default found 2024-05-07T13:57:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 4 Realm: () 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 20 zonegroup default 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.055+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3df470 con 0x7f7698037040 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3df470 con 0x5580bb3db760 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e1b40 con 0x5580bb3db760 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 20 started sync module instance, tier type = 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.056+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e0fe0 con 0x7f76940af040 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.057+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.057+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94011385582592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e0c40 con 0x7f76940af040 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.057+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e2a00 con 0x5580bb3d6fe0 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.058+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94011385582592] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.058+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.059+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94011385587024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e2e20 con 0x5580bb3d6fe0 2024-05-07T13:57:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.059+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e37e0 con 0x5580bb3db760 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.060+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.060+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94011385590576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e4030 con 0x5580bb3db760 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.060+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e4b10 con 0x7f76940af040 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.060+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94011385587024] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.061+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.061+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94011385588080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e53b0 con 0x7f76940af040 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.061+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e5d70 con 0x5580bb3d6fe0 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.061+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94011385590576] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.062+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.062+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94011385600192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e5ce0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.062+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e6c30 con 0x7f7698037040 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.062+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94011385588080] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.063+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.063+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94011385597696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e6c30 con 0x7f7698037040 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.063+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e75f0 con 0x7f7698037040 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.063+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94011385600192] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.064+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(56 notify.6 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.064+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94011385602400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e75f0 con 0x7f7698037040 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.064+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e7fb0 con 0x7f7698037040 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.064+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94011385597696] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94011385602400] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94011385606464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e7560 con 0x7f7698037040 2024-05-07T13:57:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a5638800 20 add_watcher() i=0 2024-05-07T13:57:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a5638800 20 add_watcher() i=1 2024-05-07T13:57:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a5638800 20 add_watcher() i=2 2024-05-07T13:57:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a5638800 20 add_watcher() i=3 2024-05-07T13:57:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a5638800 20 add_watcher() i=4 2024-05-07T13:57:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a5638800 20 add_watcher() i=5 2024-05-07T13:57:08.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.065+0000 7f76a5638800 20 add_watcher() i=6 2024-05-07T13:57:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.066+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94011385606464] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.066+0000 7f76a5638800 20 add_watcher() i=7 2024-05-07T13:57:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.066+0000 7f76a5638800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.066+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3eafe0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.067+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.067+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94011385608960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e8400 con 0x5580bb3d6fe0 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94011385608960] v29'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f7559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f76a5638800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f76a5638800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f76a5638800 5 note: GC not initialized 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f7558fe1640 20 reqs_thread_entry: start 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f76a5638800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f76a5638800 20 Filter name: none 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f74d27fc640 20 reqs_thread_entry: start 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.068+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41e940 con 0x5580bb3d6fe0 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.069+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.069+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41e940 con 0x7f76940af040 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.069+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.069+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41edc0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.069+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.069+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41edc0 con 0x5580bb3db760 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.069+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.069+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41f260 con 0x5580bb3db760 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41f260 con 0x5580bb3db760 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41f210 con 0x5580bb3d6fe0 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41f210 con 0x5580bb3d6fe0 2024-05-07T13:57:08.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41f1c0 con 0x5580bb3db760 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.070+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41f1a0 con 0x5580bb3db760 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.071+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.071+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41f1a0 con 0x7f7698037040 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.072+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.072+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420c20 con 0x5580bb3d6fe0 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.072+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.072+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420c20 con 0x7f76940af040 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.072+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.072+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420c20 con 0x5580bb3db760 2024-05-07T13:57:08.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.072+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.072+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420c20 con 0x7f7698037040 2024-05-07T13:57:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.073+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.073+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420bd0 con 0x7f7698037040 2024-05-07T13:57:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.073+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.073+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420b50 con 0x5580bb3db760 2024-05-07T13:57:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.073+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.073+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420b50 con 0x7f7698037040 2024-05-07T13:57:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.073+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.073+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.074+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.074+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3db760 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.074+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.074+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x7f7698037040 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.074+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.074+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x7f76940af040 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.074+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.074+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x7f7698037040 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.075+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.075+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.075+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.075+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.075+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.075+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3db760 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.075+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.075+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.076+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.076+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.076+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.076+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3db760 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.076+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.076+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3db760 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.076+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.076+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x5580bb3db760 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.077+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.077+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580bb420ae0 con 0x7f7698037040 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.077+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.078+0000 7f7559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.078+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94011385608960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41c830 con 0x5580bb3d6fe0 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.079+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94011385608960] v29'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.079+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94011385582592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb41cce0 con 0x7f76940af040 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.080+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94011385582592] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.080+0000 7f76a5638800 20 remove_watcher() i=0 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.080+0000 7f76a5638800 2 removed watcher, disabling cache 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.080+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94011385587024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e1400 con 0x5580bb3d6fe0 2024-05-07T13:57:08.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.081+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94011385587024] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.081+0000 7f76a5638800 20 remove_watcher() i=1 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.081+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94011385590576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e1400 con 0x5580bb3db760 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.083+0000 7f76a3137640 1 -- 172.21.15.50:0/3290912924 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94011385590576] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76940be020 con 0x5580bb3db760 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.083+0000 7f76a5638800 20 remove_watcher() i=2 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.083+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94011385588080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e1400 con 0x7f76940af040 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.084+0000 7f76a2936640 1 -- 172.21.15.50:0/3290912924 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94011385588080] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7698009050 con 0x7f76940af040 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.084+0000 7f76a5638800 20 remove_watcher() i=3 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.084+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94011385600192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e1400 con 0x5580bb3d6fe0 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.085+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94011385600192] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x5580bb3d6fe0 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.085+0000 7f76a5638800 20 remove_watcher() i=4 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.085+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94011385597696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e1400 con 0x7f7698037040 2024-05-07T13:57:08.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.086+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94011385597696] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.086+0000 7f76a5638800 20 remove_watcher() i=5 2024-05-07T13:57:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.086+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94011385602400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e4f00 con 0x7f7698037040 2024-05-07T13:57:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.087+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94011385602400] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.087+0000 7f76a5638800 20 remove_watcher() i=6 2024-05-07T13:57:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.087+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94011385606464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580bb3e1400 con 0x7f7698037040 2024-05-07T13:57:08.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94011385606464] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c00a4a0 con 0x7f7698037040 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 20 remove_watcher() i=7 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7698037040 msgr2=0x7f7698036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7698037040 0x7f7698036410 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb3d6fe0 msgr2=0x5580bb3d94a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb3d6fe0 0x5580bb3d94a0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f76940af040 msgr2=0x7f76940bc1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f76940af040 0x7f76940bc1c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3db760 msgr2=0x5580bb3ddb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3db760 0x5580bb3ddb50 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f756c036900 msgr2=0x7f756c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f756c036900 0x7f756c038dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7698001b60 tx=0x7f7698010000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3cb5a0 msgr2=0x5580bb3cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 --2- 172.21.15.50:0/3290912924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3cb5a0 0x5580bb3cb9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7694077bf0 tx=0x7f7694091f40 comp rx=0 tx=0).stop 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 reap_dead start 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a3938640 1 -- 172.21.15.50:0/3290912924 reap_dead start 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 shutdown_connections 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 >> 172.21.15.50:0/3290912924 conn(0x5580bb3c0420 msgr2=0x5580bb3bda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 shutdown_connections 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/3290912924 wait complete. 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/1205876359 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f757c036950 msgr2=0x7f757c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 --2- 172.21.15.50:0/1205876359 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f757c036950 0x7f757c038e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f769800bf50 tx=0x7f769800f000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 -- 172.21.15.50:0/1205876359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3b6f90 msgr2=0x5580bb3b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.088+0000 7f76a5638800 1 --2- 172.21.15.50:0/1205876359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3b6f90 0x5580bb3b73b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f769408c730 tx=0x7f7694076f50 comp rx=0 tx=0).stop 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/1205876359 shutdown_connections 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 --2- 172.21.15.50:0/1205876359 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f757c036950 0x7f757c038e10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 --2- 172.21.15.50:0/1205876359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb3b6f90 0x5580bb3b73b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/1205876359 >> 172.21.15.50:0/1205876359 conn(0x5580bb3ab030 msgr2=0x5580bb3ab430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/1205876359 shutdown_connections 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/1205876359 wait complete. 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580bb3a5ef0 msgr2=0x5580bb3a8380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580bb3a5ef0 0x5580bb3a8380 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb29c350 msgr2=0x5580bb39f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580bb29c350 0x5580bb39f680 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3a1fb0 msgr2=0x5580bb3a43a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580bb3a1fb0 0x5580bb3a43a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7588036900 msgr2=0x7f7588038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7588036900 0x7f7588038dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7698000f60 tx=0x7f76980012b0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 msgr2=0x5580bb398490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 --2- 172.21.15.50:0/2810711195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580bb29b9f0 0x5580bb398490 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7694052740 tx=0x7f7694003020 comp rx=0 tx=0).stop 2024-05-07T13:57:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a3938640 1 -- 172.21.15.50:0/2810711195 reap_dead start 2024-05-07T13:57:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 shutdown_connections 2024-05-07T13:57:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 >> 172.21.15.50:0/2810711195 conn(0x5580bb297550 msgr2=0x5580bb38abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 shutdown_connections 2024-05-07T13:57:08.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.089+0000 7f76a5638800 1 -- 172.21.15.50:0/2810711195 wait complete. 2024-05-07T13:57:08.100 INFO:teuthology.orchestra.run.smithi050.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-05-07T13:57:08.100 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-05-07T13:57:08.101 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-07T13:57:08.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-07T13:57:08.101 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-07T13:57:08.186 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:08.186 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.199+0000 7f6e6b016800 1 Processor -- start 2024-05-07T13:57:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e6b016800 1 -- start start 2024-05-07T13:57:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e6b016800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56179a9a28a0 0x56179aa31c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e6b016800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56179aa35f40 con 0x56179aa321f0 2024-05-07T13:57:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e6b016800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x56179a8c0050 con 0x56179a9a28a0 2024-05-07T13:57:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e66684640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56179a9a28a0 0x56179aa31c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e66684640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56179a9a28a0 0x56179aa31c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46330/0 (socket says 172.21.15.50:46330) 2024-05-07T13:57:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e65e83640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x56179aa321f0 0x56179aa346b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:38372/0 (socket says 172.21.15.50:38372) 2024-05-07T13:57:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e66684640 1 -- 172.21.15.50:0/3944068215 learned_addr learned my addr 172.21.15.50:0/3944068215 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e66684640 1 -- 172.21.15.50:0/3944068215 >> v1:172.21.15.22:6789/0 conn(0x56179aa321f0 legacy=0x56179aa346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.200+0000 7f6e66684640 1 -- 172.21.15.50:0/3944068215 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56179aa37170 con 0x56179a9a28a0 2024-05-07T13:57:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.202+0000 7f6e66684640 1 --2- 172.21.15.50:0/3944068215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179aa31c80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800a520 tx=0x7f6e5801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92813aeafa83aac0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.202+0000 7f6e65682640 1 -- 172.21.15.50:0/3944068215 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58057070 con 0x56179a9a28a0 2024-05-07T13:57:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.202+0000 7f6e65682640 1 -- 172.21.15.50:0/3944068215 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e58052570 con 0x56179a9a28a0 2024-05-07T13:57:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.202+0000 7f6e65682640 1 -- 172.21.15.50:0/3944068215 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5804ae60 con 0x56179a9a28a0 2024-05-07T13:57:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.203+0000 7f6e6b016800 1 -- 172.21.15.50:0/3944068215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 msgr2=0x56179aa31c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.203+0000 7f6e6b016800 1 --2- 172.21.15.50:0/3944068215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179aa31c80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800a520 tx=0x7f6e5801d010 comp rx=0 tx=0).stop 2024-05-07T13:57:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.203+0000 7f6e6b016800 1 -- 172.21.15.50:0/3944068215 shutdown_connections 2024-05-07T13:57:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.203+0000 7f6e6b016800 1 --2- 172.21.15.50:0/3944068215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179aa31c80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.203+0000 7f6e6b016800 1 -- 172.21.15.50:0/3944068215 >> 172.21.15.50:0/3944068215 conn(0x56179aa29560 msgr2=0x56179aa2b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.203+0000 7f6e6b016800 1 -- 172.21.15.50:0/3944068215 shutdown_connections 2024-05-07T13:57:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.203+0000 7f6e6b016800 1 -- 172.21.15.50:0/3944068215 wait complete. 2024-05-07T13:57:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.218+0000 7f6e6b016800 1 Processor -- start 2024-05-07T13:57:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.218+0000 7f6e6b016800 1 -- start start 2024-05-07T13:57:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.218+0000 7f6e6b016800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179ab20670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.218+0000 7f6e6b016800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56179a97a1d0 con 0x56179a9a28a0 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.219+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179ab20670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.219+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179ab20670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46334/0 (socket says 172.21.15.50:46334) 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.219+0000 7f6e66684640 1 -- 172.21.15.50:0/91495779 learned_addr learned my addr 172.21.15.50:0/91495779 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.219+0000 7f6e66684640 1 -- 172.21.15.50:0/91495779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56179ab20c40 con 0x56179a9a28a0 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.219+0000 7f6e66684640 1 --2- 172.21.15.50:0/91495779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179ab20670 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6e5801d050 tx=0x7f6e5804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6118555c04b86c6f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.219+0000 7f6d54608640 1 -- 172.21.15.50:0/91495779 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58057040 con 0x56179a9a28a0 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.219+0000 7f6d54608640 1 -- 172.21.15.50:0/91495779 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e58052720 con 0x56179a9a28a0 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.219+0000 7f6d54608640 1 -- 172.21.15.50:0/91495779 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58052a40 con 0x56179a9a28a0 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.220+0000 7f6e6b016800 1 -- 172.21.15.50:0/91495779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 msgr2=0x56179ab20670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.220+0000 7f6e6b016800 1 --2- 172.21.15.50:0/91495779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179ab20670 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6e5801d050 tx=0x7f6e5804c000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.220+0000 7f6e6b016800 1 -- 172.21.15.50:0/91495779 shutdown_connections 2024-05-07T13:57:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.220+0000 7f6e6b016800 1 --2- 172.21.15.50:0/91495779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179ab20670 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.220+0000 7f6e6b016800 1 -- 172.21.15.50:0/91495779 >> 172.21.15.50:0/91495779 conn(0x56179aa29560 msgr2=0x56179ab1bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.220+0000 7f6e6b016800 1 -- 172.21.15.50:0/91495779 shutdown_connections 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.220+0000 7f6e6b016800 1 -- 172.21.15.50:0/91495779 wait complete. 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.220+0000 7f6e6b016800 1 Processor -- start 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.220+0000 7f6e6b016800 1 -- start start 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.221+0000 7f6e6b016800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179aa2f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.221+0000 7f6e6b016800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56179aa363b0 con 0x56179a9a28a0 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.221+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179aa2f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.221+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179aa2f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46350/0 (socket says 172.21.15.50:46350) 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.221+0000 7f6e66684640 1 -- 172.21.15.50:0/1654276787 learned_addr learned my addr 172.21.15.50:0/1654276787 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.221+0000 7f6e66684640 1 -- 172.21.15.50:0/1654276787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56179aa2faa0 con 0x56179a9a28a0 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.222+0000 7f6e66684640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179aa2f560 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6e58005930 tx=0x7f6e58003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.222+0000 7f6d52e05640 1 -- 172.21.15.50:0/1654276787 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58073070 con 0x56179a9a28a0 2024-05-07T13:57:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.222+0000 7f6d52e05640 1 -- 172.21.15.50:0/1654276787 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5805d570 con 0x56179a9a28a0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.222+0000 7f6d52e05640 1 -- 172.21.15.50:0/1654276787 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58057070 con 0x56179a9a28a0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.222+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56179aa2dca0 con 0x56179a9a28a0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.222+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56179aa2e220 con 0x56179a9a28a0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.223+0000 7f6d52e05640 1 -- 172.21.15.50:0/1654276787 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e58076070 con 0x56179a9a28a0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.223+0000 7f6d52e05640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d4c036900 0x7f6d4c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.223+0000 7f6d52e05640 1 -- 172.21.15.50:0/1654276787 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6e5808df60 con 0x56179a9a28a0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.223+0000 7f6e65e83640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d4c036900 0x7f6d4c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.223+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179aa321f0 0x56179ab31460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.223+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab319e0 con 0x56179aa321f0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.223+0000 7f6e66e85640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179aa321f0 0x56179ab31460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.224+0000 7f6e65e83640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d4c036900 0x7f6d4c038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c000f60 tx=0x7f6e5c001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.224+0000 7f6e66e85640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179aa321f0 0x56179ab31460 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.224+0000 7f6e66e85640 1 -- 172.21.15.50:0/1654276787 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179aa321f0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.224+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179aa2e720 con 0x56179aa321f0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.224+0000 7f6e66e85640 1 -- 172.21.15.50:0/1654276787 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179aa321f0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.224+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab33d30 0x56179ab36120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.224+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab36810 con 0x56179ab33d30 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.224+0000 7f6e66684640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab33d30 0x56179ab36120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.225+0000 7f6e66684640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab33d30 0x56179ab36120 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.225+0000 7f6e66684640 1 -- 172.21.15.50:0/1654276787 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e58075030 con 0x56179ab33d30 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.225+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab32ce0 con 0x56179aa321f0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.225+0000 7f6e66e85640 1 -- 172.21.15.50:0/1654276787 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179aa321f0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.225+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56179ab37cc0 0x56179ab3a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.225+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab3a870 con 0x56179ab37cc0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.226+0000 7f6e65e83640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56179ab37cc0 0x56179ab3a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.226+0000 7f6e65e83640 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56179ab37cc0 0x56179ab3a110 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.226+0000 7f6e65e83640 1 -- 172.21.15.50:0/1654276787 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e5c00f690 con 0x56179ab37cc0 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.227+0000 7f6e6b016800 1 Processor -- start 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.227+0000 7f6e6b016800 1 -- start start 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.227+0000 7f6e6b016800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab48cd0 0x56179ab490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.227+0000 7f6e6b016800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56179a920cf0 con 0x56179ab48cd0 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.227+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab48cd0 0x56179ab490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.227+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab48cd0 0x56179ab490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46366/0 (socket says 172.21.15.50:46366) 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.227+0000 7f6e66684640 1 -- 172.21.15.50:0/2902672258 learned_addr learned my addr 172.21.15.50:0/2902672258 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.227+0000 7f6e66684640 1 -- 172.21.15.50:0/2902672258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56179ab49630 con 0x56179ab48cd0 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.228+0000 7f6e66684640 1 --2- 172.21.15.50:0/2902672258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab48cd0 0x56179ab490f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6e5808c1c0 tx=0x7f6e5805b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.228+0000 7f6d4bfff640 1 -- 172.21.15.50:0/2902672258 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5805da50 con 0x56179ab48cd0 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.228+0000 7f6d4bfff640 1 -- 172.21.15.50:0/2902672258 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5805dbf0 con 0x56179ab48cd0 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.228+0000 7f6e6b016800 1 -- 172.21.15.50:0/2902672258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56179ab4a0a0 con 0x56179ab48cd0 2024-05-07T13:57:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.228+0000 7f6d4bfff640 1 -- 172.21.15.50:0/2902672258 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5806f580 con 0x56179ab48cd0 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.228+0000 7f6e6b016800 1 -- 172.21.15.50:0/2902672258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56179ab4a5a0 con 0x56179ab48cd0 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.229+0000 7f6d4bfff640 1 -- 172.21.15.50:0/2902672258 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e5806f720 con 0x56179ab48cd0 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.229+0000 7f6d4bfff640 1 --2- 172.21.15.50:0/2902672258 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d40036900 0x7f6d40038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.229+0000 7f6d4bfff640 1 -- 172.21.15.50:0/2902672258 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6e58089070 con 0x56179ab48cd0 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.229+0000 7f6e65e83640 1 --2- 172.21.15.50:0/2902672258 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d40036900 0x7f6d40038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.229+0000 7f6e6b016800 1 Processor -- start 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.229+0000 7f6e6b016800 1 -- start start 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.229+0000 7f6e65e83640 1 --2- 172.21.15.50:0/2902672258 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d40036900 0x7f6d40038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56179ab322e0 tx=0x7f6e5c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.229+0000 7f6e6b016800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab56230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.229+0000 7f6e6b016800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56179ab20f00 con 0x56179ab55e10 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.230+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab56230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.230+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab56230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46370/0 (socket says 172.21.15.50:46370) 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.230+0000 7f6e66684640 1 -- 172.21.15.50:0/3672741060 learned_addr learned my addr 172.21.15.50:0/3672741060 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.230+0000 7f6e66684640 1 -- 172.21.15.50:0/3672741060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56179ab56800 con 0x56179ab55e10 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.230+0000 7f6e66684640 1 --2- 172.21.15.50:0/3672741060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab56230 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6e58075fd0 tx=0x7f6e5806c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc8aeacb9672ec server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.230+0000 7f6d49ffb640 1 -- 172.21.15.50:0/3672741060 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58092e40 con 0x56179ab55e10 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.230+0000 7f6d49ffb640 1 -- 172.21.15.50:0/3672741060 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e580a9070 con 0x56179ab55e10 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.230+0000 7f6d49ffb640 1 -- 172.21.15.50:0/3672741060 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e5809ad60 con 0x56179ab55e10 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 -- 172.21.15.50:0/3672741060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 msgr2=0x56179ab56230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 --2- 172.21.15.50:0/3672741060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab56230 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6e58075fd0 tx=0x7f6e5806c780 comp rx=0 tx=0).stop 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 -- 172.21.15.50:0/3672741060 shutdown_connections 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 --2- 172.21.15.50:0/3672741060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab56230 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 -- 172.21.15.50:0/3672741060 >> 172.21.15.50:0/3672741060 conn(0x56179ab52120 msgr2=0x56179ab50180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 -- 172.21.15.50:0/3672741060 shutdown_connections 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 -- 172.21.15.50:0/3672741060 wait complete. 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 Processor -- start 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 -- start start 2024-05-07T13:57:08.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab5d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.231+0000 7f6e6b016800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56179ab56e90 con 0x56179ab55e10 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab5d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6e66684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab5d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46374/0 (socket says 172.21.15.50:46374) 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 learned_addr learned my addr 172.21.15.50:0/1960575252 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56179ab5d750 con 0x56179ab55e10 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6e66684640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab5d210 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6e5806c7c0 tx=0x7f6e58075ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6d37fff640 1 -- 172.21.15.50:0/1960575252 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58082770 con 0x56179ab55e10 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6d37fff640 1 -- 172.21.15.50:0/1960575252 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e580776e0 con 0x56179ab55e10 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6d37fff640 1 -- 172.21.15.50:0/1960575252 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58082910 con 0x56179ab55e10 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56179ab5d750 con 0x56179ab55e10 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.232+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56179ab5d750 con 0x56179ab55e10 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.233+0000 7f6d37fff640 1 -- 172.21.15.50:0/1960575252 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e580bf060 con 0x56179ab55e10 2024-05-07T13:57:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.233+0000 7f6d37fff640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d300368b0 0x7f6d30038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.233+0000 7f6d37fff640 1 -- 172.21.15.50:0/1960575252 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6e580c2d20 con 0x56179ab55e10 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.234+0000 7f6e65e83640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d300368b0 0x7f6d30038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.234+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.234+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179ab688a0 0x56179ab6ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.234+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6b4b0 con 0x56179ab688a0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.234+0000 7f6e65e83640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d300368b0 0x7f6d30038d70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x56179ab3ac70 tx=0x7f6e5c010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.234+0000 7f6e66e85640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179ab688a0 0x56179ab6ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.234+0000 7f6e66e85640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179ab688a0 0x56179ab6ad60 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 20 realm 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6b8c0 con 0x56179ab688a0 2024-05-07T13:57:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c190 con 0x56179ab688a0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab6d020 0x56179ab6f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.235+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6fb70 con 0x56179ab6d020 2024-05-07T13:57:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.236+0000 7f6e66684640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab6d020 0x56179ab6f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.236+0000 7f6e66684640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab6d020 0x56179ab6f410 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.236+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.236+0000 7f6e6b016800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.236+0000 7f6e6b016800 20 searching for the correct realm 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.236+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab71540 con 0x56179ab6d020 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.237+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.237+0000 7f6e66684640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e58078060 0x7f6e58050340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.237+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab71540 con 0x7f6e58078060 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.237+0000 7f6e65e83640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e58078060 0x7f6e58050340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.237+0000 7f6e65e83640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e58078060 0x7f6e58050340 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.237+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c037040 con 0x7f6e58078060 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.237+0000 7f6e65e83640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e5c00f070 0x7f6e5c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.237+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab71540 con 0x7f6e5c00f070 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.238+0000 7f6e66e85640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e5c00f070 0x7f6e5c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.238+0000 7f6e66e85640 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e5c00f070 0x7f6e5c02e910 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.238+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.238+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.238+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.239+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.239+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.239+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.239+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.239+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e5c00f070 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.239+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.239+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e58078060 2024-05-07T13:57:08.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.240+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c037040 con 0x7f6e58078060 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.240+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e58078060 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.240+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c037040 con 0x7f6e58078060 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.240+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.240+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.240+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e5c00f070 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.241+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.241+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.241+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.241+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e58078060 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.241+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e5c037040 con 0x7f6e58078060 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.241+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab6d020 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.241+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.241+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab6d020 2024-05-07T13:57:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.242+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.242+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e5c00f070 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.242+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.242+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab6d020 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.242+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.242+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab6d020 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.242+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.242+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.243+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.243+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.243+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.243+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e5c00f070 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.243+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.243+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab6d020 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.244+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.244+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e58078060 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.244+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c037040 con 0x7f6e58078060 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.244+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.244+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.244+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e5c00f070 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.245+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.245+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab6d020 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.245+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.245+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e5c00f070 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.245+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.245+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e58078060 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.246+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c037040 con 0x7f6e58078060 2024-05-07T13:57:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.246+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab6d020 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.246+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.246+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e58078060 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.246+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c037040 con 0x7f6e58078060 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.246+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x56179ab688a0 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.246+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.246+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56179ab6c530 con 0x7f6e58078060 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e5c037040 con 0x7f6e58078060 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab70510 con 0x56179ab688a0 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab70900 con 0x56179ab688a0 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.247+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab70900 con 0x7f6e5c00f070 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 zone default found 2024-05-07T13:57:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 4 Realm: () 2024-05-07T13:57:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 zonegroup default 2024-05-07T13:57:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab70d20 con 0x7f6e5c00f070 2024-05-07T13:57:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab70d20 con 0x56179ab6d020 2024-05-07T13:57:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab733f0 con 0x56179ab6d020 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 started sync module instance, tier type = 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.248+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab72890 con 0x7f6e58078060 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.250+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c04a040 con 0x7f6e58078060 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.250+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94659379932336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab73c40 con 0x7f6e58078060 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.250+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab74490 con 0x56179ab688a0 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.251+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94659379932336] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c04a040 con 0x7f6e58078060 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.251+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.251+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94659379935120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab74570 con 0x56179ab688a0 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.251+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab75060 con 0x56179ab6d020 2024-05-07T13:57:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.252+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94659379935120] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.252+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.252+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94659379940144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab75450 con 0x56179ab6d020 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.252+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab75e50 con 0x7f6e58078060 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.254+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94659379940144] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.254+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c04a040 con 0x7f6e58078060 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.254+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94659379937248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab766f0 con 0x7f6e58078060 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.254+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab770b0 con 0x56179ab688a0 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.255+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94659379937248] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c04a040 con 0x7f6e58078060 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.255+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.255+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94659379948544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab774d0 con 0x56179ab688a0 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.255+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab77e90 con 0x7f6e5c00f070 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.256+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.256+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94659379952096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab782b0 con 0x7f6e5c00f070 2024-05-07T13:57:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.256+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab78d90 con 0x7f6e5c00f070 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.256+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94659379948544] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.257+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94659379952096] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.257+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.257+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94659379955872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab77e00 con 0x7f6e5c00f070 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.257+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab79630 con 0x7f6e5c00f070 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94659379955872] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94659379949600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab77e00 con 0x7f6e5c00f070 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e6b016800 20 add_watcher() i=0 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e6b016800 20 add_watcher() i=1 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e6b016800 20 add_watcher() i=2 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e6b016800 20 add_watcher() i=3 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e6b016800 20 add_watcher() i=4 2024-05-07T13:57:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e6b016800 20 add_watcher() i=5 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.258+0000 7f6e6b016800 20 add_watcher() i=6 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.259+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94659379949600] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.259+0000 7f6e6b016800 20 add_watcher() i=7 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.259+0000 7f6e6b016800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.259+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179ab7c660 con 0x56179ab688a0 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.260+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.260+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94659379958144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab79b60 con 0x56179ab688a0 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.261+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94659379958144] v29'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.261+0000 7f6d1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.261+0000 7f6e6b016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.261+0000 7f6e6b016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.261+0000 7f6e6b016800 5 note: GC not initialized 2024-05-07T13:57:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.261+0000 7f6c977fe640 20 reqs_thread_entry: start 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.261+0000 7f6e6b016800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.261+0000 7f6e6b016800 20 Filter name: none 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.261+0000 7f6c957fa640 20 reqs_thread_entry: start 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.262+0000 7f6e6b016800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.262+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179abaf640 con 0x56179ab688a0 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.262+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.262+0000 7f6e6b016800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.262+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56179abb0a30 con 0x7f6e5c00f070 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.262+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.263+0000 7f6d1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.263+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94659379958144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab65810 con 0x56179ab688a0 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.264+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94659379958144] v29'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.264+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94659379932336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab79180 con 0x7f6e58078060 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.265+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94659379932336] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c04a040 con 0x7f6e58078060 2024-05-07T13:57:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.265+0000 7f6e6b016800 20 remove_watcher() i=0 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.265+0000 7f6e6b016800 2 removed watcher, disabling cache 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.265+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94659379935120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab72cb0 con 0x56179ab688a0 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.266+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94659379935120] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.266+0000 7f6e6b016800 20 remove_watcher() i=1 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.266+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94659379940144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab72cb0 con 0x56179ab6d020 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.267+0000 7f6e66684640 1 -- 172.21.15.50:0/1960575252 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94659379940144] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e58097020 con 0x56179ab6d020 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.267+0000 7f6e6b016800 20 remove_watcher() i=2 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.268+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94659379937248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab74b30 con 0x7f6e58078060 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.269+0000 7f6e65e83640 1 -- 172.21.15.50:0/1960575252 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94659379937248] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e5c04a040 con 0x7f6e58078060 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.269+0000 7f6e6b016800 20 remove_watcher() i=3 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.269+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94659379948544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab73fe0 con 0x56179ab688a0 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.270+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94659379948544] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x56179ab688a0 2024-05-07T13:57:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.270+0000 7f6e6b016800 20 remove_watcher() i=4 2024-05-07T13:57:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.270+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94659379952096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab74b30 con 0x7f6e5c00f070 2024-05-07T13:57:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.271+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94659379952096] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.271+0000 7f6e6b016800 20 remove_watcher() i=5 2024-05-07T13:57:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.271+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94659379955872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab76c00 con 0x7f6e5c00f070 2024-05-07T13:57:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.272+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94659379955872] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.272+0000 7f6e6b016800 20 remove_watcher() i=6 2024-05-07T13:57:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.272+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94659379949600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56179ab73fe0 con 0x7f6e5c00f070 2024-05-07T13:57:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94659379949600] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6000a4a0 con 0x7f6e5c00f070 2024-05-07T13:57:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 20 remove_watcher() i=7 2024-05-07T13:57:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e5c00f070 msgr2=0x7f6e5c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f6e5c00f070 0x7f6e5c02e910 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179ab688a0 msgr2=0x56179ab6ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179ab688a0 0x56179ab6ad60 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e58078060 msgr2=0x7f6e58050340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6e58078060 0x7f6e58050340 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab6d020 msgr2=0x56179ab6f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab6d020 0x56179ab6f410 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d300368b0 msgr2=0x7f6d30038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d300368b0 0x7f6d30038d70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x56179ab3ac70 tx=0x7f6e5c010000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 msgr2=0x56179ab5d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e66e85640 1 -- 172.21.15.50:0/1960575252 reap_dead start 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab5d210 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6e5806c7c0 tx=0x7f6e58075ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 shutdown_connections 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.273+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1960575252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab55e10 0x56179ab5d210 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 >> 172.21.15.50:0/1960575252 conn(0x56179ab52120 msgr2=0x56179ab4f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 shutdown_connections 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/1960575252 wait complete. 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/2902672258 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d40036900 msgr2=0x7f6d40038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 --2- 172.21.15.50:0/2902672258 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d40036900 0x7f6d40038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56179ab322e0 tx=0x7f6e5c00f000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/2902672258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab48cd0 msgr2=0x56179ab490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 --2- 172.21.15.50:0/2902672258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab48cd0 0x56179ab490f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6e5808c1c0 tx=0x7f6e5805b450 comp rx=0 tx=0).stop 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/2902672258 shutdown_connections 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 --2- 172.21.15.50:0/2902672258 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d40036900 0x7f6d40038dc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 --2- 172.21.15.50:0/2902672258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179ab48cd0 0x56179ab490f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/2902672258 >> 172.21.15.50:0/2902672258 conn(0x56179ab3cd70 msgr2=0x56179ab3d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/2902672258 shutdown_connections 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/2902672258 wait complete. 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56179ab37cc0 msgr2=0x56179ab3a110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56179ab37cc0 0x56179ab3a110 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179aa321f0 msgr2=0x56179ab31460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56179aa321f0 0x56179ab31460 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab33d30 msgr2=0x56179ab36120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56179ab33d30 0x56179ab36120 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d4c036900 msgr2=0x7f6d4c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f6d4c036900 0x7f6d4c038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c000f60 tx=0x7f6e5c001370 comp rx=0 tx=0).stop 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 msgr2=0x56179aa2f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.274+0000 7f6e6b016800 1 --2- 172.21.15.50:0/1654276787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56179a9a28a0 0x56179aa2f560 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6e58005930 tx=0x7f6e58003020 comp rx=0 tx=0).stop 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.275+0000 7f6e66e85640 1 -- 172.21.15.50:0/1654276787 reap_dead start 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.275+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 shutdown_connections 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.275+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 >> 172.21.15.50:0/1654276787 conn(0x56179aa29560 msgr2=0x56179ab1a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.275+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 shutdown_connections 2024-05-07T13:57:08.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.275+0000 7f6e6b016800 1 -- 172.21.15.50:0/1654276787 wait complete. 2024-05-07T13:57:08.292 INFO:teuthology.orchestra.run.smithi050.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-05-07T13:57:08.293 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-05-07T13:57:08.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-07T13:57:08.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-07T13:57:08.293 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-05-07T13:57:08.346 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:08.346 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.360+0000 7f7b8e605800 1 Processor -- start 2024-05-07T13:57:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.360+0000 7f7b8e605800 1 -- start start 2024-05-07T13:57:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.360+0000 7f7b8e605800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b33ebd4540 0x55b33ebdd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.360+0000 7f7b8e605800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b33eb470a0 con 0x55b33ebd2a00 2024-05-07T13:57:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.360+0000 7f7b8e605800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55b33ea65050 con 0x55b33ebd4540 2024-05-07T13:57:08.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.360+0000 7f7b8b903640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55b33ebd4540 0x55b33ebdd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.360+0000 7f7b8c104640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55b33ebd2a00 0x55b33ebd2e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:38386/0 (socket says 172.21.15.50:38386) 2024-05-07T13:57:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.360+0000 7f7b8c104640 1 -- 172.21.15.50:0/2611880169 learned_addr learned my addr 172.21.15.50:0/2611880169 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.361+0000 7f7b8b102640 1 -- 172.21.15.50:0/2611880169 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656188444 0 0) 0x55b33eb470a0 con 0x55b33ebd2a00 2024-05-07T13:57:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.361+0000 7f7b8b102640 1 -- 172.21.15.50:0/2611880169 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b74001e10 con 0x55b33ebd2a00 2024-05-07T13:57:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.361+0000 7f7b8b903640 1 -- 172.21.15.50:0/2611880169 >> v1:172.21.15.22:6789/0 conn(0x55b33ebd2a00 legacy=0x55b33ebd2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.361+0000 7f7b8b903640 1 -- 172.21.15.50:0/2611880169 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33ebde590 con 0x55b33ebd4540 2024-05-07T13:57:08.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8b903640 1 --2- 172.21.15.50:0/2611880169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd4540 0x55b33ebdd040 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000a470 tx=0x7f7b8001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cb047951fbd9bd server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8b102640 1 -- 172.21.15.50:0/2611880169 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80057070 con 0x55b33ebd4540 2024-05-07T13:57:08.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8b102640 1 -- 172.21.15.50:0/2611880169 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8004acd0 con 0x55b33ebd4540 2024-05-07T13:57:08.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8b102640 1 -- 172.21.15.50:0/2611880169 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80052440 con 0x55b33ebd4540 2024-05-07T13:57:08.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8e605800 1 -- 172.21.15.50:0/2611880169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd4540 msgr2=0x55b33ebdd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2611880169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd4540 0x55b33ebdd040 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000a470 tx=0x7f7b8001cdb0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8e605800 1 -- 172.21.15.50:0/2611880169 shutdown_connections 2024-05-07T13:57:08.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2611880169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd4540 0x55b33ebdd040 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8e605800 1 -- 172.21.15.50:0/2611880169 >> 172.21.15.50:0/2611880169 conn(0x55b33ebce5c0 msgr2=0x55b33ebd09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8e605800 1 -- 172.21.15.50:0/2611880169 shutdown_connections 2024-05-07T13:57:08.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.363+0000 7f7b8e605800 1 -- 172.21.15.50:0/2611880169 wait complete. 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.378+0000 7f7b8e605800 1 Processor -- start 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.378+0000 7f7b8e605800 1 -- start start 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.378+0000 7f7b8e605800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33ecc77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.378+0000 7f7b8e605800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b33eb1f1c0 con 0x55b33ebd2a00 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.379+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33ecc77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.379+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33ecc77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46388/0 (socket says 172.21.15.50:46388) 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.379+0000 7f7b8c104640 1 -- 172.21.15.50:0/639913632 learned_addr learned my addr 172.21.15.50:0/639913632 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.379+0000 7f7b8c104640 1 -- 172.21.15.50:0/639913632 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33ecc7dc0 con 0x55b33ebd2a00 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.379+0000 7f7b8c104640 1 --2- 172.21.15.50:0/639913632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33ecc77f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c001d60 tx=0x7f7b7c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec1be1dc84e2620 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.379+0000 7f7a7a60c640 1 -- 172.21.15.50:0/639913632 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c012020 con 0x55b33ebd2a00 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.379+0000 7f7a7a60c640 1 -- 172.21.15.50:0/639913632 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c00e470 con 0x55b33ebd2a00 2024-05-07T13:57:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.379+0000 7f7a7a60c640 1 -- 172.21.15.50:0/639913632 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c00e810 con 0x55b33ebd2a00 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.380+0000 7f7b8e605800 1 -- 172.21.15.50:0/639913632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 msgr2=0x55b33ecc77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.380+0000 7f7b8e605800 1 --2- 172.21.15.50:0/639913632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33ecc77f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c001d60 tx=0x7f7b7c00b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.380+0000 7f7b8e605800 1 -- 172.21.15.50:0/639913632 shutdown_connections 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.380+0000 7f7b8e605800 1 --2- 172.21.15.50:0/639913632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33ecc77f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.380+0000 7f7b8e605800 1 -- 172.21.15.50:0/639913632 >> 172.21.15.50:0/639913632 conn(0x55b33ebce5c0 msgr2=0x55b33ecc3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.380+0000 7f7b8e605800 1 -- 172.21.15.50:0/639913632 shutdown_connections 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.380+0000 7f7b8e605800 1 -- 172.21.15.50:0/639913632 wait complete. 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.380+0000 7f7b8e605800 1 Processor -- start 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.380+0000 7f7b8e605800 1 -- start start 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.381+0000 7f7b8e605800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33eccf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.381+0000 7f7b8e605800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b33ebdd850 con 0x55b33ebd2a00 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.381+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33eccf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.381+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33eccf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46400/0 (socket says 172.21.15.50:46400) 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.381+0000 7f7b8c104640 1 -- 172.21.15.50:0/657832899 learned_addr learned my addr 172.21.15.50:0/657832899 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.381+0000 7f7b8c104640 1 -- 172.21.15.50:0/657832899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33eccf900 con 0x55b33ebd2a00 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.381+0000 7f7b8c104640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33eccf3c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00b700 tx=0x7f7b7c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.381+0000 7f7a78e09640 1 -- 172.21.15.50:0/657832899 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c012030 con 0x55b33ebd2a00 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.381+0000 7f7a78e09640 1 -- 172.21.15.50:0/657832899 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c01a7a0 con 0x55b33ebd2a00 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.382+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b33eccfb90 con 0x55b33ebd2a00 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.382+0000 7f7a78e09640 1 -- 172.21.15.50:0/657832899 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c01aac0 con 0x55b33ebd2a00 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.382+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33ecd2840 con 0x55b33ebd2a00 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.382+0000 7f7a78e09640 1 -- 172.21.15.50:0/657832899 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7b7c015020 con 0x55b33ebd2a00 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.383+0000 7f7a78e09640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a74036900 0x7f7a74038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.383+0000 7f7a78e09640 1 -- 172.21.15.50:0/657832899 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b7c020030 con 0x55b33ebd2a00 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.383+0000 7f7b8b903640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a74036900 0x7f7a74038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.383+0000 7f7b8e605800 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ebd4540 0x55b33ecd6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.383+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ecd6b90 con 0x55b33ebd4540 2024-05-07T13:57:08.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.383+0000 7f7b8c905640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ebd4540 0x55b33ecd6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.383+0000 7f7b8b903640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a74036900 0x7f7a74038dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7b80054000 tx=0x7f7b8004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.383+0000 7f7b8c905640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ebd4540 0x55b33ecd6600 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.384+0000 7f7b8c905640 1 -- 172.21.15.50:0/657832899 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ebd4540 2024-05-07T13:57:08.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.384+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ecd3bd0 con 0x55b33ebd4540 2024-05-07T13:57:08.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.384+0000 7f7b8c905640 1 -- 172.21.15.50:0/657832899 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ebd4540 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.384+0000 7f7b8e605800 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ecd8ee0 0x55b33ecdb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.384+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ecdb9c0 con 0x55b33ecd8ee0 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.384+0000 7f7b8c104640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ecd8ee0 0x55b33ecdb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.384+0000 7f7b8c104640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ecd8ee0 0x55b33ecdb2d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.384+0000 7f7b8c104640 1 -- 172.21.15.50:0/657832899 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b7c018950 con 0x55b33ecd8ee0 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.385+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ecd7e90 con 0x55b33ebd4540 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.385+0000 7f7b8c905640 1 -- 172.21.15.50:0/657832899 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ebd4540 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.385+0000 7f7b8e605800 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b33ecdce20 0x55b33ecdf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.385+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ecdfa40 con 0x55b33ecdce20 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.385+0000 7f7b8b903640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b33ecdce20 0x55b33ecdf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.386+0000 7f7b8b903640 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b33ecdce20 0x55b33ecdf2b0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.386+0000 7f7b8b903640 1 -- 172.21.15.50:0/657832899 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b8005a040 con 0x55b33ecdce20 2024-05-07T13:57:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.386+0000 7f7b8e605800 1 Processor -- start 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.387+0000 7f7b8e605800 1 -- start start 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.387+0000 7f7b8e605800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecedea0 0x55b33ecee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.387+0000 7f7b8e605800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b33eac5cf0 con 0x55b33ecedea0 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.387+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecedea0 0x55b33ecee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.387+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecedea0 0x55b33ecee2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46406/0 (socket says 172.21.15.50:46406) 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.387+0000 7f7b8c104640 1 -- 172.21.15.50:0/2518200705 learned_addr learned my addr 172.21.15.50:0/2518200705 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.387+0000 7f7b8c104640 1 -- 172.21.15.50:0/2518200705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33ecee800 con 0x55b33ecedea0 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.387+0000 7f7b8c104640 1 --2- 172.21.15.50:0/2518200705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecedea0 0x55b33ecee2c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0016f0 tx=0x7f7b7c00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.388+0000 7f7a71ffb640 1 -- 172.21.15.50:0/2518200705 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c0443f0 con 0x55b33ecedea0 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.388+0000 7f7a71ffb640 1 -- 172.21.15.50:0/2518200705 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c044590 con 0x55b33ecedea0 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.388+0000 7f7b8e605800 1 -- 172.21.15.50:0/2518200705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b33ecef270 con 0x55b33ecedea0 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.388+0000 7f7a71ffb640 1 -- 172.21.15.50:0/2518200705 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c0165e0 con 0x55b33ecedea0 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.388+0000 7f7b8e605800 1 -- 172.21.15.50:0/2518200705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33ecef270 con 0x55b33ecedea0 2024-05-07T13:57:08.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.388+0000 7f7a71ffb640 1 -- 172.21.15.50:0/2518200705 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7b7c04cac0 con 0x55b33ecedea0 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.388+0000 7f7a71ffb640 1 --2- 172.21.15.50:0/2518200705 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a64036950 0x7f7a64038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7a71ffb640 1 -- 172.21.15.50:0/2518200705 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b7c03d020 con 0x55b33ecedea0 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7b8b903640 1 --2- 172.21.15.50:0/2518200705 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a64036950 0x7f7a64038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7b8e605800 1 Processor -- start 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7b8e605800 1 -- start start 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7b8b903640 1 --2- 172.21.15.50:0/2518200705 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a64036950 0x7f7a64038e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55b33ecd7490 tx=0x7f7b80005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7b8e605800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ecfb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7b8e605800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b33ecc8140 con 0x55b33ecfadb0 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ecfb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ecfb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46420/0 (socket says 172.21.15.50:46420) 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.389+0000 7f7b8c104640 1 -- 172.21.15.50:0/1164095434 learned_addr learned my addr 172.21.15.50:0/1164095434 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7b8c104640 1 -- 172.21.15.50:0/1164095434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33ecfb7a0 con 0x55b33ecfadb0 2024-05-07T13:57:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7b8c104640 1 --2- 172.21.15.50:0/1164095434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ecfb1d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c018c20 tx=0x7f7b7c024cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327af0e080cd3979 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7a6b7fe640 1 -- 172.21.15.50:0/1164095434 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c051030 con 0x55b33ecfadb0 2024-05-07T13:57:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7a6b7fe640 1 -- 172.21.15.50:0/1164095434 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c016780 con 0x55b33ecfadb0 2024-05-07T13:57:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7a6b7fe640 1 -- 172.21.15.50:0/1164095434 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c03b130 con 0x55b33ecfadb0 2024-05-07T13:57:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7b8e605800 1 -- 172.21.15.50:0/1164095434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 msgr2=0x55b33ecfb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7b8e605800 1 --2- 172.21.15.50:0/1164095434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ecfb1d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c018c20 tx=0x7f7b7c024cf0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7b8e605800 1 -- 172.21.15.50:0/1164095434 shutdown_connections 2024-05-07T13:57:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7b8e605800 1 --2- 172.21.15.50:0/1164095434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ecfb1d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7b8e605800 1 -- 172.21.15.50:0/1164095434 >> 172.21.15.50:0/1164095434 conn(0x55b33ecf70d0 msgr2=0x55b33ecf5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7b8e605800 1 -- 172.21.15.50:0/1164095434 shutdown_connections 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.390+0000 7f7b8e605800 1 -- 172.21.15.50:0/1164095434 wait complete. 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.391+0000 7f7b8e605800 1 Processor -- start 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.391+0000 7f7b8e605800 1 -- start start 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.391+0000 7f7b8e605800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ed021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.391+0000 7f7b8e605800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b33ecfbec0 con 0x55b33ecfadb0 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.391+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ed021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.391+0000 7f7b8c104640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ed021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46426/0 (socket says 172.21.15.50:46426) 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.391+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 learned_addr learned my addr 172.21.15.50:0/2705178155 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.391+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b33ed026e0 con 0x55b33ecfadb0 2024-05-07T13:57:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.392+0000 7f7b8c104640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ed021a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c024e40 tx=0x7f7b7c00f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.392+0000 7f7a69ffb640 1 -- 172.21.15.50:0/2705178155 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c070070 con 0x55b33ecfadb0 2024-05-07T13:57:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.392+0000 7f7a69ffb640 1 -- 172.21.15.50:0/2705178155 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c0030d0 con 0x55b33ecfadb0 2024-05-07T13:57:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.392+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b33ed026e0 con 0x55b33ecfadb0 2024-05-07T13:57:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.392+0000 7f7a69ffb640 1 -- 172.21.15.50:0/2705178155 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c051040 con 0x55b33ecfadb0 2024-05-07T13:57:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.392+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b33ed026e0 con 0x55b33ecfadb0 2024-05-07T13:57:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.392+0000 7f7a69ffb640 1 -- 172.21.15.50:0/2705178155 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7b7c073070 con 0x55b33ecfadb0 2024-05-07T13:57:08.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.393+0000 7f7a69ffb640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a5c036950 0x7f7a5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.393+0000 7f7a69ffb640 1 -- 172.21.15.50:0/2705178155 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b7c067030 con 0x55b33ecfadb0 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.393+0000 7f7b8b903640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a5c036950 0x7f7a5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.393+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.393+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ed0d850 0x55b33ed0fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.393+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed10460 con 0x55b33ed0d850 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.393+0000 7f7b8b903640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a5c036950 0x7f7a5c038e10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55b33ecdfe40 tx=0x7f7b80060040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.393+0000 7f7b8c905640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ed0d850 0x55b33ed0fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8c905640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ed0d850 0x55b33ed0fd10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 20 realm 2024-05-07T13:57:08.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed10870 con 0x55b33ed0d850 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed11140 con 0x55b33ed0d850 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.394+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8e605800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ed11fd0 0x55b33ed143c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed14b00 con 0x55b33ed11fd0 2024-05-07T13:57:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8c104640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ed11fd0 0x55b33ed143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8c104640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ed11fd0 0x55b33ed143c0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8e605800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8e605800 20 searching for the correct realm 2024-05-07T13:57:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.395+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed164d0 con 0x55b33ed11fd0 2024-05-07T13:57:08.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.396+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.396+0000 7f7b8c104640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7b7c075060 0x7f7b7c022320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.396+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed164d0 con 0x7f7b7c075060 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.396+0000 7f7b8b903640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7b7c075060 0x7f7b7c022320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.396+0000 7f7b8b903640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7b7c075060 0x7f7b7c022320 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.397+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.397+0000 7f7b8b903640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7b80080930 0x7f7b80073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.397+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed164d0 con 0x7f7b80080930 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.397+0000 7f7b8c905640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7b80080930 0x7f7b80073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.397+0000 7f7b8c905640 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7b80080930 0x7f7b80073420 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.397+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.397+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.398+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.398+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.398+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.398+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.398+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.398+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b80080930 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.398+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.398+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b7c075060 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.399+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.399+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b7c075060 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.399+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.399+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.399+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.399+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b80080930 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.399+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.400+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.400+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.400+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b7c075060 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.400+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.400+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed11fd0 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.400+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.400+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed11fd0 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.400+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.400+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b80080930 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.401+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.401+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed11fd0 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.401+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.401+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed11fd0 2024-05-07T13:57:08.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.401+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.401+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.402+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.402+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.402+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.402+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b80080930 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.402+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.402+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed11fd0 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.402+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.402+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b7c075060 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.403+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.403+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.403+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.403+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b80080930 2024-05-07T13:57:08.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.403+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.403+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed11fd0 2024-05-07T13:57:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.404+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.404+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b80080930 2024-05-07T13:57:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.404+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.404+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b7c075060 2024-05-07T13:57:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.404+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.404+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed11fd0 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.404+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.404+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b7c075060 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x55b33ed0d850 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed114e0 con 0x7f7b7c075060 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed154a0 con 0x55b33ed0d850 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.405+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed15890 con 0x55b33ed0d850 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed15890 con 0x7f7b80080930 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 20 zone default found 2024-05-07T13:57:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 4 Realm: () 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 20 zonegroup default 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed15cb0 con 0x7f7b80080930 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.406+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed160d0 con 0x55b33ed11fd0 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.407+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.407+0000 7f7b8e605800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.407+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.407+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed18380 con 0x55b33ed11fd0 2024-05-07T13:57:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.407+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.407+0000 7f7b8e605800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.407+0000 7f7b8e605800 20 started sync module instance, tier type = 2024-05-07T13:57:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.407+0000 7f7b8e605800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.407+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed17820 con 0x7f7b7c075060 2024-05-07T13:57:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.408+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.408+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94228341423168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed18bd0 con 0x7f7b7c075060 2024-05-07T13:57:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.408+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed19420 con 0x55b33ed0d850 2024-05-07T13:57:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.409+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94228341423168] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.410+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.410+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94228341425952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed19420 con 0x55b33ed0d850 2024-05-07T13:57:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.410+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed19ea0 con 0x55b33ed11fd0 2024-05-07T13:57:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.411+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94228341425952] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.411+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.411+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94228341428080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed19390 con 0x55b33ed11fd0 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.411+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1ad60 con 0x7f7b7c075060 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.412+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94228341428080] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.412+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.412+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94228341434544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1b100 con 0x7f7b7c075060 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.412+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1bb00 con 0x55b33ed0d850 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.413+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94228341434544] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.413+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.413+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94228341432976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1bf20 con 0x55b33ed0d850 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.413+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1c920 con 0x7f7b80080930 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.414+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94228341432976] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.414+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.414+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94228341437968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1c8e0 con 0x7f7b80080930 2024-05-07T13:57:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.415+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1d330 con 0x7f7b80080930 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.416+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94228341437968] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.416+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.416+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94228341442064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1d330 con 0x7f7b80080930 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.416+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1dcf0 con 0x7f7b80080930 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94228341442064] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94228341444704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1dcf0 con 0x7f7b80080930 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8e605800 20 add_watcher() i=0 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8e605800 20 add_watcher() i=1 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8e605800 20 add_watcher() i=2 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8e605800 20 add_watcher() i=3 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8e605800 20 add_watcher() i=4 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8e605800 20 add_watcher() i=5 2024-05-07T13:57:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.417+0000 7f7b8e605800 20 add_watcher() i=6 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.418+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94228341444704] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.418+0000 7f7b8e605800 20 add_watcher() i=7 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.418+0000 7f7b8e605800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.418+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed21050 con 0x55b33ed0d850 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.418+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.418+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94228341459536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1de60 con 0x55b33ed0d850 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.419+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94228341459536] v29'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.419+0000 7f7a427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.419+0000 7f7b8e605800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.419+0000 7f7b8e605800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.419+0000 7f7b8e605800 5 note: GC not initialized 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.420+0000 7f7a417e2640 20 reqs_thread_entry: start 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.420+0000 7f7b8e605800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.420+0000 7f7b8e605800 20 Filter name: none 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.420+0000 7f79b2ffd640 20 reqs_thread_entry: start 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.420+0000 7f7b8e605800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.420+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed54100 con 0x55b33ed0d850 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.420+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.420+0000 7f7b8e605800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.420+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed554f0 con 0x7f7b80080930 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.421+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.422+0000 7f7a427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.422+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94228341459536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1fac0 con 0x55b33ed0d850 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.423+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94228341459536] v29'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.423+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94228341423168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed209e0 con 0x7f7b7c075060 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.424+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94228341423168] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.424+0000 7f7b8e605800 20 remove_watcher() i=0 2024-05-07T13:57:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.424+0000 7f7b8e605800 2 removed watcher, disabling cache 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.424+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94228341425952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed17c40 con 0x55b33ed0d850 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.425+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94228341425952] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.425+0000 7f7b8e605800 20 remove_watcher() i=1 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.425+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94228341428080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed17c40 con 0x55b33ed11fd0 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.426+0000 7f7b8c104640 1 -- 172.21.15.50:0/2705178155 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94228341428080] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c072030 con 0x55b33ed11fd0 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.426+0000 7f7b8e605800 20 remove_watcher() i=2 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.426+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94228341434544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed18f70 con 0x7f7b7c075060 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.427+0000 7f7b8b903640 1 -- 172.21.15.50:0/2705178155 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94228341434544] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b80070070 con 0x7f7b7c075060 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.427+0000 7f7b8e605800 20 remove_watcher() i=3 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.427+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94228341432976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed17c40 con 0x55b33ed0d850 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.428+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94228341432976] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x55b33ed0d850 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.429+0000 7f7b8e605800 20 remove_watcher() i=4 2024-05-07T13:57:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.429+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94228341437968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1a8b0 con 0x7f7b80080930 2024-05-07T13:57:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.430+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94228341437968] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.430+0000 7f7b8e605800 20 remove_watcher() i=5 2024-05-07T13:57:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.430+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94228341442064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1a8b0 con 0x7f7b80080930 2024-05-07T13:57:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.431+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94228341442064] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.431+0000 7f7b8e605800 20 remove_watcher() i=6 2024-05-07T13:57:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.431+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94228341444704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b33ed1a8b0 con 0x7f7b80080930 2024-05-07T13:57:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94228341444704] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8400a4a0 con 0x7f7b80080930 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 20 remove_watcher() i=7 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7b80080930 msgr2=0x7f7b80073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7b80080930 0x7f7b80073420 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ed0d850 msgr2=0x55b33ed0fd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ed0d850 0x55b33ed0fd10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7b7c075060 msgr2=0x7f7b7c022320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7b7c075060 0x7f7b7c022320 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ed11fd0 msgr2=0x55b33ed143c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ed11fd0 0x55b33ed143c0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a5c036950 msgr2=0x7f7a5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a5c036950 0x7f7a5c038e10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55b33ecdfe40 tx=0x7f7b80060040 comp rx=0 tx=0).stop 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 msgr2=0x55b33ed021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8c905640 1 -- 172.21.15.50:0/2705178155 reap_dead start 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ed021a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c024e40 tx=0x7f7b7c00f3f0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 shutdown_connections 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2705178155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecfadb0 0x55b33ed021a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 >> 172.21.15.50:0/2705178155 conn(0x55b33ecf70d0 msgr2=0x55b33ecf4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 shutdown_connections 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2705178155 wait complete. 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2518200705 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a64036950 msgr2=0x7f7a64038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2518200705 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a64036950 0x7f7a64038e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55b33ecd7490 tx=0x7f7b80005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 -- 172.21.15.50:0/2518200705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecedea0 msgr2=0x55b33ecee2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.432+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2518200705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecedea0 0x55b33ecee2c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0016f0 tx=0x7f7b7c00db20 comp rx=0 tx=0).stop 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/2518200705 shutdown_connections 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2518200705 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a64036950 0x7f7a64038e10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 --2- 172.21.15.50:0/2518200705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ecedea0 0x55b33ecee2c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/2518200705 >> 172.21.15.50:0/2518200705 conn(0x55b33ece1f40 msgr2=0x55b33ece2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/2518200705 shutdown_connections 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/2518200705 wait complete. 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b33ecdce20 msgr2=0x55b33ecdf2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55b33ecdce20 0x55b33ecdf2b0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ebd4540 msgr2=0x55b33ecd6600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55b33ebd4540 0x55b33ecd6600 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ecd8ee0 msgr2=0x55b33ecdb2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55b33ecd8ee0 0x55b33ecdb2d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a74036900 msgr2=0x7f7a74038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7a74036900 0x7f7a74038dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7b80054000 tx=0x7f7b8004e000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 msgr2=0x55b33eccf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 --2- 172.21.15.50:0/657832899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b33ebd2a00 0x55b33eccf3c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00b700 tx=0x7f7b7c000bc0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8c905640 1 -- 172.21.15.50:0/657832899 reap_dead start 2024-05-07T13:57:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 shutdown_connections 2024-05-07T13:57:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 >> 172.21.15.50:0/657832899 conn(0x55b33ebce5c0 msgr2=0x55b33ecc1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 shutdown_connections 2024-05-07T13:57:08.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.433+0000 7f7b8e605800 1 -- 172.21.15.50:0/657832899 wait complete. 2024-05-07T13:57:08.430 INFO:teuthology.orchestra.run.smithi050.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-05-07T13:57:08.430 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-05-07T13:57:08.430 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-07T13:57:08.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-07T13:57:08.430 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-05-07T13:57:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:08.478 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:08.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.491+0000 7f331bc87800 1 Processor -- start 2024-05-07T13:57:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f331bc87800 1 -- start start 2024-05-07T13:57:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f331bc87800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56210921b5f0 0x56210921ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f331bc87800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56210921c090 con 0x56210921a2b0 2024-05-07T13:57:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f331bc87800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5621090ac050 con 0x56210921b5f0 2024-05-07T13:57:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f3319786640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56210921b5f0 0x56210921ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f3319786640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56210921b5f0 0x56210921ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46432/0 (socket says 172.21.15.50:46432) 2024-05-07T13:57:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f3318f85640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x56210921a2b0 0x56210921a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:38400/0 (socket says 172.21.15.50:38400) 2024-05-07T13:57:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f3319786640 1 -- 172.21.15.50:0/3613577296 learned_addr learned my addr 172.21.15.50:0/3613577296 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f3319786640 1 -- 172.21.15.50:0/3613577296 >> v1:172.21.15.22:6789/0 conn(0x56210921a2b0 legacy=0x56210921a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.492+0000 7f3319786640 1 -- 172.21.15.50:0/3613577296 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56210921ae70 con 0x56210921b5f0 2024-05-07T13:57:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.494+0000 7f3319786640 1 --2- 172.21.15.50:0/3613577296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921b5f0 0x56210921ba10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f330c00a520 tx=0x7f330c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acb5ae7ce4f6963 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.494+0000 7f330bfff640 1 -- 172.21.15.50:0/3613577296 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c057070 con 0x56210921b5f0 2024-05-07T13:57:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.494+0000 7f330bfff640 1 -- 172.21.15.50:0/3613577296 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c052570 con 0x56210921b5f0 2024-05-07T13:57:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.494+0000 7f330bfff640 1 -- 172.21.15.50:0/3613577296 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c04ae60 con 0x56210921b5f0 2024-05-07T13:57:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.495+0000 7f331bc87800 1 -- 172.21.15.50:0/3613577296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921b5f0 msgr2=0x56210921ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.495+0000 7f331bc87800 1 --2- 172.21.15.50:0/3613577296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921b5f0 0x56210921ba10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f330c00a520 tx=0x7f330c01d010 comp rx=0 tx=0).stop 2024-05-07T13:57:08.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.495+0000 7f331bc87800 1 -- 172.21.15.50:0/3613577296 shutdown_connections 2024-05-07T13:57:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.495+0000 7f331bc87800 1 --2- 172.21.15.50:0/3613577296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921b5f0 0x56210921ba10 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.495+0000 7f331bc87800 1 -- 172.21.15.50:0/3613577296 >> 172.21.15.50:0/3613577296 conn(0x562109214d40 msgr2=0x562109217160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.495+0000 7f331bc87800 1 -- 172.21.15.50:0/3613577296 shutdown_connections 2024-05-07T13:57:08.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.495+0000 7f331bc87800 1 -- 172.21.15.50:0/3613577296 wait complete. 2024-05-07T13:57:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.510+0000 7f331bc87800 1 Processor -- start 2024-05-07T13:57:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.510+0000 7f331bc87800 1 -- start start 2024-05-07T13:57:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.510+0000 7f331bc87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109219ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.510+0000 7f331bc87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5621091661c0 con 0x56210921a2b0 2024-05-07T13:57:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.511+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109219ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.511+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109219ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46442/0 (socket says 172.21.15.50:46442) 2024-05-07T13:57:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.511+0000 7f3319786640 1 -- 172.21.15.50:0/949751365 learned_addr learned my addr 172.21.15.50:0/949751365 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.511+0000 7f3319786640 1 -- 172.21.15.50:0/949751365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56210930f670 con 0x56210921a2b0 2024-05-07T13:57:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.511+0000 7f3319786640 1 --2- 172.21.15.50:0/949751365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109219ce0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f330c055040 tx=0x7f330c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb558fb76f4cd60 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.511+0000 7f3207606640 1 -- 172.21.15.50:0/949751365 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c057040 con 0x56210921a2b0 2024-05-07T13:57:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.511+0000 7f3207606640 1 -- 172.21.15.50:0/949751365 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c052720 con 0x56210921a2b0 2024-05-07T13:57:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.511+0000 7f3207606640 1 -- 172.21.15.50:0/949751365 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c052a40 con 0x56210921a2b0 2024-05-07T13:57:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 -- 172.21.15.50:0/949751365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 msgr2=0x562109219ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 --2- 172.21.15.50:0/949751365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109219ce0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f330c055040 tx=0x7f330c04c000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 -- 172.21.15.50:0/949751365 shutdown_connections 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 --2- 172.21.15.50:0/949751365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109219ce0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 -- 172.21.15.50:0/949751365 >> 172.21.15.50:0/949751365 conn(0x562109214d40 msgr2=0x562109307160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 -- 172.21.15.50:0/949751365 shutdown_connections 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 -- 172.21.15.50:0/949751365 wait complete. 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 Processor -- start 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 -- start start 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109314350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.512+0000 7f331bc87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5621092237c0 con 0x56210921a2b0 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.513+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109314350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.513+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109314350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46450/0 (socket says 172.21.15.50:46450) 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.513+0000 7f3319786640 1 -- 172.21.15.50:0/859835880 learned_addr learned my addr 172.21.15.50:0/859835880 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.513+0000 7f3319786640 1 -- 172.21.15.50:0/859835880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562109314890 con 0x56210921a2b0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.513+0000 7f3319786640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109314350 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f330c000c00 tx=0x7f330c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.513+0000 7f3205e03640 1 -- 172.21.15.50:0/859835880 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c073070 con 0x56210921a2b0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.513+0000 7f3205e03640 1 -- 172.21.15.50:0/859835880 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c052cd0 con 0x56210921a2b0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.513+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562109314b20 con 0x56210921a2b0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.514+0000 7f3205e03640 1 -- 172.21.15.50:0/859835880 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c057070 con 0x56210921a2b0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.514+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621093177d0 con 0x56210921a2b0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.514+0000 7f3205e03640 1 -- 172.21.15.50:0/859835880 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f330c076070 con 0x56210921a2b0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.515+0000 7f3205e03640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3200036900 0x7f3200038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.515+0000 7f3205e03640 1 -- 172.21.15.50:0/859835880 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f330c08dc00 con 0x56210921a2b0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.515+0000 7f3318f85640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3200036900 0x7f3200038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.515+0000 7f331bc87800 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56210921b5f0 0x56210931b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.515+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210931bb10 con 0x56210921b5f0 2024-05-07T13:57:08.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.515+0000 7f3319f87640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56210921b5f0 0x56210931b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.515+0000 7f3318f85640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3200036900 0x7f3200038dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3310000f60 tx=0x7f3310001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.515+0000 7f3319f87640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56210921b5f0 0x56210931b590 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.515+0000 7f3319f87640 1 -- 172.21.15.50:0/859835880 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x56210921b5f0 2024-05-07T13:57:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.516+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562109318b60 con 0x56210921b5f0 2024-05-07T13:57:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.516+0000 7f3319f87640 1 -- 172.21.15.50:0/859835880 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f331400a4a0 con 0x56210921b5f0 2024-05-07T13:57:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.516+0000 7f331bc87800 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56210931de40 0x562109320230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.516+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562109320920 con 0x56210931de40 2024-05-07T13:57:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.516+0000 7f3319786640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56210931de40 0x562109320230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.516+0000 7f3319786640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56210931de40 0x562109320230 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.517+0000 7f3319786640 1 -- 172.21.15.50:0/859835880 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f330c075030 con 0x56210931de40 2024-05-07T13:57:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.517+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210931cdf0 con 0x56210921b5f0 2024-05-07T13:57:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.517+0000 7f3319f87640 1 -- 172.21.15.50:0/859835880 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f331400a4a0 con 0x56210921b5f0 2024-05-07T13:57:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.517+0000 7f331bc87800 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562109321dd0 0x562109324220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.517+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562109324980 con 0x562109321dd0 2024-05-07T13:57:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.517+0000 7f3318f85640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562109321dd0 0x562109324220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.518+0000 7f3318f85640 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562109321dd0 0x562109324220 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.518+0000 7f3318f85640 1 -- 172.21.15.50:0/859835880 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f331000f690 con 0x562109321dd0 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.518+0000 7f331bc87800 1 Processor -- start 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.518+0000 7f331bc87800 1 -- start start 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f331bc87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562109332de0 0x562109333200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f331bc87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56210910ccf0 con 0x562109332de0 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562109332de0 0x562109333200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562109332de0 0x562109333200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46464/0 (socket says 172.21.15.50:46464) 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f3319786640 1 -- 172.21.15.50:0/1879980128 learned_addr learned my addr 172.21.15.50:0/1879980128 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f3319786640 1 -- 172.21.15.50:0/1879980128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562109333740 con 0x562109332de0 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f3319786640 1 --2- 172.21.15.50:0/1879980128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562109332de0 0x562109333200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f330c0823f0 tx=0x7f330c077980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f31feffd640 1 -- 172.21.15.50:0/1879980128 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c091020 con 0x562109332de0 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f31feffd640 1 -- 172.21.15.50:0/1879980128 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c076c80 con 0x562109332de0 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.519+0000 7f31feffd640 1 -- 172.21.15.50:0/1879980128 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c0766f0 con 0x562109332de0 2024-05-07T13:57:08.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.520+0000 7f331bc87800 1 -- 172.21.15.50:0/1879980128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621093341b0 con 0x562109332de0 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.520+0000 7f331bc87800 1 -- 172.21.15.50:0/1879980128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621093346b0 con 0x562109332de0 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.520+0000 7f31feffd640 1 -- 172.21.15.50:0/1879980128 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f330c076890 con 0x562109332de0 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.520+0000 7f31feffd640 1 --2- 172.21.15.50:0/1879980128 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31f0036950 0x7f31f0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.520+0000 7f31feffd640 1 -- 172.21.15.50:0/1879980128 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f330c08a050 con 0x562109332de0 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.520+0000 7f3318f85640 1 --2- 172.21.15.50:0/1879980128 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31f0036950 0x7f31f0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.521+0000 7f331bc87800 1 Processor -- start 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.521+0000 7f331bc87800 1 -- start start 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.521+0000 7f3318f85640 1 --2- 172.21.15.50:0/1879980128 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31f0036950 0x7f31f0038e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x56210931c3f0 tx=0x7f331000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.521+0000 7f331bc87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x56210930d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.521+0000 7f331bc87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56210930f900 con 0x56210930cc50 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.521+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x56210930d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.521+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x56210930d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46468/0 (socket says 172.21.15.50:46468) 2024-05-07T13:57:08.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.521+0000 7f3319786640 1 -- 172.21.15.50:0/2155257497 learned_addr learned my addr 172.21.15.50:0/2155257497 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.522+0000 7f3319786640 1 -- 172.21.15.50:0/2155257497 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56210930b450 con 0x56210930cc50 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.522+0000 7f3319786640 1 --2- 172.21.15.50:0/2155257497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x56210930d070 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f330c08a4e0 tx=0x7f330c06e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea99e427103fab0d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.522+0000 7f31fcff9640 1 -- 172.21.15.50:0/2155257497 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c08d9b0 con 0x56210930cc50 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.522+0000 7f31fcff9640 1 -- 172.21.15.50:0/2155257497 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c0a6070 con 0x56210930cc50 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.522+0000 7f31fcff9640 1 -- 172.21.15.50:0/2155257497 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c077a90 con 0x56210930cc50 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.522+0000 7f331bc87800 1 -- 172.21.15.50:0/2155257497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 msgr2=0x56210930d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.522+0000 7f331bc87800 1 --2- 172.21.15.50:0/2155257497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x56210930d070 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f330c08a4e0 tx=0x7f330c06e880 comp rx=0 tx=0).stop 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f331bc87800 1 -- 172.21.15.50:0/2155257497 shutdown_connections 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f331bc87800 1 --2- 172.21.15.50:0/2155257497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x56210930d070 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f331bc87800 1 -- 172.21.15.50:0/2155257497 >> 172.21.15.50:0/2155257497 conn(0x56210933c280 msgr2=0x56210933a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f331bc87800 1 -- 172.21.15.50:0/2155257497 shutdown_connections 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f331bc87800 1 -- 172.21.15.50:0/2155257497 wait complete. 2024-05-07T13:57:08.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f331bc87800 1 Processor -- start 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f331bc87800 1 -- start start 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f331bc87800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x562109349510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f331bc87800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56210930b860 con 0x56210930cc50 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x562109349510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f3319786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x562109349510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46484/0 (socket says 172.21.15.50:46484) 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 learned_addr learned my addr 172.21.15.50:0/1837110738 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.523+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562109349a50 con 0x56210930cc50 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.524+0000 7f3319786640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x562109349510 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f330c08a4e0 tx=0x7f330c073000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.524+0000 7f31eeffd640 1 -- 172.21.15.50:0/1837110738 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c08d4d0 con 0x56210930cc50 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.524+0000 7f31eeffd640 1 -- 172.21.15.50:0/1837110738 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c05eca0 con 0x56210930cc50 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.524+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562109349a50 con 0x56210930cc50 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.524+0000 7f31eeffd640 1 -- 172.21.15.50:0/1837110738 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c088a20 con 0x56210930cc50 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.524+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562109349a50 con 0x56210930cc50 2024-05-07T13:57:08.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.525+0000 7f31eeffd640 1 -- 172.21.15.50:0/1837110738 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f330c0bb060 con 0x56210930cc50 2024-05-07T13:57:08.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.525+0000 7f31eeffd640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31e4036900 0x7f31e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.525+0000 7f31eeffd640 1 -- 172.21.15.50:0/1837110738 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f330c0acd90 con 0x56210930cc50 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.525+0000 7f3318f85640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31e4036900 0x7f31e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.525+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.525+0000 7f331bc87800 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562109354c20 0x5621093570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.525+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562109357830 con 0x562109354c20 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f3319f87640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562109354c20 0x5621093570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f3318f85640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31e4036900 0x7f31e4038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x562109324d80 tx=0x7f3310010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f3319f87640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562109354c20 0x5621093570e0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f331bc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f331bc87800 20 realm 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562109357c40 con 0x562109354c20 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f331bc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f331bc87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.526+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562109358510 con 0x562109354c20 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f331bc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f331bc87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f331bc87800 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5621093593a0 0x56210935b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210935bef0 con 0x5621093593a0 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f3319786640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5621093593a0 0x56210935b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.527+0000 7f3319786640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5621093593a0 0x56210935b790 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.528+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.528+0000 7f331bc87800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.528+0000 7f331bc87800 20 searching for the correct realm 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.528+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56210935d8d0 con 0x5621093593a0 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.528+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.528+0000 7f3319786640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f330c096020 0x7f330c088130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.528+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56210935d8d0 con 0x7f330c096020 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.528+0000 7f3318f85640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f330c096020 0x7f330c088130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.529+0000 7f3318f85640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f330c096020 0x7f330c088130 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.529+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x7f330c096020 2024-05-07T13:57:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.529+0000 7f3318f85640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f331000f070 0x7f331002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.529+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56210935d8d0 con 0x7f331000f070 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.529+0000 7f3319f87640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f331000f070 0x7f331002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.530+0000 7f3319f87640 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f331000f070 0x7f331002e910 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.530+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.530+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.530+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.530+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.530+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.530+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.531+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.531+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f331000f070 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.531+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.531+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f330c096020 2024-05-07T13:57:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.531+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x7f330c096020 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.531+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f330c096020 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.531+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x7f330c096020 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.531+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.532+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.532+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f331000f070 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.532+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.532+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.532+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.532+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f330c096020 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.533+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3310037040 con 0x7f330c096020 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.533+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x5621093593a0 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.533+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.533+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x5621093593a0 2024-05-07T13:57:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.533+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.533+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f331000f070 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.533+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.533+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x5621093593a0 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.534+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.534+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x5621093593a0 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.534+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.534+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.534+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.534+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.534+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.534+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f331000f070 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.535+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.535+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x5621093593a0 2024-05-07T13:57:08.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.535+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.535+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f330c096020 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.535+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x7f330c096020 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.535+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.535+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.535+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f331000f070 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.536+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.536+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x5621093593a0 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.536+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.536+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f331000f070 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.536+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.536+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f330c096020 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.537+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x7f330c096020 2024-05-07T13:57:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.537+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x5621093593a0 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.537+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.537+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f330c096020 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.537+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x7f330c096020 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.537+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x562109354c20 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.537+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.537+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5621093588b0 con 0x7f330c096020 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x7f330c096020 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210935c8a0 con 0x562109354c20 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210935cc90 con 0x562109354c20 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.538+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210935cc90 con 0x7f331000f070 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 20 zone default found 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 4 Realm: () 2024-05-07T13:57:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 20 zonegroup default 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210935d0b0 con 0x7f331000f070 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210935d0b0 con 0x5621093593a0 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210935f780 con 0x5621093593a0 2024-05-07T13:57:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.539+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.540+0000 7f331bc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.540+0000 7f331bc87800 20 started sync module instance, tier type = 2024-05-07T13:57:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.540+0000 7f331bc87800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.540+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56210935ec20 con 0x7f330c096020 2024-05-07T13:57:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.541+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331004a040 con 0x7f330c096020 2024-05-07T13:57:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.541+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94699888439360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56210935e880 con 0x7f330c096020 2024-05-07T13:57:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.541+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109360640 con 0x562109354c20 2024-05-07T13:57:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.542+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94699888439360] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331004a040 con 0x7f330c096020 2024-05-07T13:57:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.542+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.542+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94699888443792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109360a60 con 0x562109354c20 2024-05-07T13:57:08.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.542+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109361330 con 0x5621093593a0 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.543+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94699888443792] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.543+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.543+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94699888445328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109361720 con 0x5621093593a0 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.543+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109362170 con 0x7f330c096020 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.544+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94699888445328] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.544+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331004a040 con 0x7f330c096020 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.544+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94699888446512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109362a10 con 0x7f330c096020 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.544+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5621093633d0 con 0x562109354c20 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.545+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94699888446512] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331004a040 con 0x7f330c096020 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.546+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.546+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94699888455456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5621093637f0 con 0x562109354c20 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.546+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5621093641b0 con 0x7f331000f070 2024-05-07T13:57:08.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.547+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.547+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94699888455456] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.547+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94699888459008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109364120 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.547+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109364b60 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.548+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94699888459008] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.548+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.548+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94699888456512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109364b60 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.548+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109365520 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(58 notify.7 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94699888463984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109365980 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f331bc87800 20 add_watcher() i=0 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f331bc87800 20 add_watcher() i=1 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94699888456512] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f331bc87800 20 add_watcher() i=2 2024-05-07T13:57:08.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f331bc87800 20 add_watcher() i=3 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f331bc87800 20 add_watcher() i=4 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f331bc87800 20 add_watcher() i=5 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.549+0000 7f331bc87800 20 add_watcher() i=6 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.550+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94699888463984] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.550+0000 7f331bc87800 20 add_watcher() i=7 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.550+0000 7f331bc87800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.550+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562109364660 con 0x562109354c20 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.550+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.550+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94699888465040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109364660 con 0x562109354c20 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.551+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94699888465040] v29'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.551+0000 7f31cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.552+0000 7f331bc87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:08.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.552+0000 7f331bc87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.552+0000 7f331bc87800 5 note: GC not initialized 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.552+0000 7f31cefe5640 20 reqs_thread_entry: start 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.552+0000 7f331bc87800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.552+0000 7f331bc87800 20 Filter name: none 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.552+0000 7f31ccfe1640 20 reqs_thread_entry: start 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.552+0000 7f331bc87800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.552+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210939bb00 con 0x562109354c20 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.553+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.553+0000 7f331bc87800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.553+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56210939cef0 con 0x7f331000f070 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.553+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.554+0000 7f31cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.554+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94699888465040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109371cf0 con 0x562109354c20 2024-05-07T13:57:08.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.555+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94699888465040] v29'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.555+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94699888439360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109365490 con 0x7f330c096020 2024-05-07T13:57:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.556+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94699888439360] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331004a040 con 0x7f330c096020 2024-05-07T13:57:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.556+0000 7f331bc87800 20 remove_watcher() i=0 2024-05-07T13:57:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.556+0000 7f331bc87800 2 removed watcher, disabling cache 2024-05-07T13:57:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.556+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94699888443792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56210935f040 con 0x562109354c20 2024-05-07T13:57:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.557+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94699888443792] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.557+0000 7f331bc87800 20 remove_watcher() i=1 2024-05-07T13:57:08.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.558+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94699888445328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56210935f040 con 0x5621093593a0 2024-05-07T13:57:08.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.559+0000 7f3319786640 1 -- 172.21.15.50:0/1837110738 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94699888445328] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c093020 con 0x5621093593a0 2024-05-07T13:57:08.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.559+0000 7f331bc87800 20 remove_watcher() i=2 2024-05-07T13:57:08.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.559+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94699888446512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56210935f040 con 0x7f330c096020 2024-05-07T13:57:08.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.560+0000 7f3318f85640 1 -- 172.21.15.50:0/1837110738 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94699888446512] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331004a040 con 0x7f330c096020 2024-05-07T13:57:08.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.560+0000 7f331bc87800 20 remove_watcher() i=3 2024-05-07T13:57:08.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.560+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94699888455456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56210935f040 con 0x562109354c20 2024-05-07T13:57:08.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.561+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94699888455456] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x562109354c20 2024-05-07T13:57:08.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.561+0000 7f331bc87800 20 remove_watcher() i=4 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.561+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94699888459008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109362f20 con 0x7f331000f070 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.562+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94699888459008] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.562+0000 7f331bc87800 20 remove_watcher() i=5 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.562+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94699888456512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109362f20 con 0x7f331000f070 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.563+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94699888456512] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.563+0000 7f331bc87800 20 remove_watcher() i=6 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.563+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94699888463984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562109362f20 con 0x7f331000f070 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94699888463984] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4a0 con 0x7f331000f070 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 20 remove_watcher() i=7 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f331000f070 msgr2=0x7f331002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f331000f070 0x7f331002e910 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562109354c20 msgr2=0x5621093570e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562109354c20 0x5621093570e0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f330c096020 msgr2=0x7f330c088130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f330c096020 0x7f330c088130 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5621093593a0 msgr2=0x56210935b790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5621093593a0 0x56210935b790 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31e4036900 msgr2=0x7f31e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31e4036900 0x7f31e4038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x562109324d80 tx=0x7f3310010000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 msgr2=0x562109349510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 --2- 172.21.15.50:0/1837110738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210930cc50 0x562109349510 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f330c08a4e0 tx=0x7f330c073000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 reap_dead start 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f3319f87640 1 -- 172.21.15.50:0/1837110738 reap_dead start 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 shutdown_connections 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 >> 172.21.15.50:0/1837110738 conn(0x56210933c280 msgr2=0x5621093398e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 shutdown_connections 2024-05-07T13:57:08.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.564+0000 7f331bc87800 1 -- 172.21.15.50:0/1837110738 wait complete. 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/1879980128 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31f0036950 msgr2=0x7f31f0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 --2- 172.21.15.50:0/1879980128 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31f0036950 0x7f31f0038e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x56210931c3f0 tx=0x7f331000f000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/1879980128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562109332de0 msgr2=0x562109333200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 --2- 172.21.15.50:0/1879980128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562109332de0 0x562109333200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f330c0823f0 tx=0x7f330c077980 comp rx=0 tx=0).stop 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/1879980128 shutdown_connections 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 --2- 172.21.15.50:0/1879980128 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f31f0036950 0x7f31f0038e10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 --2- 172.21.15.50:0/1879980128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562109332de0 0x562109333200 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/1879980128 >> 172.21.15.50:0/1879980128 conn(0x562109326e80 msgr2=0x562109327280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/1879980128 shutdown_connections 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/1879980128 wait complete. 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562109321dd0 msgr2=0x562109324220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562109321dd0 0x562109324220 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56210921b5f0 msgr2=0x56210931b590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56210921b5f0 0x56210931b590 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56210931de40 msgr2=0x562109320230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56210931de40 0x562109320230 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3200036900 msgr2=0x7f3200038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3200036900 0x7f3200038dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3310000f60 tx=0x7f3310001370 comp rx=0 tx=0).stop 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 msgr2=0x562109314350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 --2- 172.21.15.50:0/859835880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56210921a2b0 0x562109314350 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f330c000c00 tx=0x7f330c003020 comp rx=0 tx=0).stop 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f3319f87640 1 -- 172.21.15.50:0/859835880 reap_dead start 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 shutdown_connections 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 >> 172.21.15.50:0/859835880 conn(0x562109214d40 msgr2=0x562109305960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 shutdown_connections 2024-05-07T13:57:08.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.565+0000 7f331bc87800 1 -- 172.21.15.50:0/859835880 wait complete. 2024-05-07T13:57:08.561 INFO:teuthology.orchestra.run.smithi050.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-05-07T13:57:08.562 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-05-07T13:57:08.562 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-07T13:57:08.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-07T13:57:08.562 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-05-07T13:57:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:08.610 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.623+0000 7f3780c1f800 1 Processor -- start 2024-05-07T13:57:08.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.623+0000 7f3780c1f800 1 -- start start 2024-05-07T13:57:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.623+0000 7f3780c1f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55fb69fc5530 0x55fb69fce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.623+0000 7f3780c1f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb69f38930 con 0x55fb69fc39f0 2024-05-07T13:57:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.623+0000 7f3780c1f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55fb69e56050 con 0x55fb69fc5530 2024-05-07T13:57:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.624+0000 7f377df1d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55fb69fc5530 0x55fb69fce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.624+0000 7f377df1d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55fb69fc5530 0x55fb69fce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46496/0 (socket says 172.21.15.50:46496) 2024-05-07T13:57:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.624+0000 7f377df1d640 1 -- 172.21.15.50:0/3463788143 learned_addr learned my addr 172.21.15.50:0/3463788143 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.624+0000 7f377df1d640 1 -- 172.21.15.50:0/3463788143 >> v1:172.21.15.22:6789/0 conn(0x55fb69fc39f0 legacy=0x55fb69fc3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.624+0000 7f377df1d640 1 -- 172.21.15.50:0/3463788143 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb69fcf580 con 0x55fb69fc5530 2024-05-07T13:57:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.626+0000 7f377df1d640 1 --2- 172.21.15.50:0/3463788143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc5530 0x55fb69fce030 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f377400a520 tx=0x7f377401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4452b298114cb49e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.626+0000 7f377d71c640 1 -- 172.21.15.50:0/3463788143 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3774057070 con 0x55fb69fc5530 2024-05-07T13:57:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.626+0000 7f377d71c640 1 -- 172.21.15.50:0/3463788143 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3774052570 con 0x55fb69fc5530 2024-05-07T13:57:08.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.626+0000 7f377d71c640 1 -- 172.21.15.50:0/3463788143 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3774052870 con 0x55fb69fc5530 2024-05-07T13:57:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.626+0000 7f3780c1f800 1 -- 172.21.15.50:0/3463788143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc5530 msgr2=0x55fb69fce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.626+0000 7f3780c1f800 1 --2- 172.21.15.50:0/3463788143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc5530 0x55fb69fce030 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f377400a520 tx=0x7f377401d010 comp rx=0 tx=0).stop 2024-05-07T13:57:08.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.627+0000 7f3780c1f800 1 -- 172.21.15.50:0/3463788143 shutdown_connections 2024-05-07T13:57:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.627+0000 7f3780c1f800 1 --2- 172.21.15.50:0/3463788143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc5530 0x55fb69fce030 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.627+0000 7f3780c1f800 1 -- 172.21.15.50:0/3463788143 >> 172.21.15.50:0/3463788143 conn(0x55fb69fbf570 msgr2=0x55fb69fc1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.627+0000 7f3780c1f800 1 -- 172.21.15.50:0/3463788143 shutdown_connections 2024-05-07T13:57:08.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.627+0000 7f3780c1f800 1 -- 172.21.15.50:0/3463788143 wait complete. 2024-05-07T13:57:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.642+0000 7f3780c1f800 1 Processor -- start 2024-05-07T13:57:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.642+0000 7f3780c1f800 1 -- start start 2024-05-07T13:57:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.642+0000 7f3780c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.642+0000 7f3780c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fb69f101c0 con 0x55fb69fc39f0 2024-05-07T13:57:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.642+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.642+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0b89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46502/0 (socket says 172.21.15.50:46502) 2024-05-07T13:57:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.642+0000 7f377e71e640 1 -- 172.21.15.50:0/2686067411 learned_addr learned my addr 172.21.15.50:0/2686067411 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.643+0000 7f377e71e640 1 -- 172.21.15.50:0/2686067411 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb6a0b8fb0 con 0x55fb69fc39f0 2024-05-07T13:57:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.643+0000 7f377e71e640 1 --2- 172.21.15.50:0/2686067411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0b89e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3770001cd0 tx=0x7f377000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50420e650077311e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.643+0000 7f366c608640 1 -- 172.21.15.50:0/2686067411 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f377000be10 con 0x55fb69fc39f0 2024-05-07T13:57:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.643+0000 7f366c608640 1 -- 172.21.15.50:0/2686067411 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377000f400 con 0x55fb69fc39f0 2024-05-07T13:57:08.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.643+0000 7f366c608640 1 -- 172.21.15.50:0/2686067411 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f377000f720 con 0x55fb69fc39f0 2024-05-07T13:57:08.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 -- 172.21.15.50:0/2686067411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 msgr2=0x55fb6a0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2686067411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0b89e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3770001cd0 tx=0x7f377000b5b0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 -- 172.21.15.50:0/2686067411 shutdown_connections 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2686067411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0b89e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 -- 172.21.15.50:0/2686067411 >> 172.21.15.50:0/2686067411 conn(0x55fb69fbf570 msgr2=0x55fb6a0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 -- 172.21.15.50:0/2686067411 shutdown_connections 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 -- 172.21.15.50:0/2686067411 wait complete. 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 Processor -- start 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 -- start start 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f3780c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fb69fce840 con 0x55fb69fc39f0 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0c0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46504/0 (socket says 172.21.15.50:46504) 2024-05-07T13:57:08.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.644+0000 7f377e71e640 1 -- 172.21.15.50:0/2608280380 learned_addr learned my addr 172.21.15.50:0/2608280380 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.645+0000 7f377e71e640 1 -- 172.21.15.50:0/2608280380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb6a0c0a90 con 0x55fb69fc39f0 2024-05-07T13:57:08.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.645+0000 7f377e71e640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0c0550 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f377000b5f0 tx=0x7f3770000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.645+0000 7f366ae05640 1 -- 172.21.15.50:0/2608280380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f377001a7c0 con 0x55fb69fc39f0 2024-05-07T13:57:08.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.645+0000 7f366ae05640 1 -- 172.21.15.50:0/2608280380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377001a960 con 0x55fb69fc39f0 2024-05-07T13:57:08.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.645+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb6a0c0d20 con 0x55fb69fc39f0 2024-05-07T13:57:08.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.645+0000 7f366ae05640 1 -- 172.21.15.50:0/2608280380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f377001ac60 con 0x55fb69fc39f0 2024-05-07T13:57:08.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.645+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6a0c39d0 con 0x55fb69fc39f0 2024-05-07T13:57:08.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.646+0000 7f366ae05640 1 -- 172.21.15.50:0/2608280380 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3770017070 con 0x55fb69fc39f0 2024-05-07T13:57:08.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.646+0000 7f366ae05640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3664036900 0x7f3664038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.646+0000 7f366ae05640 1 -- 172.21.15.50:0/2608280380 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3770015020 con 0x55fb69fc39f0 2024-05-07T13:57:08.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.646+0000 7f377df1d640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3664036900 0x7f3664038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.646+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb69fc5530 0x55fb6a0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.646+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a0c7d60 con 0x55fb69fc5530 2024-05-07T13:57:08.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.647+0000 7f377ef1f640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb69fc5530 0x55fb6a0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.647+0000 7f377df1d640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3664036900 0x7f3664038dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3774054000 tx=0x7f377404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.647+0000 7f377ef1f640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb69fc5530 0x55fb6a0c7790 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.647+0000 7f377ef1f640 1 -- 172.21.15.50:0/2608280380 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb69fc5530 2024-05-07T13:57:08.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.647+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a0c4d60 con 0x55fb69fc5530 2024-05-07T13:57:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.647+0000 7f377ef1f640 1 -- 172.21.15.50:0/2608280380 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb69fc5530 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.648+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a0ca090 0x55fb6a0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.648+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a0ccb70 con 0x55fb6a0ca090 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.648+0000 7f377e71e640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a0ca090 0x55fb6a0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.648+0000 7f377e71e640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a0ca090 0x55fb6a0cc480 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.648+0000 7f377e71e640 1 -- 172.21.15.50:0/2608280380 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f377002e070 con 0x55fb6a0ca090 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.648+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a0c9040 con 0x55fb69fc5530 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.649+0000 7f377ef1f640 1 -- 172.21.15.50:0/2608280380 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb69fc5530 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.649+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55fb6a0ce020 0x55fb6a0d0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.649+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a0d0bd0 con 0x55fb6a0ce020 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.649+0000 7f377df1d640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55fb6a0ce020 0x55fb6a0d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.649+0000 7f377df1d640 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55fb6a0ce020 0x55fb6a0d0470 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.650+0000 7f377df1d640 1 -- 172.21.15.50:0/2608280380 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f377405a040 con 0x55fb6a0ce020 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.650+0000 7f3780c1f800 1 Processor -- start 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.650+0000 7f3780c1f800 1 -- start start 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.650+0000 7f3780c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0df030 0x55fb6a0df450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.650+0000 7f3780c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fb69eb6cf0 con 0x55fb6a0df030 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.650+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0df030 0x55fb6a0df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.650+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0df030 0x55fb6a0df450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46508/0 (socket says 172.21.15.50:46508) 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.650+0000 7f377e71e640 1 -- 172.21.15.50:0/700958402 learned_addr learned my addr 172.21.15.50:0/700958402 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.651+0000 7f377e71e640 1 -- 172.21.15.50:0/700958402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb6a0df990 con 0x55fb6a0df030 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.651+0000 7f377e71e640 1 --2- 172.21.15.50:0/700958402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0df030 0x55fb6a0df450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f37700012d0 tx=0x7f3770017e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.651+0000 7f3663fff640 1 -- 172.21.15.50:0/700958402 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3770035070 con 0x55fb6a0df030 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.651+0000 7f3663fff640 1 -- 172.21.15.50:0/700958402 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377000ed60 con 0x55fb6a0df030 2024-05-07T13:57:08.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.651+0000 7f3780c1f800 1 -- 172.21.15.50:0/700958402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb6a0e0400 con 0x55fb6a0df030 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.651+0000 7f3663fff640 1 -- 172.21.15.50:0/700958402 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f377001c580 con 0x55fb6a0df030 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.651+0000 7f3780c1f800 1 -- 172.21.15.50:0/700958402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6a0e0400 con 0x55fb6a0df030 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.652+0000 7f3663fff640 1 -- 172.21.15.50:0/700958402 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f377000e070 con 0x55fb6a0df030 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.652+0000 7f3663fff640 1 --2- 172.21.15.50:0/700958402 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3658036900 0x7f3658038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.652+0000 7f3663fff640 1 -- 172.21.15.50:0/700958402 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3770038020 con 0x55fb6a0df030 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.652+0000 7f377df1d640 1 --2- 172.21.15.50:0/700958402 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3658036900 0x7f3658038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.652+0000 7f3780c1f800 1 Processor -- start 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.652+0000 7f3780c1f800 1 -- start start 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.652+0000 7f377df1d640 1 --2- 172.21.15.50:0/700958402 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3658036900 0x7f3658038dc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55fb6a0c8640 tx=0x7f3774005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.652+0000 7f3780c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0ec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.652+0000 7f3780c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fb6a0b9330 con 0x55fb6a0ec050 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.653+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.653+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0ec430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46510/0 (socket says 172.21.15.50:46510) 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.653+0000 7f377e71e640 1 -- 172.21.15.50:0/381791085 learned_addr learned my addr 172.21.15.50:0/381791085 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.653+0000 7f377e71e640 1 -- 172.21.15.50:0/381791085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb6a0eca00 con 0x55fb6a0ec050 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.653+0000 7f377e71e640 1 --2- 172.21.15.50:0/381791085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0ec430 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f377003f190 tx=0x7f37700318c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e2e16c0ef2d606 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.653+0000 7f3661ffb640 1 -- 172.21.15.50:0/381791085 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f377003ee60 con 0x55fb6a0ec050 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.653+0000 7f3661ffb640 1 -- 172.21.15.50:0/381791085 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3770031c60 con 0x55fb6a0ec050 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.653+0000 7f3661ffb640 1 -- 172.21.15.50:0/381791085 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3770010df0 con 0x55fb6a0ec050 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 -- 172.21.15.50:0/381791085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 msgr2=0x55fb6a0ec430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 --2- 172.21.15.50:0/381791085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0ec430 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f377003f190 tx=0x7f37700318c0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 -- 172.21.15.50:0/381791085 shutdown_connections 2024-05-07T13:57:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 --2- 172.21.15.50:0/381791085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0ec430 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 -- 172.21.15.50:0/381791085 >> 172.21.15.50:0/381791085 conn(0x55fb6a0e8320 msgr2=0x55fb6a0e6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 -- 172.21.15.50:0/381791085 shutdown_connections 2024-05-07T13:57:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 -- 172.21.15.50:0/381791085 wait complete. 2024-05-07T13:57:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 Processor -- start 2024-05-07T13:57:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 -- start start 2024-05-07T13:57:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.654+0000 7f3780c1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fb6a0ed110 con 0x55fb6a0ec050 2024-05-07T13:57:08.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f377e71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46522/0 (socket says 172.21.15.50:46522) 2024-05-07T13:57:08.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 learned_addr learned my addr 172.21.15.50:0/79480508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb6a0f38d0 con 0x55fb6a0ec050 2024-05-07T13:57:08.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f377e71e640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0f3390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3770010d70 tx=0x7f377001e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f364ffff640 1 -- 172.21.15.50:0/79480508 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37700492a0 con 0x55fb6a0ec050 2024-05-07T13:57:08.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f364ffff640 1 -- 172.21.15.50:0/79480508 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3770042d70 con 0x55fb6a0ec050 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f364ffff640 1 -- 172.21.15.50:0/79480508 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3770044590 con 0x55fb6a0ec050 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb6a0f38d0 con 0x55fb6a0ec050 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.655+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6a0f38d0 con 0x55fb6a0ec050 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.656+0000 7f364ffff640 1 -- 172.21.15.50:0/79480508 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f377006d070 con 0x55fb6a0ec050 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.656+0000 7f364ffff640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3648036860 0x7f3648038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.656+0000 7f364ffff640 1 -- 172.21.15.50:0/79480508 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3770071d40 con 0x55fb6a0ec050 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.656+0000 7f377df1d640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3648036860 0x7f3648038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.657+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.657+0000 7f3780c1f800 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb6a0fe9b0 0x55fb6a100e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.657+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a1015c0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.657+0000 7f377ef1f640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb6a0fe9b0 0x55fb6a100e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.657+0000 7f377df1d640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3648036860 0x7f3648038d20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3774052bb0 tx=0x7f377404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.657+0000 7f377ef1f640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb6a0fe9b0 0x55fb6a100e70 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 20 realm 2024-05-07T13:57:08.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a1019d0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a1022a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a102640 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a103130 0x55fb6a105520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a105c80 con 0x55fb6a103130 2024-05-07T13:57:08.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.658+0000 7f377e71e640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a103130 0x55fb6a105520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.659+0000 7f377e71e640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a103130 0x55fb6a105520 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.659+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.659+0000 7f3780c1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:08.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.659+0000 7f3780c1f800 20 searching for the correct realm 2024-05-07T13:57:08.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.659+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a107660 con 0x55fb6a103130 2024-05-07T13:57:08.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.659+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.659+0000 7f377e71e640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3770056070 0x7f377001e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.659+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a107660 con 0x7f3770056070 2024-05-07T13:57:08.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.660+0000 7f377df1d640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3770056070 0x7f377001e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.660+0000 7f377df1d640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3770056070 0x7f377001e810 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.660+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.660+0000 7f377df1d640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3774074040 0x7f3774081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.660+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a107660 con 0x7f3774074040 2024-05-07T13:57:08.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.661+0000 7f377ef1f640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3774074040 0x7f3774081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.661+0000 7f377ef1f640 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3774074040 0x7f3774081410 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.661+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.661+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a102640 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.661+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.661+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a102640 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.662+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.662+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a102640 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.662+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.662+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a102640 con 0x7f3774074040 2024-05-07T13:57:08.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.662+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.662+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a102640 con 0x7f3770056070 2024-05-07T13:57:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.662+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.662+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a102640 con 0x7f3770056070 2024-05-07T13:57:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.663+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.663+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.663+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.663+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3774074040 2024-05-07T13:57:08.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.663+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.663+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.663+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.663+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3770056070 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.664+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.664+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a103130 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.664+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.664+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a103130 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.664+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.664+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3774074040 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a103130 2024-05-07T13:57:08.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a103130 2024-05-07T13:57:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.665+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3774074040 2024-05-07T13:57:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.666+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.666+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a103130 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.666+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.666+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3770056070 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.666+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.666+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.666+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.666+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3774074040 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.667+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.667+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a103130 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.667+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.667+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3774074040 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.667+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.667+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3770056070 2024-05-07T13:57:08.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.668+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.668+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a103130 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.668+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.668+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3770056070 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.668+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.668+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.668+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.668+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f377408e040 con 0x7f3770056070 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:08.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a106630 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a106a20 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.669+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a106a20 con 0x7f3774074040 2024-05-07T13:57:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 20 zone default found 2024-05-07T13:57:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 4 Realm: () 2024-05-07T13:57:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:08.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 20 zonegroup default 2024-05-07T13:57:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a106e40 con 0x7f3774074040 2024-05-07T13:57:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a106e40 con 0x55fb6a103130 2024-05-07T13:57:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.670+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a109510 con 0x55fb6a103130 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.671+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.671+0000 7f3780c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.671+0000 7f3780c1f800 20 started sync module instance, tier type = 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.671+0000 7f3780c1f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.671+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a1089b0 con 0x7f3770056070 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.672+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.672+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94538304622032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a109d60 con 0x7f3770056070 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.672+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10a5b0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.673+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94538304622032] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.673+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.673+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94538304624816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10a610 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.673+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10b120 con 0x55fb6a103130 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.674+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94538304624816] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.674+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.674+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94538304629712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10b0e0 con 0x55fb6a103130 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.674+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10bbb0 con 0x7f3770056070 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.675+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94538304629712] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.675+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.675+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94538304632544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10bfa0 con 0x7f3770056070 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.675+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10c9c0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.676+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.677+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94538304636080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10c980 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.677+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10d980 con 0x7f3774074040 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.677+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94538304632544] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.678+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.678+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94538304626944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10d980 con 0x7f3774074040 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.678+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10e390 con 0x7f3774074040 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.678+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94538304636080] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.679+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94538304626944] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.679+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.679+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94538304640128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10dee0 con 0x7f3774074040 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.679+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10e8a0 con 0x7f3774074040 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(58 notify.7 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94538304640128] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94538304644080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10ecc0 con 0x7f3774074040 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f3780c1f800 20 add_watcher() i=0 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f3780c1f800 20 add_watcher() i=1 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f3780c1f800 20 add_watcher() i=2 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f3780c1f800 20 add_watcher() i=3 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f3780c1f800 20 add_watcher() i=4 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f3780c1f800 20 add_watcher() i=5 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.680+0000 7f3780c1f800 20 add_watcher() i=6 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.681+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94538304644080] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.681+0000 7f3780c1f800 20 add_watcher() i=7 2024-05-07T13:57:08.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.681+0000 7f3780c1f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:08.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.681+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a111cf0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.681+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.681+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94538304645136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10f110 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.682+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94538304645136] v29'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.682+0000 7f3634fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f3780c1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f3780c1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f3780c1f800 5 note: GC not initialized 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f35af7fe640 20 reqs_thread_entry: start 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f3780c1f800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f3780c1f800 20 Filter name: none 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f35ad7fa640 20 reqs_thread_entry: start 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f3780c1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a144b50 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.683+0000 7f3780c1f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.684+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a145f40 con 0x7f3774074040 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.684+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.685+0000 7f3634fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.685+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94538304645136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a0fb210 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.686+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94538304645136] v29'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.686+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94538304622032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10e810 con 0x7f3770056070 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.687+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94538304622032] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.687+0000 7f3780c1f800 20 remove_watcher() i=0 2024-05-07T13:57:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.687+0000 7f3780c1f800 2 removed watcher, disabling cache 2024-05-07T13:57:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.687+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94538304624816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10e810 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.688+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94538304624816] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.688+0000 7f3780c1f800 20 remove_watcher() i=1 2024-05-07T13:57:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.688+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94538304629712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a1098b0 con 0x55fb6a103130 2024-05-07T13:57:08.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.689+0000 7f377e71e640 1 -- 172.21.15.50:0/79480508 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94538304629712] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3770076020 con 0x55fb6a103130 2024-05-07T13:57:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.689+0000 7f3780c1f800 20 remove_watcher() i=2 2024-05-07T13:57:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.689+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94538304632544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10e810 con 0x7f3770056070 2024-05-07T13:57:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.690+0000 7f377df1d640 1 -- 172.21.15.50:0/79480508 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94538304632544] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377407f070 con 0x7f3770056070 2024-05-07T13:57:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.691+0000 7f3780c1f800 20 remove_watcher() i=3 2024-05-07T13:57:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.691+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94538304636080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10abd0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.692+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94538304636080] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x55fb6a0fe9b0 2024-05-07T13:57:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.692+0000 7f3780c1f800 20 remove_watcher() i=4 2024-05-07T13:57:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.692+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94538304626944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10b6e0 con 0x7f3774074040 2024-05-07T13:57:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.693+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94538304626944] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.693+0000 7f3780c1f800 20 remove_watcher() i=5 2024-05-07T13:57:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.693+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94538304640128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10e810 con 0x7f3774074040 2024-05-07T13:57:08.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.694+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94538304640128] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.694+0000 7f3780c1f800 20 remove_watcher() i=6 2024-05-07T13:57:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.694+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94538304644080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fb6a10abd0 con 0x7f3774074040 2024-05-07T13:57:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94538304644080] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f377800a4a0 con 0x7f3774074040 2024-05-07T13:57:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 20 remove_watcher() i=7 2024-05-07T13:57:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3774074040 msgr2=0x7f3774081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3774074040 0x7f3774081410 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb6a0fe9b0 msgr2=0x55fb6a100e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb6a0fe9b0 0x55fb6a100e70 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3770056070 msgr2=0x7f377001e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3770056070 0x7f377001e810 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a103130 msgr2=0x55fb6a105520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a103130 0x55fb6a105520 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3648036860 msgr2=0x7f3648038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3648036860 0x7f3648038d20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3774052bb0 tx=0x7f377404f000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 msgr2=0x55fb6a0f3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 --2- 172.21.15.50:0/79480508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0ec050 0x55fb6a0f3390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3770010d70 tx=0x7f377001e4c0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 reap_dead start 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f377ef1f640 1 -- 172.21.15.50:0/79480508 reap_dead start 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 shutdown_connections 2024-05-07T13:57:08.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 >> 172.21.15.50:0/79480508 conn(0x55fb6a0e8320 msgr2=0x55fb6a0e5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 shutdown_connections 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.695+0000 7f3780c1f800 1 -- 172.21.15.50:0/79480508 wait complete. 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/700958402 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3658036900 msgr2=0x7f3658038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 --2- 172.21.15.50:0/700958402 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3658036900 0x7f3658038dc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55fb6a0c8640 tx=0x7f3774005ac0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/700958402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0df030 msgr2=0x55fb6a0df450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 --2- 172.21.15.50:0/700958402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0df030 0x55fb6a0df450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f37700012d0 tx=0x7f3770017e80 comp rx=0 tx=0).stop 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/700958402 shutdown_connections 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 --2- 172.21.15.50:0/700958402 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3658036900 0x7f3658038dc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 --2- 172.21.15.50:0/700958402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb6a0df030 0x55fb6a0df450 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/700958402 >> 172.21.15.50:0/700958402 conn(0x55fb6a0d30d0 msgr2=0x55fb6a0d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/700958402 shutdown_connections 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/700958402 wait complete. 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55fb6a0ce020 msgr2=0x55fb6a0d0470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55fb6a0ce020 0x55fb6a0d0470 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb69fc5530 msgr2=0x55fb6a0c7790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55fb69fc5530 0x55fb6a0c7790 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a0ca090 msgr2=0x55fb6a0cc480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55fb6a0ca090 0x55fb6a0cc480 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3664036900 msgr2=0x7f3664038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3664036900 0x7f3664038dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3774054000 tx=0x7f377404e000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 msgr2=0x55fb6a0c0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 --2- 172.21.15.50:0/2608280380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fb69fc39f0 0x55fb6a0c0550 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f377000b5f0 tx=0x7f3770000bc0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f377ef1f640 1 -- 172.21.15.50:0/2608280380 reap_dead start 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 shutdown_connections 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 >> 172.21.15.50:0/2608280380 conn(0x55fb69fbf570 msgr2=0x55fb6a0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 shutdown_connections 2024-05-07T13:57:08.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.696+0000 7f3780c1f800 1 -- 172.21.15.50:0/2608280380 wait complete. 2024-05-07T13:57:08.714 INFO:teuthology.orchestra.run.smithi050.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-05-07T13:57:08.715 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-05-07T13:57:08.715 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-07T13:57:08.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-07T13:57:08.715 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-05-07T13:57:08.762 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.776+0000 7f85f9e12800 1 Processor -- start 2024-05-07T13:57:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.776+0000 7f85f9e12800 1 -- start start 2024-05-07T13:57:08.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.776+0000 7f85f9e12800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a736eee470 0x55a736ef0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.776+0000 7f85f9e12800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a736ef0e30 con 0x55a736ee9fe0 2024-05-07T13:57:08.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.776+0000 7f85f9e12800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55a736d7c050 con 0x55a736eee470 2024-05-07T13:57:08.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.776+0000 7f85effff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a736eee470 0x55a736ef0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.776+0000 7f85f555c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55a736ee9fe0 0x55a736eea400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:38426/0 (socket says 172.21.15.50:38426) 2024-05-07T13:57:08.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.776+0000 7f85f555c640 1 -- 172.21.15.50:0/2971155577 learned_addr learned my addr 172.21.15.50:0/2971155577 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:08.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.777+0000 7f85effff640 1 -- 172.21.15.50:0/2971155577 >> v1:172.21.15.22:6789/0 conn(0x55a736ee9fe0 legacy=0x55a736eea400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.777+0000 7f85effff640 1 -- 172.21.15.50:0/2971155577 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a736ef2060 con 0x55a736eee470 2024-05-07T13:57:08.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85effff640 1 --2- 172.21.15.50:0/2971155577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736eee470 0x55a736ef0860 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f85e000a470 tx=0x7f85e001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f11d6a71c012b09 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f4d5b640 1 -- 172.21.15.50:0/2971155577 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e0057070 con 0x55a736eee470 2024-05-07T13:57:08.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f4d5b640 1 -- 172.21.15.50:0/2971155577 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e0052570 con 0x55a736eee470 2024-05-07T13:57:08.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f4d5b640 1 -- 172.21.15.50:0/2971155577 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e0052870 con 0x55a736eee470 2024-05-07T13:57:08.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f9e12800 1 -- 172.21.15.50:0/2971155577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736eee470 msgr2=0x55a736ef0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f9e12800 1 --2- 172.21.15.50:0/2971155577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736eee470 0x55a736ef0860 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f85e000a470 tx=0x7f85e001ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:08.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f9e12800 1 -- 172.21.15.50:0/2971155577 shutdown_connections 2024-05-07T13:57:08.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f9e12800 1 --2- 172.21.15.50:0/2971155577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736eee470 0x55a736ef0860 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f9e12800 1 -- 172.21.15.50:0/2971155577 >> 172.21.15.50:0/2971155577 conn(0x55a736ee55c0 msgr2=0x55a736ee79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f9e12800 1 -- 172.21.15.50:0/2971155577 shutdown_connections 2024-05-07T13:57:08.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.779+0000 7f85f9e12800 1 -- 172.21.15.50:0/2971155577 wait complete. 2024-05-07T13:57:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.794+0000 7f85f9e12800 1 Processor -- start 2024-05-07T13:57:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.795+0000 7f85f9e12800 1 -- start start 2024-05-07T13:57:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.795+0000 7f85f9e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fdc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.795+0000 7f85f9e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a736e361c0 con 0x55a736ee9fe0 2024-05-07T13:57:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.795+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fdc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.795+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fdc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46530/0 (socket says 172.21.15.50:46530) 2024-05-07T13:57:08.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.795+0000 7f85f555c640 1 -- 172.21.15.50:0/1038192820 learned_addr learned my addr 172.21.15.50:0/1038192820 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.795+0000 7f85f555c640 1 -- 172.21.15.50:0/1038192820 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a736fdccc0 con 0x55a736ee9fe0 2024-05-07T13:57:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.795+0000 7f85f555c640 1 --2- 172.21.15.50:0/1038192820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fdc6f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f85e8001d80 tx=0x7f85e8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630ec13aaf267843 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.796+0000 7f84e3606640 1 -- 172.21.15.50:0/1038192820 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8013030 con 0x55a736ee9fe0 2024-05-07T13:57:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.796+0000 7f84e3606640 1 -- 172.21.15.50:0/1038192820 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e800e470 con 0x55a736ee9fe0 2024-05-07T13:57:08.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.796+0000 7f84e3606640 1 -- 172.21.15.50:0/1038192820 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e800e810 con 0x55a736ee9fe0 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.796+0000 7f85f9e12800 1 -- 172.21.15.50:0/1038192820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 msgr2=0x55a736fdc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.796+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1038192820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fdc6f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f85e8001d80 tx=0x7f85e8001e70 comp rx=0 tx=0).stop 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.796+0000 7f85f9e12800 1 -- 172.21.15.50:0/1038192820 shutdown_connections 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.796+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1038192820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fdc6f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.796+0000 7f85f9e12800 1 -- 172.21.15.50:0/1038192820 >> 172.21.15.50:0/1038192820 conn(0x55a736ee55c0 msgr2=0x55a736fdab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.796+0000 7f85f9e12800 1 -- 172.21.15.50:0/1038192820 shutdown_connections 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.797+0000 7f85f9e12800 1 -- 172.21.15.50:0/1038192820 wait complete. 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.797+0000 7f85f9e12800 1 Processor -- start 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.797+0000 7f85f9e12800 1 -- start start 2024-05-07T13:57:08.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.797+0000 7f85f9e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fe4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.797+0000 7f85f9e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a736ef1300 con 0x55a736ee9fe0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.797+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fe4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.797+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fe4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46536/0 (socket says 172.21.15.50:46536) 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.797+0000 7f85f555c640 1 -- 172.21.15.50:0/1027879149 learned_addr learned my addr 172.21.15.50:0/1027879149 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.798+0000 7f85f555c640 1 -- 172.21.15.50:0/1027879149 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a736fe4840 con 0x55a736ee9fe0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.798+0000 7f85f555c640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fe4300 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f85e8004000 tx=0x7f85e8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.798+0000 7f84e1e03640 1 -- 172.21.15.50:0/1027879149 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8027070 con 0x55a736ee9fe0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.798+0000 7f84e1e03640 1 -- 172.21.15.50:0/1027879149 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8019900 con 0x55a736ee9fe0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.798+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a736fe4ad0 con 0x55a736ee9fe0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.798+0000 7f84e1e03640 1 -- 172.21.15.50:0/1027879149 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8019c60 con 0x55a736ee9fe0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.798+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a736fe7780 con 0x55a736ee9fe0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.799+0000 7f84e1e03640 1 -- 172.21.15.50:0/1027879149 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f85e802a070 con 0x55a736ee9fe0 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.799+0000 7f84e1e03640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84dc036900 0x7f84dc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.799+0000 7f84e1e03640 1 -- 172.21.15.50:0/1027879149 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f85e801f070 con 0x55a736ee9fe0 2024-05-07T13:57:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.799+0000 7f85effff640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84dc036900 0x7f84dc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.799+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a736eee470 0x55a736feb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.799+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a736febb10 con 0x55a736eee470 2024-05-07T13:57:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.799+0000 7f85f5d5d640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a736eee470 0x55a736feb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.800+0000 7f85effff640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84dc036900 0x7f84dc038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f85e0054000 tx=0x7f85e004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.800+0000 7f85f5d5d640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a736eee470 0x55a736feb540 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.800+0000 7f85f5d5d640 1 -- 172.21.15.50:0/1027879149 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a736eee470 2024-05-07T13:57:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.800+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a736fe8b10 con 0x55a736eee470 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.800+0000 7f85f5d5d640 1 -- 172.21.15.50:0/1027879149 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a736eee470 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.800+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a736fede20 0x55a736ff0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.800+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a736ff08b0 con 0x55a736fede20 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.800+0000 7f85f555c640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a736fede20 0x55a736ff0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.801+0000 7f85f555c640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a736fede20 0x55a736ff0210 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.801+0000 7f85f555c640 1 -- 172.21.15.50:0/1027879149 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85e8029030 con 0x55a736fede20 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.801+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a736fecdd0 con 0x55a736eee470 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.801+0000 7f85f5d5d640 1 -- 172.21.15.50:0/1027879149 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a736eee470 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.801+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a736ff1d60 0x55a736ff41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.801+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a736ff4910 con 0x55a736ff1d60 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.802+0000 7f85effff640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a736ff1d60 0x55a736ff41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.802+0000 7f85effff640 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a736ff1d60 0x55a736ff41b0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.802+0000 7f85effff640 1 -- 172.21.15.50:0/1027879149 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f85e005a040 con 0x55a736ff1d60 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.803+0000 7f85f9e12800 1 Processor -- start 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.803+0000 7f85f9e12800 1 -- start start 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.803+0000 7f85f9e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a737002d00 0x55a737003120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.803+0000 7f85f9e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a736ddccf0 con 0x55a737002d00 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.803+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a737002d00 0x55a737003120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.803+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a737002d00 0x55a737003120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46550/0 (socket says 172.21.15.50:46550) 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.803+0000 7f85f555c640 1 -- 172.21.15.50:0/3027303495 learned_addr learned my addr 172.21.15.50:0/3027303495 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.803+0000 7f85f555c640 1 -- 172.21.15.50:0/3027303495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a737003660 con 0x55a737002d00 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.804+0000 7f85f555c640 1 --2- 172.21.15.50:0/3027303495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a737002d00 0x55a737003120 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f85e8016fd0 tx=0x7f85e80177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.804+0000 7f84daffd640 1 -- 172.21.15.50:0/3027303495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e80444c0 con 0x55a737002d00 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.804+0000 7f84daffd640 1 -- 172.21.15.50:0/3027303495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8044660 con 0x55a737002d00 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.804+0000 7f84daffd640 1 -- 172.21.15.50:0/3027303495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e804c1a0 con 0x55a737002d00 2024-05-07T13:57:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.804+0000 7f85f9e12800 1 -- 172.21.15.50:0/3027303495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7370040d0 con 0x55a737002d00 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.804+0000 7f85f9e12800 1 -- 172.21.15.50:0/3027303495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7370045d0 con 0x55a737002d00 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.804+0000 7f84daffd640 1 -- 172.21.15.50:0/3027303495 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f85e8033070 con 0x55a737002d00 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.805+0000 7f84daffd640 1 --2- 172.21.15.50:0/3027303495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84cc036950 0x7f84cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.805+0000 7f84daffd640 1 -- 172.21.15.50:0/3027303495 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f85e8014070 con 0x55a737002d00 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.805+0000 7f85effff640 1 --2- 172.21.15.50:0/3027303495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84cc036950 0x7f84cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.805+0000 7f85f9e12800 1 Processor -- start 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.805+0000 7f85f9e12800 1 -- start start 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.805+0000 7f85effff640 1 --2- 172.21.15.50:0/3027303495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84cc036950 0x7f84cc038e10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55a736fe8a30 tx=0x7f85e0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.805+0000 7f85f9e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370102e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.805+0000 7f85f9e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a736fdd040 con 0x55a73700fec0 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.806+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.806+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370102e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46562/0 (socket says 172.21.15.50:46562) 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.806+0000 7f85f555c640 1 -- 172.21.15.50:0/832247266 learned_addr learned my addr 172.21.15.50:0/832247266 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.806+0000 7f85f555c640 1 -- 172.21.15.50:0/832247266 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7370108b0 con 0x55a73700fec0 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.806+0000 7f85f555c640 1 --2- 172.21.15.50:0/832247266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370102e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f85e80498d0 tx=0x7f85e8022890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bda8971c18223b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.806+0000 7f84d8ff9640 1 -- 172.21.15.50:0/832247266 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e8053040 con 0x55a73700fec0 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.806+0000 7f84d8ff9640 1 -- 172.21.15.50:0/832247266 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8049130 con 0x55a73700fec0 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.806+0000 7f84d8ff9640 1 -- 172.21.15.50:0/832247266 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e804c980 con 0x55a73700fec0 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 -- 172.21.15.50:0/832247266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 msgr2=0x55a7370102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 --2- 172.21.15.50:0/832247266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370102e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f85e80498d0 tx=0x7f85e8022890 comp rx=0 tx=0).stop 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 -- 172.21.15.50:0/832247266 shutdown_connections 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 --2- 172.21.15.50:0/832247266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370102e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 -- 172.21.15.50:0/832247266 >> 172.21.15.50:0/832247266 conn(0x55a73700c1e0 msgr2=0x55a73700a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 -- 172.21.15.50:0/832247266 shutdown_connections 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 -- 172.21.15.50:0/832247266 wait complete. 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 Processor -- start 2024-05-07T13:57:08.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 -- start start 2024-05-07T13:57:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370172f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f9e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a737010fd0 con 0x55a73700fec0 2024-05-07T13:57:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f555c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370172f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46576/0 (socket says 172.21.15.50:46576) 2024-05-07T13:57:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.807+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 learned_addr learned my addr 172.21.15.50:0/3755941037 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.808+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a737017830 con 0x55a73700fec0 2024-05-07T13:57:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.808+0000 7f85f555c640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370172f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f85e8044870 tx=0x7f85e803af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.808+0000 7f84caffd640 1 -- 172.21.15.50:0/3755941037 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e804c340 con 0x55a73700fec0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.808+0000 7f84caffd640 1 -- 172.21.15.50:0/3755941037 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8067030 con 0x55a73700fec0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.808+0000 7f84caffd640 1 -- 172.21.15.50:0/3755941037 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e804c610 con 0x55a73700fec0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.808+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a737017830 con 0x55a73700fec0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.808+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a737017830 con 0x55a73700fec0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.809+0000 7f84caffd640 1 -- 172.21.15.50:0/3755941037 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f85e8016070 con 0x55a73700fec0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.809+0000 7f84caffd640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84c0036900 0x7f84c0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.809+0000 7f84caffd640 1 -- 172.21.15.50:0/3755941037 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f85e806dd40 con 0x55a73700fec0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.809+0000 7f85effff640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84c0036900 0x7f84c0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.809+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.809+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a737022930 0x55a737024df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.809+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a737025540 con 0x55a737022930 2024-05-07T13:57:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f5d5d640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a737022930 0x55a737024df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85effff640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84c0036900 0x7f84c0038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55a736ff4d10 tx=0x7f85e004f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f5d5d640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a737022930 0x55a737024df0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f9e12800 20 realm 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a737025950 con 0x55a737022930 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f9e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.810+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a737026220 con 0x55a737022930 2024-05-07T13:57:08.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a7370265c0 con 0x55a737022930 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f9e12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a7370270b0 0x55a7370294a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a737029c00 con 0x55a7370270b0 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f555c640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a7370270b0 0x55a7370294a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.811+0000 7f85f555c640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a7370270b0 0x55a7370294a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.812+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.812+0000 7f85f9e12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.812+0000 7f85f9e12800 20 searching for the correct realm 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.812+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a73702b5e0 con 0x55a7370270b0 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.812+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.812+0000 7f85f555c640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f85e8062050 0x7f85e80131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.812+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a73702b5e0 con 0x7f85e8062050 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.812+0000 7f85effff640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f85e8062050 0x7f85e80131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.813+0000 7f85effff640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f85e8062050 0x7f85e80131d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.813+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.813+0000 7f85effff640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f85e0074040 0x7f85e0081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.813+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a73702b5e0 con 0x7f85e0074040 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.813+0000 7f85f5d5d640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f85e0074040 0x7f85e0081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.814+0000 7f85f5d5d640 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f85e0074040 0x7f85e0081410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.814+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.814+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a7370265c0 con 0x55a737022930 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.814+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.814+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a7370265c0 con 0x55a737022930 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.814+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.814+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a7370265c0 con 0x55a737022930 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.814+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.814+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a7370265c0 con 0x7f85e0074040 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.815+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.815+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a7370265c0 con 0x7f85e8062050 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.815+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.815+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a7370265c0 con 0x7f85e8062050 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.815+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.815+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a737022930 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.815+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.815+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e0074040 2024-05-07T13:57:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.816+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.816+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a737022930 2024-05-07T13:57:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.816+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.816+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e8062050 2024-05-07T13:57:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.816+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.816+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a7370270b0 2024-05-07T13:57:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.816+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.816+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a7370270b0 2024-05-07T13:57:08.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.817+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.817+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e0074040 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.817+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.817+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a7370270b0 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.817+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.817+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a7370270b0 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.817+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.817+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a737022930 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.818+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.818+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a737022930 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.818+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.818+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e0074040 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.818+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.818+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a7370270b0 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.819+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.819+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e8062050 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.819+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.819+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a737022930 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.819+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.819+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e0074040 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.820+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.820+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a7370270b0 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.820+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.820+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e0074040 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.820+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.820+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e8062050 2024-05-07T13:57:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.820+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.820+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a7370270b0 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e8062050 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x55a737022930 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f85e008e040 con 0x7f85e8062050 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f9e12800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f9e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f9e12800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f9e12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f9e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f9e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.821+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a73702a5b0 con 0x55a737022930 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.822+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.822+0000 7f85f9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.822+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.822+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a73702a9a0 con 0x55a737022930 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.822+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.822+0000 7f85f9e12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.822+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.822+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a73702a9a0 con 0x7f85e0074040 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 20 zone default found 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 4 Realm: () 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 20 zonegroup default 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a73702adc0 con 0x7f85e0074040 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a73702adc0 con 0x55a7370270b0 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.823+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a73702d490 con 0x55a7370270b0 2024-05-07T13:57:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.824+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.824+0000 7f85f9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.824+0000 7f85f9e12800 20 started sync module instance, tier type = 2024-05-07T13:57:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.824+0000 7f85f9e12800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:08.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.824+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a73702c930 con 0x7f85e8062050 2024-05-07T13:57:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.825+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.825+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94176670829856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a73702dce0 con 0x7f85e8062050 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.825+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a73702e530 con 0x55a737022930 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.826+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94176670829856] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.826+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.826+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94176670832688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a73702e570 con 0x55a737022930 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.826+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a73702f080 con 0x55a7370270b0 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.827+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.827+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94176670837552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a73702f920 con 0x55a7370270b0 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.827+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737030420 con 0x7f85e8062050 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.827+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94176670832688] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.828+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94176670837552] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.828+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.828+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94176670842640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737030810 con 0x7f85e8062050 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.828+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737031060 con 0x55a737022930 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.829+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94176670842640] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.829+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.829+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94176670844944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737031450 con 0x55a737022930 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.829+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737031ca0 con 0x7f85e0074040 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.830+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94176670844944] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.830+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.830+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94176670847776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737031bf0 con 0x7f85e0074040 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.830+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a7370324a0 con 0x7f85e0074040 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.832+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94176670847776] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.832+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.832+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94176670848832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737032680 con 0x7f85e0074040 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.832+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737032ed0 con 0x7f85e0074040 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(58 notify.7 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94176670848832] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94176670849952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737032d50 con 0x7f85e0074040 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f9e12800 20 add_watcher() i=0 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f9e12800 20 add_watcher() i=1 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f9e12800 20 add_watcher() i=2 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f9e12800 20 add_watcher() i=3 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f9e12800 20 add_watcher() i=4 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f9e12800 20 add_watcher() i=5 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.833+0000 7f85f9e12800 20 add_watcher() i=6 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.834+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94176670849952] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.834+0000 7f85f9e12800 20 add_watcher() i=7 2024-05-07T13:57:08.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.834+0000 7f85f9e12800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.834+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a737036290 con 0x55a737022930 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.834+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.834+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94176670852944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737033750 con 0x55a737022930 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.835+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94176670852944] v29'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.835+0000 7f84ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.835+0000 7f85f9e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.835+0000 7f85f9e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.835+0000 7f85f9e12800 5 note: GC not initialized 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.835+0000 7f84aa7e4640 20 reqs_thread_entry: start 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.836+0000 7f85f9e12800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.836+0000 7f85f9e12800 20 Filter name: none 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.836+0000 7f841bfff640 20 reqs_thread_entry: start 2024-05-07T13:57:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.836+0000 7f85f9e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.836+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a737069390 con 0x55a737022930 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.836+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.836+0000 7f85f9e12800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.836+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a73706a780 con 0x7f85e0074040 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.837+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.838+0000 7f84ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.838+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94176670852944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737020050 con 0x55a737022930 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.839+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94176670852944] v29'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.839+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94176670829856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737032750 con 0x7f85e8062050 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.840+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94176670829856] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.840+0000 7f85f9e12800 20 remove_watcher() i=0 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.840+0000 7f85f9e12800 2 removed watcher, disabling cache 2024-05-07T13:57:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.840+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94176670832688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737032750 con 0x55a737022930 2024-05-07T13:57:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.841+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94176670832688] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.841+0000 7f85f9e12800 20 remove_watcher() i=1 2024-05-07T13:57:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.841+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94176670837552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a73702d830 con 0x55a7370270b0 2024-05-07T13:57:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.842+0000 7f85f555c640 1 -- 172.21.15.50:0/3755941037 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94176670837552] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e8073070 con 0x55a7370270b0 2024-05-07T13:57:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.842+0000 7f85f9e12800 20 remove_watcher() i=2 2024-05-07T13:57:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.842+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94176670842640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737032750 con 0x7f85e8062050 2024-05-07T13:57:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.843+0000 7f85effff640 1 -- 172.21.15.50:0/3755941037 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94176670842640] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e007f070 con 0x7f85e8062050 2024-05-07T13:57:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.843+0000 7f85f9e12800 20 remove_watcher() i=3 2024-05-07T13:57:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.843+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94176670844944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a73702d830 con 0x55a737022930 2024-05-07T13:57:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.844+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94176670844944] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x55a737022930 2024-05-07T13:57:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.844+0000 7f85f9e12800 20 remove_watcher() i=4 2024-05-07T13:57:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.844+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94176670847776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a73702ff10 con 0x7f85e0074040 2024-05-07T13:57:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.845+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94176670847776] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.845+0000 7f85f9e12800 20 remove_watcher() i=5 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.845+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94176670848832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737032750 con 0x7f85e0074040 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.846+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94176670848832] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.846+0000 7f85f9e12800 20 remove_watcher() i=6 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.846+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94176670849952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a737030810 con 0x7f85e0074040 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94176670849952] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f000a4a0 con 0x7f85e0074040 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f9e12800 20 remove_watcher() i=7 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f85e0074040 msgr2=0x7f85e0081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f85e0074040 0x7f85e0081410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a737022930 msgr2=0x55a737024df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a737022930 0x55a737024df0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f85e8062050 msgr2=0x7f85e80131d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f85e8062050 0x7f85e80131d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a7370270b0 msgr2=0x55a7370294a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.847+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a7370270b0 0x55a7370294a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84c0036900 msgr2=0x7f84c0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84c0036900 0x7f84c0038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55a736ff4d10 tx=0x7f85e004f000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 msgr2=0x55a7370172f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3755941037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a73700fec0 0x55a7370172f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f85e8044870 tx=0x7f85e803af40 comp rx=0 tx=0).stop 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 reap_dead start 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f5d5d640 1 -- 172.21.15.50:0/3755941037 reap_dead start 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 shutdown_connections 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 >> 172.21.15.50:0/3755941037 conn(0x55a73700c1e0 msgr2=0x55a737009840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 shutdown_connections 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3755941037 wait complete. 2024-05-07T13:57:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3027303495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84cc036950 msgr2=0x7f84cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3027303495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84cc036950 0x7f84cc038e10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55a736fe8a30 tx=0x7f85e0005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3027303495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a737002d00 msgr2=0x55a737003120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3027303495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a737002d00 0x55a737003120 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f85e8016fd0 tx=0x7f85e80177a0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3027303495 shutdown_connections 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3027303495 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84cc036950 0x7f84cc038e10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 --2- 172.21.15.50:0/3027303495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a737002d00 0x55a737003120 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3027303495 >> 172.21.15.50:0/3027303495 conn(0x55a736ff6da0 msgr2=0x55a736ff71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3027303495 shutdown_connections 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.848+0000 7f85f9e12800 1 -- 172.21.15.50:0/3027303495 wait complete. 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a736ff1d60 msgr2=0x55a736ff41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55a736ff1d60 0x55a736ff41b0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a736eee470 msgr2=0x55a736feb540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a736eee470 0x55a736feb540 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a736fede20 msgr2=0x55a736ff0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a736fede20 0x55a736ff0210 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84dc036900 msgr2=0x7f84dc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f84dc036900 0x7f84dc038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f85e0054000 tx=0x7f85e004e000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 msgr2=0x55a736fe4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 --2- 172.21.15.50:0/1027879149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a736ee9fe0 0x55a736fe4300 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f85e8004000 tx=0x7f85e8000bc0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f5d5d640 1 -- 172.21.15.50:0/1027879149 reap_dead start 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 shutdown_connections 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 >> 172.21.15.50:0/1027879149 conn(0x55a736ee55c0 msgr2=0x55a736fd5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 shutdown_connections 2024-05-07T13:57:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.849+0000 7f85f9e12800 1 -- 172.21.15.50:0/1027879149 wait complete. 2024-05-07T13:57:08.845 INFO:teuthology.orchestra.run.smithi050.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-07T13:00:00.000000Z","epoch":1715086800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-05-07T13:57:08.845 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-05-07T13:57:08.846 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-07T13:57:08.846 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-07T13:57:08.846 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-05-07T13:57:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:08.900 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.913+0000 7fc9d3d2c800 1 Processor -- start 2024-05-07T13:57:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.913+0000 7fc9d3d2c800 1 -- start start 2024-05-07T13:57:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.914+0000 7fc9d3d2c800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5602aa430a20 0x5602aa430e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.914+0000 7fc9d3d2c800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5602aa3a5aa0 con 0x5602aa431380 2024-05-07T13:57:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.914+0000 7fc9d3d2c800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5602aa2c3050 con 0x5602aa430a20 2024-05-07T13:57:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.914+0000 7fc9cfa64640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5602aa430a20 0x5602aa430e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.914+0000 7fc9cf263640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5602aa431380 0x5602aa431830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:38440/0 (socket says 172.21.15.50:38440) 2024-05-07T13:57:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.914+0000 7fc9cfa64640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5602aa430a20 0x5602aa430e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46586/0 (socket says 172.21.15.50:46586) 2024-05-07T13:57:08.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.914+0000 7fc9cf263640 1 -- 172.21.15.50:0/3140004737 learned_addr learned my addr 172.21.15.50:0/3140004737 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:08.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.914+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3140004737 >> v1:172.21.15.22:6789/0 conn(0x5602aa431380 legacy=0x5602aa431830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.914+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3140004737 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602aa431f40 con 0x5602aa430a20 2024-05-07T13:57:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.916+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/3140004737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa430e40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000a470 tx=0x7fc9c001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9610f1ea0cdb53f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.916+0000 7fc9cea62640 1 -- 172.21.15.50:0/3140004737 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0057070 con 0x5602aa430a20 2024-05-07T13:57:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.916+0000 7fc9cea62640 1 -- 172.21.15.50:0/3140004737 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c0052570 con 0x5602aa430a20 2024-05-07T13:57:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.916+0000 7fc9cea62640 1 -- 172.21.15.50:0/3140004737 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0052870 con 0x5602aa430a20 2024-05-07T13:57:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.917+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3140004737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 msgr2=0x5602aa430e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.917+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3140004737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa430e40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000a470 tx=0x7fc9c001ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.917+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3140004737 shutdown_connections 2024-05-07T13:57:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.917+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3140004737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa430e40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.917+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3140004737 >> 172.21.15.50:0/3140004737 conn(0x5602aa42c5a0 msgr2=0x5602aa42e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.917+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3140004737 shutdown_connections 2024-05-07T13:57:08.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.917+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3140004737 wait complete. 2024-05-07T13:57:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.932+0000 7fc9d3d2c800 1 Processor -- start 2024-05-07T13:57:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.932+0000 7fc9d3d2c800 1 -- start start 2024-05-07T13:57:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.932+0000 7fc9d3d2c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa525b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.932+0000 7fc9d3d2c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5602aa37d1f0 con 0x5602aa430a20 2024-05-07T13:57:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.932+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa525b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.932+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa525b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46596/0 (socket says 172.21.15.50:46596) 2024-05-07T13:57:08.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.932+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3614552199 learned_addr learned my addr 172.21.15.50:0/3614552199 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.933+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3614552199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602aa526160 con 0x5602aa430a20 2024-05-07T13:57:08.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.933+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/3614552199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa525b90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc9c001ced0 tx=0x7fc9c004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409c8150436a99ff server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.933+0000 7fc8bde0b640 1 -- 172.21.15.50:0/3614552199 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0057040 con 0x5602aa430a20 2024-05-07T13:57:08.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.933+0000 7fc8bde0b640 1 -- 172.21.15.50:0/3614552199 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c00529a0 con 0x5602aa430a20 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.933+0000 7fc8bde0b640 1 -- 172.21.15.50:0/3614552199 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0052cc0 con 0x5602aa430a20 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.934+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3614552199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 msgr2=0x5602aa525b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.934+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3614552199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa525b90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc9c001ced0 tx=0x7fc9c004c000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.934+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3614552199 shutdown_connections 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.934+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3614552199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa525b90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.934+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3614552199 >> 172.21.15.50:0/3614552199 conn(0x5602aa42c5a0 msgr2=0x5602aa5214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.934+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3614552199 shutdown_connections 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.934+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3614552199 wait complete. 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.934+0000 7fc9d3d2c800 1 Processor -- start 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.934+0000 7fc9d3d2c800 1 -- start start 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc9d3d2c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa52d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc9d3d2c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5602aa432470 con 0x5602aa430a20 2024-05-07T13:57:08.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa52d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa52d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46608/0 (socket says 172.21.15.50:46608) 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc9cfa64640 1 -- 172.21.15.50:0/4018625409 learned_addr learned my addr 172.21.15.50:0/4018625409 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc9cfa64640 1 -- 172.21.15.50:0/4018625409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602aa52db50 con 0x5602aa430a20 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa52d610 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0000c00 tx=0x7fc9c0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc8b7fff640 1 -- 172.21.15.50:0/4018625409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0073070 con 0x5602aa430a20 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc8b7fff640 1 -- 172.21.15.50:0/4018625409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c005d780 con 0x5602aa430a20 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602aa52dde0 con 0x5602aa430a20 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.935+0000 7fc8b7fff640 1 -- 172.21.15.50:0/4018625409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0057070 con 0x5602aa430a20 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.936+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602aa530a90 con 0x5602aa430a20 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.936+0000 7fc8b7fff640 1 -- 172.21.15.50:0/4018625409 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9c0076070 con 0x5602aa430a20 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.936+0000 7fc8b7fff640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8b8036950 0x7fc8b8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.937+0000 7fc8b7fff640 1 -- 172.21.15.50:0/4018625409 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc9c008e070 con 0x5602aa430a20 2024-05-07T13:57:08.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.937+0000 7fc9cf263640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8b8036950 0x7fc8b8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.937+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa431380 0x5602aa534850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.937+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa534e20 con 0x5602aa431380 2024-05-07T13:57:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.937+0000 7fc9d0265640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa431380 0x5602aa534850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.937+0000 7fc9cf263640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8b8036950 0x7fc8b8038e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4000f60 tx=0x7fc9c40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.937+0000 7fc9d0265640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa431380 0x5602aa534850 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.937+0000 7fc9d0265640 1 -- 172.21.15.50:0/4018625409 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa431380 2024-05-07T13:57:08.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.937+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa531e20 con 0x5602aa431380 2024-05-07T13:57:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.938+0000 7fc9d0265640 1 -- 172.21.15.50:0/4018625409 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa431380 2024-05-07T13:57:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.938+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa537150 0x5602aa539540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.938+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa539c30 con 0x5602aa537150 2024-05-07T13:57:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.938+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa537150 0x5602aa539540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.938+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa537150 0x5602aa539540 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.938+0000 7fc9cfa64640 1 -- 172.21.15.50:0/4018625409 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa537150 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.939+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5360d0 con 0x5602aa431380 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.939+0000 7fc9d0265640 1 -- 172.21.15.50:0/4018625409 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa431380 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.939+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5602aa53b090 0x5602aa53d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.939+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa53dc60 con 0x5602aa53b090 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.939+0000 7fc9cf263640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5602aa53b090 0x5602aa53d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.939+0000 7fc9cf263640 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5602aa53b090 0x5602aa53d500 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.940+0000 7fc9cf263640 1 -- 172.21.15.50:0/4018625409 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9c4009050 con 0x5602aa53b090 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.940+0000 7fc9d3d2c800 1 Processor -- start 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.940+0000 7fc9d3d2c800 1 -- start start 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.940+0000 7fc9d3d2c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa54c0c0 0x5602aa54c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.940+0000 7fc9d3d2c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5602aa323cf0 con 0x5602aa54c0c0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.940+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa54c0c0 0x5602aa54c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.940+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa54c0c0 0x5602aa54c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46610/0 (socket says 172.21.15.50:46610) 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.940+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3755899356 learned_addr learned my addr 172.21.15.50:0/3755899356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.941+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3755899356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602aa54ca20 con 0x5602aa54c0c0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.941+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/3755899356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa54c0c0 0x5602aa54c4e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc9c008c360 tx=0x7fc9c005ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.941+0000 7fc8b57fa640 1 -- 172.21.15.50:0/3755899356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0006950 con 0x5602aa54c0c0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.941+0000 7fc8b57fa640 1 -- 172.21.15.50:0/3755899356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c005da80 con 0x5602aa54c0c0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.941+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3755899356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602aa54d490 con 0x5602aa54c0c0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.941+0000 7fc8b57fa640 1 -- 172.21.15.50:0/3755899356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c005dd60 con 0x5602aa54c0c0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.941+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3755899356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602aa54d990 con 0x5602aa54c0c0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.942+0000 7fc8b57fa640 1 -- 172.21.15.50:0/3755899356 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9c00773b0 con 0x5602aa54c0c0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.942+0000 7fc8b57fa640 1 --2- 172.21.15.50:0/3755899356 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8a8036950 0x7fc8a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.942+0000 7fc8b57fa640 1 -- 172.21.15.50:0/3755899356 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc9c004c0e0 con 0x5602aa54c0c0 2024-05-07T13:57:08.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.942+0000 7fc9cf263640 1 --2- 172.21.15.50:0/3755899356 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8a8036950 0x7fc8a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.942+0000 7fc9d3d2c800 1 Processor -- start 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.942+0000 7fc9d3d2c800 1 -- start start 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc9cf263640 1 --2- 172.21.15.50:0/3755899356 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8a8036950 0x7fc8a8038e10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400bf50 tx=0x7fc9c400f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc9d3d2c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa559660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc9d3d2c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5602aa526420 con 0x5602aa559240 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa559660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa559660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46624/0 (socket says 172.21.15.50:46624) 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc9cfa64640 1 -- 172.21.15.50:0/953532775 learned_addr learned my addr 172.21.15.50:0/953532775 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc9cfa64640 1 -- 172.21.15.50:0/953532775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602aa559c30 con 0x5602aa559240 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/953532775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa559660 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc9c008b130 tx=0x7fc9c0002000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8d90f3c81be22b server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc8aeffd640 1 -- 172.21.15.50:0/953532775 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0076360 con 0x5602aa559240 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc8aeffd640 1 -- 172.21.15.50:0/953532775 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c00a9070 con 0x5602aa559240 2024-05-07T13:57:08.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.943+0000 7fc8aeffd640 1 -- 172.21.15.50:0/953532775 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0093ca0 con 0x5602aa559240 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/953532775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 msgr2=0x5602aa559660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/953532775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa559660 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc9c008b130 tx=0x7fc9c0002000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/953532775 shutdown_connections 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/953532775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa559660 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/953532775 >> 172.21.15.50:0/953532775 conn(0x5602aa555510 msgr2=0x5602aa553570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/953532775 shutdown_connections 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/953532775 wait complete. 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 Processor -- start 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 -- start start 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa560560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.944+0000 7fc9d3d2c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5602aa55a290 con 0x5602aa559240 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa560560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc9cfa64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa560560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46638/0 (socket says 172.21.15.50:46638) 2024-05-07T13:57:08.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 learned_addr learned my addr 172.21.15.50:0/3982572718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602aa560aa0 con 0x5602aa559240 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa560560 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006c470 tx=0x7fc9c007ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc8ad7fa640 1 -- 172.21.15.50:0/3982572718 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c0091e50 con 0x5602aa559240 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc8ad7fa640 1 -- 172.21.15.50:0/3982572718 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c0076a90 con 0x5602aa559240 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc8ad7fa640 1 -- 172.21.15.50:0/3982572718 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c00777f0 con 0x5602aa559240 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602aa560aa0 con 0x5602aa559240 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.945+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602aa560aa0 con 0x5602aa559240 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.946+0000 7fc8ad7fa640 1 -- 172.21.15.50:0/3982572718 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9c00bf060 con 0x5602aa559240 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.946+0000 7fc8ad7fa640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc898036aa0 0x7fc898038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.946+0000 7fc8ad7fa640 1 -- 172.21.15.50:0/3982572718 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc9c00c2d20 con 0x5602aa559240 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.946+0000 7fc9cf263640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc898036aa0 0x7fc898038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.947+0000 7fc9cf263640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc898036aa0 0x7fc898038f60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4001b60 tx=0x7fc9c4010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.947+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.947+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa56bcb0 0x5602aa56e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.947+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56e8c0 con 0x5602aa56bcb0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.947+0000 7fc9d0265640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa56bcb0 0x5602aa56e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d0265640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa56bcb0 0x5602aa56e170 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 20 realm 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56ecd0 con 0x5602aa56bcb0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f5a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.948+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9d3d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa5706a0 0x5602aa572a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5730a0 con 0x5602aa5706a0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa5706a0 0x5602aa572a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa5706a0 0x5602aa572a90 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9d3d2c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:08.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9d3d2c800 20 searching for the correct realm 2024-05-07T13:57:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.949+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5749d0 con 0x5602aa5706a0 2024-05-07T13:57:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.950+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.950+0000 7fc9cfa64640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc9c0091460 0x7fc9c0073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.950+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5749d0 con 0x7fc9c0091460 2024-05-07T13:57:08.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.950+0000 7fc9cf263640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc9c0091460 0x7fc9c0073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.950+0000 7fc9cf263640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc9c0091460 0x7fc9c0073210 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.950+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c4009050 con 0x7fc9c0091460 2024-05-07T13:57:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.951+0000 7fc9cf263640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc9c4038040 0x7fc9c401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.951+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5749d0 con 0x7fc9c4038040 2024-05-07T13:57:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.951+0000 7fc9d0265640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc9c4038040 0x7fc9c401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.951+0000 7fc9d0265640 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc9c4038040 0x7fc9c401bab0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:08.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.951+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.951+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.952+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.952+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.952+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.952+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.952+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.952+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c4038040 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.952+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.953+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c0091460 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.953+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c4009050 con 0x7fc9c0091460 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.953+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c0091460 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.953+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c4009050 con 0x7fc9c0091460 2024-05-07T13:57:08.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.953+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.953+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.953+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c4038040 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.954+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.954+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.954+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.954+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c0091460 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.954+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9c4009050 con 0x7fc9c0091460 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.954+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa5706a0 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.954+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.954+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa5706a0 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.955+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.955+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c4038040 2024-05-07T13:57:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.955+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.955+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa5706a0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.955+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.955+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa5706a0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.955+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.955+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.956+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.956+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.956+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.956+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c4038040 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.956+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.956+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa5706a0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.956+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.956+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c0091460 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.957+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c4009050 con 0x7fc9c0091460 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.957+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.957+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.957+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c4038040 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.957+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.957+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa5706a0 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.958+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.958+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c4038040 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.958+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.958+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c0091460 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.958+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c4045040 con 0x7fc9c0091460 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.958+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa5706a0 2024-05-07T13:57:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c0091460 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c4045040 con 0x7fc9c0091460 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x5602aa56bcb0 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5602aa56f940 con 0x7fc9c0091460 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9c4045040 con 0x7fc9c0091460 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d3d2c800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d3d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d3d2c800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d3d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d3d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d3d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.959+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa573960 con 0x5602aa56bcb0 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.960+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.960+0000 7fc9d3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.960+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.960+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa573d50 con 0x5602aa56bcb0 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.960+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.960+0000 7fc9d3d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.960+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.960+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa573d50 con 0x7fc9c4038040 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 zone default found 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 4 Realm: () 2024-05-07T13:57:08.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 zonegroup default 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa574e50 con 0x7fc9c4038040 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa576830 con 0x5602aa5706a0 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa576bd0 con 0x5602aa5706a0 2024-05-07T13:57:08.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.961+0000 7fc9d3d2c800 20 started sync module instance, tier type = 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.962+0000 7fc9d3d2c800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.962+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa575cd0 con 0x7fc9c0091460 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.963+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c4045040 con 0x7fc9c0091460 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.963+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94569447774240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa576f70 con 0x7fc9c0091460 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.963+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5777c0 con 0x5602aa56bcb0 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.964+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.964+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94569447781616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa578060 con 0x5602aa56bcb0 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.964+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa578b30 con 0x5602aa5706a0 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.964+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94569447774240] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c4045040 con 0x7fc9c0091460 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.965+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94569447781616] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.965+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.965+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94569447776496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa578060 con 0x5602aa5706a0 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.965+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa579540 con 0x7fc9c0091460 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.966+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94569447776496] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.966+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c4045040 con 0x7fc9c0091460 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.966+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94569447783344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa579d90 con 0x7fc9c0091460 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.966+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57a640 con 0x5602aa56bcb0 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.967+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.967+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94569447792944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57aee0 con 0x5602aa56bcb0 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.967+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57b980 con 0x7fc9c4038040 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.967+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94569447783344] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c4045040 con 0x7fc9c0091460 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.968+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.968+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94569447797840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57b940 con 0x7fc9c4038040 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.968+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57c390 con 0x7fc9c4038040 2024-05-07T13:57:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.968+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94569447792944] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.969+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94569447797840] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.970+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.970+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94569447790816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57bee0 con 0x7fc9c4038040 2024-05-07T13:57:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.970+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57c8a0 con 0x7fc9c4038040 2024-05-07T13:57:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94569447790816] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94569447795248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57c8a0 con 0x7fc9c4038040 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d3d2c800 20 add_watcher() i=0 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d3d2c800 20 add_watcher() i=1 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d3d2c800 20 add_watcher() i=2 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d3d2c800 20 add_watcher() i=3 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d3d2c800 20 add_watcher() i=4 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d3d2c800 20 add_watcher() i=5 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.971+0000 7fc9d3d2c800 20 add_watcher() i=6 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.972+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94569447795248] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.972+0000 7fc9d3d2c800 20 add_watcher() i=7 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.972+0000 7fc9d3d2c800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.972+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57fb90 con 0x5602aa56bcb0 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.972+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.972+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94569447802208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57ce30 con 0x5602aa56bcb0 2024-05-07T13:57:08.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.973+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94569447802208] v29'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.973+0000 7fc885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.973+0000 7fc9d3d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.973+0000 7fc9d3d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.973+0000 7fc9d3d2c800 5 note: GC not initialized 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.973+0000 7fc884fe1640 20 reqs_thread_entry: start 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 20 Filter name: none 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc7fe7fc640 20 reqs_thread_entry: start 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5b31a0 con 0x7fc9c4038040 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.974+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5b1940 con 0x5602aa56bcb0 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.975+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.975+0000 7fc9d3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.975+0000 7fc9d3d2c800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.975+0000 7fc9d3d2c800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.975+0000 7fc9d3d2c800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.975+0000 7fc9d3d2c800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.975+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5b2210 con 0x7fc9c4038040 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v29'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc9d3d2c800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-07T13:57:08.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc9d3d2c800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc9d3d2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94569448021344 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5b2200 con 0x7fc9c4038040 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== watch-notify(notify (1) cookie 94569447795248 notify 124554051600 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5602aa5b25b0 con 0x7fc9c4038040 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc8aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051600 cookie 94569447795248 notifier 4719 bl.length()=556 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(65 notify.7 [notify cookie 94569448021344 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc8aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc8aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.976+0000 7fc8aeffd640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc894003ea0 con 0x7fc9c4038040 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.977+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.977+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== watch-notify(notify_complete (2) cookie 94569448021344 notify 124554051600 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602aa5b1a20 con 0x7fc9c4038040 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.977+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5b4610 con 0x5602aa56bcb0 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc9d3d2c800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc9d3d2c800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc9d3d2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94569448021264 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5b4610 con 0x7fc9c4038040 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== watch-notify(notify (1) cookie 94569447797840 notify 124554051601 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5602aa5b1a20 con 0x7fc9c4038040 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc8aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051601 cookie 94569447797840 notifier 4719 bl.length()=177 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc8aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc8aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(68 notify.5 [notify cookie 94569448021264 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc8aeffd640 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc894003ea0 con 0x7fc9c4038040 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.978+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== watch-notify(notify_complete (2) cookie 94569448021264 notify 124554051601 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc9c803d040 con 0x7fc9c4038040 2024-05-07T13:57:08.977 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-07T13:57:08.975474Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:08.975459Z","tags":[],"group_ids":[]} 2024-05-07T13:57:08.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.979+0000 7fc885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.979+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94569447802208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57f230 con 0x5602aa56bcb0 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.980+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94569447802208] v29'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.980+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94569447774240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57c560 con 0x7fc9c0091460 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.981+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94569447774240] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c4045040 con 0x7fc9c0091460 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.981+0000 7fc9d3d2c800 20 remove_watcher() i=0 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.981+0000 7fc9d3d2c800 2 removed watcher, disabling cache 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.981+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94569447781616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa575820 con 0x5602aa56bcb0 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.982+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94569447781616] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.983+0000 7fc9d3d2c800 20 remove_watcher() i=1 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.983+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94569447776496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa575820 con 0x5602aa5706a0 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.983+0000 7fc9cfa64640 1 -- 172.21.15.50:0/3982572718 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94569447776496] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c0075030 con 0x5602aa5706a0 2024-05-07T13:57:08.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.984+0000 7fc9d3d2c800 20 remove_watcher() i=2 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.984+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94569447783344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa5760f0 con 0x7fc9c0091460 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.984+0000 7fc9cf263640 1 -- 172.21.15.50:0/3982572718 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94569447783344] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c4045040 con 0x7fc9c0091460 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.984+0000 7fc9d3d2c800 20 remove_watcher() i=3 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.984+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94569447792944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa577bb0 con 0x5602aa56bcb0 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.985+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94569447792944] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x5602aa56bcb0 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.986+0000 7fc9d3d2c800 20 remove_watcher() i=4 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.986+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94569447797840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa577bb0 con 0x7fc9c4038040 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.987+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94569447797840] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.987+0000 7fc9d3d2c800 20 remove_watcher() i=5 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.987+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94569447790816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57b450 con 0x7fc9c4038040 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.988+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94569447790816] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.988+0000 7fc9d3d2c800 20 remove_watcher() i=6 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.988+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94569447795248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5602aa57a130 con 0x7fc9c4038040 2024-05-07T13:57:08.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94569447795248] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9c800a4a0 con 0x7fc9c4038040 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 20 remove_watcher() i=7 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc9c4038040 msgr2=0x7fc9c401bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc9c4038040 0x7fc9c401bab0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa56bcb0 msgr2=0x5602aa56e170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa56bcb0 0x5602aa56e170 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc9c0091460 msgr2=0x7fc9c0073210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc9c0091460 0x7fc9c0073210 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa5706a0 msgr2=0x5602aa572a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa5706a0 0x5602aa572a90 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc898036aa0 msgr2=0x7fc898038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc898036aa0 0x7fc898038f60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4001b60 tx=0x7fc9c4010000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 msgr2=0x5602aa560560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d0265640 1 -- 172.21.15.50:0/3982572718 reap_dead start 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa560560 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006c470 tx=0x7fc9c007ff10 comp rx=0 tx=0).stop 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 shutdown_connections 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3982572718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa559240 0x5602aa560560 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 >> 172.21.15.50:0/3982572718 conn(0x5602aa555510 msgr2=0x5602aa552b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 shutdown_connections 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3982572718 wait complete. 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3755899356 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8a8036950 msgr2=0x7fc8a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3755899356 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8a8036950 0x7fc8a8038e10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400bf50 tx=0x7fc9c400f000 comp rx=0 tx=0).stop 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3755899356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa54c0c0 msgr2=0x5602aa54c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.989+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3755899356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa54c0c0 0x5602aa54c4e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc9c008c360 tx=0x7fc9c005ce60 comp rx=0 tx=0).stop 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3755899356 shutdown_connections 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3755899356 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8a8036950 0x7fc8a8038e10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/3755899356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa54c0c0 0x5602aa54c4e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3755899356 >> 172.21.15.50:0/3755899356 conn(0x5602aa540160 msgr2=0x5602aa540560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3755899356 shutdown_connections 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/3755899356 wait complete. 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5602aa53b090 msgr2=0x5602aa53d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5602aa53b090 0x5602aa53d500 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa431380 msgr2=0x5602aa534850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5602aa431380 0x5602aa534850 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa537150 msgr2=0x5602aa539540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5602aa537150 0x5602aa539540 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8b8036950 msgr2=0x7fc8b8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc8b8036950 0x7fc8b8038e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4000f60 tx=0x7fc9c40012b0 comp rx=0 tx=0).stop 2024-05-07T13:57:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 msgr2=0x5602aa52d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 --2- 172.21.15.50:0/4018625409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5602aa430a20 0x5602aa52d610 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0000c00 tx=0x7fc9c0003020 comp rx=0 tx=0).stop 2024-05-07T13:57:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d0265640 1 -- 172.21.15.50:0/4018625409 reap_dead start 2024-05-07T13:57:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 shutdown_connections 2024-05-07T13:57:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 >> 172.21.15.50:0/4018625409 conn(0x5602aa42c5a0 msgr2=0x5602aa51fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 shutdown_connections 2024-05-07T13:57:08.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:08.990+0000 7fc9d3d2c800 1 -- 172.21.15.50:0/4018625409 wait complete. 2024-05-07T13:57:08.988 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-07T13:57:08.975474Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:08.975459Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:09.000 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:57:09.005 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-05-07T13:57:09.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-07T13:57:09.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-07T13:57:09.005 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-05-07T13:57:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.066+0000 7f65ecd0c800 1 Processor -- start 2024-05-07T13:57:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.066+0000 7f65ecd0c800 1 -- start start 2024-05-07T13:57:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.066+0000 7f65ecd0c800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5632d4ba2550 0x5632d4bab050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.066+0000 7f65ecd0c800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632d4b15910 con 0x5632d4ba0a10 2024-05-07T13:57:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.066+0000 7f65ecd0c800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5632d4a33050 con 0x5632d4ba2550 2024-05-07T13:57:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.067+0000 7f65ea011640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5632d4ba2550 0x5632d4bab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.067+0000 7f65ea812640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5632d4ba0a10 0x5632d4ba0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:38452/0 (socket says 172.21.15.50:38452) 2024-05-07T13:57:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.067+0000 7f65ea812640 1 -- 172.21.15.50:0/2120279434 learned_addr learned my addr 172.21.15.50:0/2120279434 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.067+0000 7f65ea011640 1 -- 172.21.15.50:0/2120279434 >> v1:172.21.15.22:6789/0 conn(0x5632d4ba0a10 legacy=0x5632d4ba0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.067+0000 7f65ea011640 1 -- 172.21.15.50:0/2120279434 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d4b15ae0 con 0x5632d4ba2550 2024-05-07T13:57:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65ea011640 1 --2- 172.21.15.50:0/2120279434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba2550 0x5632d4bab050 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f65e000a470 tx=0x7f65e001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b1494c33c2b316 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65e9810640 1 -- 172.21.15.50:0/2120279434 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e0057070 con 0x5632d4ba2550 2024-05-07T13:57:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65e9810640 1 -- 172.21.15.50:0/2120279434 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e0052570 con 0x5632d4ba2550 2024-05-07T13:57:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65e9810640 1 -- 172.21.15.50:0/2120279434 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e0052870 con 0x5632d4ba2550 2024-05-07T13:57:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2120279434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba2550 msgr2=0x5632d4bab050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/2120279434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba2550 0x5632d4bab050 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f65e000a470 tx=0x7f65e001ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2120279434 shutdown_connections 2024-05-07T13:57:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/2120279434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba2550 0x5632d4bab050 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2120279434 >> 172.21.15.50:0/2120279434 conn(0x5632d4b9c570 msgr2=0x5632d4b9e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2120279434 shutdown_connections 2024-05-07T13:57:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.069+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2120279434 wait complete. 2024-05-07T13:57:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.084+0000 7f65ecd0c800 1 Processor -- start 2024-05-07T13:57:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.084+0000 7f65ecd0c800 1 -- start start 2024-05-07T13:57:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.084+0000 7f65ecd0c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c958f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.085+0000 7f65ecd0c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5632d4aed1c0 con 0x5632d4ba0a10 2024-05-07T13:57:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.085+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.085+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c958f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46648/0 (socket says 172.21.15.50:46648) 2024-05-07T13:57:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.085+0000 7f65ea812640 1 -- 172.21.15.50:0/2775833456 learned_addr learned my addr 172.21.15.50:0/2775833456 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.085+0000 7f65ea812640 1 -- 172.21.15.50:0/2775833456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d4c95ec0 con 0x5632d4ba0a10 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.085+0000 7f65ea812640 1 --2- 172.21.15.50:0/2775833456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c958f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f65dc001de0 tx=0x7f65dc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b08de749aa4785 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f64d8e09640 1 -- 172.21.15.50:0/2775833456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc012020 con 0x5632d4ba0a10 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f64d8e09640 1 -- 172.21.15.50:0/2775833456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc00e5a0 con 0x5632d4ba0a10 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f64d8e09640 1 -- 172.21.15.50:0/2775833456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc00e8c0 con 0x5632d4ba0a10 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2775833456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 msgr2=0x5632d4c958f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/2775833456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c958f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f65dc001de0 tx=0x7f65dc00b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2775833456 shutdown_connections 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/2775833456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c958f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2775833456 >> 172.21.15.50:0/2775833456 conn(0x5632d4b9c570 msgr2=0x5632d4c91210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2775833456 shutdown_connections 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.086+0000 7f65ecd0c800 1 -- 172.21.15.50:0/2775833456 wait complete. 2024-05-07T13:57:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.087+0000 7f65ecd0c800 1 Processor -- start 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.087+0000 7f65ecd0c800 1 -- start start 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.087+0000 7f65ecd0c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c9d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.087+0000 7f65ecd0c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5632d4bab860 con 0x5632d4ba0a10 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.087+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c9d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.087+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c9d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46658/0 (socket says 172.21.15.50:46658) 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.087+0000 7f65ea812640 1 -- 172.21.15.50:0/1270011822 learned_addr learned my addr 172.21.15.50:0/1270011822 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.087+0000 7f65ea812640 1 -- 172.21.15.50:0/1270011822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d4c9d9a0 con 0x5632d4ba0a10 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.087+0000 7f65ea812640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c9d460 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c010 tx=0x7f65dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.088+0000 7f64d7606640 1 -- 172.21.15.50:0/1270011822 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc012070 con 0x5632d4ba0a10 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.088+0000 7f64d7606640 1 -- 172.21.15.50:0/1270011822 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc01a7a0 con 0x5632d4ba0a10 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.088+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632d4c9dc30 con 0x5632d4ba0a10 2024-05-07T13:57:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.088+0000 7f64d7606640 1 -- 172.21.15.50:0/1270011822 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc01aa80 con 0x5632d4ba0a10 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.088+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632d4ca08e0 con 0x5632d4ba0a10 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.088+0000 7f64d7606640 1 -- 172.21.15.50:0/1270011822 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65dc015020 con 0x5632d4ba0a10 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.089+0000 7f64d7606640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64d0036900 0x7f64d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.089+0000 7f64d7606640 1 -- 172.21.15.50:0/1270011822 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f65dc020070 con 0x5632d4ba0a10 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.089+0000 7f65ea011640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64d0036900 0x7f64d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.089+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4ba2550 0x5632d4ca46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.089+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ca4c20 con 0x5632d4ba2550 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.089+0000 7f65eb013640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4ba2550 0x5632d4ca46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.089+0000 7f65ea011640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64d0036900 0x7f64d0038dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f65e0054000 tx=0x7f65e004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.089+0000 7f65eb013640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4ba2550 0x5632d4ca46a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.090+0000 7f65eb013640 1 -- 172.21.15.50:0/1270011822 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4ba2550 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.090+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ca1c70 con 0x5632d4ba2550 2024-05-07T13:57:09.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.090+0000 7f65eb013640 1 -- 172.21.15.50:0/1270011822 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4ba2550 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.090+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ca6f80 0x5632d4ca9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.090+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ca9a10 con 0x5632d4ca6f80 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.090+0000 7f65ea812640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ca6f80 0x5632d4ca9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.090+0000 7f65ea812640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ca6f80 0x5632d4ca9370 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.091+0000 7f65ea812640 1 -- 172.21.15.50:0/1270011822 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ca6f80 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.091+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ca5f30 con 0x5632d4ba2550 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.091+0000 7f65eb013640 1 -- 172.21.15.50:0/1270011822 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4ba2550 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.091+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5632d4caaec0 0x5632d4cad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.091+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cada70 con 0x5632d4caaec0 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.091+0000 7f65ea011640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5632d4caaec0 0x5632d4cad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.092+0000 7f65ea011640 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5632d4caaec0 0x5632d4cad310 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.092+0000 7f65ea011640 1 -- 172.21.15.50:0/1270011822 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65e005a040 con 0x5632d4caaec0 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.093+0000 7f65ecd0c800 1 Processor -- start 2024-05-07T13:57:09.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.093+0000 7f65ecd0c800 1 -- start start 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.093+0000 7f65ecd0c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cbbe80 0x5632d4cbc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.093+0000 7f65ecd0c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5632d4a93cf0 con 0x5632d4cbbe80 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.093+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cbbe80 0x5632d4cbc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.093+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cbbe80 0x5632d4cbc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46660/0 (socket says 172.21.15.50:46660) 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.093+0000 7f65ea812640 1 -- 172.21.15.50:0/806029379 learned_addr learned my addr 172.21.15.50:0/806029379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.093+0000 7f65ea812640 1 -- 172.21.15.50:0/806029379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d4cbc7e0 con 0x5632d4cbbe80 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.093+0000 7f65ea812640 1 --2- 172.21.15.50:0/806029379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cbbe80 0x5632d4cbc2a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f65dc04acf0 tx=0x7f65dc02caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.094+0000 7f64d4e01640 1 -- 172.21.15.50:0/806029379 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc04c560 con 0x5632d4cbbe80 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.094+0000 7f64d4e01640 1 -- 172.21.15.50:0/806029379 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc047260 con 0x5632d4cbbe80 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.094+0000 7f65ecd0c800 1 -- 172.21.15.50:0/806029379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632d4cbd250 con 0x5632d4cbbe80 2024-05-07T13:57:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.094+0000 7f64d4e01640 1 -- 172.21.15.50:0/806029379 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc049230 con 0x5632d4cbbe80 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.094+0000 7f65ecd0c800 1 -- 172.21.15.50:0/806029379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632d4cbd750 con 0x5632d4cbbe80 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.094+0000 7f64d4e01640 1 -- 172.21.15.50:0/806029379 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65dc0493d0 con 0x5632d4cbbe80 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.094+0000 7f64d4e01640 1 --2- 172.21.15.50:0/806029379 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64c40369c0 0x7f64c4038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.094+0000 7f64d4e01640 1 -- 172.21.15.50:0/806029379 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f65dc039d50 con 0x5632d4cbbe80 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.095+0000 7f65ea011640 1 --2- 172.21.15.50:0/806029379 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64c40369c0 0x7f64c4038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.095+0000 7f65ecd0c800 1 Processor -- start 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.095+0000 7f65ecd0c800 1 -- start start 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.095+0000 7f65ecd0c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cc9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.095+0000 7f65ecd0c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5632d4c96240 con 0x5632d4cc9000 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.095+0000 7f65ea011640 1 --2- 172.21.15.50:0/806029379 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64c40369c0 0x7f64c4038e80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5632d4ca1b90 tx=0x7f65e0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.095+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cc9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.095+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cc9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46674/0 (socket says 172.21.15.50:46674) 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.095+0000 7f65ea812640 1 -- 172.21.15.50:0/3129617804 learned_addr learned my addr 172.21.15.50:0/3129617804 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f65ea812640 1 -- 172.21.15.50:0/3129617804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d4cc99d0 con 0x5632d4cc9000 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f65ea812640 1 --2- 172.21.15.50:0/3129617804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cc9400 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f65dc024eb0 tx=0x7f65dc022f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35363ff024a3070 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f64ce7fc640 1 -- 172.21.15.50:0/3129617804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc03d040 con 0x5632d4cc9000 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f64ce7fc640 1 -- 172.21.15.50:0/3129617804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc044390 con 0x5632d4cc9000 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f64ce7fc640 1 -- 172.21.15.50:0/3129617804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc0478d0 con 0x5632d4cc9000 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3129617804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 msgr2=0x5632d4cc9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3129617804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cc9400 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f65dc024eb0 tx=0x7f65dc022f80 comp rx=0 tx=0).stop 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3129617804 shutdown_connections 2024-05-07T13:57:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3129617804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cc9400 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3129617804 >> 172.21.15.50:0/3129617804 conn(0x5632d4cc52d0 msgr2=0x5632d4cc3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3129617804 shutdown_connections 2024-05-07T13:57:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.096+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3129617804 wait complete. 2024-05-07T13:57:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.097+0000 7f65ecd0c800 1 Processor -- start 2024-05-07T13:57:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.097+0000 7f65ecd0c800 1 -- start start 2024-05-07T13:57:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.097+0000 7f65ecd0c800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cd0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.097+0000 7f65ecd0c800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5632d4cca0c0 con 0x5632d4cc9000 2024-05-07T13:57:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.097+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cd0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.097+0000 7f65ea812640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cd0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:46676/0 (socket says 172.21.15.50:46676) 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.097+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 learned_addr learned my addr 172.21.15.50:0/3875461769 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.097+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d4cd08a0 con 0x5632d4cc9000 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.097+0000 7f65ea812640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cd0360 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f65dc024eb0 tx=0x7f65dc04ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.098+0000 7f64ccff9640 1 -- 172.21.15.50:0/3875461769 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc03d070 con 0x5632d4cc9000 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.098+0000 7f64ccff9640 1 -- 172.21.15.50:0/3875461769 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc066030 con 0x5632d4cc9000 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.098+0000 7f64ccff9640 1 -- 172.21.15.50:0/3875461769 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65dc04cda0 con 0x5632d4cc9000 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.098+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632d4cd08a0 con 0x5632d4cc9000 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.098+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632d4cd08a0 con 0x5632d4cc9000 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.098+0000 7f64ccff9640 1 -- 172.21.15.50:0/3875461769 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65dc05d040 con 0x5632d4cc9000 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.099+0000 7f64ccff9640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64b4036950 0x7f64b4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.099+0000 7f64ccff9640 1 -- 172.21.15.50:0/3875461769 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f65dc05b020 con 0x5632d4cc9000 2024-05-07T13:57:09.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.099+0000 7f65ea011640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64b4036950 0x7f64b4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.099+0000 7f65ea011640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64b4036950 0x7f64b4038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5632d4cade70 tx=0x7f65e004f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.099+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.099+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4cdbae0 0x5632d4cddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.099+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cde6f0 con 0x5632d4cdbae0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.099+0000 7f65eb013640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4cdbae0 0x5632d4cddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65eb013640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4cdbae0 0x5632d4cddfa0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65ecd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65ecd0c800 20 realm 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cdeb00 con 0x5632d4cdbae0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65ecd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65ecd0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.100+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cdf3d0 con 0x5632d4cdbae0 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65ecd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cdf770 con 0x5632d4cdbae0 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65ecd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ce04d0 0x5632d4ce28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce2ed0 con 0x5632d4ce04d0 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65ea812640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ce04d0 0x5632d4ce28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.101+0000 7f65ea812640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ce04d0 0x5632d4ce28c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.102+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.102+0000 7f65ecd0c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.102+0000 7f65ecd0c800 20 searching for the correct realm 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.102+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce4820 con 0x5632d4ce04d0 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.102+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.102+0000 7f65ea812640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65dc056070 0x7f65dc02e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.102+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce4820 con 0x7f65dc056070 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.102+0000 7f65ea011640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65dc056070 0x7f65dc02e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.102+0000 7f65ea011640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65dc056070 0x7f65dc02e450 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.103+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.103+0000 7f65ea011640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65e0074040 0x7f65e0081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.103+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce4820 con 0x7f65e0074040 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.103+0000 7f65eb013640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65e0074040 0x7f65e0081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.103+0000 7f65eb013640 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65e0074040 0x7f65e0081410 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.104+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.104+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cdf770 con 0x5632d4cdbae0 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.104+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.104+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cdf770 con 0x5632d4cdbae0 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.104+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.104+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cdf770 con 0x5632d4cdbae0 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.104+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.104+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cdf770 con 0x7f65e0074040 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.105+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.105+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cdf770 con 0x7f65dc056070 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.105+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.105+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cdf770 con 0x7f65dc056070 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.105+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.105+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4cdbae0 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.105+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.105+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65e0074040 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.106+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.106+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4cdbae0 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.106+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.106+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65dc056070 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.106+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.106+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4ce04d0 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.106+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.106+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4ce04d0 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.107+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.107+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65e0074040 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.107+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.107+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4ce04d0 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.107+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.107+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4ce04d0 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.108+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.108+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4cdbae0 2024-05-07T13:57:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.108+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.108+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4cdbae0 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.108+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.108+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65e0074040 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.109+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.109+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4ce04d0 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.109+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.109+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65dc056070 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.109+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.109+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4cdbae0 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.109+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.109+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65e0074040 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.110+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.110+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4ce04d0 2024-05-07T13:57:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.110+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.110+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65e0074040 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.110+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.110+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65dc056070 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.111+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.111+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4ce04d0 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.111+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.111+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65dc056070 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.111+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.111+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x5632d4cdbae0 2024-05-07T13:57:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.111+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.111+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f65e008e040 con 0x7f65dc056070 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce3790 con 0x5632d4cdbae0 2024-05-07T13:57:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce3b80 con 0x5632d4cdbae0 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce3b80 con 0x7f65e0074040 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.112+0000 7f65ecd0c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 zone default found 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 4 Realm: () 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 zonegroup default 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce33b0 con 0x7f65e0074040 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce6650 con 0x5632d4ce04d0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce69f0 con 0x5632d4ce04d0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:09.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 started sync module instance, tier type = 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.113+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce5af0 con 0x7f65dc056070 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.114+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.114+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94776318645824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce6d90 con 0x7f65dc056070 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.114+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce7640 con 0x5632d4cdbae0 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.115+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94776318645824] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.116+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.116+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94776318652720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce7a30 con 0x5632d4cdbae0 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.116+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce8490 con 0x5632d4ce04d0 2024-05-07T13:57:09.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.117+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94776318652720] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.117+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.117+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94776318648032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce8880 con 0x5632d4ce04d0 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.117+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce92c0 con 0x7f65dc056070 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.118+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.118+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94776318648032] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.118+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94776318659984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ce9b60 con 0x7f65dc056070 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.118+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cea520 con 0x5632d4cdbae0 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.119+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94776318659984] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.119+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.119+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94776318662800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cea520 con 0x5632d4cdbae0 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.119+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ceaee0 con 0x7f65e0074040 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.120+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.120+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94776318667312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4ceae50 con 0x7f65e0074040 2024-05-07T13:57:09.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.120+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cebeb0 con 0x7f65e0074040 2024-05-07T13:57:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.120+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94776318662800] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.121+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(56 notify.6 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.121+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94776318671264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cebe70 con 0x7f65e0074040 2024-05-07T13:57:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.121+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cec8c0 con 0x7f65e0074040 2024-05-07T13:57:09.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.121+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94776318667312] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(58 notify.7 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94776318671264] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94776318669520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cec410 con 0x7f65e0074040 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65ecd0c800 20 add_watcher() i=0 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65ecd0c800 20 add_watcher() i=1 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65ecd0c800 20 add_watcher() i=2 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65ecd0c800 20 add_watcher() i=3 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65ecd0c800 20 add_watcher() i=4 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65ecd0c800 20 add_watcher() i=5 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.122+0000 7f65ecd0c800 20 add_watcher() i=6 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.123+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94776318669520] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.123+0000 7f65ecd0c800 20 add_watcher() i=7 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.123+0000 7f65ecd0c800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:09.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.123+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cef8f0 con 0x5632d4cdbae0 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.124+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.124+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94776318673936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4cecce0 con 0x5632d4cdbae0 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.125+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94776318673936] v29'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.125+0000 7f64a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.125+0000 7f65ecd0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.125+0000 7f65ecd0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.125+0000 7f65ecd0c800 5 note: GC not initialized 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.125+0000 7f641bfff640 20 reqs_thread_entry: start 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.125+0000 7f65ecd0c800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.125+0000 7f65ecd0c800 20 Filter name: none 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f6419ffb640 20 reqs_thread_entry: start 2024-05-07T13:57:09.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f65ecd0c800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d22c10 con 0x7f65e0074040 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f65ecd0c800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f65ecd0c800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f65ecd0c800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f65ecd0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.126+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d26cd0 con 0x7f65dc056070 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.127+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v29'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.127+0000 7f65ecd0c800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-07T13:57:09.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.127+0000 7f65ecd0c800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-07T13:57:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.127+0000 7f65ecd0c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-07T13:57:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.127+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94776318908336 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d27840 con 0x7f65e0074040 2024-05-07T13:57:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.128+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== watch-notify(notify (1) cookie 94776318667312 notify 124554051602 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f65e403d040 con 0x7f65e0074040 2024-05-07T13:57:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.128+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(64 notify.5 [notify cookie 94776318908336 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.128+0000 7f64ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94776318667312 notifier 4726 bl.length()=382 2024-05-07T13:57:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.128+0000 7f64ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-07T13:57:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.128+0000 7f64ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-07T13:57:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.128+0000 7f64ce7fc640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f64b0003ea0 con 0x7f65e0074040 2024-05-07T13:57:09.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== watch-notify(notify_complete (2) cookie 94776318908336 notify 124554051602 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f65e402f040 con 0x7f65e0074040 2024-05-07T13:57:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d27740 con 0x5632d4cdbae0 2024-05-07T13:57:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 : miss 2024-05-07T13:57:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 20 rados->read ofs=0 len=0 2024-05-07T13:57:09.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 8.19 8:9c34a662:root::.bucket.meta.myfoo6%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d24ef0 con 0x5632d4cdbae0 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(67 .bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 info.flags=0x17 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 to cache LRU end 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.129+0000 7f65ecd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.130+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 8.19 8:9c34a662:root::.bucket.meta.myfoo6%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d2ea50 con 0x5632d4cdbae0 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 .bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v29'6 uv6 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f65ecd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 info.flags=0x17 2024-05-07T13:57:09.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f65ecd0c800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 to cache LRU end 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f65ecd0c800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f65ecd0c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9, ofs0, ns] 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94776318907744 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d2d6c0 con 0x7f65dc056070 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== watch-notify(notify (1) cookie 94776318659984 notify 124554051621 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f65e0088040 con 0x7f65dc056070 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(69 notify.3 [notify cookie 94776318907744 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f64ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051621 cookie 94776318659984 notifier 4726 bl.length()=748 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f64ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 info.flags=0x17 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f64ce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 to cache LRU end 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f64ce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.131+0000 7f64ce7fc640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f64b0003ea0 con 0x7f65dc056070 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.132+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== watch-notify(notify_complete (2) cookie 94776318907744 notify 124554051621 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632d4b15ae0 con 0x7f65dc056070 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.132+0000 7f65ecd0c800 20 handle_bi_update(): bucket=:myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9]): orig_sources= new_sources= 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.132+0000 7f65ecd0c800 20 handle_bi_update(): bucket=:myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9]): potential sources added=[] removed=[] 2024-05-07T13:57:09.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.132+0000 7f65ecd0c800 20 handle_bi_update(): bucket=:myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9]): orig_dests= new_dests= 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.132+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.132+0000 7f65ecd0c800 20 handle_bi_update(): bucket=:myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9]): potential dests added=[] removed=[] 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.132+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d2d210 con 0x5632d4cdbae0 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.133+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(71 bud.buckets [call] v29'7 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.133+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d2d210 con 0x5632d4cdbae0 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.134+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(72 bud.buckets [call] v29'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.134+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d2e220 con 0x5632d4cdbae0 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v29'19 uv19 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f65ecd0c800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f65ecd0c800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f65ecd0c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94776318907712 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d2e220 con 0x7f65dc056070 2024-05-07T13:57:09.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== watch-notify(notify (1) cookie 94776318659984 notify 124554051622 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7f65e0081950 con 0x7f65dc056070 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f64ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051622 cookie 94776318659984 notifier 4726 bl.length()=316 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f64ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f64ce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(74 notify.3 [notify cookie 94776318907712 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.135+0000 7f64ce7fc640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f64b0003ea0 con 0x7f65dc056070 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.136+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== watch-notify(notify_complete (2) cookie 94776318907712 notify 124554051622 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f65e0081b20 con 0x7f65dc056070 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.136+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.136+0000 7f65ecd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 : hit (requested=0x17, cached=0x17) 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.136+0000 7f65ecd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.136+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 8.19 8:9c34a662:root::.bucket.meta.myfoo6%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d263f0 con 0x5632d4cdbae0 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(76 .bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v29'9 uv9 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f65ecd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 info.flags=0x17 2024-05-07T13:57:09.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f65ecd0c800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 to cache LRU end 2024-05-07T13:57:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f65ecd0c800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-07T13:57:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f65ecd0c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9, ofs0, ns] 2024-05-07T13:57:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94776318908944 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d28c80 con 0x7f65dc056070 2024-05-07T13:57:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== watch-notify(notify (1) cookie 94776318659984 notify 124554051623 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f65e0081b20 con 0x7f65dc056070 2024-05-07T13:57:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(77 notify.3 [notify cookie 94776318908944 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f64cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051623 cookie 94776318659984 notifier 4726 bl.length()=748 2024-05-07T13:57:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f64cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 info.flags=0x17 2024-05-07T13:57:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f64cdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 to cache LRU end 2024-05-07T13:57:09.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f64cdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.137+0000 7f64cdffb640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6420003470 con 0x7f65dc056070 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== watch-notify(notify_complete (2) cookie 94776318908944 notify 124554051623 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f65e00997d0 con 0x7f65dc056070 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ecd0c800 20 handle_bi_update(): bucket=:myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9]): orig_sources= new_sources= 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ecd0c800 20 handle_bi_update(): bucket=:myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9]): potential sources added=[] removed=[] 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ecd0c800 20 handle_bi_update(): bucket=:myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9]): orig_dests= new_dests= 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ecd0c800 20 handle_bi_update(): bucket=:myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9]): potential dests added=[] removed=[] 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:79 4.22 4:462a00f5:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4cdbae0 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(79 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:80 4.1f 4:fb6a4abc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4ce04d0 2024-05-07T13:57:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(80 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.138+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:81 4.10 4:09a0a451:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4ce04d0 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.139+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(81 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.139+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 4.0 4:009ab4d8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4ce04d0 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.139+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(82 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.139+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:83 4.16 4:68f47a17:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4ce04d0 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.139+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(83 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.139+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:84 4.3e 4:7ef75f7c:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x7f65dc056070 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.140+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 26 ==== osd_op_reply(84 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.140+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:85 4.22 4:46940a90:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4cdbae0 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.140+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(85 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.140+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:86 4.26 4:6465abf7:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x7f65e0074040 2024-05-07T13:57:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.140+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(86 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.140+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 4.1f 4:faa6a74d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4ce04d0 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.141+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(87 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65dc02b070 con 0x5632d4ce04d0 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.141+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:88 4.29 4:967c563d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4ce04d0 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.141+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(88 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 [call out=376b] v0'0 uv5 ondisk = 0) ==== 194+0+376 (crc 0 0 0) 0x7f65dc092040 con 0x5632d4ce04d0 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.141+0000 7f65ecd0c800 10 cls_bucket_list_unordered: got thirteen 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.141+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 4.19 4:9aa0c7c3:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4ce04d0 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.141+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(89 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65dc092040 con 0x5632d4ce04d0 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.141+0000 7f65ecd0c800 20 get_obj_state: octx=0x7f65e400aaf0 obj=myfoo6:thirteen state=0x5632d4d23978 s->prefetch_data=0 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.141+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:90 3.2s0 3:437497b3:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d25a10 con 0x5632d4ce04d0 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(90 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9_thirteen [getxattrs out=852b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+868 (crc 0 0 0) 0x7f65dc092040 con 0x5632d4ce04d0 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 10 manifest: total_size = 8 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 get_obj_state: setting s->obj_tag to 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.334983720857961816 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 Read xattr rgw_rados: user.rgw.acl 2024-05-07T13:57:09.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 Read xattr rgw_rados: user.rgw.content_type 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 Read xattr rgw_rados: user.rgw.etag 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 Read xattr rgw_rados: user.rgw.idtag 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 Read xattr rgw_rados: user.rgw.manifest 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 get_obj_state: octx=0x7f65e400aaf0 obj=myfoo6:thirteen state=0x5632d4d23978 s->prefetch_data=0 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 : hit (requested=0x17, cached=0x17) 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.142+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 4.29 4:967c563d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d32120 con 0x5632d4ce04d0 2024-05-07T13:57:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.143+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(91 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 [stat,call,call] v29'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f65dc092040 con 0x5632d4ce04d0 2024-05-07T13:57:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.143+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:92 3.2s0 3:437497b3:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9_thirteen:head [cmpxattr user.rgw.idtag (61) op 1 mode 1 in=75b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d305b0 con 0x5632d4ce04d0 2024-05-07T13:57:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.144+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(92 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9_thirteen [cmpxattr (61) op 1 mode 1,setxattr (117),setxattr (33)] v29'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f65dc092040 con 0x5632d4ce04d0 2024-05-07T13:57:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.144+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:93 4.29 4:967c563d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d31990 con 0x5632d4ce04d0 2024-05-07T13:57:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:1 objects processed in :myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9]). Next marker thirteen 2024-05-07T13:57:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.144+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d261e0 con 0x7f65dc056070 2024-05-07T13:57:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(93 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 [stat,call,call] v29'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f65dc092040 con 0x5632d4ce04d0 2024-05-07T13:57:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f64cdffb640 20 handle_completion(): completion ok for obj=thirteen 2024-05-07T13:57:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 27 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v29'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f65ecd0c800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f65ecd0c800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f65ecd0c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94776318915520 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d31990 con 0x7f65e0074040 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== watch-notify(notify (1) cookie 94776318667312 notify 124554051603 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5632d4d252e0 con 0x7f65e0074040 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f64ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051603 cookie 94776318667312 notifier 4726 bl.length()=556 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f64ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f64ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(95 notify.5 [notify cookie 94776318915520 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.146+0000 7f64ce7fc640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f64b0003ea0 con 0x7f65e0074040 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.147+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== watch-notify(notify_complete (2) cookie 94776318915520 notify 124554051603 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632d4d2bcb0 con 0x7f65e0074040 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.147+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.147+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x5632d4cdbae0 2024-05-07T13:57:09.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f65ecd0c800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f65ecd0c800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f65ecd0c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94776318915488 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x7f65e0074040 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== watch-notify(notify (1) cookie 94776318667312 notify 124554051604 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5632d4d2bcb0 con 0x7f65e0074040 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f64ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051604 cookie 94776318667312 notifier 4726 bl.length()=177 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f64ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f64ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(98 notify.5 [notify cookie 94776318915488 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.148+0000 7f64ce7fc640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f64b0003ea0 con 0x7f65e0074040 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.149+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== watch-notify(notify_complete (2) cookie 94776318915488 notify 124554051604 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632d4d247a0 con 0x7f65e0074040 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.149+0000 7f65ecd0c800 10 removing user index: bar 2024-05-07T13:57:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.149+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.149+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x7f65e0074040 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(100 bar [delete] v29'6 uv6 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f65ecd0c800 10 removing default.rgw.meta+users.uid+bar from cache 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f65ecd0c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94776318915488 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x7f65e0074040 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== watch-notify(notify (1) cookie 94776318669520 notify 124554051605 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5632d4d247a0 con 0x7f65e0074040 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f64cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94776318669520 notifier 4726 bl.length()=152 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== osd_op_reply(101 notify.7 [notify cookie 94776318915488 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f64cdffb640 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6420003450 con 0x7f65e0074040 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== watch-notify(notify_complete (2) cookie 94776318915488 notify 124554051605 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f65e402f040 con 0x7f65e0074040 2024-05-07T13:57:09.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.150+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.167 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-07T13:57:08.975474Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:08.975459Z","tags":[],"group_ids":[]} 2024-05-07T13:57:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.151+0000 7f64a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.151+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94776318673936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x5632d4cdbae0 2024-05-07T13:57:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.152+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94776318673936] v29'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.152+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94776318645824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x7f65dc056070 2024-05-07T13:57:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.153+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 28 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94776318645824] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.153+0000 7f65ecd0c800 20 remove_watcher() i=0 2024-05-07T13:57:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.153+0000 7f65ecd0c800 2 removed watcher, disabling cache 2024-05-07T13:57:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.153+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94776318652720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x5632d4cdbae0 2024-05-07T13:57:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.154+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94776318652720] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.155+0000 7f65ecd0c800 20 remove_watcher() i=1 2024-05-07T13:57:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.155+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94776318648032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x5632d4ce04d0 2024-05-07T13:57:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.156+0000 7f65ea812640 1 -- 172.21.15.50:0/3875461769 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94776318648032] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65dc092040 con 0x5632d4ce04d0 2024-05-07T13:57:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.156+0000 7f65ecd0c800 20 remove_watcher() i=2 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.156+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94776318659984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x7f65dc056070 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.157+0000 7f65ea011640 1 -- 172.21.15.50:0/3875461769 <== osd.2 v2:172.21.15.50:6808/2034796854 29 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94776318659984] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e007f070 con 0x7f65dc056070 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.157+0000 7f65ecd0c800 20 remove_watcher() i=3 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.157+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94776318662800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x5632d4cdbae0 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.158+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94776318662800] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x5632d4cdbae0 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.158+0000 7f65ecd0c800 20 remove_watcher() i=4 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.158+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94776318667312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x7f65e0074040 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.159+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94776318667312] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.159+0000 7f65ecd0c800 20 remove_watcher() i=5 2024-05-07T13:57:09.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.159+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94776318671264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x7f65e0074040 2024-05-07T13:57:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.160+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94776318671264] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.160+0000 7f65ecd0c800 20 remove_watcher() i=6 2024-05-07T13:57:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.160+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94776318669520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5632d4d314e0 con 0x7f65e0074040 2024-05-07T13:57:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.161+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94776318669520] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400a4a0 con 0x7f65e0074040 2024-05-07T13:57:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 20 remove_watcher() i=7 2024-05-07T13:57:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65e0074040 msgr2=0x7f65e0081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65e0074040 0x7f65e0081410 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4cdbae0 msgr2=0x5632d4cddfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4cdbae0 0x5632d4cddfa0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65dc056070 msgr2=0x7f65dc02e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65dc056070 0x7f65dc02e450 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ce04d0 msgr2=0x5632d4ce28c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ce04d0 0x5632d4ce28c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64b4036950 msgr2=0x7f64b4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64b4036950 0x7f64b4038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5632d4cade70 tx=0x7f65e004f000 comp rx=0 tx=0).stop 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 msgr2=0x5632d4cd0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/3875461769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cc9000 0x5632d4cd0360 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f65dc024eb0 tx=0x7f65dc04ef70 comp rx=0 tx=0).stop 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65eb013640 1 -- 172.21.15.50:0/3875461769 reap_dead start 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 shutdown_connections 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 >> 172.21.15.50:0/3875461769 conn(0x5632d4cc52d0 msgr2=0x5632d4cc2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 shutdown_connections 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/3875461769 wait complete. 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/806029379 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64c40369c0 msgr2=0x7f64c4038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/806029379 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64c40369c0 0x7f64c4038e80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5632d4ca1b90 tx=0x7f65e0005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/806029379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cbbe80 msgr2=0x5632d4cbc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/806029379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cbbe80 0x5632d4cbc2a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f65dc04acf0 tx=0x7f65dc02caa0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/806029379 shutdown_connections 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/806029379 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64c40369c0 0x7f64c4038e80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/806029379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4cbbe80 0x5632d4cbc2a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/806029379 >> 172.21.15.50:0/806029379 conn(0x5632d4caff20 msgr2=0x5632d4cb0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.162+0000 7f65ecd0c800 1 -- 172.21.15.50:0/806029379 shutdown_connections 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/806029379 wait complete. 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5632d4caaec0 msgr2=0x5632d4cad310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5632d4caaec0 0x5632d4cad310 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4ba2550 msgr2=0x5632d4ca46a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5632d4ba2550 0x5632d4ca46a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ca6f80 msgr2=0x5632d4ca9370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5632d4ca6f80 0x5632d4ca9370 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64d0036900 msgr2=0x7f64d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f64d0036900 0x7f64d0038dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f65e0054000 tx=0x7f65e004e000 comp rx=0 tx=0).stop 2024-05-07T13:57:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 msgr2=0x5632d4c9d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 --2- 172.21.15.50:0/1270011822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5632d4ba0a10 0x5632d4c9d460 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00c010 tx=0x7f65dc000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65eb013640 1 -- 172.21.15.50:0/1270011822 reap_dead start 2024-05-07T13:57:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 shutdown_connections 2024-05-07T13:57:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 >> 172.21.15.50:0/1270011822 conn(0x5632d4b9c570 msgr2=0x5632d4c8fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 shutdown_connections 2024-05-07T13:57:09.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:09.163+0000 7f65ecd0c800 1 -- 172.21.15.50:0/1270011822 wait complete. 2024-05-07T13:57:09.183 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-07T13:57:08.975474Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:08.975459Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:14.191 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:57:14.191 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-07T13:57:14.192 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-07T13:57:14.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-07T13:57:14.192 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-05-07T13:57:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:14.253 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.267+0000 7f5f0ec1f800 1 Processor -- start 2024-05-07T13:57:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.267+0000 7f5f0ec1f800 1 -- start start 2024-05-07T13:57:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.267+0000 7f5f0ec1f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56169e0c7570 0x56169e0d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.267+0000 7f5f0ec1f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56169e03a0d0 con 0x56169e0c5a30 2024-05-07T13:57:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.267+0000 7f5f0ec1f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x56169df58050 con 0x56169e0c7570 2024-05-07T13:57:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.267+0000 7f5f0bf1d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x56169e0c7570 0x56169e0d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.268+0000 7f5f0c71e640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x56169e0c5a30 0x56169e0c5e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:47546/0 (socket says 172.21.15.50:47546) 2024-05-07T13:57:14.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.268+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3786532441 learned_addr learned my addr 172.21.15.50:0/3786532441 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.268+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3786532441 >> v1:172.21.15.22:6789/0 conn(0x56169e0c5a30 legacy=0x56169e0c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.268+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3786532441 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169e0d15c0 con 0x56169e0c7570 2024-05-07T13:57:14.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.270+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/3786532441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c7570 0x56169e0d0070 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000a470 tx=0x7f5f0001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305cc1b0f1ee4512 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.270+0000 7f5f0b71c640 1 -- 172.21.15.50:0/3786532441 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f00057070 con 0x56169e0c7570 2024-05-07T13:57:14.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.270+0000 7f5f0b71c640 1 -- 172.21.15.50:0/3786532441 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0004adc0 con 0x56169e0c7570 2024-05-07T13:57:14.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.270+0000 7f5f0b71c640 1 -- 172.21.15.50:0/3786532441 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f00052590 con 0x56169e0c7570 2024-05-07T13:57:14.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.271+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3786532441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c7570 msgr2=0x56169e0d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.271+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3786532441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c7570 0x56169e0d0070 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000a470 tx=0x7f5f0001ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.271+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3786532441 shutdown_connections 2024-05-07T13:57:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.271+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3786532441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c7570 0x56169e0d0070 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.271+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3786532441 >> 172.21.15.50:0/3786532441 conn(0x56169e0c15f0 msgr2=0x56169e0c3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.271+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3786532441 shutdown_connections 2024-05-07T13:57:14.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.271+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3786532441 wait complete. 2024-05-07T13:57:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.288+0000 7f5f0ec1f800 1 Processor -- start 2024-05-07T13:57:14.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.288+0000 7f5f0ec1f800 1 -- start start 2024-05-07T13:57:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.288+0000 7f5f0ec1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1bab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.288+0000 7f5f0ec1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56169e0121f0 con 0x56169e0c5a30 2024-05-07T13:57:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.288+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.288+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1bab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60692/0 (socket says 172.21.15.50:60692) 2024-05-07T13:57:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.288+0000 7f5f0c71e640 1 -- 172.21.15.50:0/2134739388 learned_addr learned my addr 172.21.15.50:0/2134739388 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.288+0000 7f5f0c71e640 1 -- 172.21.15.50:0/2134739388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169e1bb0e0 con 0x56169e0c5a30 2024-05-07T13:57:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.289+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/2134739388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1bab10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5efc001de0 tx=0x7f5efc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228d70f85db5cd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.289+0000 7f5dfa60c640 1 -- 172.21.15.50:0/2134739388 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc012020 con 0x56169e0c5a30 2024-05-07T13:57:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.289+0000 7f5dfa60c640 1 -- 172.21.15.50:0/2134739388 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc00e5a0 con 0x56169e0c5a30 2024-05-07T13:57:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.289+0000 7f5dfa60c640 1 -- 172.21.15.50:0/2134739388 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc00e8c0 con 0x56169e0c5a30 2024-05-07T13:57:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/2134739388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 msgr2=0x56169e1bab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/2134739388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1bab10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5efc001de0 tx=0x7f5efc00b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/2134739388 shutdown_connections 2024-05-07T13:57:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/2134739388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1bab10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/2134739388 >> 172.21.15.50:0/2134739388 conn(0x56169e0c15f0 msgr2=0x56169e1b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/2134739388 shutdown_connections 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/2134739388 wait complete. 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 Processor -- start 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 -- start start 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.290+0000 7f5f0ec1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56169e0d0880 con 0x56169e0c5a30 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1c2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60708/0 (socket says 172.21.15.50:60708) 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5f0c71e640 1 -- 172.21.15.50:0/1681331084 learned_addr learned my addr 172.21.15.50:0/1681331084 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5f0c71e640 1 -- 172.21.15.50:0/1681331084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169e1c2b70 con 0x56169e0c5a30 2024-05-07T13:57:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1c2630 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00c010 tx=0x7f5efc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5df8e09640 1 -- 172.21.15.50:0/1681331084 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc012070 con 0x56169e0c5a30 2024-05-07T13:57:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5df8e09640 1 -- 172.21.15.50:0/1681331084 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc01a7a0 con 0x56169e0c5a30 2024-05-07T13:57:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56169e1c2e00 con 0x56169e0c5a30 2024-05-07T13:57:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5df8e09640 1 -- 172.21.15.50:0/1681331084 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc01aa80 con 0x56169e0c5a30 2024-05-07T13:57:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.291+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169e1c5ab0 con 0x56169e0c5a30 2024-05-07T13:57:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.292+0000 7f5df8e09640 1 -- 172.21.15.50:0/1681331084 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5efc015020 con 0x56169e0c5a30 2024-05-07T13:57:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.292+0000 7f5df8e09640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036900 0x7f5df4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.293+0000 7f5df8e09640 1 -- 172.21.15.50:0/1681331084 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5efc020070 con 0x56169e0c5a30 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.293+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036900 0x7f5df4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.293+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e0c7570 0x56169e1c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.293+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e1c9db0 con 0x56169e0c7570 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.293+0000 7f5f0cf1f640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e0c7570 0x56169e1c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.293+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036900 0x7f5df4038dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5f00054000 tx=0x7f5f0004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.293+0000 7f5f0cf1f640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e0c7570 0x56169e1c9870 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.294+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/1681331084 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e0c7570 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.294+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e1c6e40 con 0x56169e0c7570 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.294+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/1681331084 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e0c7570 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.294+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e1cc100 0x56169e1ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.294+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e1cebe0 con 0x56169e1cc100 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.294+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e1cc100 0x56169e1ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.294+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e1cc100 0x56169e1ce4f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.295+0000 7f5f0c71e640 1 -- 172.21.15.50:0/1681331084 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e1cc100 2024-05-07T13:57:14.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.295+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e1cb0b0 con 0x56169e0c7570 2024-05-07T13:57:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.295+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/1681331084 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e0c7570 2024-05-07T13:57:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.295+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56169e1d0090 0x56169e1d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.295+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e1d2c40 con 0x56169e1d0090 2024-05-07T13:57:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.295+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56169e1d0090 0x56169e1d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.296+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56169e1d0090 0x56169e1d24e0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.296+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/1681331084 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f0005a040 con 0x56169e1d0090 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.297+0000 7f5f0ec1f800 1 Processor -- start 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.297+0000 7f5f0ec1f800 1 -- start start 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.297+0000 7f5f0ec1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1e10a0 0x56169e1e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.297+0000 7f5f0ec1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56169dfb8cf0 con 0x56169e1e10a0 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.297+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1e10a0 0x56169e1e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.297+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1e10a0 0x56169e1e14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60712/0 (socket says 172.21.15.50:60712) 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.297+0000 7f5f0c71e640 1 -- 172.21.15.50:0/1903295988 learned_addr learned my addr 172.21.15.50:0/1903295988 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.297+0000 7f5f0c71e640 1 -- 172.21.15.50:0/1903295988 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169e1e1a00 con 0x56169e1e10a0 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.298+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/1903295988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1e10a0 0x56169e1e14c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5efc04acf0 tx=0x7f5efc02caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.298+0000 7f5df1ffb640 1 -- 172.21.15.50:0/1903295988 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc04c560 con 0x56169e1e10a0 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.298+0000 7f5df1ffb640 1 -- 172.21.15.50:0/1903295988 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc047260 con 0x56169e1e10a0 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.298+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1903295988 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56169e1e2470 con 0x56169e1e10a0 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.298+0000 7f5df1ffb640 1 -- 172.21.15.50:0/1903295988 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc049230 con 0x56169e1e10a0 2024-05-07T13:57:14.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.298+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1903295988 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169e1e2970 con 0x56169e1e10a0 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.299+0000 7f5df1ffb640 1 -- 172.21.15.50:0/1903295988 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5efc0493d0 con 0x56169e1e10a0 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.299+0000 7f5df1ffb640 1 --2- 172.21.15.50:0/1903295988 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5de4036950 0x7f5de4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.299+0000 7f5df1ffb640 1 -- 172.21.15.50:0/1903295988 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5efc039d50 con 0x56169e1e10a0 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.299+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/1903295988 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5de4036950 0x7f5de4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.299+0000 7f5f0ec1f800 1 Processor -- start 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.299+0000 7f5f0ec1f800 1 -- start start 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.299+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/1903295988 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5de4036950 0x7f5de4038e10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x56169e1ca6b0 tx=0x7f5f00005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.299+0000 7f5f0ec1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.300+0000 7f5f0ec1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56169e1bb460 con 0x56169e1ee220 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.300+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.300+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1ee640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60718/0 (socket says 172.21.15.50:60718) 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.300+0000 7f5f0c71e640 1 -- 172.21.15.50:0/1956731837 learned_addr learned my addr 172.21.15.50:0/1956731837 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.300+0000 7f5f0c71e640 1 -- 172.21.15.50:0/1956731837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169e1eec10 con 0x56169e1ee220 2024-05-07T13:57:14.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.300+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/1956731837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1ee640 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0497b0 tx=0x7f5efc024dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52dba900dafbb8e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.300+0000 7f5deb7fe640 1 -- 172.21.15.50:0/1956731837 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc03d040 con 0x56169e1ee220 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.300+0000 7f5deb7fe640 1 -- 172.21.15.50:0/1956731837 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc044390 con 0x56169e1ee220 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.300+0000 7f5deb7fe640 1 -- 172.21.15.50:0/1956731837 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc030110 con 0x56169e1ee220 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1956731837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 msgr2=0x56169e1ee640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1956731837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1ee640 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0497b0 tx=0x7f5efc024dc0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1956731837 shutdown_connections 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1956731837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1ee640 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1956731837 >> 172.21.15.50:0/1956731837 conn(0x56169e1ea4f0 msgr2=0x56169e1e8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1956731837 shutdown_connections 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1956731837 wait complete. 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 Processor -- start 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 -- start start 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.301+0000 7f5f0ec1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56169e1ef270 con 0x56169e1ee220 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.302+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.302+0000 7f5f0c71e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60726/0 (socket says 172.21.15.50:60726) 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.302+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 learned_addr learned my addr 172.21.15.50:0/3413663667 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.302+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169e1f5a80 con 0x56169e1ee220 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.302+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1f5540 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5efc039fc0 tx=0x7f5efc04ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.303+0000 7f5de9ffb640 1 -- 172.21.15.50:0/3413663667 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc03d070 con 0x56169e1ee220 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.303+0000 7f5de9ffb640 1 -- 172.21.15.50:0/3413663667 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc066030 con 0x56169e1ee220 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.303+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56169e1f5a80 con 0x56169e1ee220 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.303+0000 7f5de9ffb640 1 -- 172.21.15.50:0/3413663667 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5efc04ca70 con 0x56169e1ee220 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.303+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169e1f5a80 con 0x56169e1ee220 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.304+0000 7f5de9ffb640 1 -- 172.21.15.50:0/3413663667 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5efc05d040 con 0x56169e1ee220 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.304+0000 7f5de9ffb640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5ddc036900 0x7f5ddc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.304+0000 7f5de9ffb640 1 -- 172.21.15.50:0/3413663667 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5efc05b020 con 0x56169e1ee220 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.304+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5ddc036900 0x7f5ddc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.304+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5ddc036900 0x7f5ddc038dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5f00055040 tx=0x7f5f00060040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e200ce0 0x56169e2031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e2038f0 con 0x56169e200ce0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0cf1f640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e200ce0 0x56169e2031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0cf1f640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e200ce0 0x56169e2031a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0ec1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0ec1f800 20 realm 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.305+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e203d00 con 0x56169e200ce0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:14.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e2045d0 con 0x56169e200ce0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e2056d0 0x56169e207ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e2080d0 con 0x56169e2056d0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.306+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e2056d0 0x56169e207ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.307+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e2056d0 0x56169e207ac0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.307+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.307+0000 7f5f0ec1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.307+0000 7f5f0ec1f800 20 searching for the correct realm 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.307+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e2099e0 con 0x56169e2056d0 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.307+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.307+0000 7f5f0c71e640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5efc056070 0x7f5efc016550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.307+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e2099e0 con 0x7f5efc056070 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.308+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5efc056070 0x7f5efc016550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.308+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5efc056070 0x7f5efc016550 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.308+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.308+0000 7f5f0bf1d640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f00081040 0x7f5f00082940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.308+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e2099e0 con 0x7f5f00081040 2024-05-07T13:57:14.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.309+0000 7f5f0cf1f640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f00081040 0x7f5f00082940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.309+0000 7f5f0cf1f640 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f00081040 0x7f5f00082940 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.309+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.309+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.310+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.310+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.310+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.310+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.310+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.310+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5f00081040 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.310+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.310+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5efc056070 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.311+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.311+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5efc056070 2024-05-07T13:57:14.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.311+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.311+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.311+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.311+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5f00081040 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.312+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.312+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.312+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.312+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5efc056070 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.312+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.312+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e2056d0 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.312+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.312+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e2056d0 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.313+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.313+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5f00081040 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.313+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.313+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e2056d0 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.313+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.313+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e2056d0 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.314+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.314+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.314+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.314+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.314+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.314+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5f00081040 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.314+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.314+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e2056d0 2024-05-07T13:57:14.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.315+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.315+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5efc056070 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.315+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.315+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.315+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.315+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5f00081040 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.316+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.316+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e2056d0 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.316+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.316+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5f00081040 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.316+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.316+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5efc056070 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.317+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.317+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e2056d0 2024-05-07T13:57:14.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.317+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.317+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5efc056070 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.317+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.317+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x56169e200ce0 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.317+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.317+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56169e204970 con 0x7f5efc056070 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e208990 con 0x56169e200ce0 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e208d80 con 0x56169e200ce0 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.318+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e208d80 con 0x7f5f00081040 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 20 zone default found 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 4 Realm: () 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:14.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 20 zonegroup default 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e2085f0 con 0x7f5f00081040 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e2085f0 con 0x56169e2056d0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.319+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e20b910 con 0x56169e2056d0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.320+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.320+0000 7f5f0ec1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.320+0000 7f5f0ec1f800 20 started sync module instance, tier type = 2024-05-07T13:57:14.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.320+0000 7f5f0ec1f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:14.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.320+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20ace0 con 0x7f5efc056070 2024-05-07T13:57:14.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.321+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.321+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94655142211792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20c220 con 0x7f5efc056070 2024-05-07T13:57:14.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.321+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20ca70 con 0x56169e200ce0 2024-05-07T13:57:14.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.322+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94655142211792] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.322+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.322+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94655142215024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20ca70 con 0x56169e200ce0 2024-05-07T13:57:14.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.322+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20d570 con 0x56169e2056d0 2024-05-07T13:57:14.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.324+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94655142215024] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.324+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.324+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94655142217152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20c9e0 con 0x56169e2056d0 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.324+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20e430 con 0x7f5efc056070 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.325+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94655142217152] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.325+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.325+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94655142222176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20ec80 con 0x7f5efc056070 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.325+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20f640 con 0x56169e200ce0 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.326+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94655142222176] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.327+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.327+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94655142228368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20fa60 con 0x56169e200ce0 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.327+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e210420 con 0x7f5f00081040 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.328+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94655142228368] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.328+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.328+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94655142229904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e210420 con 0x7f5f00081040 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.328+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e210de0 con 0x7f5f00081040 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.329+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(56 notify.6 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.329+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94655142234416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e210d50 con 0x7f5f00081040 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.329+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e211d80 con 0x7f5f00081040 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.329+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94655142229904] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94655142234416] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94655142238288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e211180 con 0x7f5f00081040 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0ec1f800 20 add_watcher() i=0 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0ec1f800 20 add_watcher() i=1 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0ec1f800 20 add_watcher() i=2 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0ec1f800 20 add_watcher() i=3 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0ec1f800 20 add_watcher() i=4 2024-05-07T13:57:14.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0ec1f800 20 add_watcher() i=5 2024-05-07T13:57:14.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.330+0000 7f5f0ec1f800 20 add_watcher() i=6 2024-05-07T13:57:14.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.332+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94655142238288] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.332+0000 7f5f0ec1f800 20 add_watcher() i=7 2024-05-07T13:57:14.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.332+0000 7f5f0ec1f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:14.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.332+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e214d70 con 0x56169e200ce0 2024-05-07T13:57:14.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.332+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.332+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94655142231920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e2121f0 con 0x56169e200ce0 2024-05-07T13:57:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.333+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94655142231920] v29'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.333+0000 7f5dc27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.333+0000 7f5f0ec1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.333+0000 7f5f0ec1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.334+0000 7f5f0ec1f800 5 note: GC not initialized 2024-05-07T13:57:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.334+0000 7f5dc17e2640 20 reqs_thread_entry: start 2024-05-07T13:57:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.334+0000 7f5f0ec1f800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:14.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.334+0000 7f5f0ec1f800 20 Filter name: none 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.334+0000 7f5d32ffd640 20 reqs_thread_entry: start 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.334+0000 7f5f0ec1f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.334+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.334+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e2481d0 con 0x7f5f00081040 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e246970 con 0x7f5f00081040 2024-05-07T13:57:14.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.335+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e247240 con 0x7f5f00081040 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.336+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v29'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.336+0000 7f5f0ec1f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.336+0000 7f5f0ec1f800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.336+0000 7f5f0ec1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.336+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94655142456720 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e24bb10 con 0x7f5f00081040 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.336+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== watch-notify(notify (1) cookie 94655142229904 notify 124554051606 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56169e2475e0 con 0x7f5f00081040 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.337+0000 7f5deb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 94655142229904 notifier 4733 bl.length()=556 2024-05-07T13:57:14.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.337+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(65 notify.5 [notify cookie 94655142456720 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.337+0000 7f5deb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-07T13:57:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.337+0000 7f5deb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:57:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.337+0000 7f5deb7fe640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f5dd0003ea0 con 0x7f5f00081040 2024-05-07T13:57:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.337+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.337+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== watch-notify(notify_complete (2) cookie 94655142456720 notify 124554051606 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56169e246a70 con 0x7f5f00081040 2024-05-07T13:57:14.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.337+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e249640 con 0x7f5f00081040 2024-05-07T13:57:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.338+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.338+0000 7f5f0ec1f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-07T13:57:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.338+0000 7f5f0ec1f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:57:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.338+0000 7f5f0ec1f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-07T13:57:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.338+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94655142456640 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56169e24bb10 con 0x56169e2056d0 2024-05-07T13:57:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.339+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== watch-notify(notify (1) cookie 94655142217152 notify 124554051590 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56169e1e2470 con 0x56169e2056d0 2024-05-07T13:57:14.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.339+0000 7f5deb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94655142217152 notifier 4733 bl.length()=177 2024-05-07T13:57:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.339+0000 7f5deb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-07T13:57:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.339+0000 7f5deb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-07T13:57:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.339+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(68 notify.2 [notify cookie 94655142456640 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.339+0000 7f5deb7fe640 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f5dd0003ea0 con 0x56169e2056d0 2024-05-07T13:57:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.339+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== watch-notify(notify_complete (2) cookie 94655142456640 notify 124554051590 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56169e1e1a00 con 0x56169e2056d0 2024-05-07T13:57:14.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.339+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.330 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-07T13:57:14.335796Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:14.335776Z","tags":[],"group_ids":[]} 2024-05-07T13:57:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.340+0000 7f5dc27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.340+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94655142231920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e1fd410 con 0x56169e200ce0 2024-05-07T13:57:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.341+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94655142231920] v29'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.341+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94655142211792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20ff70 con 0x7f5efc056070 2024-05-07T13:57:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.342+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94655142211792] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.342+0000 7f5f0ec1f800 20 remove_watcher() i=0 2024-05-07T13:57:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.342+0000 7f5f0ec1f800 2 removed watcher, disabling cache 2024-05-07T13:57:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.342+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94655142215024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20b0d0 con 0x56169e200ce0 2024-05-07T13:57:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.344+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94655142215024] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.344+0000 7f5f0ec1f800 20 remove_watcher() i=1 2024-05-07T13:57:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.344+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94655142217152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20bd70 con 0x56169e2056d0 2024-05-07T13:57:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.345+0000 7f5f0c71e640 1 -- 172.21.15.50:0/3413663667 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94655142217152] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5efc02b070 con 0x56169e2056d0 2024-05-07T13:57:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.345+0000 7f5f0ec1f800 20 remove_watcher() i=2 2024-05-07T13:57:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.345+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94655142222176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20c5c0 con 0x7f5efc056070 2024-05-07T13:57:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.346+0000 7f5f0bf1d640 1 -- 172.21.15.50:0/3413663667 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94655142222176] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f00070070 con 0x7f5efc056070 2024-05-07T13:57:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.346+0000 7f5f0ec1f800 20 remove_watcher() i=3 2024-05-07T13:57:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.346+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94655142228368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20c5c0 con 0x56169e200ce0 2024-05-07T13:57:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.347+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94655142228368] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x56169e200ce0 2024-05-07T13:57:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.347+0000 7f5f0ec1f800 20 remove_watcher() i=4 2024-05-07T13:57:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.347+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94655142229904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20f190 con 0x7f5f00081040 2024-05-07T13:57:14.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.348+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94655142229904] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.348+0000 7f5f0ec1f800 20 remove_watcher() i=5 2024-05-07T13:57:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.348+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94655142234416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20f790 con 0x7f5f00081040 2024-05-07T13:57:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.349+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94655142234416] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.349+0000 7f5f0ec1f800 20 remove_watcher() i=6 2024-05-07T13:57:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.349+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94655142238288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56169e20f190 con 0x7f5f00081040 2024-05-07T13:57:14.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.350+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94655142238288] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f0400a4a0 con 0x7f5f00081040 2024-05-07T13:57:14.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.350+0000 7f5f0ec1f800 20 remove_watcher() i=7 2024-05-07T13:57:14.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f00081040 msgr2=0x7f5f00082940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f5f00081040 0x7f5f00082940 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e200ce0 msgr2=0x56169e2031a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e200ce0 0x56169e2031a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5efc056070 msgr2=0x7f5efc016550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5efc056070 0x7f5efc016550 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e2056d0 msgr2=0x56169e207ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e2056d0 0x56169e207ac0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5ddc036900 msgr2=0x7f5ddc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5ddc036900 0x7f5ddc038dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5f00055040 tx=0x7f5f00060040 comp rx=0 tx=0).stop 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 msgr2=0x56169e1f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1f5540 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5efc039fc0 tx=0x7f5efc04ef20 comp rx=0 tx=0).stop 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/3413663667 reap_dead start 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 shutdown_connections 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/3413663667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1ee220 0x56169e1f5540 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 >> 172.21.15.50:0/3413663667 conn(0x56169e1ea4f0 msgr2=0x56169e1e7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 shutdown_connections 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/3413663667 wait complete. 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1903295988 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5de4036950 msgr2=0x7f5de4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1903295988 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5de4036950 0x7f5de4038e10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x56169e1ca6b0 tx=0x7f5f00005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1903295988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1e10a0 msgr2=0x56169e1e14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1903295988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1e10a0 0x56169e1e14c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5efc04acf0 tx=0x7f5efc02caa0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1903295988 shutdown_connections 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1903295988 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5de4036950 0x7f5de4038e10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1903295988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e1e10a0 0x56169e1e14c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1903295988 >> 172.21.15.50:0/1903295988 conn(0x56169e1d5140 msgr2=0x56169e1d5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1903295988 shutdown_connections 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.351+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1903295988 wait complete. 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56169e1d0090 msgr2=0x56169e1d24e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x56169e1d0090 0x56169e1d24e0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e0c7570 msgr2=0x56169e1c9870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x56169e0c7570 0x56169e1c9870 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e1cc100 msgr2=0x56169e1ce4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x56169e1cc100 0x56169e1ce4f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036900 msgr2=0x7f5df4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5df4036900 0x7f5df4038dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5f00054000 tx=0x7f5f0004e000 comp rx=0 tx=0).stop 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 msgr2=0x56169e1c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 --2- 172.21.15.50:0/1681331084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169e0c5a30 0x56169e1c2630 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00c010 tx=0x7f5efc000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0cf1f640 1 -- 172.21.15.50:0/1681331084 reap_dead start 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 shutdown_connections 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 >> 172.21.15.50:0/1681331084 conn(0x56169e0c15f0 msgr2=0x56169e1b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 shutdown_connections 2024-05-07T13:57:14.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.352+0000 7f5f0ec1f800 1 -- 172.21.15.50:0/1681331084 wait complete. 2024-05-07T13:57:14.348 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-07T13:57:14.335796Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:14.335776Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:14.361 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:57:14.365 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-05-07T13:57:14.365 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-07T13:57:14.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-07T13:57:14.366 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-05-07T13:57:14.413 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:14.414 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:14.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.427+0000 7f1ba9537800 1 Processor -- start 2024-05-07T13:57:14.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.427+0000 7f1ba9537800 1 -- start start 2024-05-07T13:57:14.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.427+0000 7f1ba9537800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558d54f94bf0 0x558d54f96fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.427+0000 7f1ba9537800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d54f975b0 con 0x558d54f90760 2024-05-07T13:57:14.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.427+0000 7f1ba9537800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x558d54e23050 con 0x558d54f94bf0 2024-05-07T13:57:14.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.427+0000 7f1ba4af8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x558d54f94bf0 0x558d54f96fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.427+0000 7f1ba52f9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x558d54f90760 0x558d54f90b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:47552/0 (socket says 172.21.15.50:47552) 2024-05-07T13:57:14.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.427+0000 7f1ba52f9640 1 -- 172.21.15.50:0/1963211586 learned_addr learned my addr 172.21.15.50:0/1963211586 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:14.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.428+0000 7f1b9ffff640 1 -- 172.21.15.50:0/1963211586 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841890378 0 0) 0x558d54f975b0 con 0x558d54f90760 2024-05-07T13:57:14.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.428+0000 7f1b9ffff640 1 -- 172.21.15.50:0/1963211586 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b94001e10 con 0x558d54f90760 2024-05-07T13:57:14.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.428+0000 7f1ba4af8640 1 -- 172.21.15.50:0/1963211586 >> v1:172.21.15.22:6789/0 conn(0x558d54f90760 legacy=0x558d54f90b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.428+0000 7f1ba4af8640 1 -- 172.21.15.50:0/1963211586 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d54ef4e70 con 0x558d54f94bf0 2024-05-07T13:57:14.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/1963211586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f94bf0 0x558d54f96fe0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000a470 tx=0x7f1b9001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c4ea7d4eecc86b server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1b9ffff640 1 -- 172.21.15.50:0/1963211586 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b90057070 con 0x558d54f94bf0 2024-05-07T13:57:14.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1b9ffff640 1 -- 172.21.15.50:0/1963211586 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b90052570 con 0x558d54f94bf0 2024-05-07T13:57:14.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1b9ffff640 1 -- 172.21.15.50:0/1963211586 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b90052850 con 0x558d54f94bf0 2024-05-07T13:57:14.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1ba9537800 1 -- 172.21.15.50:0/1963211586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f94bf0 msgr2=0x558d54f96fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1ba9537800 1 --2- 172.21.15.50:0/1963211586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f94bf0 0x558d54f96fe0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000a470 tx=0x7f1b9001cdb0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1ba9537800 1 -- 172.21.15.50:0/1963211586 shutdown_connections 2024-05-07T13:57:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1ba9537800 1 --2- 172.21.15.50:0/1963211586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f94bf0 0x558d54f96fe0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1ba9537800 1 -- 172.21.15.50:0/1963211586 >> 172.21.15.50:0/1963211586 conn(0x558d54f8bd40 msgr2=0x558d54f8e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.430+0000 7f1ba9537800 1 -- 172.21.15.50:0/1963211586 shutdown_connections 2024-05-07T13:57:14.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.431+0000 7f1ba9537800 1 -- 172.21.15.50:0/1963211586 wait complete. 2024-05-07T13:57:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.446+0000 7f1ba9537800 1 Processor -- start 2024-05-07T13:57:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.446+0000 7f1ba9537800 1 -- start start 2024-05-07T13:57:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.446+0000 7f1ba9537800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d55081860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.446+0000 7f1ba9537800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558d54edd1c0 con 0x558d54f90760 2024-05-07T13:57:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.446+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d55081860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.446+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d55081860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60758/0 (socket says 172.21.15.50:60758) 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.446+0000 7f1ba52f9640 1 -- 172.21.15.50:0/1475997571 learned_addr learned my addr 172.21.15.50:0/1475997571 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.447+0000 7f1ba52f9640 1 -- 172.21.15.50:0/1475997571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d55081e30 con 0x558d54f90760 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.447+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/1475997571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d55081860 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1b98001db0 tx=0x7f1b9800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a73f39adb2f155e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.447+0000 7f1a93606640 1 -- 172.21.15.50:0/1475997571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b98012020 con 0x558d54f90760 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.447+0000 7f1a93606640 1 -- 172.21.15.50:0/1475997571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b9800e5a0 con 0x558d54f90760 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.447+0000 7f1a93606640 1 -- 172.21.15.50:0/1475997571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b9800e940 con 0x558d54f90760 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 -- 172.21.15.50:0/1475997571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 msgr2=0x558d55081860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 --2- 172.21.15.50:0/1475997571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d55081860 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1b98001db0 tx=0x7f1b9800b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 -- 172.21.15.50:0/1475997571 shutdown_connections 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 --2- 172.21.15.50:0/1475997571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d55081860 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 -- 172.21.15.50:0/1475997571 >> 172.21.15.50:0/1475997571 conn(0x558d54f8bd40 msgr2=0x558d5507d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 -- 172.21.15.50:0/1475997571 shutdown_connections 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 -- 172.21.15.50:0/1475997571 wait complete. 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 Processor -- start 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 -- start start 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d5508d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba9537800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558d54f97a80 con 0x558d54f90760 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.448+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d5508d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.449+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d5508d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60764/0 (socket says 172.21.15.50:60764) 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.449+0000 7f1ba52f9640 1 -- 172.21.15.50:0/3716092441 learned_addr learned my addr 172.21.15.50:0/3716092441 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.449+0000 7f1ba52f9640 1 -- 172.21.15.50:0/3716092441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5508dd20 con 0x558d54f90760 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.449+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d5508d7e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x558d550825f0 tx=0x7f1b98000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.449+0000 7f1a91e03640 1 -- 172.21.15.50:0/3716092441 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b98012030 con 0x558d54f90760 2024-05-07T13:57:14.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.449+0000 7f1a91e03640 1 -- 172.21.15.50:0/3716092441 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b98001430 con 0x558d54f90760 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.449+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d5508dfb0 con 0x558d54f90760 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.449+0000 7f1a91e03640 1 -- 172.21.15.50:0/3716092441 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b9801a8a0 con 0x558d54f90760 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.449+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d55090c60 con 0x558d54f90760 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.450+0000 7f1a91e03640 1 -- 172.21.15.50:0/3716092441 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1b98015020 con 0x558d54f90760 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.450+0000 7f1a91e03640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a8c036900 0x7f1a8c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.450+0000 7f1a91e03640 1 -- 172.21.15.50:0/3716092441 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1b98020030 con 0x558d54f90760 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.450+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a8c036900 0x7f1a8c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.450+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d54f94bf0 0x558d55094a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.450+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d55094fb0 con 0x558d54f94bf0 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.451+0000 7f1ba5afa640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d54f94bf0 0x558d55094a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.451+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a8c036900 0x7f1a8c038dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1b90054000 tx=0x7f1b9004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.451+0000 7f1ba5afa640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d54f94bf0 0x558d55094a20 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.451+0000 7f1ba5afa640 1 -- 172.21.15.50:0/3716092441 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d54f94bf0 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.451+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d55091ff0 con 0x558d54f94bf0 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.451+0000 7f1ba5afa640 1 -- 172.21.15.50:0/3716092441 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d54f94bf0 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.451+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550972e0 0x558d550996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.452+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d55099d70 con 0x558d550972e0 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.452+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550972e0 0x558d550996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.452+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550972e0 0x558d550996d0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.452+0000 7f1ba52f9640 1 -- 172.21.15.50:0/3716092441 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b98018430 con 0x558d550972e0 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.452+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d55096290 con 0x558d54f94bf0 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.453+0000 7f1ba5afa640 1 -- 172.21.15.50:0/3716092441 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d54f94bf0 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.453+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558d5509b220 0x558d5509d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.453+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d5509ddd0 con 0x558d5509b220 2024-05-07T13:57:14.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.453+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558d5509b220 0x558d5509d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.453+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558d5509b220 0x558d5509d670 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.453+0000 7f1ba4af8640 1 -- 172.21.15.50:0/3716092441 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b9005a040 con 0x558d5509b220 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.454+0000 7f1ba9537800 1 Processor -- start 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.454+0000 7f1ba9537800 1 -- start start 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.454+0000 7f1ba9537800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550ac230 0x558d550ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.454+0000 7f1ba9537800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558d54e83cf0 con 0x558d550ac230 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.454+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550ac230 0x558d550ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.454+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550ac230 0x558d550ac650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60768/0 (socket says 172.21.15.50:60768) 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.454+0000 7f1ba52f9640 1 -- 172.21.15.50:0/211843581 learned_addr learned my addr 172.21.15.50:0/211843581 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.455+0000 7f1ba52f9640 1 -- 172.21.15.50:0/211843581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d550acb90 con 0x558d550ac230 2024-05-07T13:57:14.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.455+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/211843581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550ac230 0x558d550ac650 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1b9804ae80 tx=0x7f1b9800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.455+0000 7f1a8affd640 1 -- 172.21.15.50:0/211843581 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b98026be0 con 0x558d550ac230 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.455+0000 7f1a8affd640 1 -- 172.21.15.50:0/211843581 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b98026d80 con 0x558d550ac230 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.455+0000 7f1ba9537800 1 -- 172.21.15.50:0/211843581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d550ad600 con 0x558d550ac230 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.455+0000 7f1a8affd640 1 -- 172.21.15.50:0/211843581 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b98044600 con 0x558d550ac230 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.455+0000 7f1ba9537800 1 -- 172.21.15.50:0/211843581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d550adb00 con 0x558d550ac230 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.456+0000 7f1a8affd640 1 -- 172.21.15.50:0/211843581 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1b98036030 con 0x558d550ac230 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.456+0000 7f1a8affd640 1 --2- 172.21.15.50:0/211843581 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a7c036950 0x7f1a7c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.456+0000 7f1a8affd640 1 -- 172.21.15.50:0/211843581 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1b98019070 con 0x558d550ac230 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.456+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/211843581 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a7c036950 0x7f1a7c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.456+0000 7f1ba9537800 1 Processor -- start 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.456+0000 7f1ba9537800 1 -- start start 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.456+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/211843581 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a7c036950 0x7f1a7c038e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x558d55091f10 tx=0x7f1b90005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1ba9537800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550b9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1ba9537800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558d550821b0 con 0x558d550b9350 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550b9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60774/0 (socket says 172.21.15.50:60774) 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1ba52f9640 1 -- 172.21.15.50:0/3646384519 learned_addr learned my addr 172.21.15.50:0/3646384519 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1ba52f9640 1 -- 172.21.15.50:0/3646384519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d550b9d40 con 0x558d550b9350 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/3646384519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550b9770 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800d6e0 tx=0x7f1b98038840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea42c97264679507 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1a88ff9640 1 -- 172.21.15.50:0/3646384519 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b98066070 con 0x558d550b9350 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1a88ff9640 1 -- 172.21.15.50:0/3646384519 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b980499a0 con 0x558d550b9350 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.457+0000 7f1a88ff9640 1 -- 172.21.15.50:0/3646384519 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b98024420 con 0x558d550b9350 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 -- 172.21.15.50:0/3646384519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 msgr2=0x558d550b9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3646384519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550b9770 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800d6e0 tx=0x7f1b98038840 comp rx=0 tx=0).stop 2024-05-07T13:57:14.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 -- 172.21.15.50:0/3646384519 shutdown_connections 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3646384519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550b9770 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 -- 172.21.15.50:0/3646384519 >> 172.21.15.50:0/3646384519 conn(0x558d550b56b0 msgr2=0x558d550b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 -- 172.21.15.50:0/3646384519 shutdown_connections 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 -- 172.21.15.50:0/3646384519 wait complete. 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 Processor -- start 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 -- start start 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.458+0000 7f1ba9537800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558d550ba3f0 con 0x558d550b9350 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1ba52f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550c07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60778/0 (socket says 172.21.15.50:60778) 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 learned_addr learned my addr 172.21.15.50:0/127045768 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d550c0d00 con 0x558d550b9350 2024-05-07T13:57:14.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550c07c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1b98000fb0 tx=0x7f1b98011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1a7affd640 1 -- 172.21.15.50:0/127045768 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b98071070 con 0x558d550b9350 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1a7affd640 1 -- 172.21.15.50:0/127045768 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b98024420 con 0x558d550b9350 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d550c0d00 con 0x558d550b9350 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1a7affd640 1 -- 172.21.15.50:0/127045768 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b98066040 con 0x558d550b9350 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.459+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d550c0d00 con 0x558d550b9350 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.460+0000 7f1a7affd640 1 -- 172.21.15.50:0/127045768 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1b98074070 con 0x558d550b9350 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.460+0000 7f1a7affd640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a70036900 0x7f1a70038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.460+0000 7f1a7affd640 1 -- 172.21.15.50:0/127045768 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1b98077d70 con 0x558d550b9350 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.460+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a70036900 0x7f1a70038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.461+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.461+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a70036900 0x7f1a70038dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x558d5509e1d0 tx=0x7f1b9004f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.461+0000 7f1ba9537800 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d550cbf40 0x558d550ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.461+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550ceb50 con 0x558d550cbf40 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.461+0000 7f1ba5afa640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d550cbf40 0x558d550ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.461+0000 7f1ba5afa640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d550cbf40 0x558d550ce400 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 20 realm 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550cef60 con 0x558d550cbf40 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550cf830 con 0x558d550cbf40 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550cfbd0 con 0x558d550cbf40 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550d0930 0x558d550d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550d3330 con 0x558d550d0930 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.462+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550d0930 0x558d550d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.463+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550d0930 0x558d550d2d20 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.463+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.463+0000 7f1ba9537800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:14.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.463+0000 7f1ba9537800 20 searching for the correct realm 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.463+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d550d4c90 con 0x558d550d0930 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.463+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.463+0000 7f1ba52f9640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1b98076070 0x7f1b980136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.463+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d550d4c90 con 0x7f1b98076070 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.464+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1b98076070 0x7f1b980136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.464+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1b98076070 0x7f1b980136f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.464+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.464+0000 7f1ba4af8640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1b90074040 0x7f1b90081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.464+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d550d4c90 con 0x7f1b90074040 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.464+0000 7f1ba5afa640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1b90074040 0x7f1b90081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.465+0000 7f1ba5afa640 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1b90074040 0x7f1b90081410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.465+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.465+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d550cfbd0 con 0x558d550cbf40 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.465+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.465+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d550cfbd0 con 0x558d550cbf40 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.466+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.466+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d550cfbd0 con 0x558d550cbf40 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.466+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.466+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d550cfbd0 con 0x7f1b90074040 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.466+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.466+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d550cfbd0 con 0x7f1b98076070 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.466+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.466+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558d550cfbd0 con 0x7f1b98076070 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.467+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.467+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550cbf40 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.467+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.467+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b90074040 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.467+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.467+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550cbf40 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.467+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.467+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b98076070 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.468+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.468+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550d0930 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.468+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.468+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550d0930 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.468+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.468+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b90074040 2024-05-07T13:57:14.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550d0930 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550d0930 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550cbf40 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550cbf40 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.469+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b90074040 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.470+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.470+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550d0930 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.470+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.470+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b98076070 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.470+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.470+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550cbf40 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.471+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.471+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b90074040 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.471+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.471+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550d0930 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.471+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.471+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b90074040 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.472+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.472+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b98076070 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.472+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.472+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550d0930 2024-05-07T13:57:14.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.472+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.472+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b98076070 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.472+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.472+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x558d550cbf40 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1b9008e040 con 0x7f1b98076070 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:14.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550d3740 con 0x558d550cbf40 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550d3b30 con 0x558d550cbf40 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.473+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550d3b30 con 0x7f1b90074040 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 20 zone default found 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 4 Realm: () 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 20 zonegroup default 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550d47e0 con 0x7f1b90074040 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.474+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550d4810 con 0x558d550d0930 2024-05-07T13:57:14.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.475+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.475+0000 7f1ba9537800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.475+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.475+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550d6c80 con 0x558d550d0930 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.475+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.475+0000 7f1ba9537800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.475+0000 7f1ba9537800 20 started sync module instance, tier type = 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.475+0000 7f1ba9537800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.475+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d5f90 con 0x7f1b98076070 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.476+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.476+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94065505690496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d5bf0 con 0x7f1b98076070 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.476+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d7bb0 con 0x558d550cbf40 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.477+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94065505690496] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.477+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.477+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94065505695488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d7b20 con 0x558d550cbf40 2024-05-07T13:57:14.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.477+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d8a70 con 0x558d550d0930 2024-05-07T13:57:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.479+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.479+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94065505695488] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.479+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94065505699264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d8e60 con 0x558d550d0930 2024-05-07T13:57:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.479+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d9860 con 0x7f1b98076070 2024-05-07T13:57:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.480+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94065505699264] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.480+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.480+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94065505697696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550da100 con 0x7f1b98076070 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.480+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550daac0 con 0x558d550cbf40 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.481+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.481+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94065505707536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550daf20 con 0x558d550cbf40 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.481+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550dba20 con 0x7f1b90074040 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.481+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94065505697696] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.482+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94065505707536] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.482+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.482+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94065505711376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550db9e0 con 0x7f1b90074040 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.482+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550dc2c0 con 0x7f1b90074040 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.483+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94065505711376] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.483+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.483+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94065505705040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550db9e0 con 0x7f1b90074040 2024-05-07T13:57:14.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.483+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550dc8e0 con 0x7f1b90074040 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.484+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94065505705040] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.484+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.484+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94065505713680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550dc8e0 con 0x7f1b90074040 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 20 add_watcher() i=0 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 20 add_watcher() i=1 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 20 add_watcher() i=2 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 20 add_watcher() i=3 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 20 add_watcher() i=4 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 20 add_watcher() i=5 2024-05-07T13:57:14.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 20 add_watcher() i=6 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94065505713680] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 20 add_watcher() i=7 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.485+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d550dfc40 con 0x558d550cbf40 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.486+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.486+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94065505715616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550dce70 con 0x558d550cbf40 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.487+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94065505715616] v29'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.487+0000 7f1a5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.487+0000 7f1ba9537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.487+0000 7f1ba9537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.487+0000 7f1ba9537800 5 note: GC not initialized 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.487+0000 7f1a5a7e4640 20 reqs_thread_entry: start 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.487+0000 7f1ba9537800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:14.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.487+0000 7f1ba9537800 20 Filter name: none 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f19cbfff640 20 reqs_thread_entry: start 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f1ba9537800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f1ba9537800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558d551131b0 con 0x7f1b98076070 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f1ba9537800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f1ba9537800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f1ba9537800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f1ba9537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:14.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.488+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d551172d0 con 0x7f1b90074040 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.490+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v29'8 uv7 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.491+0000 7f1a5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.491+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94065505715616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550df290 con 0x558d550cbf40 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.492+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94065505715616] v29'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.492+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94065505690496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550dc5a0 con 0x7f1b98076070 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.493+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94065505690496] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.493+0000 7f1ba9537800 20 remove_watcher() i=0 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.493+0000 7f1ba9537800 2 removed watcher, disabling cache 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.493+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94065505695488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550dc5a0 con 0x558d550cbf40 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.494+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94065505695488] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.494+0000 7f1ba9537800 20 remove_watcher() i=1 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.494+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94065505699264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550dc5a0 con 0x558d550d0930 2024-05-07T13:57:14.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.495+0000 7f1ba52f9640 1 -- 172.21.15.50:0/127045768 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94065505699264] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b9807d070 con 0x558d550d0930 2024-05-07T13:57:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.495+0000 7f1ba9537800 20 remove_watcher() i=2 2024-05-07T13:57:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.495+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94065505697696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d85c0 con 0x7f1b98076070 2024-05-07T13:57:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.496+0000 7f1ba4af8640 1 -- 172.21.15.50:0/127045768 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94065505697696] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b9007f070 con 0x7f1b98076070 2024-05-07T13:57:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.496+0000 7f1ba9537800 20 remove_watcher() i=3 2024-05-07T13:57:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.496+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94065505707536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d7fa0 con 0x558d550cbf40 2024-05-07T13:57:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.497+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94065505707536] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x558d550cbf40 2024-05-07T13:57:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.497+0000 7f1ba9537800 20 remove_watcher() i=4 2024-05-07T13:57:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.497+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94065505711376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d85c0 con 0x7f1b90074040 2024-05-07T13:57:14.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.499+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94065505711376] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.499+0000 7f1ba9537800 20 remove_watcher() i=5 2024-05-07T13:57:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.499+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94065505705040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550da610 con 0x7f1b90074040 2024-05-07T13:57:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.500+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94065505705040] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.500+0000 7f1ba9537800 20 remove_watcher() i=6 2024-05-07T13:57:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.500+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94065505713680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558d550d7fa0 con 0x7f1b90074040 2024-05-07T13:57:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94065505713680] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba000a4a0 con 0x7f1b90074040 2024-05-07T13:57:14.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 20 remove_watcher() i=7 2024-05-07T13:57:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1b90074040 msgr2=0x7f1b90081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1b90074040 0x7f1b90081410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d550cbf40 msgr2=0x558d550ce400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d550cbf40 0x558d550ce400 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1b98076070 msgr2=0x7f1b980136f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1b98076070 0x7f1b980136f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550d0930 msgr2=0x558d550d2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550d0930 0x558d550d2d20 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a70036900 msgr2=0x7f1a70038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a70036900 0x7f1a70038dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x558d5509e1d0 tx=0x7f1b9004f000 comp rx=0 tx=0).stop 2024-05-07T13:57:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 msgr2=0x558d550c07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/127045768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550b9350 0x558d550c07c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1b98000fb0 tx=0x7f1b98011df0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 reap_dead start 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba5afa640 1 -- 172.21.15.50:0/127045768 reap_dead start 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 shutdown_connections 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 >> 172.21.15.50:0/127045768 conn(0x558d550b56b0 msgr2=0x558d550b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 shutdown_connections 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/127045768 wait complete. 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/211843581 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a7c036950 msgr2=0x7f1a7c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/211843581 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a7c036950 0x7f1a7c038e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x558d55091f10 tx=0x7f1b90005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/211843581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550ac230 msgr2=0x558d550ac650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/211843581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550ac230 0x558d550ac650 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1b9804ae80 tx=0x7f1b9800db20 comp rx=0 tx=0).stop 2024-05-07T13:57:14.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/211843581 shutdown_connections 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/211843581 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a7c036950 0x7f1a7c038e10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 --2- 172.21.15.50:0/211843581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d550ac230 0x558d550ac650 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.501+0000 7f1ba9537800 1 -- 172.21.15.50:0/211843581 >> 172.21.15.50:0/211843581 conn(0x558d550a02d0 msgr2=0x558d550a06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/211843581 shutdown_connections 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/211843581 wait complete. 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558d5509b220 msgr2=0x558d5509d670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x558d5509b220 0x558d5509d670 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d54f94bf0 msgr2=0x558d55094a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558d54f94bf0 0x558d55094a20 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550972e0 msgr2=0x558d550996d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x558d550972e0 0x558d550996d0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a8c036900 msgr2=0x7f1a8c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1a8c036900 0x7f1a8c038dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1b90054000 tx=0x7f1b9004e000 comp rx=0 tx=0).stop 2024-05-07T13:57:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 msgr2=0x558d5508d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 --2- 172.21.15.50:0/3716092441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558d54f90760 0x558d5508d7e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x558d550825f0 tx=0x7f1b98000bc0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba5afa640 1 -- 172.21.15.50:0/3716092441 reap_dead start 2024-05-07T13:57:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 shutdown_connections 2024-05-07T13:57:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 >> 172.21.15.50:0/3716092441 conn(0x558d54f8bd40 msgr2=0x558d5507b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 shutdown_connections 2024-05-07T13:57:14.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.502+0000 7f1ba9537800 1 -- 172.21.15.50:0/3716092441 wait complete. 2024-05-07T13:57:14.509 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-07T13:57:14.558 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:57:14.559 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-07T13:57:14.563 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-07T13:57:14.564 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-05-07T13:57:14.564 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-07T13:57:14.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-07T13:57:14.564 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-05-07T13:57:14.612 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:14.612 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:14.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.624+0000 7f0b1c9a2800 1 Processor -- start 2024-05-07T13:57:14.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.624+0000 7f0b1c9a2800 1 -- start start 2024-05-07T13:57:14.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.624+0000 7f0b1c9a2800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5586b57138a0 0x5586b5715c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.624+0000 7f0b1c9a2800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5586b57161d0 con 0x5586b570d650 2024-05-07T13:57:14.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.624+0000 7f0b1c9a2800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5586b559e050 con 0x5586b57138a0 2024-05-07T13:57:14.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.625+0000 7f0b13fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5586b57138a0 0x5586b5715c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.625+0000 7f0b1a4a1640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5586b570d650 0x5586b570da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:47562/0 (socket says 172.21.15.50:47562) 2024-05-07T13:57:14.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.625+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/596354331 learned_addr learned my addr 172.21.15.50:0/596354331 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:14.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.625+0000 7f0b13fff640 1 -- 172.21.15.50:0/596354331 >> v1:172.21.15.22:6789/0 conn(0x5586b570d650 legacy=0x5586b570da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.625+0000 7f0b19ca0640 1 -- 172.21.15.50:0/596354331 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796821694 0 0) 0x5586b57161d0 con 0x5586b570d650 2024-05-07T13:57:14.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.625+0000 7f0b13fff640 1 -- 172.21.15.50:0/596354331 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b57173b0 con 0x5586b57138a0 2024-05-07T13:57:14.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.627+0000 7f0b13fff640 1 --2- 172.21.15.50:0/596354331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b57138a0 0x5586b5715c90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400a470 tx=0x7f0b0401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d38d87f29384365 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.627+0000 7f0b19ca0640 1 -- 172.21.15.50:0/596354331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b04057070 con 0x5586b57138a0 2024-05-07T13:57:14.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.627+0000 7f0b19ca0640 1 -- 172.21.15.50:0/596354331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b04052570 con 0x5586b57138a0 2024-05-07T13:57:14.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.627+0000 7f0b19ca0640 1 -- 172.21.15.50:0/596354331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b04052870 con 0x5586b57138a0 2024-05-07T13:57:14.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.628+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/596354331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b57138a0 msgr2=0x5586b5715c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.628+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/596354331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b57138a0 0x5586b5715c90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400a470 tx=0x7f0b0401ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:14.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.628+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/596354331 shutdown_connections 2024-05-07T13:57:14.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.628+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/596354331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b57138a0 0x5586b5715c90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.628+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/596354331 >> 172.21.15.50:0/596354331 conn(0x5586b5706d40 msgr2=0x5586b5709160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.628+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/596354331 shutdown_connections 2024-05-07T13:57:14.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.628+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/596354331 wait complete. 2024-05-07T13:57:14.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.643+0000 7f0b1c9a2800 1 Processor -- start 2024-05-07T13:57:14.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.643+0000 7f0b1c9a2800 1 -- start start 2024-05-07T13:57:14.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.643+0000 7f0b1c9a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5800660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.643+0000 7f0b1c9a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586b56581c0 con 0x5586b570d650 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.643+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5800660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.644+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5800660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60794/0 (socket says 172.21.15.50:60794) 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.644+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/1898432584 learned_addr learned my addr 172.21.15.50:0/1898432584 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.644+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/1898432584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b5800c30 con 0x5586b570d650 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.644+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/1898432584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5800660 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00b240 tx=0x7f0b0c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6909ace8d048a8b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.644+0000 7f0a08608640 1 -- 172.21.15.50:0/1898432584 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c008070 con 0x5586b570d650 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.644+0000 7f0a08608640 1 -- 172.21.15.50:0/1898432584 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c00d500 con 0x5586b570d650 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.644+0000 7f0a08608640 1 -- 172.21.15.50:0/1898432584 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c00d860 con 0x5586b570d650 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1898432584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 msgr2=0x5586b5800660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/1898432584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5800660 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00b240 tx=0x7f0b0c00b700 comp rx=0 tx=0).stop 2024-05-07T13:57:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1898432584 shutdown_connections 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/1898432584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5800660 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1898432584 >> 172.21.15.50:0/1898432584 conn(0x5586b5706d40 msgr2=0x5586b57fbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1898432584 shutdown_connections 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1898432584 wait complete. 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 Processor -- start 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 -- start start 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5808290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.645+0000 7f0b1c9a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586b57166a0 con 0x5586b570d650 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5808290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5808290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60810/0 (socket says 172.21.15.50:60810) 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/3790818776 learned_addr learned my addr 172.21.15.50:0/3790818776 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/3790818776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b58087d0 con 0x5586b570d650 2024-05-07T13:57:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5808290 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x5586b58013f0 tx=0x7f0b0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0a06e05640 1 -- 172.21.15.50:0/3790818776 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c019870 con 0x5586b570d650 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0a06e05640 1 -- 172.21.15.50:0/3790818776 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c019a10 con 0x5586b570d650 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0a06e05640 1 -- 172.21.15.50:0/3790818776 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c019d30 con 0x5586b570d650 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586b5808a60 con 0x5586b570d650 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.646+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b580b710 con 0x5586b570d650 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.647+0000 7f0a06e05640 1 -- 172.21.15.50:0/3790818776 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b0c017040 con 0x5586b570d650 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.647+0000 7f0a06e05640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0a00036900 0x7f0a00038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.647+0000 7f0a06e05640 1 -- 172.21.15.50:0/3790818776 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0b0c015020 con 0x5586b570d650 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.647+0000 7f0b13fff640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0a00036900 0x7f0a00038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.648+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b57138a0 0x5586b580f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.648+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b580fa10 con 0x5586b57138a0 2024-05-07T13:57:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.648+0000 7f0b1aca2640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b57138a0 0x5586b580f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.648+0000 7f0b13fff640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0a00036900 0x7f0a00038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0b04054000 tx=0x7f0b0404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.648+0000 7f0b1aca2640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b57138a0 0x5586b580f4d0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.648+0000 7f0b1aca2640 1 -- 172.21.15.50:0/3790818776 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b57138a0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.648+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b580caa0 con 0x5586b57138a0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.649+0000 7f0b1aca2640 1 -- 172.21.15.50:0/3790818776 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b57138a0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.649+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b5811d90 0x5586b5814180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.649+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5814820 con 0x5586b5811d90 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.649+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b5811d90 0x5586b5814180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.649+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b5811d90 0x5586b5814180 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.649+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/3790818776 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b0c02d070 con 0x5586b5811d90 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.649+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5810d40 con 0x5586b57138a0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.650+0000 7f0b1aca2640 1 -- 172.21.15.50:0/3790818776 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b57138a0 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.650+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5586b5815cd0 0x5586b5818120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.650+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5818880 con 0x5586b5815cd0 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.650+0000 7f0b13fff640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5586b5815cd0 0x5586b5818120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.650+0000 7f0b13fff640 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5586b5815cd0 0x5586b5818120 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.651+0000 7f0b13fff640 1 -- 172.21.15.50:0/3790818776 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b0405a040 con 0x5586b5815cd0 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.651+0000 7f0b1c9a2800 1 Processor -- start 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.651+0000 7f0b1c9a2800 1 -- start start 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.651+0000 7f0b1c9a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5826c10 0x5586b5827030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.651+0000 7f0b1c9a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586b55fecf0 con 0x5586b5826c10 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.651+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5826c10 0x5586b5827030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.651+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5826c10 0x5586b5827030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60816/0 (socket says 172.21.15.50:60816) 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.651+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/1240427178 learned_addr learned my addr 172.21.15.50:0/1240427178 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.652+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/1240427178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b5827570 con 0x5586b5826c10 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.652+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/1240427178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5826c10 0x5586b5827030 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00e910 tx=0x7f0b0c00f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.652+0000 7f09fffff640 1 -- 172.21.15.50:0/1240427178 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c041e40 con 0x5586b5826c10 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.652+0000 7f09fffff640 1 -- 172.21.15.50:0/1240427178 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c01a3c0 con 0x5586b5826c10 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.652+0000 7f09fffff640 1 -- 172.21.15.50:0/1240427178 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c01a6c0 con 0x5586b5826c10 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.652+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1240427178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586b5827fe0 con 0x5586b5826c10 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.652+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1240427178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b58284e0 con 0x5586b5826c10 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.653+0000 7f09fffff640 1 -- 172.21.15.50:0/1240427178 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b0c03f2a0 con 0x5586b5826c10 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.653+0000 7f09fffff640 1 --2- 172.21.15.50:0/1240427178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09f4036900 0x7f09f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.653+0000 7f09fffff640 1 -- 172.21.15.50:0/1240427178 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0b0c031020 con 0x5586b5826c10 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.653+0000 7f0b13fff640 1 --2- 172.21.15.50:0/1240427178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09f4036900 0x7f09f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.653+0000 7f0b1c9a2800 1 Processor -- start 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f0b1c9a2800 1 -- start start 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f0b13fff640 1 --2- 172.21.15.50:0/1240427178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09f4036900 0x7f09f4038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5586b580c9c0 tx=0x7f0b04005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f0b1c9a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b5834200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f0b1c9a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586b5800fb0 con 0x5586b5833de0 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b5834200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b5834200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60824/0 (socket says 172.21.15.50:60824) 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2058435886 learned_addr learned my addr 172.21.15.50:0/2058435886 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2058435886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b58347d0 con 0x5586b5833de0 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/2058435886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b5834200 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00ffd0 tx=0x7f0b0c026dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643d52745aece098 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.654+0000 7f09fdffb640 1 -- 172.21.15.50:0/2058435886 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c044fa0 con 0x5586b5833de0 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f09fdffb640 1 -- 172.21.15.50:0/2058435886 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c03f5e0 con 0x5586b5833de0 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f09fdffb640 1 -- 172.21.15.50:0/2058435886 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c01ce00 con 0x5586b5833de0 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2058435886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 msgr2=0x5586b5834200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2058435886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b5834200 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00ffd0 tx=0x7f0b0c026dc0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2058435886 shutdown_connections 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2058435886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b5834200 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2058435886 >> 172.21.15.50:0/2058435886 conn(0x5586b5830060 msgr2=0x5586b582e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2058435886 shutdown_connections 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2058435886 wait complete. 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 Processor -- start 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 -- start start 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b583b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.655+0000 7f0b1c9a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586b5834e40 con 0x5586b5833de0 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b583b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f0b1a4a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b583b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60836/0 (socket says 172.21.15.50:60836) 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 learned_addr learned my addr 172.21.15.50:0/2749582605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b583b690 con 0x5586b5833de0 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b583b150 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c04a220 tx=0x7f0b0c014f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f09ebfff640 1 -- 172.21.15.50:0/2749582605 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c044fa0 con 0x5586b5833de0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f09ebfff640 1 -- 172.21.15.50:0/2749582605 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c068030 con 0x5586b5833de0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f09ebfff640 1 -- 172.21.15.50:0/2749582605 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c0307c0 con 0x5586b5833de0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586b583b690 con 0x5586b5833de0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.656+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b583b690 con 0x5586b5833de0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.657+0000 7f09ebfff640 1 -- 172.21.15.50:0/2749582605 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b0c05b030 con 0x5586b5833de0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.658+0000 7f09ebfff640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09e4036900 0x7f09e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.658+0000 7f09ebfff640 1 -- 172.21.15.50:0/2749582605 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0b0c059070 con 0x5586b5833de0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.658+0000 7f0b13fff640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09e4036900 0x7f09e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.658+0000 7f0b13fff640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09e4036900 0x7f09e4038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0b0401ced0 tx=0x7f0b0404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.658+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.658+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b5846700 0x5586b5848bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.658+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5849310 con 0x5586b5846700 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.658+0000 7f0b1aca2640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b5846700 0x5586b5848bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1aca2640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b5846700 0x5586b5848bc0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 20 realm 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5849720 con 0x5586b5846700 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5849ff0 con 0x5586b5846700 2024-05-07T13:57:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.659+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1c9a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b584b0f0 0x5586b584d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b584daf0 con 0x5586b584b0f0 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b584b0f0 0x5586b584d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b584b0f0 0x5586b584d4e0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1c9a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1c9a2800 20 searching for the correct realm 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.660+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584f420 con 0x5586b584b0f0 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.661+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.661+0000 7f0b1a4a1640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0b0c01c610 0x7f0b0c052440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.661+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584f420 con 0x7f0b0c01c610 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.661+0000 7f0b13fff640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0b0c01c610 0x7f0b0c052440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.661+0000 7f0b13fff640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0b0c01c610 0x7f0b0c052440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.662+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.662+0000 7f0b13fff640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f0b04083040 0x7f0b04075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.662+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584f420 con 0x7f0b04083040 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.662+0000 7f0b1aca2640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f0b04083040 0x7f0b04075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.662+0000 7f0b1aca2640 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f0b04083040 0x7f0b04075430 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.663+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.663+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.663+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.663+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.663+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.663+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.663+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.663+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b04083040 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.664+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.664+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b0c01c610 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.664+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.664+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b0c01c610 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.664+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.664+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.664+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.664+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b04083040 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.665+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.665+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.665+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.665+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b0c01c610 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.665+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.665+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b584b0f0 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.665+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.665+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b584b0f0 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.666+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.666+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b04083040 2024-05-07T13:57:14.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.666+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.666+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b584b0f0 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.666+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.666+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b584b0f0 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.666+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.666+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.667+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.667+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.667+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.667+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b04083040 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.667+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.667+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b584b0f0 2024-05-07T13:57:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.668+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.668+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b0c01c610 2024-05-07T13:57:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.668+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.668+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.668+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.668+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b04083040 2024-05-07T13:57:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.668+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.668+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b584b0f0 2024-05-07T13:57:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.669+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.669+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b04083040 2024-05-07T13:57:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.669+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.669+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b0c01c610 2024-05-07T13:57:14.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.669+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.669+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b584b0f0 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b0c01c610 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x5586b5846700 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5586b584a390 con 0x7f0b0c01c610 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1c9a2800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1c9a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1c9a2800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:14.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1c9a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1c9a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1c9a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.670+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b584e3b0 con 0x5586b5846700 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b584e7a0 con 0x5586b5846700 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1c9a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b584e7a0 con 0x7f0b04083040 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.671+0000 7f0b1c9a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 20 zone default found 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 4 Realm: () 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 20 zonegroup default 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b584f8a0 con 0x7f0b04083040 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5851280 con 0x5586b584b0f0 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.672+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5851620 con 0x5586b584b0f0 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.673+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.673+0000 7f0b1c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.673+0000 7f0b1c9a2800 20 started sync module instance, tier type = 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.673+0000 7f0b1c9a2800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.673+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5850720 con 0x7f0b0c01c610 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.674+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.674+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94037059371632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58519c0 con 0x7f0b0c01c610 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.674+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5852210 con 0x5586b5846700 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.675+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94037059371632] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.675+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.675+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94037059378528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5852180 con 0x5586b5846700 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.675+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58530d0 con 0x5586b584b0f0 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.676+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94037059378528] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.677+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.677+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94037059382304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58534c0 con 0x5586b584b0f0 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.677+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5853f10 con 0x7f0b0c01c610 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.678+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.678+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94037059388160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5854bd0 con 0x7f0b0c01c610 2024-05-07T13:57:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.678+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5855620 con 0x5586b5846700 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.678+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94037059382304] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.679+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.679+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94037059391760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5855a40 con 0x5586b5846700 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.679+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94037059388160] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.679+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5856400 con 0x7f0b04083040 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.680+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94037059391760] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.680+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.680+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94037059380656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5855f50 con 0x7f0b04083040 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.680+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5856ca0 con 0x7f0b04083040 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.681+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94037059380656] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.681+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.681+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94037059389216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5856aa0 con 0x7f0b04083040 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.681+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58572f0 con 0x7f0b04083040 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94037059389216] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94037059397584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5857120 con 0x7f0b04083040 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1c9a2800 20 add_watcher() i=0 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1c9a2800 20 add_watcher() i=1 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1c9a2800 20 add_watcher() i=2 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1c9a2800 20 add_watcher() i=3 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1c9a2800 20 add_watcher() i=4 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1c9a2800 20 add_watcher() i=5 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.682+0000 7f0b1c9a2800 20 add_watcher() i=6 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.683+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94037059397584] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.683+0000 7f0b1c9a2800 20 add_watcher() i=7 2024-05-07T13:57:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.683+0000 7f0b1c9a2800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.683+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b585a720 con 0x5586b5846700 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.684+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.684+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94037059398640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5857b10 con 0x5586b5846700 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.685+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94037059398640] v29'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.685+0000 7f09d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.685+0000 7f0b1c9a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.685+0000 7f0b1c9a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.685+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5859eb0 con 0x5586b5846700 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.686+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.686+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58637e0 con 0x7f0b04083040 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.687+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.687+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5863c90 con 0x5586b584b0f0 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.688+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.688+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5863db0 con 0x5586b5846700 2024-05-07T13:57:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.689+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.689+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5863df0 con 0x7f0b0c01c610 2024-05-07T13:57:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.690+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.690+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5864910 con 0x5586b584b0f0 2024-05-07T13:57:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.691+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.691+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5864910 con 0x5586b5846700 2024-05-07T13:57:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.692+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.692+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5864910 con 0x7f0b04083040 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.694+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.694+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5864d70 con 0x7f0b0c01c610 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.695+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.695+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5865220 con 0x5586b584b0f0 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.696+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.696+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5865220 con 0x7f0b0c01c610 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.697+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.697+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5865220 con 0x7f0b04083040 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.698+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.698+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x7f0b0c01c610 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.699+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.699+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x7f0b04083040 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.700+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.700+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b5846700 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.701+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.701+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b584b0f0 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.702+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'62 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.702+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x7f0b0c01c610 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.703+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.703+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b584b0f0 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.704+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.704+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b5846700 2024-05-07T13:57:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.706+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'35 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.706+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b5846700 2024-05-07T13:57:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.707+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.707+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b584b0f0 2024-05-07T13:57:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.708+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'63 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.708+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x7f0b0c01c610 2024-05-07T13:57:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.709+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.709+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b584b0f0 2024-05-07T13:57:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.710+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.710+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b584b0f0 2024-05-07T13:57:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.711+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.711+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b584b0f0 2024-05-07T13:57:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.712+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.712+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b584b0f0 2024-05-07T13:57:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.713+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.713+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x7f0b04083040 2024-05-07T13:57:14.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.714+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.714+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b584b0f0 2024-05-07T13:57:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.715+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.715+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x7f0b04083040 2024-05-07T13:57:14.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.716+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.716+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x5586b584b0f0 2024-05-07T13:57:14.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.717+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'64 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.717+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x7f0b04083040 2024-05-07T13:57:14.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.718+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.718+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58652f0 con 0x7f0b0c01c610 2024-05-07T13:57:14.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.719+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.719+0000 7f094b7fe640 20 reqs_thread_entry: start 2024-05-07T13:57:14.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.719+0000 7f0b1c9a2800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:14.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.719+0000 7f0b1c9a2800 20 Filter name: none 2024-05-07T13:57:14.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f09497fa640 20 reqs_thread_entry: start 2024-05-07T13:57:14.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-07T13:57:14.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58905d0 con 0x7f0b0c01c610 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5892f00 con 0x5586b5846700 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv8 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 : miss 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.720+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:96 8.19 8:9c34a662:root::.bucket.meta.myfoo6%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5892cb0 con 0x5586b5846700 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(96 .bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv9 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1c9a2800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:57:14.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1c9a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 info.flags=0x17 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1c9a2800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 to cache LRU end 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1c9a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1c9a2800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1c9a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:97 4.22 4:462a00f5:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101a0 con 0x5586b5846700 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(97 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.721+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 4.1f 4:fb6a4abc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101a0 con 0x5586b584b0f0 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.722+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(98 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.722+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:99 4.10 4:09a0a451:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101e0 con 0x5586b584b0f0 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.722+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(99 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.722+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:100 4.0 4:009ab4d8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101e0 con 0x5586b584b0f0 2024-05-07T13:57:14.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.722+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(100 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.722+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:101 4.16 4:68f47a17:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101e0 con 0x5586b584b0f0 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.723+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(101 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.723+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:102 4.3e 4:7ef75f7c:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101e0 con 0x7f0b0c01c610 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.723+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(102 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.723+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:103 4.22 4:46940a90:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101e0 con 0x5586b5846700 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.723+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(103 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.723+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:104 4.26 4:6465abf7:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101e0 con 0x7f0b04083040 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.724+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(104 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.724+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:105 4.1f 4:faa6a74d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101e0 con 0x5586b584b0f0 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.724+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== osd_op_reply(105 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.724+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:106 4.29 4:967c563d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5910170 con 0x5586b584b0f0 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(106 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 [call out=289b] v0'0 uv7 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 10 cls_bucket_list_unordered: got thirteen 2024-05-07T13:57:14.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:107 4.19 4:9aa0c7c3:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b59101b0 con 0x5586b584b0f0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 32 ==== osd_op_reply(107 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 20 get_obj_state: octx=0x5586b5862750 obj=myfoo6:thirteen state=0x5586b590e248 s->prefetch_data=0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:108 3.2s0 3:437497b3:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f070 con 0x5586b584b0f0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 33 ==== osd_op_reply(108 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9_thirteen [getxattrs out=818b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+834 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 10 manifest: total_size = 8 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 20 get_obj_state: setting s->obj_tag to _3hvb-xJ_ZsziKZIuG114JdXmzBV7P4S 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 20 get_obj_state: octx=0x5586b5862750 obj=myfoo6:thirteen state=0x5586b590e248 s->prefetch_data=0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 20 prepare_atomic_modification: state is not atomic. state=0x5586b590e248 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.725+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:109 4.29 4:967c563d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f900 con 0x5586b584b0f0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.726+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 34 ==== osd_op_reply(109 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 [stat,call,call] v29'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.726+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:110 3.2s0 3:437497b3:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f900 con 0x5586b584b0f0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.728+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 35 ==== osd_op_reply(110 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9_thirteen [call] v29'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.728+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:111 4.29 4:967c563d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5897390 con 0x5586b584b0f0 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.728+0000 7f0b1c9a2800 20 list_objects_ordered: starting attempt 1 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.728+0000 7f0b1c9a2800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.728+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:112 4.22 4:462a00f5:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5897390 con 0x5586b5846700 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.728+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:113 4.1f 4:fb6a4abc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b589b420 con 0x5586b584b0f0 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.728+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:114 4.10 4:09a0a451:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b589dde0 con 0x5586b584b0f0 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 36 ==== osd_op_reply(113 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.728+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:115 4.0 4:009ab4d8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b589dde0 con 0x5586b584b0f0 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:116 4.16 4:68f47a17:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a2d20 con 0x5586b584b0f0 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:117 4.3e 4:7ef75f7c:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5899fa0 con 0x7f0b0c01c610 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 37 ==== osd_op_reply(114 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:118 4.22 4:46940a90:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b589ac90 con 0x5586b5846700 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:119 4.26 4:6465abf7:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b589dde0 con 0x7f0b04083040 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(112 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:120 4.1f 4:faa6a74d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b589acb0 con 0x5586b584b0f0 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:121 4.29 4:967c563d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a8f20 con 0x5586b584b0f0 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:122 4.19 4:9aa0c7c3:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58abbc0 con 0x5586b584b0f0 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(118 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 38 ==== osd_op_reply(111 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 [stat,call,call] v29'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f09fd7fa640 20 handle_completion(): completion ok for obj=thirteen 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(119 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.729+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 39 ==== osd_op_reply(115 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(117 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 40 ==== osd_op_reply(116 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 41 ==== osd_op_reply(120 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 42 ==== osd_op_reply(121 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 43 ==== osd_op_reply(122 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9])"; uploads.size()=0; is_truncated=0 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:123 4.22 4:462a00f5:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5899fa0 con 0x5586b5846700 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:124 4.1f 4:fb6a4abc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a8f20 con 0x5586b584b0f0 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:125 4.10 4:09a0a451:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a2d80 con 0x5586b584b0f0 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:126 4.0 4:009ab4d8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58ab570 con 0x5586b584b0f0 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:127 4.16 4:68f47a17:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b589e270 con 0x5586b584b0f0 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:128 4.3e 4:7ef75f7c:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a2d80 con 0x7f0b0c01c610 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:129 4.22 4:46940a90:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b589e270 con 0x5586b5846700 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:130 4.26 4:6465abf7:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a8f20 con 0x7f0b04083040 2024-05-07T13:57:14.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:131 4.1f 4:faa6a74d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5899fa0 con 0x5586b584b0f0 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:132 4.29 4:967c563d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b589e270 con 0x5586b584b0f0 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:133 4.19 4:9aa0c7c3:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58ab570 con 0x5586b584b0f0 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 44 ==== osd_op_reply(124 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(123 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 45 ==== osd_op_reply(127 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(128 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b04070030 con 0x7f0b0c01c610 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(130 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 46 ==== osd_op_reply(132 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 47 ==== osd_op_reply(131 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.730+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 35 ==== osd_op_reply(129 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.731+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 48 ==== osd_op_reply(125 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.731+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 49 ==== osd_op_reply(133 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.731+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 50 ==== osd_op_reply(126 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.731+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a8f20 con 0x5586b5846700 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.732+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 36 ==== osd_op_reply(134 bud.buckets [call] v29'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.732+0000 7f0b1c9a2800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.732+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.732+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a8f20 con 0x5586b5846700 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.732+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 37 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv19 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.732+0000 7f0b1c9a2800 20 rados_obj.operate() r=0 bl.length=166 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.732+0000 7f0b1c9a2800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.732+0000 7f0b1c9a2800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-07T13:57:14.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.732+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a8f20 con 0x5586b5846700 2024-05-07T13:57:14.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.733+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 38 ==== osd_op_reply(136 myfoo6 [call,call,delete] v29'20 uv20 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.733+0000 7f0b1c9a2800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.733+0000 7f0b1c9a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.733+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94037059710336 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a8f20 con 0x7f0b0c01c610 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.733+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== watch-notify(notify (1) cookie 94037059388160 notify 124554051625 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5586b5865830 con 0x7f0b0c01c610 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.733+0000 7f09fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051625 cookie 94037059388160 notifier 4747 bl.length()=150 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.733+0000 7f09fd7fa640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f09500032c0 con 0x7f0b0c01c610 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.733+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== osd_op_reply(137 notify.3 [notify cookie 94037059710336 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0b04097020 con 0x7f0b0c01c610 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.734+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 26 ==== watch-notify(notify_complete (2) cookie 94037059710336 notify 124554051625 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5586b58649e0 con 0x7f0b0c01c610 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.734+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 27 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04097020 con 0x7f0b0c01c610 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.734+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:139 8.19 8:9c34a662:root::.bucket.meta.myfoo6%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a2d80 con 0x5586b5846700 2024-05-07T13:57:14.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.735+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 39 ==== osd_op_reply(139 .bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 [call,call,delete] v29'11 uv11 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.735+0000 7f0b1c9a2800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 from cache 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.735+0000 7f0b1c9a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9, ofs0, ns] 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.735+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94037059710336 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x7f0b0c01c610 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.735+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 28 ==== watch-notify(notify (1) cookie 94037059388160 notify 124554051626 ret 0) ==== 249+0+0 (crc 0 0 0) 0x5586b58649e0 con 0x7f0b0c01c610 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.735+0000 7f09fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051626 cookie 94037059388160 notifier 4747 bl.length()=207 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.735+0000 7f09fdffb640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f09e0003d60 con 0x7f0b0c01c610 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.735+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 29 ==== osd_op_reply(140 notify.3 [notify cookie 94037059710336 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0b04097020 con 0x7f0b0c01c610 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 30 ==== watch-notify(notify_complete (2) cookie 94037059710336 notify 124554051626 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5586b5859b30 con 0x7f0b0c01c610 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 31 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04097020 con 0x7f0b0c01c610 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:142 4.22 4:462a00f5:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a2d80 con 0x5586b5846700 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:143 4.1f 4:fb6a4abc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b589a4b0 con 0x5586b584b0f0 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:144 4.10 4:09a0a451:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b589a850 con 0x5586b584b0f0 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:145 4.0 4:009ab4d8:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a9d20 con 0x5586b584b0f0 2024-05-07T13:57:14.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:146 4.16 4:68f47a17:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5891630 con 0x5586b584b0f0 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:147 4.3e 4:7ef75f7c:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b589a4b0 con 0x7f0b0c01c610 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:148 4.22 4:46940a90:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a2d80 con 0x5586b5846700 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:149 4.26 4:6465abf7:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b589a850 con 0x7f0b04083040 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:150 4.1f 4:faa6a74d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a9d20 con 0x5586b584b0f0 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:151 4.29 4:967c563d:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5891630 con 0x5586b584b0f0 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.736+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:152 4.19 4:9aa0c7c3:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a9d20 con 0x5586b584b0f0 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.737+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 51 ==== osd_op_reply(146 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.4 [delete] v29'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 52 ==== osd_op_reply(143 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.1 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(149 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.7 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 53 ==== osd_op_reply(152 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.10 [delete] v29'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 54 ==== osd_op_reply(150 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.8 [delete] v29'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 40 ==== osd_op_reply(142 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.0 [delete] v29'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 41 ==== osd_op_reply(148 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.6 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 32 ==== osd_op_reply(147 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.5 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b04097020 con 0x7f0b0c01c610 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 55 ==== osd_op_reply(144 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.2 [delete] v29'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 56 ==== osd_op_reply(145 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.3 [delete] v29'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 57 ==== osd_op_reply(151 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9.9 [delete] v29'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1c9a2800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 : miss 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1c9a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.738+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:153 6.10 6:0df1aa98:::pubsub..bucket.myfoo6%2f2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b58a2d80 con 0x7f0b04083040 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.739+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(153 pubsub..bucket.myfoo6/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.739+0000 7f0b1c9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.739+0000 7f0b1c9a2800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 info.flags=0x0 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.739+0000 7f0b1c9a2800 10 adding default.rgw.log++pubsub..bucket.myfoo6/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 to cache LRU end 2024-05-07T13:57:14.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.739+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:154 6.10 6:0df1aa98:::pubsub..bucket.myfoo6%2f2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b589a4b0 con 0x7f0b04083040 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.740+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(154 pubsub..bucket.myfoo6/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9 [delete] v29'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.740+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x5586b5846700 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.741+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 42 ==== osd_op_reply(155 bud.buckets [call] v29'12 uv12 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.741+0000 7f0b1c9a2800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.741+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5892c20 con 0x5586b5846700 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.742+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 43 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v29'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.742+0000 7f0b1c9a2800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.742+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94037060155424 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5890a30 con 0x7f0b04083040 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.742+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== watch-notify(notify (1) cookie 94037059380656 notify 124554051607 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5586b58921f0 con 0x7f0b04083040 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.742+0000 7f09fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94037059380656 notifier 4747 bl.length()=170 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.742+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(157 notify.5 [notify cookie 94037060155424 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.742+0000 7f09fd7fa640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f09500032c0 con 0x7f0b04083040 2024-05-07T13:57:14.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.742+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.743+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== watch-notify(notify_complete (2) cookie 94037060155424 notify 124554051607 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5586b5859960 con 0x7f0b04083040 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.743+0000 7f0b1c9a2800 10 removing email index: 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.743+0000 7f0b1c9a2800 10 removing user buckets index 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.743+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b5892c20 con 0x5586b5846700 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 44 ==== osd_op_reply(159 bud.buckets [delete] v29'13 uv13 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f0b1c9a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94037060155424 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b5890a30 con 0x7f0b04083040 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== watch-notify(notify (1) cookie 94037059389216 notify 124554051608 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5586b5859960 con 0x7f0b04083040 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f09fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 94037059389216 notifier 4747 bl.length()=160 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f09fd7fa640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f09500032c0 con 0x7f0b04083040 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== osd_op_reply(160 notify.6 [notify cookie 94037060155424 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== watch-notify(notify_complete (2) cookie 94037060155424 notify 124554051608 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5586b585a250 con 0x7f0b04083040 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f0b1c9a2800 10 removing user index: bud 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.744+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x7f0b0c01c610 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.745+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 33 ==== osd_op_reply(162 bud [call,call,delete] v29'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0b04097020 con 0x7f0b0c01c610 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.745+0000 7f0b1c9a2800 10 removing default.rgw.meta+users.uid+bud from cache 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.745+0000 7f0b1c9a2800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.745+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94037059644448 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x7f0b04083040 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.746+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== watch-notify(notify (1) cookie 94037059380656 notify 124554051609 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5586b585a250 con 0x7f0b04083040 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.746+0000 7f09fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 94037059380656 notifier 4747 bl.length()=152 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.746+0000 7f09fdffb640 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f09e0003d60 con 0x7f0b04083040 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.746+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 38 ==== osd_op_reply(163 notify.5 [notify cookie 94037059644448 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.746+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 39 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.746+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 40 ==== watch-notify(notify_complete (2) cookie 94037059644448 notify 124554051609 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5586b58596d0 con 0x7f0b04083040 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.747+0000 7f09d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:14.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.747+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94037059398640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x5586b5846700 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.748+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 45 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94037059398640] v29'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.748+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94037059371632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x7f0b0c01c610 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.749+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 34 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94037059371632] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04097020 con 0x7f0b0c01c610 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.749+0000 7f0b1c9a2800 20 remove_watcher() i=0 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.749+0000 7f0b1c9a2800 2 removed watcher, disabling cache 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.749+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94037059378528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x5586b5846700 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.750+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 46 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94037059378528] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.750+0000 7f0b1c9a2800 20 remove_watcher() i=1 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.750+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94037059382304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x5586b584b0f0 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.751+0000 7f0b1a4a1640 1 -- 172.21.15.50:0/2749582605 <== osd.3 v2:172.21.15.50:6814/3553060046 58 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94037059382304] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b0c048070 con 0x5586b584b0f0 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.751+0000 7f0b1c9a2800 20 remove_watcher() i=2 2024-05-07T13:57:14.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.751+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94037059388160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x7f0b0c01c610 2024-05-07T13:57:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.752+0000 7f0b13fff640 1 -- 172.21.15.50:0/2749582605 <== osd.2 v2:172.21.15.50:6808/2034796854 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94037059388160] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b04097020 con 0x7f0b0c01c610 2024-05-07T13:57:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.752+0000 7f0b1c9a2800 20 remove_watcher() i=3 2024-05-07T13:57:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.752+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94037059391760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x5586b5846700 2024-05-07T13:57:14.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.753+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.1 v2:172.21.15.50:6800/3441257969 47 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94037059391760] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x5586b5846700 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.753+0000 7f0b1c9a2800 20 remove_watcher() i=4 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.753+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94037059380656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x7f0b04083040 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.754+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 41 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94037059380656] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.754+0000 7f0b1c9a2800 20 remove_watcher() i=5 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.754+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94037059389216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x7f0b04083040 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.756+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 42 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94037059389216] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.756+0000 7f0b1c9a2800 20 remove_watcher() i=6 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.756+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94037059397584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5586b590f820 con 0x7f0b04083040 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 <== osd.0 v2:172.21.15.22:6800/2215278347 43 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94037059397584] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1400a4a0 con 0x7f0b04083040 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 20 remove_watcher() i=7 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f0b04083040 msgr2=0x7f0b04075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f0b04083040 0x7f0b04075430 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b5846700 msgr2=0x5586b5848bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b5846700 0x5586b5848bc0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0b0c01c610 msgr2=0x7f0b0c052440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f0b0c01c610 0x7f0b0c052440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b584b0f0 msgr2=0x5586b584d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b584b0f0 0x5586b584d4e0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09e4036900 msgr2=0x7f09e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09e4036900 0x7f09e4038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0b0401ced0 tx=0x7f0b0404f000 comp rx=0 tx=0).stop 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 msgr2=0x5586b583b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/2749582605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5833de0 0x5586b583b150 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c04a220 tx=0x7f0b0c014f40 comp rx=0 tx=0).stop 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 reap_dead start 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1aca2640 1 -- 172.21.15.50:0/2749582605 reap_dead start 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 shutdown_connections 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 >> 172.21.15.50:0/2749582605 conn(0x5586b5830060 msgr2=0x5586b582d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 shutdown_connections 2024-05-07T13:57:14.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/2749582605 wait complete. 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1240427178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09f4036900 msgr2=0x7f09f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/1240427178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09f4036900 0x7f09f4038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5586b580c9c0 tx=0x7f0b04005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1240427178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5826c10 msgr2=0x5586b5827030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/1240427178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5826c10 0x5586b5827030 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00e910 tx=0x7f0b0c00f840 comp rx=0 tx=0).stop 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1240427178 shutdown_connections 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/1240427178 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f09f4036900 0x7f09f4038dc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/1240427178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b5826c10 0x5586b5827030 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.757+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1240427178 >> 172.21.15.50:0/1240427178 conn(0x5586b581acb0 msgr2=0x5586b581b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1240427178 shutdown_connections 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/1240427178 wait complete. 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5586b5815cd0 msgr2=0x5586b5818120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5586b5815cd0 0x5586b5818120 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b57138a0 msgr2=0x5586b580f4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5586b57138a0 0x5586b580f4d0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b5811d90 msgr2=0x5586b5814180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5586b5811d90 0x5586b5814180 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0a00036900 msgr2=0x7f0a00038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0a00036900 0x7f0a00038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0b04054000 tx=0x7f0b0404e000 comp rx=0 tx=0).stop 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 msgr2=0x5586b5808290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 --2- 172.21.15.50:0/3790818776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586b570d650 0x5586b5808290 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x5586b58013f0 tx=0x7f0b0c000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1aca2640 1 -- 172.21.15.50:0/3790818776 reap_dead start 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 shutdown_connections 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 >> 172.21.15.50:0/3790818776 conn(0x5586b5706d40 msgr2=0x5586b57fa780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 shutdown_connections 2024-05-07T13:57:14.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.758+0000 7f0b1c9a2800 1 -- 172.21.15.50:0/3790818776 wait complete. 2024-05-07T13:57:14.755 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-07T13:57:14.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-07T13:57:14.756 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-05-07T13:57:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.815+0000 7f65b8411800 1 Processor -- start 2024-05-07T13:57:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.815+0000 7f65b8411800 1 -- start start 2024-05-07T13:57:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.815+0000 7f65b8411800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x559d81a69b60 0x559d81a6bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.816+0000 7f65b8411800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d81a6ffa0 con 0x559d81a6c490 2024-05-07T13:57:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.816+0000 7f65b8411800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x559d818fa050 con 0x559d81a69b60 2024-05-07T13:57:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.816+0000 7f65b39dc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x559d81a69b60 0x559d81a6bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.816+0000 7f65b39dc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x559d81a69b60 0x559d81a6bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60844/0 (socket says 172.21.15.50:60844) 2024-05-07T13:57:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.816+0000 7f65b39dc640 1 -- 172.21.15.50:0/58547811 learned_addr learned my addr 172.21.15.50:0/58547811 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.816+0000 7f65b39dc640 1 -- 172.21.15.50:0/58547811 >> v1:172.21.15.22:6789/0 conn(0x559d81a6c490 legacy=0x559d81a6e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.816+0000 7f65b39dc640 1 -- 172.21.15.50:0/58547811 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d81a71180 con 0x559d81a69b60 2024-05-07T13:57:14.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.816+0000 7f65b29da640 1 -- 172.21.15.50:0/58547811 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 62538300 0 0) 0x559d81a6ffa0 con 0x559d81a6c490 2024-05-07T13:57:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.818+0000 7f65b39dc640 1 --2- 172.21.15.50:0/58547811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81a6bf50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f65a400a520 tx=0x7f65a401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a212191c1c174987 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.818+0000 7f65b29da640 1 -- 172.21.15.50:0/58547811 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a4057070 con 0x559d81a69b60 2024-05-07T13:57:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.818+0000 7f65b29da640 1 -- 172.21.15.50:0/58547811 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4052570 con 0x559d81a69b60 2024-05-07T13:57:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.818+0000 7f65b29da640 1 -- 172.21.15.50:0/58547811 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a404ae60 con 0x559d81a69b60 2024-05-07T13:57:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.819+0000 7f65b8411800 1 -- 172.21.15.50:0/58547811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 msgr2=0x559d81a6bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.819+0000 7f65b8411800 1 --2- 172.21.15.50:0/58547811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81a6bf50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f65a400a520 tx=0x7f65a401d010 comp rx=0 tx=0).stop 2024-05-07T13:57:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.819+0000 7f65b8411800 1 -- 172.21.15.50:0/58547811 shutdown_connections 2024-05-07T13:57:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.819+0000 7f65b8411800 1 --2- 172.21.15.50:0/58547811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81a6bf50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.819+0000 7f65b8411800 1 -- 172.21.15.50:0/58547811 >> 172.21.15.50:0/58547811 conn(0x559d81a63570 msgr2=0x559d81a65990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.819+0000 7f65b8411800 1 -- 172.21.15.50:0/58547811 shutdown_connections 2024-05-07T13:57:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.819+0000 7f65b8411800 1 -- 172.21.15.50:0/58547811 wait complete. 2024-05-07T13:57:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.834+0000 7f65b8411800 1 Processor -- start 2024-05-07T13:57:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.834+0000 7f65b8411800 1 -- start start 2024-05-07T13:57:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.834+0000 7f65b8411800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b5a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.834+0000 7f65b8411800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559d819b41c0 con 0x559d81a69b60 2024-05-07T13:57:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.835+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b5a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.835+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b5a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60846/0 (socket says 172.21.15.50:60846) 2024-05-07T13:57:14.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.835+0000 7f65b39dc640 1 -- 172.21.15.50:0/1753296501 learned_addr learned my addr 172.21.15.50:0/1753296501 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.835+0000 7f65b39dc640 1 -- 172.21.15.50:0/1753296501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d81b5aa10 con 0x559d81a69b60 2024-05-07T13:57:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.835+0000 7f65b39dc640 1 --2- 172.21.15.50:0/1753296501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b5a440 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f65a4055040 tx=0x7f65a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c5845815d39a18 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.835+0000 7f64a1e0b640 1 -- 172.21.15.50:0/1753296501 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a4062070 con 0x559d81a69b60 2024-05-07T13:57:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.835+0000 7f64a1e0b640 1 -- 172.21.15.50:0/1753296501 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4052720 con 0x559d81a69b60 2024-05-07T13:57:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.835+0000 7f64a1e0b640 1 -- 172.21.15.50:0/1753296501 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a4057040 con 0x559d81a69b60 2024-05-07T13:57:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.836+0000 7f65b8411800 1 -- 172.21.15.50:0/1753296501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 msgr2=0x559d81b5a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.836+0000 7f65b8411800 1 --2- 172.21.15.50:0/1753296501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b5a440 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f65a4055040 tx=0x7f65a404c000 comp rx=0 tx=0).stop 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.836+0000 7f65b8411800 1 -- 172.21.15.50:0/1753296501 shutdown_connections 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.836+0000 7f65b8411800 1 --2- 172.21.15.50:0/1753296501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b5a440 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.836+0000 7f65b8411800 1 -- 172.21.15.50:0/1753296501 >> 172.21.15.50:0/1753296501 conn(0x559d81a63570 msgr2=0x559d81b55d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.836+0000 7f65b8411800 1 -- 172.21.15.50:0/1753296501 shutdown_connections 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.836+0000 7f65b8411800 1 -- 172.21.15.50:0/1753296501 wait complete. 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.836+0000 7f65b8411800 1 Processor -- start 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.836+0000 7f65b8411800 1 -- start start 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.837+0000 7f65b8411800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b61e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.837+0000 7f65b8411800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559d81a70470 con 0x559d81a69b60 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.837+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b61e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.837+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b61e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60850/0 (socket says 172.21.15.50:60850) 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.837+0000 7f65b39dc640 1 -- 172.21.15.50:0/2068144626 learned_addr learned my addr 172.21.15.50:0/2068144626 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.837+0000 7f65b39dc640 1 -- 172.21.15.50:0/2068144626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d81b623d0 con 0x559d81a69b60 2024-05-07T13:57:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.837+0000 7f65b39dc640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b61e90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f65a4005400 tx=0x7f65a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.837+0000 7f649bfff640 1 -- 172.21.15.50:0/2068144626 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a4057050 con 0x559d81a69b60 2024-05-07T13:57:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.838+0000 7f649bfff640 1 -- 172.21.15.50:0/2068144626 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4067450 con 0x559d81a69b60 2024-05-07T13:57:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.838+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d81b62660 con 0x559d81a69b60 2024-05-07T13:57:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.838+0000 7f649bfff640 1 -- 172.21.15.50:0/2068144626 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a4062040 con 0x559d81a69b60 2024-05-07T13:57:14.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.838+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d81b65310 con 0x559d81a69b60 2024-05-07T13:57:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.838+0000 7f649bfff640 1 -- 172.21.15.50:0/2068144626 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65a4067730 con 0x559d81a69b60 2024-05-07T13:57:14.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.839+0000 7f649bfff640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f649c036950 0x7f649c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.839+0000 7f649bfff640 1 -- 172.21.15.50:0/2068144626 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f65a408e310 con 0x559d81a69b60 2024-05-07T13:57:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.839+0000 7f65b31db640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f649c036950 0x7f649c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.839+0000 7f65b8411800 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81a6c490 0x559d81b690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.839+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81b69610 con 0x559d81a6c490 2024-05-07T13:57:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.839+0000 7f65b41dd640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81a6c490 0x559d81b690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.839+0000 7f65b31db640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f649c036950 0x7f649c038e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65a8000f60 tx=0x7f65a80013f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.839+0000 7f65b41dd640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81a6c490 0x559d81b690d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.840+0000 7f65b41dd640 1 -- 172.21.15.50:0/2068144626 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81a6c490 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.840+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81b66680 con 0x559d81a6c490 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.840+0000 7f65b41dd640 1 -- 172.21.15.50:0/2068144626 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81a6c490 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.840+0000 7f65b8411800 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81b6b950 0x559d81b6dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.840+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81b6e430 con 0x559d81b6b950 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.840+0000 7f65b39dc640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81b6b950 0x559d81b6dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.840+0000 7f65b39dc640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81b6b950 0x559d81b6dd40 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.841+0000 7f65b39dc640 1 -- 172.21.15.50:0/2068144626 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65a4064070 con 0x559d81b6b950 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.841+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81b6a900 con 0x559d81a6c490 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.841+0000 7f65b41dd640 1 -- 172.21.15.50:0/2068144626 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81a6c490 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.841+0000 7f65b8411800 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559d81b6f890 0x559d81b71d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.841+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81b72460 con 0x559d81b6f890 2024-05-07T13:57:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.841+0000 7f65b31db640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559d81b6f890 0x559d81b71d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.842+0000 7f65b31db640 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559d81b6f890 0x559d81b71d00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.842+0000 7f65b31db640 1 -- 172.21.15.50:0/2068144626 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65a8010590 con 0x559d81b6f890 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.842+0000 7f65b8411800 1 Processor -- start 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.842+0000 7f65b8411800 1 -- start start 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f65b8411800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69720 0x559d81a67b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f65b8411800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559d8195acf0 con 0x559d81a69720 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69720 0x559d81a67b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69720 0x559d81a67b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60852/0 (socket says 172.21.15.50:60852) 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f65b39dc640 1 -- 172.21.15.50:0/398184786 learned_addr learned my addr 172.21.15.50:0/398184786 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f65b39dc640 1 -- 172.21.15.50:0/398184786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d81a680d0 con 0x559d81a69720 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f65b39dc640 1 --2- 172.21.15.50:0/398184786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69720 0x559d81a67b90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f65a408c600 tx=0x7f65a405ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f64997fa640 1 -- 172.21.15.50:0/398184786 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a408b1c0 con 0x559d81a69720 2024-05-07T13:57:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f64997fa640 1 -- 172.21.15.50:0/398184786 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4007dd0 con 0x559d81a69720 2024-05-07T13:57:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f65b8411800 1 -- 172.21.15.50:0/398184786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d81a68360 con 0x559d81a69720 2024-05-07T13:57:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f64997fa640 1 -- 172.21.15.50:0/398184786 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a40080b0 con 0x559d81a69720 2024-05-07T13:57:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.843+0000 7f65b8411800 1 -- 172.21.15.50:0/398184786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d81a68860 con 0x559d81a69720 2024-05-07T13:57:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.844+0000 7f64997fa640 1 -- 172.21.15.50:0/398184786 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65a4084070 con 0x559d81a69720 2024-05-07T13:57:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.844+0000 7f64997fa640 1 --2- 172.21.15.50:0/398184786 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f648c036970 0x7f648c038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.844+0000 7f64997fa640 1 -- 172.21.15.50:0/398184786 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f65a40900c0 con 0x559d81a69720 2024-05-07T13:57:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.844+0000 7f65b31db640 1 --2- 172.21.15.50:0/398184786 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f648c036970 0x7f648c038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.845+0000 7f65b8411800 1 Processor -- start 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.845+0000 7f65b8411800 1 -- start start 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.845+0000 7f65b31db640 1 --2- 172.21.15.50:0/398184786 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f648c036970 0x7f648c038e30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559d81b69f00 tx=0x7f65a8006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.845+0000 7f65b8411800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b90190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.845+0000 7f65b8411800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559d81b5acd0 con 0x559d81b8fd70 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.845+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b90190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.845+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b90190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60860/0 (socket says 172.21.15.50:60860) 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.845+0000 7f65b39dc640 1 -- 172.21.15.50:0/2115396864 learned_addr learned my addr 172.21.15.50:0/2115396864 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.845+0000 7f65b39dc640 1 -- 172.21.15.50:0/2115396864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d81b90760 con 0x559d81b8fd70 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f65b39dc640 1 --2- 172.21.15.50:0/2115396864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b90190 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f65a406f5c0 tx=0x7f65a4097d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d854311d9d7bb96a server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f6492ffd640 1 -- 172.21.15.50:0/2115396864 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a40a8070 con 0x559d81b8fd70 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f6492ffd640 1 -- 172.21.15.50:0/2115396864 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4066a10 con 0x559d81b8fd70 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f6492ffd640 1 -- 172.21.15.50:0/2115396864 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a40663e0 con 0x559d81b8fd70 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f65b8411800 1 -- 172.21.15.50:0/2115396864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 msgr2=0x559d81b90190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f65b8411800 1 --2- 172.21.15.50:0/2115396864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b90190 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f65a406f5c0 tx=0x7f65a4097d10 comp rx=0 tx=0).stop 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f65b8411800 1 -- 172.21.15.50:0/2115396864 shutdown_connections 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f65b8411800 1 --2- 172.21.15.50:0/2115396864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b90190 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f65b8411800 1 -- 172.21.15.50:0/2115396864 >> 172.21.15.50:0/2115396864 conn(0x559d81b8bff0 msgr2=0x559d81b8a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f65b8411800 1 -- 172.21.15.50:0/2115396864 shutdown_connections 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f65b8411800 1 -- 172.21.15.50:0/2115396864 wait complete. 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.846+0000 7f65b8411800 1 Processor -- start 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.847+0000 7f65b8411800 1 -- start start 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.847+0000 7f65b8411800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b97130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.847+0000 7f65b8411800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559d81b90dd0 con 0x559d81b8fd70 2024-05-07T13:57:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.847+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b97130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.847+0000 7f65b39dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b97130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:60870/0 (socket says 172.21.15.50:60870) 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.847+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 learned_addr learned my addr 172.21.15.50:0/938514056 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.847+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d81b97670 con 0x559d81b8fd70 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.847+0000 7f65b39dc640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b97130 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f65a40669c0 tx=0x7f65a4094ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.848+0000 7f64917fa640 1 -- 172.21.15.50:0/938514056 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a40b3020 con 0x559d81b8fd70 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.848+0000 7f64917fa640 1 -- 172.21.15.50:0/938514056 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4097940 con 0x559d81b8fd70 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.848+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d81b97670 con 0x559d81b8fd70 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.848+0000 7f64917fa640 1 -- 172.21.15.50:0/938514056 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a40a8030 con 0x559d81b8fd70 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.848+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d81b97670 con 0x559d81b8fd70 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.848+0000 7f64917fa640 1 -- 172.21.15.50:0/938514056 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65a40b6020 con 0x559d81b8fd70 2024-05-07T13:57:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.849+0000 7f64917fa640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f647c0368b0 0x7f647c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.849+0000 7f64917fa640 1 -- 172.21.15.50:0/938514056 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f65a40a9070 con 0x559d81b8fd70 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.849+0000 7f65b31db640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f647c0368b0 0x7f647c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.849+0000 7f65b31db640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f647c0368b0 0x7f647c038d70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x559d81b6a8d0 tx=0x7f65a8022040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.849+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.849+0000 7f65b8411800 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81ba2650 0x559d81ba4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.849+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba5260 con 0x559d81ba2650 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b41dd640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81ba2650 0x559d81ba4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b41dd640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81ba2650 0x559d81ba4b10 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b8411800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b8411800 20 realm 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba5670 con 0x559d81ba2650 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b8411800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b8411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.850+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba5f40 con 0x559d81ba2650 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b8411800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b8411800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b8411800 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81ba7040 0x559d81ba9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba99f0 con 0x559d81ba7040 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b39dc640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81ba7040 0x559d81ba9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.851+0000 7f65b39dc640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81ba7040 0x559d81ba9430 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.852+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.852+0000 7f65b8411800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.852+0000 7f65b8411800 20 searching for the correct realm 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.852+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81bab340 con 0x559d81ba7040 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.852+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.852+0000 7f65b39dc640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65a40c3040 0x7f65a4094730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.852+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81bab340 con 0x7f65a40c3040 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.852+0000 7f65b31db640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65a40c3040 0x7f65a4094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.852+0000 7f65b31db640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65a40c3040 0x7f65a4094730 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.853+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a8036040 con 0x7f65a40c3040 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.853+0000 7f65b31db640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65a8003a40 0x7f65a80393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.853+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81bab340 con 0x7f65a8003a40 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.853+0000 7f65b41dd640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65a8003a40 0x7f65a80393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.853+0000 7f65b41dd640 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65a8003a40 0x7f65a80393c0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.854+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.854+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.854+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.854+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.854+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.854+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.855+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.855+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a8003a40 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.855+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.855+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a40c3040 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.855+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a8036040 con 0x7f65a40c3040 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.855+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a40c3040 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.855+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a8036040 con 0x7f65a40c3040 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.855+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.856+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.856+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a8003a40 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.856+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.856+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.856+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.856+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a40c3040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.856+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f65a8036040 con 0x7f65a40c3040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.856+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba7040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.857+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.857+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba7040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.857+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.857+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a8003a40 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.857+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.857+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba7040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.857+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.857+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba7040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.858+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.858+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.858+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.858+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.858+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.858+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a8003a40 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.858+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.858+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba7040 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.859+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.859+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a40c3040 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.859+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a8036040 con 0x7f65a40c3040 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.859+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.859+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.859+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a8003a40 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.860+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.860+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba7040 2024-05-07T13:57:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.860+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.860+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a8003a40 2024-05-07T13:57:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.860+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.860+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a40c3040 2024-05-07T13:57:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.860+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a8036040 con 0x7f65a40c3040 2024-05-07T13:57:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.860+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba7040 2024-05-07T13:57:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a40c3040 2024-05-07T13:57:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a8036040 con 0x7f65a40c3040 2024-05-07T13:57:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x559d81ba2650 2024-05-07T13:57:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba62e0 con 0x7f65a40c3040 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a8036040 con 0x7f65a40c3040 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b8411800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b8411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b8411800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b8411800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b8411800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b8411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.861+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81baa2b0 con 0x559d81ba2650 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.862+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.862+0000 7f65b8411800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.862+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.862+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81baa6a0 con 0x559d81ba2650 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.862+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.862+0000 7f65b8411800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.862+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.862+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81baa6a0 con 0x7f65a8003a40 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 zone default found 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 4 Realm: () 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 zonegroup default 2024-05-07T13:57:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba9e80 con 0x7f65a8003a40 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81ba9f10 con 0x559d81ba7040 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bad2c0 con 0x559d81ba7040 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 started sync module instance, tier type = 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.863+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bac610 con 0x7f65a40c3040 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.865+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.865+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94134974728704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bac270 con 0x7f65a40c3040 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.865+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bae1f0 con 0x559d81ba2650 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.866+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94134974728704] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.866+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.866+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94134974733632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bae610 con 0x559d81ba2650 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.866+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81baefd0 con 0x559d81ba7040 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.867+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.867+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94134974737184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81baf870 con 0x559d81ba7040 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.867+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb0350 con 0x7f65a40c3040 2024-05-07T13:57:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.867+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94134974733632] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.868+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94134974737184] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.868+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.868+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94134974739392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bae160 con 0x7f65a40c3040 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.868+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb0d10 con 0x559d81ba2650 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.869+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.869+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94134974745152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb1450 con 0x559d81ba2650 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.869+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb1f70 con 0x7f65a8003a40 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.869+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94134974739392] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.870+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.870+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94134974745152] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.870+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94134974749248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb1f30 con 0x7f65a8003a40 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.870+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb0ee0 con 0x7f65a8003a40 2024-05-07T13:57:14.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.871+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94134974749248] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.871+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.871+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94134974742112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb0ea0 con 0x7f65a8003a40 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.871+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb2e30 con 0x7f65a8003a40 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94134974742112] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94134974751952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb2da0 con 0x7f65a8003a40 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b8411800 20 add_watcher() i=0 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b8411800 20 add_watcher() i=1 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b8411800 20 add_watcher() i=2 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b8411800 20 add_watcher() i=3 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b8411800 20 add_watcher() i=4 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b8411800 20 add_watcher() i=5 2024-05-07T13:57:14.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.872+0000 7f65b8411800 20 add_watcher() i=6 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.873+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94134974751952] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.873+0000 7f65b8411800 20 add_watcher() i=7 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.873+0000 7f65b8411800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.873+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb6250 con 0x559d81ba2650 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.874+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.874+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94134974753472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb36c0 con 0x559d81ba2650 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.875+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94134974753472] v29'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.875+0000 7f6469fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.875+0000 7f65b8411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.875+0000 7f65b8411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.875+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb5f30 con 0x559d81ba2650 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.876+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.876+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bbf280 con 0x7f65a8003a40 2024-05-07T13:57:14.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.878+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.878+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bbf280 con 0x559d81ba7040 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.879+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.879+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bbf730 con 0x559d81ba2650 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.880+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.880+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bbf730 con 0x7f65a40c3040 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.881+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.881+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bbfda0 con 0x559d81ba7040 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.882+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.882+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bbfe30 con 0x559d81ba2650 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.883+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.883+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bbfec0 con 0x7f65a8003a40 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.884+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.884+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bbff50 con 0x7f65a40c3040 2024-05-07T13:57:14.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.886+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.886+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc0580 con 0x559d81ba7040 2024-05-07T13:57:14.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.887+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.887+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bbf530 con 0x7f65a40c3040 2024-05-07T13:57:14.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.887+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.888+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc0c00 con 0x7f65a8003a40 2024-05-07T13:57:14.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.889+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.889+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc0c90 con 0x7f65a40c3040 2024-05-07T13:57:14.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.889+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.889+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1140 con 0x7f65a8003a40 2024-05-07T13:57:14.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.891+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.891+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1140 con 0x559d81ba2650 2024-05-07T13:57:14.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.892+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.892+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc10b0 con 0x559d81ba7040 2024-05-07T13:57:14.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.893+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'65 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.893+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc10b0 con 0x7f65a40c3040 2024-05-07T13:57:14.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.894+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.894+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba7040 2024-05-07T13:57:14.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.895+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.895+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba2650 2024-05-07T13:57:14.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.896+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'36 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.896+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba2650 2024-05-07T13:57:14.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.897+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.897+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba7040 2024-05-07T13:57:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.898+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'66 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.898+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x7f65a40c3040 2024-05-07T13:57:14.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.899+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.899+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba7040 2024-05-07T13:57:14.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.900+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.900+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba7040 2024-05-07T13:57:14.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.901+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.901+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba7040 2024-05-07T13:57:14.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.902+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.902+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba7040 2024-05-07T13:57:14.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.903+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.903+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x7f65a8003a40 2024-05-07T13:57:14.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.904+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.904+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba7040 2024-05-07T13:57:14.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.906+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.906+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x7f65a8003a40 2024-05-07T13:57:14.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.907+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.907+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x559d81ba7040 2024-05-07T13:57:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.908+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'67 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.908+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x7f65a8003a40 2024-05-07T13:57:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.909+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.909+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bc1490 con 0x7f65a40c3040 2024-05-07T13:57:14.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.910+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f6468fe1640 20 reqs_thread_entry: start 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f65b8411800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f65b8411800 20 Filter name: none 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f63e27fc640 20 reqs_thread_entry: start 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f65b8411800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bec0f0 con 0x7f65a8003a40 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f65b8411800 20 rados_obj.operate() r=0 bl.length=380 2024-05-07T13:57:14.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.911+0000 7f65b8411800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bee9e0 con 0x7f65a8003a40 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv9 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 : miss 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:96 8.6 8:6330f1e5:root::.bucket.meta.myfoo7%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bee870 con 0x7f65a8003a40 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(96 .bucket.meta.myfoo7:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f65ac00a4a0 con 0x7f65a8003a40 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 20 rados_obj.operate() r=0 bl.length=382 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 info.flags=0x17 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 to cache LRU end 2024-05-07T13:57:14.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.912+0000 7f65b8411800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:57:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.913+0000 7f65b8411800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 2024-05-07T13:57:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.913+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:97 4.36 4:6fd27264:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6bda0 con 0x559d81ba2650 2024-05-07T13:57:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.913+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(97 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.913+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:98 4.28 4:17fd3ff5:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6bde0 con 0x559d81ba2650 2024-05-07T13:57:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.913+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(98 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac00a4a0 con 0x559d81ba2650 2024-05-07T13:57:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.913+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:99 4.25 4:a43ccafc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6bde0 con 0x559d81ba7040 2024-05-07T13:57:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.914+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(99 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.914+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:100 4.12 4:4bf1a422:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6bde0 con 0x559d81ba2650 2024-05-07T13:57:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.914+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(100 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.914+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:101 4.d 4:b1af907b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6bde0 con 0x559d81ba7040 2024-05-07T13:57:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.914+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(101 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.914+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:102 4.30 4:0c59bfa9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6be20 con 0x559d81ba7040 2024-05-07T13:57:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.915+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(102 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5 [call out=377b] v0'0 uv17 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.915+0000 7f65b8411800 10 cls_bucket_list_unordered: got fourteen 2024-05-07T13:57:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.915+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:103 4.1f 4:f9bbe1c1:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6be60 con 0x559d81ba7040 2024-05-07T13:57:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.915+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(103 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.915+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:104 4.2c 4:35e42016:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6bea0 con 0x559d81ba2650 2024-05-07T13:57:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.915+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(104 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.915+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:105 4.4 4:20192001:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6bea0 con 0x7f65a8003a40 2024-05-07T13:57:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.916+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(105 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.916+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:106 4.4 4:235ae22b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6bea0 con 0x7f65a8003a40 2024-05-07T13:57:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.916+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(106 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.916+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:107 4.10 4:0ba26160:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6bea0 con 0x559d81ba7040 2024-05-07T13:57:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== osd_op_reply(107 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b8411800 20 get_obj_state: octx=0x7f65ac00ab10 obj=myfoo7:fourteen state=0x559d81c69e68 s->prefetch_data=0 2024-05-07T13:57:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:108 3.1es0 3:78ae5e72:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6ac90 con 0x7f65a8003a40 2024-05-07T13:57:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(108 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b8411800 10 manifest: total_size = 8 2024-05-07T13:57:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b8411800 20 get_obj_state: setting s->obj_tag to 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9961673883594676996 2024-05-07T13:57:14.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b8411800 20 get_obj_state: octx=0x7f65ac00ab10 obj=myfoo7:fourteen state=0x559d81c69e68 s->prefetch_data=0 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b8411800 20 prepare_atomic_modification: state is not atomic. state=0x559d81c69e68 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b8411800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.917+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:109 4.30 4:0c59bfa9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6b510 con 0x559d81ba7040 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.918+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(109 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5 [stat,call,call] v29'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.918+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:110 3.1es0 3:78ae5e72:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c6b510 con 0x7f65a8003a40 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.920+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(110 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10_fourteen [call] v29'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.920+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:111 4.30 4:0c59bfa9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bf2f70 con 0x559d81ba7040 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.920+0000 7f65b8411800 20 list_objects_ordered: starting attempt 1 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.920+0000 7f65b8411800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.920+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:112 4.36 4:6fd27264:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bf2f70 con 0x559d81ba2650 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.920+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:113 4.28 4:17fd3ff5:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bf2f70 con 0x559d81ba2650 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.920+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:114 4.25 4:a43ccafc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bf96b0 con 0x559d81ba7040 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:115 4.12 4:4bf1a422:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bfc180 con 0x559d81ba2650 2024-05-07T13:57:14.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:116 4.d 4:b1af907b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bfef80 con 0x559d81ba7040 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:117 4.30 4:0c59bfa9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c01e00 con 0x559d81ba7040 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:118 4.1f 4:f9bbe1c1:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c04c80 con 0x559d81ba7040 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:119 4.2c 4:35e42016:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c07ab0 con 0x559d81ba2650 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:120 4.4 4:20192001:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0a8e0 con 0x7f65a8003a40 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:121 4.4 4:235ae22b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0d710 con 0x7f65a8003a40 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:122 4.10 4:0ba26160:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba7040 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 32 ==== osd_op_reply(114 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(112 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(113 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 33 ==== osd_op_reply(116 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 34 ==== osd_op_reply(122 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 35 ==== osd_op_reply(118 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(120 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.921+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(115 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== osd_op_reply(121 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 35 ==== osd_op_reply(119 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 36 ==== osd_op_reply(111 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5 [stat,call,call] v29'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f64927fc640 20 handle_completion(): completion ok for obj=fourteen 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 37 ==== osd_op_reply(117 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5 [call out=124b] v0'0 uv19 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-07T13:57:14.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10])"; uploads.size()=0; is_truncated=0 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:123 4.36 4:6fd27264:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba2650 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:124 4.28 4:17fd3ff5:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0d710 con 0x559d81ba2650 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:125 4.25 4:a43ccafc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0a8e0 con 0x559d81ba7040 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:126 4.12 4:4bf1a422:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c01e00 con 0x559d81ba2650 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:127 4.d 4:b1af907b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba7040 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:128 4.30 4:0c59bfa9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0d710 con 0x559d81ba7040 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:129 4.1f 4:f9bbe1c1:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0a8e0 con 0x559d81ba7040 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:130 4.2c 4:35e42016:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba2650 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:131 4.4 4:20192001:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0d710 con 0x7f65a8003a40 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:132 4.4 4:235ae22b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0a8e0 con 0x7f65a8003a40 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.922+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:133 4.10 4:0ba26160:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81bf2f70 con 0x559d81ba7040 2024-05-07T13:57:14.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 36 ==== osd_op_reply(123 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 37 ==== osd_op_reply(126 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 38 ==== osd_op_reply(124 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 39 ==== osd_op_reply(130 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 38 ==== osd_op_reply(125 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== osd_op_reply(131 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 39 ==== osd_op_reply(127 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== osd_op_reply(132 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 40 ==== osd_op_reply(128 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5 [call out=124b] v0'0 uv19 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 41 ==== osd_op_reply(129 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 42 ==== osd_op_reply(133 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.923+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a8003a40 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.924+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== osd_op_reply(134 fud.buckets [call] v29'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.924+0000 7f65b8411800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.924+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.924+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a40c3040 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.924+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.924+0000 7f65b8411800 20 rados_obj.operate() r=0 bl.length=168 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.924+0000 7f65b8411800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.924+0000 7f65b8411800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-05-07T13:57:14.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.924+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a40c3040 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.925+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(136 myfoo7 [call,call,delete] v29'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.925+0000 7f65b8411800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.925+0000 7f65b8411800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.925+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94134975113440 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a40c3040 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.926+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== watch-notify(notify (1) cookie 94134974739392 notify 124554051627 ret 0) ==== 192+0+0 (crc 0 0 0) 0x559d81bbf530 con 0x7f65a40c3040 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.926+0000 7f6492ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051627 cookie 94134974739392 notifier 4754 bl.length()=150 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.926+0000 7f6492ffd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6478003d60 con 0x7f65a40c3040 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.926+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(137 notify.3 [notify cookie 94134975113440 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.926+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.926+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== watch-notify(notify_complete (2) cookie 94134975113440 notify 124554051627 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d81bc0a30 con 0x7f65a40c3040 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.926+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:139 8.6 8:6330f1e5:root::.bucket.meta.myfoo7%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a8003a40 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.927+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(139 .bucket.meta.myfoo7:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 [call,call,delete] v29'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.927+0000 7f65b8411800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 from cache 2024-05-07T13:57:14.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.927+0000 7f65b8411800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10, ofs0, ns] 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.927+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94134975509552 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba7040 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 43 ==== watch-notify(notify (1) cookie 94134974737184 notify 124554051592 ret 0) ==== 250+0+0 (crc 0 0 0) 0x559d81bbffa0 con 0x559d81ba7040 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f64927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94134974737184 notifier 4754 bl.length()=208 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f64927fc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f63e80032c0 con 0x559d81ba7040 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 44 ==== osd_op_reply(140 notify.2 [notify cookie 94134975509552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 45 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 46 ==== watch-notify(notify_complete (2) cookie 94134975509552 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d81a680d0 con 0x559d81ba7040 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:142 4.36 4:6fd27264:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba2650 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:143 4.28 4:17fd3ff5:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bee7e0 con 0x559d81ba2650 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:144 4.25 4:a43ccafc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0d050 con 0x559d81ba7040 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:145 4.12 4:4bf1a422:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c08430 con 0x559d81ba2650 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:146 4.d 4:b1af907b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba7040 2024-05-07T13:57:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:147 4.30 4:0c59bfa9:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bee7e0 con 0x559d81ba7040 2024-05-07T13:57:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.928+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:148 4.1f 4:f9bbe1c1:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bffe00 con 0x559d81ba7040 2024-05-07T13:57:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.929+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:149 4.2c 4:35e42016:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c08430 con 0x559d81ba2650 2024-05-07T13:57:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.929+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:150 4.4 4:20192001:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bee7e0 con 0x7f65a8003a40 2024-05-07T13:57:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.929+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:151 4.4 4:235ae22b:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a8003a40 2024-05-07T13:57:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.929+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:152 4.10 4:0ba26160:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c0d050 con 0x559d81ba7040 2024-05-07T13:57:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.930+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 47 ==== osd_op_reply(144 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.2 [delete] v29'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.930+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 48 ==== osd_op_reply(146 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.4 [delete] v29'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.930+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 49 ==== osd_op_reply(148 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.6 [delete] v29'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.930+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 40 ==== osd_op_reply(143 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.1 [delete] v29'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.930+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 41 ==== osd_op_reply(145 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.3 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.930+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 42 ==== osd_op_reply(142 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.0 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 50 ==== osd_op_reply(147 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.5 [delete] v29'20 uv20 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== osd_op_reply(150 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.8 [delete] v29'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 43 ==== osd_op_reply(149 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.7 [delete] v29'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 51 ==== osd_op_reply(152 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.10 [delete] v29'8 uv8 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== osd_op_reply(151 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10.9 [delete] v29'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b8411800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 : miss 2024-05-07T13:57:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b8411800 20 rados->read ofs=0 len=0 2024-05-07T13:57:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:153 6.6 6:6026bc13:::pubsub..bucket.myfoo7%2f2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba7040 2024-05-07T13:57:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 52 ==== osd_op_reply(153 pubsub..bucket.myfoo7/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b8411800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b8411800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 info.flags=0x0 2024-05-07T13:57:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b8411800 10 adding default.rgw.log++pubsub..bucket.myfoo7/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 to cache LRU end 2024-05-07T13:57:14.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.931+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:154 6.6 6:6026bc13:::pubsub..bucket.myfoo7%2f2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba7040 2024-05-07T13:57:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.932+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 53 ==== osd_op_reply(154 pubsub..bucket.myfoo7/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.10 [delete] v29'13 uv12 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.932+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a8003a40 2024-05-07T13:57:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.933+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 38 ==== osd_op_reply(155 fud.buckets [call] v29'11 uv11 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.933+0000 7f65b8411800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-07T13:57:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.933+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a8003a40 2024-05-07T13:57:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.934+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 39 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v29'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.934+0000 7f65b8411800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-07T13:57:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.934+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94134975123536 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba7040 2024-05-07T13:57:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.934+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 54 ==== watch-notify(notify (1) cookie 94134974737184 notify 124554051593 ret 0) ==== 212+0+0 (crc 0 0 0) 0x559d81a680d0 con 0x559d81ba7040 2024-05-07T13:57:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.934+0000 7f64927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94134974737184 notifier 4754 bl.length()=170 2024-05-07T13:57:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.935+0000 7f64927fc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f63e80032c0 con 0x559d81ba7040 2024-05-07T13:57:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.935+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 55 ==== osd_op_reply(157 notify.2 [notify cookie 94134975123536 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.935+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 56 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.935+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 57 ==== watch-notify(notify_complete (2) cookie 94134975123536 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d81b65310 con 0x559d81ba7040 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.935+0000 7f65b8411800 10 removing email index: 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.935+0000 7f65b8411800 10 removing user buckets index 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.935+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a8003a40 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.936+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 40 ==== osd_op_reply(159 fud.buckets [delete] v29'12 uv12 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.936+0000 7f65b8411800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.936+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94134975509552 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a8003a40 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.936+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 41 ==== watch-notify(notify (1) cookie 94134974742112 notify 124554051610 ret 0) ==== 202+0+0 (crc 0 0 0) 0x559d81bedd90 con 0x7f65a8003a40 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.936+0000 7f6492ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 94134974742112 notifier 4754 bl.length()=160 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.936+0000 7f6492ffd640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6478003d60 con 0x7f65a8003a40 2024-05-07T13:57:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.936+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 42 ==== osd_op_reply(160 notify.6 [notify cookie 94134975509552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.936+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 43 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.937+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 44 ==== watch-notify(notify_complete (2) cookie 94134975509552 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d81bb59e0 con 0x7f65a8003a40 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.937+0000 7f65b8411800 10 removing user index: fud 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.937+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a8003a40 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 45 ==== osd_op_reply(162 fud [call,call,delete] v29'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f65b8411800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f65b8411800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94134975509552 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a8003a40 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 46 ==== watch-notify(notify (1) cookie 94134974749248 notify 124554051611 ret 0) ==== 194+0+0 (crc 0 0 0) 0x559d81bb59e0 con 0x7f65a8003a40 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f64927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051611 cookie 94134974749248 notifier 4754 bl.length()=152 2024-05-07T13:57:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f64927fc640 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f63e80032c0 con 0x7f65a8003a40 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 47 ==== osd_op_reply(163 notify.5 [notify cookie 94134975509552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 48 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.938+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 49 ==== watch-notify(notify_complete (2) cookie 94134975509552 notify 124554051611 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d81bb62d0 con 0x7f65a8003a40 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.939+0000 7f6469fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.939+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94134974753472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x559d81ba2650 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.940+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 44 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94134974753472] v29'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.940+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94134974728704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81c10590 con 0x7f65a40c3040 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.941+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 26 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94134974728704] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.941+0000 7f65b8411800 20 remove_watcher() i=0 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.941+0000 7f65b8411800 2 removed watcher, disabling cache 2024-05-07T13:57:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.941+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94134974733632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81baca00 con 0x559d81ba2650 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.943+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 45 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94134974733632] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.943+0000 7f65b8411800 20 remove_watcher() i=1 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.943+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94134974737184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81baca00 con 0x559d81ba7040 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.944+0000 7f65b39dc640 1 -- 172.21.15.50:0/938514056 <== osd.3 v2:172.21.15.50:6814/3553060046 58 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94134974737184] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a4094020 con 0x559d81ba7040 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.944+0000 7f65b8411800 20 remove_watcher() i=2 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.944+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94134974739392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81baca00 con 0x7f65a40c3040 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.945+0000 7f65b31db640 1 -- 172.21.15.50:0/938514056 <== osd.2 v2:172.21.15.50:6808/2034796854 27 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94134974739392] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a8049040 con 0x7f65a40c3040 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.945+0000 7f65b8411800 20 remove_watcher() i=3 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.945+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94134974745152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81baca00 con 0x559d81ba2650 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.946+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.1 v2:172.21.15.50:6800/3441257969 46 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94134974745152] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x559d81ba2650 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.946+0000 7f65b8411800 20 remove_watcher() i=4 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.946+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94134974749248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81baca00 con 0x7f65a8003a40 2024-05-07T13:57:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.947+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 50 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94134974749248] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.947+0000 7f65b8411800 20 remove_watcher() i=5 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.947+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94134974742112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81bb1a40 con 0x7f65a8003a40 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.948+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 51 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94134974742112] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.948+0000 7f65b8411800 20 remove_watcher() i=6 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.948+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94134974751952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d81baca00 con 0x7f65a8003a40 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 <== osd.0 v2:172.21.15.22:6800/2215278347 52 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94134974751952] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac04b040 con 0x7f65a8003a40 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 20 remove_watcher() i=7 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65a8003a40 msgr2=0x7f65a80393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f65a8003a40 0x7f65a80393c0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81ba2650 msgr2=0x559d81ba4b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81ba2650 0x559d81ba4b10 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65a40c3040 msgr2=0x7f65a4094730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f65a40c3040 0x7f65a4094730 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81ba7040 msgr2=0x559d81ba9430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81ba7040 0x559d81ba9430 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f647c0368b0 msgr2=0x7f647c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f647c0368b0 0x7f647c038d70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x559d81b6a8d0 tx=0x7f65a8022040 comp rx=0 tx=0).stop 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 msgr2=0x559d81b97130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 --2- 172.21.15.50:0/938514056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81b8fd70 0x559d81b97130 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f65a40669c0 tx=0x7f65a4094ee0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 reap_dead start 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b41dd640 1 -- 172.21.15.50:0/938514056 reap_dead start 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 shutdown_connections 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 >> 172.21.15.50:0/938514056 conn(0x559d81b8bff0 msgr2=0x559d81b89650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 shutdown_connections 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.949+0000 7f65b8411800 1 -- 172.21.15.50:0/938514056 wait complete. 2024-05-07T13:57:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/398184786 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f648c036970 msgr2=0x7f648c038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 --2- 172.21.15.50:0/398184786 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f648c036970 0x7f648c038e30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559d81b69f00 tx=0x7f65a8006000 comp rx=0 tx=0).stop 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/398184786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69720 msgr2=0x559d81a67b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 --2- 172.21.15.50:0/398184786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69720 0x559d81a67b90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f65a408c600 tx=0x7f65a405ce20 comp rx=0 tx=0).stop 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/398184786 shutdown_connections 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 --2- 172.21.15.50:0/398184786 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f648c036970 0x7f648c038e30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 --2- 172.21.15.50:0/398184786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69720 0x559d81a67b90 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/398184786 >> 172.21.15.50:0/398184786 conn(0x559d81b74960 msgr2=0x559d81b74d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/398184786 shutdown_connections 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/398184786 wait complete. 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559d81b6f890 msgr2=0x559d81b71d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559d81b6f890 0x559d81b71d00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81a6c490 msgr2=0x559d81b690d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559d81a6c490 0x559d81b690d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81b6b950 msgr2=0x559d81b6dd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559d81b6b950 0x559d81b6dd40 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f649c036950 msgr2=0x7f649c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f649c036950 0x7f649c038e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65a8000f60 tx=0x7f65a80013f0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 msgr2=0x559d81b61e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 --2- 172.21.15.50:0/2068144626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559d81a69b60 0x559d81b61e90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f65a4005400 tx=0x7f65a4002fb0 comp rx=0 tx=0).stop 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b41dd640 1 -- 172.21.15.50:0/2068144626 reap_dead start 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 shutdown_connections 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 >> 172.21.15.50:0/2068144626 conn(0x559d81a63570 msgr2=0x559d81b54560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 shutdown_connections 2024-05-07T13:57:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:14.950+0000 7f65b8411800 1 -- 172.21.15.50:0/2068144626 wait complete. 2024-05-07T13:57:54.955 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-05-07T13:57:54.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-05-07T13:57:54.955 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-05-07T13:57:55.009 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:55.009 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.023+0000 7efc73f1f800 1 Processor -- start 2024-05-07T13:57:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.023+0000 7efc73f1f800 1 -- start start 2024-05-07T13:57:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.023+0000 7efc73f1f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561fb9681fd0 0x561fb96823f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.023+0000 7efc73f1f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561fb9682a70 con 0x561fb9683230 2024-05-07T13:57:55.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.023+0000 7efc73f1f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x561fb9514050 con 0x561fb9681fd0 2024-05-07T13:57:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.023+0000 7efc6fbca640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561fb9681fd0 0x561fb96823f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.023+0000 7efc6fbca640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561fb9681fd0 0x561fb96823f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58138/0 (socket says 172.21.15.50:58138) 2024-05-07T13:57:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.023+0000 7efc6fbca640 1 -- 172.21.15.50:0/814626570 learned_addr learned my addr 172.21.15.50:0/814626570 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.023+0000 7efc6f3c9640 1 --1- 172.21.15.50:0/814626570 >> v1:172.21.15.22:6789/0 conn(0x561fb9683230 0x561fb96836b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56736/0 (socket says 172.21.15.50:56736) 2024-05-07T13:57:55.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.024+0000 7efc6fbca640 1 -- 172.21.15.50:0/814626570 >> v1:172.21.15.22:6789/0 conn(0x561fb9683230 legacy=0x561fb96836b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.024+0000 7efc6fbca640 1 -- 172.21.15.50:0/814626570 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb9683df0 con 0x561fb9681fd0 2024-05-07T13:57:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.026+0000 7efc6fbca640 1 --2- 172.21.15.50:0/814626570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb96823f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7efc6000a520 tx=0x7efc6001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4da8db37dd39b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.026+0000 7efc6ebc8640 1 -- 172.21.15.50:0/814626570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60057070 con 0x561fb9681fd0 2024-05-07T13:57:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.026+0000 7efc6ebc8640 1 -- 172.21.15.50:0/814626570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60052570 con 0x561fb9681fd0 2024-05-07T13:57:55.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.026+0000 7efc6ebc8640 1 -- 172.21.15.50:0/814626570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60052870 con 0x561fb9681fd0 2024-05-07T13:57:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.027+0000 7efc73f1f800 1 -- 172.21.15.50:0/814626570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 msgr2=0x561fb96823f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.027+0000 7efc73f1f800 1 --2- 172.21.15.50:0/814626570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb96823f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7efc6000a520 tx=0x7efc6001d010 comp rx=0 tx=0).stop 2024-05-07T13:57:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.027+0000 7efc73f1f800 1 -- 172.21.15.50:0/814626570 shutdown_connections 2024-05-07T13:57:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.027+0000 7efc73f1f800 1 --2- 172.21.15.50:0/814626570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb96823f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.027+0000 7efc73f1f800 1 -- 172.21.15.50:0/814626570 >> 172.21.15.50:0/814626570 conn(0x561fb967d5b0 msgr2=0x561fb967f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.027+0000 7efc73f1f800 1 -- 172.21.15.50:0/814626570 shutdown_connections 2024-05-07T13:57:55.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.027+0000 7efc73f1f800 1 -- 172.21.15.50:0/814626570 wait complete. 2024-05-07T13:57:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.044+0000 7efc73f1f800 1 Processor -- start 2024-05-07T13:57:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.044+0000 7efc73f1f800 1 -- start start 2024-05-07T13:57:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.045+0000 7efc73f1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb95f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.045+0000 7efc73f1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561fb95ce1d0 con 0x561fb9681fd0 2024-05-07T13:57:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.045+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb95f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.045+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb95f5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58148/0 (socket says 172.21.15.50:58148) 2024-05-07T13:57:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.045+0000 7efc6fbca640 1 -- 172.21.15.50:0/1637906757 learned_addr learned my addr 172.21.15.50:0/1637906757 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.045+0000 7efc6fbca640 1 -- 172.21.15.50:0/1637906757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb9775350 con 0x561fb9681fd0 2024-05-07T13:57:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.045+0000 7efc6fbca640 1 --2- 172.21.15.50:0/1637906757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb95f5e40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efc60055040 tx=0x7efc6004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe98672394edd94 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.046+0000 7efb5de0b640 1 -- 172.21.15.50:0/1637906757 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60057040 con 0x561fb9681fd0 2024-05-07T13:57:55.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.046+0000 7efb5de0b640 1 -- 172.21.15.50:0/1637906757 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60052850 con 0x561fb9681fd0 2024-05-07T13:57:55.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.046+0000 7efb5de0b640 1 -- 172.21.15.50:0/1637906757 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60052b50 con 0x561fb9681fd0 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.046+0000 7efc73f1f800 1 -- 172.21.15.50:0/1637906757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 msgr2=0x561fb95f5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.046+0000 7efc73f1f800 1 --2- 172.21.15.50:0/1637906757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb95f5e40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efc60055040 tx=0x7efc6004c000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.046+0000 7efc73f1f800 1 -- 172.21.15.50:0/1637906757 shutdown_connections 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.046+0000 7efc73f1f800 1 --2- 172.21.15.50:0/1637906757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb95f5e40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.046+0000 7efc73f1f800 1 -- 172.21.15.50:0/1637906757 >> 172.21.15.50:0/1637906757 conn(0x561fb967d5b0 msgr2=0x561fb976f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.047+0000 7efc73f1f800 1 -- 172.21.15.50:0/1637906757 shutdown_connections 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.047+0000 7efc73f1f800 1 -- 172.21.15.50:0/1637906757 wait complete. 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.047+0000 7efc73f1f800 1 Processor -- start 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.047+0000 7efc73f1f800 1 -- start start 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.047+0000 7efc73f1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb977e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.047+0000 7efc73f1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561fb968b700 con 0x561fb9681fd0 2024-05-07T13:57:55.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.047+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb977e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.047+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb977e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58152/0 (socket says 172.21.15.50:58152) 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.047+0000 7efc6fbca640 1 -- 172.21.15.50:0/2775308599 learned_addr learned my addr 172.21.15.50:0/2775308599 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.048+0000 7efc6fbca640 1 -- 172.21.15.50:0/2775308599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb977ea00 con 0x561fb9681fd0 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.048+0000 7efc6fbca640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb977e4c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efc6000a520 tx=0x7efc60003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.048+0000 7efb57fff640 1 -- 172.21.15.50:0/2775308599 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60073070 con 0x561fb9681fd0 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.048+0000 7efb57fff640 1 -- 172.21.15.50:0/2775308599 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6005d570 con 0x561fb9681fd0 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.048+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fb977ec90 con 0x561fb9681fd0 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.048+0000 7efb57fff640 1 -- 172.21.15.50:0/2775308599 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60057070 con 0x561fb9681fd0 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.048+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb9781940 con 0x561fb9681fd0 2024-05-07T13:57:55.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.049+0000 7efb57fff640 1 -- 172.21.15.50:0/2775308599 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efc60076070 con 0x561fb9681fd0 2024-05-07T13:57:55.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.049+0000 7efb57fff640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb58036950 0x7efb58038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.049+0000 7efb57fff640 1 -- 172.21.15.50:0/2775308599 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7efc6008de60 con 0x561fb9681fd0 2024-05-07T13:57:55.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.050+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb58036950 0x7efb58038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.050+0000 7efc73f1f800 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb9683230 0x561fb9785700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.050+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb9785c40 con 0x561fb9683230 2024-05-07T13:57:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.050+0000 7efc703cb640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb9683230 0x561fb9785700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.050+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb58036950 0x7efb58038e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc64000f60 tx=0x7efc64001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.050+0000 7efc703cb640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb9683230 0x561fb9785700 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.051+0000 7efc703cb640 1 -- 172.21.15.50:0/2775308599 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb9683230 2024-05-07T13:57:55.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.051+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb9782cd0 con 0x561fb9683230 2024-05-07T13:57:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.051+0000 7efc703cb640 1 -- 172.21.15.50:0/2775308599 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb9683230 2024-05-07T13:57:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.051+0000 7efc73f1f800 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb9787fa0 0x561fb978a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.051+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb978aa80 con 0x561fb9787fa0 2024-05-07T13:57:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.051+0000 7efc6fbca640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb9787fa0 0x561fb978a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.051+0000 7efc6fbca640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb9787fa0 0x561fb978a390 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.052+0000 7efc6fbca640 1 -- 172.21.15.50:0/2775308599 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efc60075030 con 0x561fb9787fa0 2024-05-07T13:57:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.052+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb9786f50 con 0x561fb9683230 2024-05-07T13:57:55.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.052+0000 7efc703cb640 1 -- 172.21.15.50:0/2775308599 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb9683230 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.052+0000 7efc73f1f800 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561fb978bf30 0x561fb978e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.052+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb978eae0 con 0x561fb978bf30 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.052+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561fb978bf30 0x561fb978e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.053+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561fb978bf30 0x561fb978e380 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.053+0000 7efc6f3c9640 1 -- 172.21.15.50:0/2775308599 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efc6400f690 con 0x561fb978bf30 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.054+0000 7efc73f1f800 1 Processor -- start 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.054+0000 7efc73f1f800 1 -- start start 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.054+0000 7efc73f1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb979cf40 0x561fb979d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.054+0000 7efc73f1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561fb9574cf0 con 0x561fb979cf40 2024-05-07T13:57:55.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.054+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb979cf40 0x561fb979d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.054+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb979cf40 0x561fb979d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58166/0 (socket says 172.21.15.50:58166) 2024-05-07T13:57:55.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.054+0000 7efc6fbca640 1 -- 172.21.15.50:0/1297959173 learned_addr learned my addr 172.21.15.50:0/1297959173 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.055+0000 7efc6fbca640 1 -- 172.21.15.50:0/1297959173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb979d8a0 con 0x561fb979cf40 2024-05-07T13:57:55.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.055+0000 7efc6fbca640 1 --2- 172.21.15.50:0/1297959173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb979cf40 0x561fb979d360 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7efc60006b30 tx=0x7efc60076650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.055+0000 7efb557fa640 1 -- 172.21.15.50:0/1297959173 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60079b80 con 0x561fb979cf40 2024-05-07T13:57:55.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.055+0000 7efb557fa640 1 -- 172.21.15.50:0/1297959173 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60079d20 con 0x561fb979cf40 2024-05-07T13:57:55.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.055+0000 7efb557fa640 1 -- 172.21.15.50:0/1297959173 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc600766f0 con 0x561fb979cf40 2024-05-07T13:57:55.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.055+0000 7efc73f1f800 1 -- 172.21.15.50:0/1297959173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fb979e310 con 0x561fb979cf40 2024-05-07T13:57:55.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.055+0000 7efc73f1f800 1 -- 172.21.15.50:0/1297959173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb979e810 con 0x561fb979cf40 2024-05-07T13:57:55.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.056+0000 7efb557fa640 1 -- 172.21.15.50:0/1297959173 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efc60092030 con 0x561fb979cf40 2024-05-07T13:57:55.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.056+0000 7efb557fa640 1 --2- 172.21.15.50:0/1297959173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb48036950 0x7efb48038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.056+0000 7efb557fa640 1 -- 172.21.15.50:0/1297959173 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7efc60090070 con 0x561fb979cf40 2024-05-07T13:57:55.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.056+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/1297959173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb48036950 0x7efb48038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.056+0000 7efc73f1f800 1 Processor -- start 2024-05-07T13:57:55.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.057+0000 7efc73f1f800 1 -- start start 2024-05-07T13:57:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.057+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/1297959173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb48036950 0x7efb48038e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x561fb9786550 tx=0x7efc6400f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.057+0000 7efc73f1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.057+0000 7efc73f1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561fb9779a20 con 0x561fb97aa0d0 2024-05-07T13:57:55.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.057+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.057+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97aa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58180/0 (socket says 172.21.15.50:58180) 2024-05-07T13:57:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.057+0000 7efc6fbca640 1 -- 172.21.15.50:0/714333085 learned_addr learned my addr 172.21.15.50:0/714333085 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.057+0000 7efc6fbca640 1 -- 172.21.15.50:0/714333085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb97aaa80 con 0x561fb97aa0d0 2024-05-07T13:57:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.057+0000 7efc6fbca640 1 --2- 172.21.15.50:0/714333085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97aa4b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7efc60077fd0 tx=0x7efc6008cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4c736ccb2ce583 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efb4effd640 1 -- 172.21.15.50:0/714333085 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6005d850 con 0x561fb97aa0d0 2024-05-07T13:57:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efb4effd640 1 -- 172.21.15.50:0/714333085 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60077a90 con 0x561fb97aa0d0 2024-05-07T13:57:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efb4effd640 1 -- 172.21.15.50:0/714333085 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6005d9f0 con 0x561fb97aa0d0 2024-05-07T13:57:55.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efc73f1f800 1 -- 172.21.15.50:0/714333085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 msgr2=0x561fb97aa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efc73f1f800 1 --2- 172.21.15.50:0/714333085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97aa4b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7efc60077fd0 tx=0x7efc6008cc20 comp rx=0 tx=0).stop 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efc73f1f800 1 -- 172.21.15.50:0/714333085 shutdown_connections 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efc73f1f800 1 --2- 172.21.15.50:0/714333085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97aa4b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efc73f1f800 1 -- 172.21.15.50:0/714333085 >> 172.21.15.50:0/714333085 conn(0x561fb97a63a0 msgr2=0x561fb97a4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efc73f1f800 1 -- 172.21.15.50:0/714333085 shutdown_connections 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efc73f1f800 1 -- 172.21.15.50:0/714333085 wait complete. 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.058+0000 7efc73f1f800 1 Processor -- start 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.059+0000 7efc73f1f800 1 -- start start 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.059+0000 7efc73f1f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.059+0000 7efc73f1f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561fb97ab190 con 0x561fb97aa0d0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.059+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.059+0000 7efc6fbca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58196/0 (socket says 172.21.15.50:58196) 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.059+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 learned_addr learned my addr 172.21.15.50:0/670799001 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.059+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb97b1910 con 0x561fb97aa0d0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.060+0000 7efc6fbca640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97b13d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efc60077fd0 tx=0x7efc60002710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.060+0000 7efb4d7fa640 1 -- 172.21.15.50:0/670799001 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6005ca60 con 0x561fb97aa0d0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.060+0000 7efb4d7fa640 1 -- 172.21.15.50:0/670799001 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6005cc00 con 0x561fb97aa0d0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.060+0000 7efb4d7fa640 1 -- 172.21.15.50:0/670799001 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc600073e0 con 0x561fb97aa0d0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.060+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fb97b1910 con 0x561fb97aa0d0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.060+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb97b1910 con 0x561fb97aa0d0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.061+0000 7efb4d7fa640 1 -- 172.21.15.50:0/670799001 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efc600ba020 con 0x561fb97aa0d0 2024-05-07T13:57:55.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.061+0000 7efb4d7fa640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb38036950 0x7efb38038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.061+0000 7efb4d7fa640 1 -- 172.21.15.50:0/670799001 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7efc600b8020 con 0x561fb97aa0d0 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.061+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb38036950 0x7efb38038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.062+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb38036950 0x7efb38038e10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561fb978eee0 tx=0x7efc64010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.062+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.062+0000 7efc73f1f800 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb97bcb10 0x561fb97befd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.062+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97bf720 con 0x561fb97bcb10 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.062+0000 7efc703cb640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb97bcb10 0x561fb97befd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.062+0000 7efc703cb640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb97bcb10 0x561fb97befd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 20 realm 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97bfb30 con 0x561fb97bcb10 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c0400 con 0x561fb97bcb10 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.063+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.064+0000 7efc73f1f800 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb97c1500 0x561fb97c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.064+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c3f00 con 0x561fb97c1500 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.064+0000 7efc6fbca640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb97c1500 0x561fb97c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.064+0000 7efc6fbca640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb97c1500 0x561fb97c38f0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.064+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.064+0000 7efc73f1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:55.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.064+0000 7efc73f1f800 20 searching for the correct realm 2024-05-07T13:57:55.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.064+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c5830 con 0x561fb97c1500 2024-05-07T13:57:55.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.065+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.065+0000 7efc6fbca640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efc60078060 0x7efc6009e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.065+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c5830 con 0x7efc60078060 2024-05-07T13:57:55.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.065+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efc60078060 0x7efc6009e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.065+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efc60078060 0x7efc6009e480 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.066+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x7efc60078060 2024-05-07T13:57:55.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.066+0000 7efc6f3c9640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7efc6400f070 0x7efc6402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.066+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c5830 con 0x7efc6400f070 2024-05-07T13:57:55.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.066+0000 7efc703cb640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7efc6400f070 0x7efc6402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.066+0000 7efc703cb640 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7efc6400f070 0x7efc6402e910 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.067+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.067+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.067+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.067+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.067+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.067+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.068+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.068+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc6400f070 2024-05-07T13:57:55.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.068+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.068+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc60078060 2024-05-07T13:57:55.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.068+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x7efc60078060 2024-05-07T13:57:55.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.068+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc60078060 2024-05-07T13:57:55.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.069+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x7efc60078060 2024-05-07T13:57:55.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.069+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.069+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.069+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc6400f070 2024-05-07T13:57:55.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.069+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.069+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.070+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.070+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc60078060 2024-05-07T13:57:55.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.070+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efc64037040 con 0x7efc60078060 2024-05-07T13:57:55.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.070+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97c1500 2024-05-07T13:57:55.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.070+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.070+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97c1500 2024-05-07T13:57:55.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.070+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.070+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc6400f070 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.071+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.071+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97c1500 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.071+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.071+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97c1500 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.071+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.071+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.072+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.072+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.072+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.072+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc6400f070 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.072+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.072+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97c1500 2024-05-07T13:57:55.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.073+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.073+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc60078060 2024-05-07T13:57:55.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.073+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x7efc60078060 2024-05-07T13:57:55.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.073+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.073+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.073+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc6400f070 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.074+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.074+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97c1500 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.074+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.074+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc6400f070 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.074+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.074+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc60078060 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.074+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x7efc60078060 2024-05-07T13:57:55.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.075+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97c1500 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.075+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.075+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc60078060 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.075+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x7efc60078060 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.075+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x561fb97bcb10 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.075+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.075+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c07a0 con 0x7efc60078060 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x7efc60078060 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:55.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c47c0 con 0x561fb97bcb10 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c4bb0 con 0x561fb97bcb10 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.076+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c4bb0 con 0x7efc6400f070 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:55.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 20 zone default found 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 4 Realm: () 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 20 zonegroup default 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c5cb0 con 0x7efc6400f070 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c7690 con 0x561fb97c1500 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.077+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c7a30 con 0x561fb97c1500 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.078+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.078+0000 7efc73f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.078+0000 7efc73f1f800 20 started sync module instance, tier type = 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.078+0000 7efc73f1f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.078+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c6b30 con 0x7efc60078060 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.079+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6404a040 con 0x7efc60078060 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.079+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94694255912576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c7dd0 con 0x7efc60078060 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.079+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c8620 con 0x561fb97bcb10 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.080+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94694255912576] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6404a040 con 0x7efc60078060 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.081+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.081+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94694255919472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c8590 con 0x561fb97bcb10 2024-05-07T13:57:55.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.081+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c94e0 con 0x561fb97c1500 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.082+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.082+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94694255923248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c9d80 con 0x561fb97c1500 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.082+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97ca830 con 0x7efc60078060 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.082+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94694255919472] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.083+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94694255923248] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.083+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6404a040 con 0x7efc60078060 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.083+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94694255921680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97c9d80 con 0x7efc60078060 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.084+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97cb150 con 0x561fb97bcb10 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.085+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94694255921680] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6404a040 con 0x7efc60078060 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.085+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.085+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94694255930400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97cb540 con 0x561fb97bcb10 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.085+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97cbf40 con 0x7efc6400f070 2024-05-07T13:57:55.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.086+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94694255930400] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.086+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.086+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94694255925456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97cbf00 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.086+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97cc950 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.087+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94694255925456] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.087+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.087+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94694255934032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97ccb30 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.087+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97cd380 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.088+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94694255934032] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.089+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.089+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94694255937632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97cd190 con 0x7efc6400f070 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.089+0000 7efc73f1f800 20 add_watcher() i=0 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.089+0000 7efc73f1f800 20 add_watcher() i=1 2024-05-07T13:57:55.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.089+0000 7efc73f1f800 20 add_watcher() i=2 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.089+0000 7efc73f1f800 20 add_watcher() i=3 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.089+0000 7efc73f1f800 20 add_watcher() i=4 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.089+0000 7efc73f1f800 20 add_watcher() i=5 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.089+0000 7efc73f1f800 20 add_watcher() i=6 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.090+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94694255937632] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.090+0000 7efc73f1f800 20 add_watcher() i=7 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.090+0000 7efc73f1f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.090+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb97d0700 con 0x561fb97bcb10 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.090+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.090+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94694255938688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97cdbc0 con 0x561fb97bcb10 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.091+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94694255938688] v29'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.091+0000 7efb25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:55.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.091+0000 7efc73f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.091+0000 7efc73f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.091+0000 7efc73f1f800 5 note: GC not initialized 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efb24fe1640 20 reqs_thread_entry: start 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 20 Filter name: none 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efa9e7fc640 20 reqs_thread_entry: start 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561fb9803c00 con 0x561fb97bcb10 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:57:55.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.092+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb9806530 con 0x7efc6400f070 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.094+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 usage.10 [call] v29'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.094+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb9806530 con 0x7efc6400f070 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.096+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(64 usage.10 [call] v29'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.096+0000 7efb25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.096+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94694255938688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97d0290 con 0x561fb97bcb10 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.098+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94694255938688] v29'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.098+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94694255912576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb97ccc80 con 0x7efc60078060 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.099+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94694255912576] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6404a040 con 0x7efc60078060 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.099+0000 7efc73f1f800 20 remove_watcher() i=0 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.099+0000 7efc73f1f800 2 removed watcher, disabling cache 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.099+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94694255919472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb98037a0 con 0x561fb97bcb10 2024-05-07T13:57:55.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.100+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94694255919472] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.100+0000 7efc73f1f800 20 remove_watcher() i=1 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.100+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94694255923248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb98037a0 con 0x561fb97c1500 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.101+0000 7efc6fbca640 1 -- 172.21.15.50:0/670799001 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94694255923248] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6009b070 con 0x561fb97c1500 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.102+0000 7efc73f1f800 20 remove_watcher() i=2 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.102+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94694255921680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb98037a0 con 0x7efc60078060 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.103+0000 7efc6f3c9640 1 -- 172.21.15.50:0/670799001 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94694255921680] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6404a040 con 0x7efc60078060 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.103+0000 7efc73f1f800 20 remove_watcher() i=3 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.103+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94694255930400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb98037a0 con 0x561fb97bcb10 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.104+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94694255930400] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x561fb97bcb10 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.104+0000 7efc73f1f800 20 remove_watcher() i=4 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.104+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94694255925456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb98037a0 con 0x7efc6400f070 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.105+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94694255925456] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.105+0000 7efc73f1f800 20 remove_watcher() i=5 2024-05-07T13:57:55.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.105+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94694255934032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb98037a0 con 0x7efc6400f070 2024-05-07T13:57:55.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.107+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94694255934032] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.107+0000 7efc73f1f800 20 remove_watcher() i=6 2024-05-07T13:57:55.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.107+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94694255937632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561fb98037a0 con 0x7efc6400f070 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94694255937632] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6800a4a0 con 0x7efc6400f070 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 20 remove_watcher() i=7 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7efc6400f070 msgr2=0x7efc6402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7efc6400f070 0x7efc6402e910 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb97bcb10 msgr2=0x561fb97befd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb97bcb10 0x561fb97befd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efc60078060 msgr2=0x7efc6009e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7efc60078060 0x7efc6009e480 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb97c1500 msgr2=0x561fb97c38f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb97c1500 0x561fb97c38f0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb38036950 msgr2=0x7efb38038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb38036950 0x7efb38038e10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561fb978eee0 tx=0x7efc64010000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 msgr2=0x561fb97b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 --2- 172.21.15.50:0/670799001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb97aa0d0 0x561fb97b13d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efc60077fd0 tx=0x7efc60002710 comp rx=0 tx=0).stop 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 reap_dead start 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc703cb640 1 -- 172.21.15.50:0/670799001 reap_dead start 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 shutdown_connections 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 >> 172.21.15.50:0/670799001 conn(0x561fb97a63a0 msgr2=0x561fb97a3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 shutdown_connections 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.108+0000 7efc73f1f800 1 -- 172.21.15.50:0/670799001 wait complete. 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/1297959173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb48036950 msgr2=0x7efb48038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 --2- 172.21.15.50:0/1297959173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb48036950 0x7efb48038e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x561fb9786550 tx=0x7efc6400f000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/1297959173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb979cf40 msgr2=0x561fb979d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 --2- 172.21.15.50:0/1297959173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb979cf40 0x561fb979d360 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7efc60006b30 tx=0x7efc60076650 comp rx=0 tx=0).stop 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/1297959173 shutdown_connections 2024-05-07T13:57:55.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 --2- 172.21.15.50:0/1297959173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb48036950 0x7efb48038e10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 --2- 172.21.15.50:0/1297959173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb979cf40 0x561fb979d360 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/1297959173 >> 172.21.15.50:0/1297959173 conn(0x561fb9790fe0 msgr2=0x561fb97913e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/1297959173 shutdown_connections 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/1297959173 wait complete. 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561fb978bf30 msgr2=0x561fb978e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561fb978bf30 0x561fb978e380 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb9683230 msgr2=0x561fb9785700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561fb9683230 0x561fb9785700 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb9787fa0 msgr2=0x561fb978a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561fb9787fa0 0x561fb978a390 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb58036950 msgr2=0x7efb58038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efb58036950 0x7efb58038e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc64000f60 tx=0x7efc64001370 comp rx=0 tx=0).stop 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 msgr2=0x561fb977e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 --2- 172.21.15.50:0/2775308599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561fb9681fd0 0x561fb977e4c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efc6000a520 tx=0x7efc60003020 comp rx=0 tx=0).stop 2024-05-07T13:57:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc703cb640 1 -- 172.21.15.50:0/2775308599 reap_dead start 2024-05-07T13:57:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 shutdown_connections 2024-05-07T13:57:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 >> 172.21.15.50:0/2775308599 conn(0x561fb967d5b0 msgr2=0x561fb976d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 shutdown_connections 2024-05-07T13:57:55.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.109+0000 7efc73f1f800 1 -- 172.21.15.50:0/2775308599 wait complete. 2024-05-07T13:57:55.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-07T13:57:55.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-07T13:57:55.133 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-07T13:57:55.180 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:55.180 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:55.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.193+0000 7fad66fa2800 1 Processor -- start 2024-05-07T13:57:55.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.193+0000 7fad66fa2800 1 -- start start 2024-05-07T13:57:55.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.194+0000 7fad66fa2800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x559971e435d0 0x559971ed7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.194+0000 7fad66fa2800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559971e43af0 con 0x559971e449b0 2024-05-07T13:57:55.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.194+0000 7fad66fa2800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x559971d60050 con 0x559971e435d0 2024-05-07T13:57:55.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.194+0000 7fad642a7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x559971e435d0 0x559971ed7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.194+0000 7fad64aa8640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x559971e449b0 0x559971e42ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56750/0 (socket says 172.21.15.50:56750) 2024-05-07T13:57:55.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.194+0000 7fad64aa8640 1 -- 172.21.15.50:0/1905455527 learned_addr learned my addr 172.21.15.50:0/1905455527 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:55.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.194+0000 7fad642a7640 1 -- 172.21.15.50:0/1905455527 >> v1:172.21.15.22:6789/0 conn(0x559971e449b0 legacy=0x559971e42ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.194+0000 7fad642a7640 1 -- 172.21.15.50:0/1905455527 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559971ed9530 con 0x559971e435d0 2024-05-07T13:57:55.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.196+0000 7fad642a7640 1 --2- 172.21.15.50:0/1905455527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971ed7fe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fad5800a470 tx=0x7fad5801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1adde8b3563723 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.196+0000 7fad63aa6640 1 -- 172.21.15.50:0/1905455527 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad58057070 con 0x559971e435d0 2024-05-07T13:57:55.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.196+0000 7fad63aa6640 1 -- 172.21.15.50:0/1905455527 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad58052570 con 0x559971e435d0 2024-05-07T13:57:55.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.196+0000 7fad63aa6640 1 -- 172.21.15.50:0/1905455527 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad58052870 con 0x559971e435d0 2024-05-07T13:57:55.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.197+0000 7fad66fa2800 1 -- 172.21.15.50:0/1905455527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 msgr2=0x559971ed7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.197+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1905455527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971ed7fe0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fad5800a470 tx=0x7fad5801ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:55.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.197+0000 7fad66fa2800 1 -- 172.21.15.50:0/1905455527 shutdown_connections 2024-05-07T13:57:55.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.197+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1905455527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971ed7fe0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.197+0000 7fad66fa2800 1 -- 172.21.15.50:0/1905455527 >> 172.21.15.50:0/1905455527 conn(0x559971eca780 msgr2=0x559971eccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.197+0000 7fad66fa2800 1 -- 172.21.15.50:0/1905455527 shutdown_connections 2024-05-07T13:57:55.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.197+0000 7fad66fa2800 1 -- 172.21.15.50:0/1905455527 wait complete. 2024-05-07T13:57:55.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.212+0000 7fad66fa2800 1 Processor -- start 2024-05-07T13:57:55.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.212+0000 7fad66fa2800 1 -- start start 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.212+0000 7fad66fa2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fc28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.212+0000 7fad66fa2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559971e1a1d0 con 0x559971e435d0 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.212+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fc28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.213+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fc28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58208/0 (socket says 172.21.15.50:58208) 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.213+0000 7fad64aa8640 1 -- 172.21.15.50:0/3927033178 learned_addr learned my addr 172.21.15.50:0/3927033178 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.213+0000 7fad64aa8640 1 -- 172.21.15.50:0/3927033178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559971fc2e70 con 0x559971e435d0 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.213+0000 7fad64aa8640 1 --2- 172.21.15.50:0/3927033178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fc28a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fad54001dd0 tx=0x7fad5400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4e1d42e58f1650 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.213+0000 7fac52e0d640 1 -- 172.21.15.50:0/3927033178 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad54012020 con 0x559971e435d0 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.213+0000 7fac52e0d640 1 -- 172.21.15.50:0/3927033178 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5400e5a0 con 0x559971e435d0 2024-05-07T13:57:55.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.213+0000 7fac52e0d640 1 -- 172.21.15.50:0/3927033178 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5400e900 con 0x559971e435d0 2024-05-07T13:57:55.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 -- 172.21.15.50:0/3927033178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 msgr2=0x559971fc28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 --2- 172.21.15.50:0/3927033178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fc28a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fad54001dd0 tx=0x7fad5400b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 -- 172.21.15.50:0/3927033178 shutdown_connections 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 --2- 172.21.15.50:0/3927033178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fc28a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 -- 172.21.15.50:0/3927033178 >> 172.21.15.50:0/3927033178 conn(0x559971eca780 msgr2=0x559971fbe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 -- 172.21.15.50:0/3927033178 shutdown_connections 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 -- 172.21.15.50:0/3927033178 wait complete. 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 Processor -- start 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 -- start start 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.214+0000 7fad66fa2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559971ed8760 con 0x559971e435d0 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.215+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.215+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58224/0 (socket says 172.21.15.50:58224) 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.215+0000 7fad64aa8640 1 -- 172.21.15.50:0/1526547303 learned_addr learned my addr 172.21.15.50:0/1526547303 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.215+0000 7fad64aa8640 1 -- 172.21.15.50:0/1526547303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559971fca950 con 0x559971e435d0 2024-05-07T13:57:55.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.215+0000 7fad64aa8640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fca410 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fad54001dd0 tx=0x7fad54000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.216+0000 7fac5160a640 1 -- 172.21.15.50:0/1526547303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad54012030 con 0x559971e435d0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.216+0000 7fac5160a640 1 -- 172.21.15.50:0/1526547303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5401a720 con 0x559971e435d0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.216+0000 7fac5160a640 1 -- 172.21.15.50:0/1526547303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5401aa40 con 0x559971e435d0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.216+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559971fcabe0 con 0x559971e435d0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.216+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559971fcd890 con 0x559971e435d0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.217+0000 7fac5160a640 1 -- 172.21.15.50:0/1526547303 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad54015020 con 0x559971e435d0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.217+0000 7fac5160a640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac4c036900 0x7fac4c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.217+0000 7fac5160a640 1 -- 172.21.15.50:0/1526547303 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fad54020030 con 0x559971e435d0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.217+0000 7fad642a7640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac4c036900 0x7fac4c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.217+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559971e449b0 0x559971fd1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.217+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559971fd1b90 con 0x559971e449b0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.217+0000 7fad652a9640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559971e449b0 0x559971fd1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.217+0000 7fad642a7640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac4c036900 0x7fac4c038dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad58054000 tx=0x7fad5804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.217+0000 7fad652a9640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559971e449b0 0x559971fd1650 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.218+0000 7fad652a9640 1 -- 172.21.15.50:0/1526547303 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x559971e449b0 2024-05-07T13:57:55.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.218+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559971fcec20 con 0x559971e449b0 2024-05-07T13:57:55.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.218+0000 7fad652a9640 1 -- 172.21.15.50:0/1526547303 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad5c00a4a0 con 0x559971e449b0 2024-05-07T13:57:55.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.218+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559971fd3ea0 0x559971fd6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.218+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559971fd6980 con 0x559971fd3ea0 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.218+0000 7fad64aa8640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559971fd3ea0 0x559971fd6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.218+0000 7fad64aa8640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559971fd3ea0 0x559971fd6290 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.219+0000 7fad64aa8640 1 -- 172.21.15.50:0/1526547303 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad54018950 con 0x559971fd3ea0 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.219+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559971fd2e50 con 0x559971e449b0 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.219+0000 7fad652a9640 1 -- 172.21.15.50:0/1526547303 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad5c00a4a0 con 0x559971e449b0 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.219+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559971fd7e30 0x559971fda280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.219+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559971fda9e0 con 0x559971fd7e30 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.219+0000 7fad642a7640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559971fd7e30 0x559971fda280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.220+0000 7fad642a7640 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559971fd7e30 0x559971fda280 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.220+0000 7fad642a7640 1 -- 172.21.15.50:0/1526547303 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad5805a040 con 0x559971fd7e30 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.221+0000 7fad66fa2800 1 Processor -- start 2024-05-07T13:57:55.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.221+0000 7fad66fa2800 1 -- start start 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.221+0000 7fad66fa2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971fe8e40 0x559971fe9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.221+0000 7fad66fa2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559971dc0cf0 con 0x559971fe8e40 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.221+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971fe8e40 0x559971fe9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.221+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971fe8e40 0x559971fe9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58240/0 (socket says 172.21.15.50:58240) 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.221+0000 7fad64aa8640 1 -- 172.21.15.50:0/1717999626 learned_addr learned my addr 172.21.15.50:0/1717999626 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.221+0000 7fad64aa8640 1 -- 172.21.15.50:0/1717999626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559971fe97a0 con 0x559971fe8e40 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.222+0000 7fad64aa8640 1 --2- 172.21.15.50:0/1717999626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971fe8e40 0x559971fe9260 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fad54001740 tx=0x7fad5400d6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.222+0000 7fac4a7fc640 1 -- 172.21.15.50:0/1717999626 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5403a070 con 0x559971fe8e40 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.222+0000 7fac4a7fc640 1 -- 172.21.15.50:0/1717999626 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad54041040 con 0x559971fe8e40 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.222+0000 7fad66fa2800 1 -- 172.21.15.50:0/1717999626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559971fea210 con 0x559971fe8e40 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.222+0000 7fac4a7fc640 1 -- 172.21.15.50:0/1717999626 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad54045a10 con 0x559971fe8e40 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.222+0000 7fad66fa2800 1 -- 172.21.15.50:0/1717999626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559971fea710 con 0x559971fe8e40 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.222+0000 7fac4a7fc640 1 -- 172.21.15.50:0/1717999626 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad5403d070 con 0x559971fe8e40 2024-05-07T13:57:55.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.223+0000 7fac4a7fc640 1 --2- 172.21.15.50:0/1717999626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac3c036900 0x7fac3c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.223+0000 7fac4a7fc640 1 -- 172.21.15.50:0/1717999626 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fad54043270 con 0x559971fe8e40 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.223+0000 7fad642a7640 1 --2- 172.21.15.50:0/1717999626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac3c036900 0x7fac3c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.223+0000 7fad66fa2800 1 Processor -- start 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.223+0000 7fad66fa2800 1 -- start start 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.223+0000 7fad642a7640 1 --2- 172.21.15.50:0/1717999626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac3c036900 0x7fac3c038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x559971fd2450 tx=0x7fad58005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.223+0000 7fad66fa2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ff63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.223+0000 7fad66fa2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559971fc31f0 con 0x559971ff5f80 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.224+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ff63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.224+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ff63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58244/0 (socket says 172.21.15.50:58244) 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.224+0000 7fad64aa8640 1 -- 172.21.15.50:0/1289771706 learned_addr learned my addr 172.21.15.50:0/1289771706 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.224+0000 7fad64aa8640 1 -- 172.21.15.50:0/1289771706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559971ff6970 con 0x559971ff5f80 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.224+0000 7fad64aa8640 1 --2- 172.21.15.50:0/1289771706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ff63a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fad54038040 tx=0x7fad54035d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d9c0f61eb0f75b server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.224+0000 7fac3bfff640 1 -- 172.21.15.50:0/1289771706 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5405f020 con 0x559971ff5f80 2024-05-07T13:57:55.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.224+0000 7fac3bfff640 1 -- 172.21.15.50:0/1289771706 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad540442a0 con 0x559971ff5f80 2024-05-07T13:57:55.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.224+0000 7fac3bfff640 1 -- 172.21.15.50:0/1289771706 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5404caa0 con 0x559971ff5f80 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 -- 172.21.15.50:0/1289771706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 msgr2=0x559971ff63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1289771706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ff63a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fad54038040 tx=0x7fad54035d50 comp rx=0 tx=0).stop 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 -- 172.21.15.50:0/1289771706 shutdown_connections 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1289771706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ff63a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 -- 172.21.15.50:0/1289771706 >> 172.21.15.50:0/1289771706 conn(0x559971ff2200 msgr2=0x559971ff0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 -- 172.21.15.50:0/1289771706 shutdown_connections 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 -- 172.21.15.50:0/1289771706 wait complete. 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 Processor -- start 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 -- start start 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ffd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad66fa2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559971ff6fe0 con 0x559971ff5f80 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ffd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad64aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ffd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58254/0 (socket says 172.21.15.50:58254) 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.225+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 learned_addr learned my addr 172.21.15.50:0/1076742067 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.226+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559971ffd800 con 0x559971ff5f80 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.226+0000 7fad64aa8640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ffd2c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fad54020ff0 tx=0x7fad54057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.226+0000 7fac3a7fc640 1 -- 172.21.15.50:0/1076742067 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad54073070 con 0x559971ff5f80 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.226+0000 7fac3a7fc640 1 -- 172.21.15.50:0/1076742067 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad54037ec0 con 0x559971ff5f80 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.226+0000 7fac3a7fc640 1 -- 172.21.15.50:0/1076742067 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5404cbd0 con 0x559971ff5f80 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.226+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559971ffd800 con 0x559971ff5f80 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.226+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559971ffd800 con 0x559971ff5f80 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.227+0000 7fac3a7fc640 1 -- 172.21.15.50:0/1076742067 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad54076070 con 0x559971ff5f80 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.227+0000 7fac3a7fc640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac30036900 0x7fac30038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.227+0000 7fac3a7fc640 1 -- 172.21.15.50:0/1076742067 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fad5406b050 con 0x559971ff5f80 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.227+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad642a7640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac30036900 0x7fac30038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5599720089a0 0x55997200ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55997200b590 con 0x5599720089a0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad652a9640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5599720089a0 0x55997200ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad642a7640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac30036900 0x7fac30038dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x559971fdade0 tx=0x7fad5804f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad652a9640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5599720089a0 0x55997200ae40 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad66fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad66fa2800 20 realm 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.228+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55997200b9a0 con 0x5599720089a0 2024-05-07T13:57:55.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55997200c240 con 0x5599720089a0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55997200c5e0 con 0x5599720089a0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55997200d340 0x55997200f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55997200fcb0 con 0x55997200d340 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.229+0000 7fad64aa8640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55997200d340 0x55997200f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.230+0000 7fad64aa8640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55997200d340 0x55997200f730 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.230+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.230+0000 7fad66fa2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.230+0000 7fad66fa2800 20 searching for the correct realm 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.230+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559972011630 con 0x55997200d340 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.230+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.230+0000 7fad64aa8640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fad54078060 0x7fad54037460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.230+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559972011630 con 0x7fad54078060 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.230+0000 7fad642a7640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fad54078060 0x7fad54037460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.231+0000 7fad642a7640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fad54078060 0x7fad54037460 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.231+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.231+0000 7fad642a7640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fad58074040 0x7fad58081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.231+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559972011630 con 0x7fad58074040 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.231+0000 7fad652a9640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fad58074040 0x7fad58081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.232+0000 7fad652a9640 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fad58074040 0x7fad58081410 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.232+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.232+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55997200c5e0 con 0x5599720089a0 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.232+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.232+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55997200c5e0 con 0x5599720089a0 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.233+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.233+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55997200c5e0 con 0x5599720089a0 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.233+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.233+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55997200c5e0 con 0x7fad58074040 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.233+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.233+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55997200c5e0 con 0x7fad54078060 2024-05-07T13:57:55.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.233+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.233+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55997200c5e0 con 0x7fad54078060 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.234+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.234+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x5599720089a0 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.234+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.234+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad58074040 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.234+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.234+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x5599720089a0 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.234+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.234+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad54078060 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.235+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.235+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x55997200d340 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.235+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.235+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x55997200d340 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.235+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.235+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad58074040 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.236+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.236+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x55997200d340 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.236+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.236+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x55997200d340 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.236+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.236+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x5599720089a0 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.236+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.236+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x5599720089a0 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.237+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.237+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad58074040 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.237+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.237+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x55997200d340 2024-05-07T13:57:55.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.237+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.237+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad54078060 2024-05-07T13:57:55.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.237+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.237+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x5599720089a0 2024-05-07T13:57:55.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.238+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.238+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad58074040 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.238+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.238+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x55997200d340 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.238+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.238+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad58074040 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.239+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.239+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad54078060 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.239+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.239+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x55997200d340 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.239+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.239+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad54078060 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.239+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.239+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x5599720089a0 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fad5808e040 con 0x7fad54078060 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559972010600 con 0x5599720089a0 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5599720109f0 con 0x5599720089a0 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.240+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5599720109f0 con 0x7fad58074040 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 20 zone default found 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 4 Realm: () 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:55.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 20 zonegroup default 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559972010e10 con 0x7fad58074040 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559972010e10 con 0x55997200d340 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.241+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5599720134e0 con 0x55997200d340 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.242+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.242+0000 7fad66fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.242+0000 7fad66fa2800 20 started sync module instance, tier type = 2024-05-07T13:57:55.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.242+0000 7fad66fa2800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.242+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972012980 con 0x7fad54078060 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.243+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.243+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117531037040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972013d80 con 0x7fad54078060 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.243+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5599720145d0 con 0x5599720089a0 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.244+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94117531037040] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.244+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.244+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117531039952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972014630 con 0x5599720089a0 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.244+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972015120 con 0x55997200d340 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.245+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.245+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117531044848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5599720159f0 con 0x55997200d340 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.245+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5599720164d0 con 0x7fad54078060 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.246+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94117531039952] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.246+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.246+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117531042080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972016d70 con 0x7fad54078060 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.246+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972017730 con 0x5599720089a0 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.247+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94117531044848] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.248+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94117531042080] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.248+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.248+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117531052224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972016ce0 con 0x5599720089a0 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.248+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972017c60 con 0x7fad58074040 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.249+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94117531052224] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.249+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.249+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117531054720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972017c20 con 0x7fad58074040 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.249+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972018670 con 0x7fad58074040 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.250+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94117531054720] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.250+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.250+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117531055776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972018670 con 0x7fad58074040 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.250+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972019030 con 0x7fad58074040 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94117531055776] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117531058624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972019210 con 0x7fad58074040 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad66fa2800 20 add_watcher() i=0 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad66fa2800 20 add_watcher() i=1 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad66fa2800 20 add_watcher() i=2 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad66fa2800 20 add_watcher() i=3 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad66fa2800 20 add_watcher() i=4 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad66fa2800 20 add_watcher() i=5 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.251+0000 7fad66fa2800 20 add_watcher() i=6 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.252+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94117531058624] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.252+0000 7fad66fa2800 20 add_watcher() i=7 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.252+0000 7fad66fa2800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.252+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55997201c3c0 con 0x5599720089a0 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.253+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.253+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117531073872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972019160 con 0x5599720089a0 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.254+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94117531073872] v29'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.254+0000 7fac1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.254+0000 7fad66fa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.254+0000 7fad66fa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.254+0000 7fad66fa2800 5 note: GC not initialized 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.254+0000 7fac1a7e4640 20 reqs_thread_entry: start 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.254+0000 7fad66fa2800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.254+0000 7fad66fa2800 20 Filter name: none 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.255+0000 7fac13fff640 20 reqs_thread_entry: start 2024-05-07T13:57:55.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.255+0000 7fad66fa2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.255+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55997204f4e0 con 0x5599720089a0 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.255+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.255+0000 7fad66fa2800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.255+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5599720508d0 con 0x7fad58074040 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.256+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.257+0000 7fac1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.257+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117531073872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55997201ade0 con 0x5599720089a0 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.258+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94117531073872] v29'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.258+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117531037040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55997201bd50 con 0x7fad54078060 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.259+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94117531037040] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.259+0000 7fad66fa2800 20 remove_watcher() i=0 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.259+0000 7fad66fa2800 2 removed watcher, disabling cache 2024-05-07T13:57:55.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.259+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117531039952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972012d70 con 0x5599720089a0 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.260+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94117531039952] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.260+0000 7fad66fa2800 20 remove_watcher() i=1 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.260+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117531044848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972012d70 con 0x55997200d340 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.261+0000 7fad64aa8640 1 -- 172.21.15.50:0/1076742067 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94117531044848] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54075030 con 0x55997200d340 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.261+0000 7fad66fa2800 20 remove_watcher() i=2 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.261+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117531042080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972012d70 con 0x7fad54078060 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.262+0000 7fad642a7640 1 -- 172.21.15.50:0/1076742067 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94117531042080] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5807f070 con 0x7fad54078060 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.262+0000 7fad66fa2800 20 remove_watcher() i=3 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.262+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117531052224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972014120 con 0x5599720089a0 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.263+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94117531052224] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x5599720089a0 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.263+0000 7fad66fa2800 20 remove_watcher() i=4 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.263+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117531054720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559972012d70 con 0x7fad58074040 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.264+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94117531054720] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.265+0000 7fad66fa2800 20 remove_watcher() i=5 2024-05-07T13:57:55.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.265+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117531055776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5599720168c0 con 0x7fad58074040 2024-05-07T13:57:55.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.266+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94117531055776] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.266+0000 7fad66fa2800 20 remove_watcher() i=6 2024-05-07T13:57:55.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.266+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117531058624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5599720168c0 con 0x7fad58074040 2024-05-07T13:57:55.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94117531058624] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c00a4a0 con 0x7fad58074040 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 20 remove_watcher() i=7 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fad58074040 msgr2=0x7fad58081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fad58074040 0x7fad58081410 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5599720089a0 msgr2=0x55997200ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5599720089a0 0x55997200ae40 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fad54078060 msgr2=0x7fad54037460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fad54078060 0x7fad54037460 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55997200d340 msgr2=0x55997200f730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55997200d340 0x55997200f730 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac30036900 msgr2=0x7fac30038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac30036900 0x7fac30038dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x559971fdade0 tx=0x7fad5804f000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 msgr2=0x559971ffd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad652a9640 1 -- 172.21.15.50:0/1076742067 reap_dead start 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ffd2c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fad54020ff0 tx=0x7fad54057000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 shutdown_connections 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1076742067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971ff5f80 0x559971ffd2c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 >> 172.21.15.50:0/1076742067 conn(0x559971ff2200 msgr2=0x559971fef860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 shutdown_connections 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1076742067 wait complete. 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1717999626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac3c036900 msgr2=0x7fac3c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1717999626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac3c036900 0x7fac3c038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x559971fd2450 tx=0x7fad58005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 -- 172.21.15.50:0/1717999626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971fe8e40 msgr2=0x559971fe9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.267+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1717999626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971fe8e40 0x559971fe9260 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fad54001740 tx=0x7fad5400d6a0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1717999626 shutdown_connections 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1717999626 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac3c036900 0x7fac3c038dc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1717999626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971fe8e40 0x559971fe9260 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1717999626 >> 172.21.15.50:0/1717999626 conn(0x559971fdcee0 msgr2=0x559971fdd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1717999626 shutdown_connections 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1717999626 wait complete. 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559971fd7e30 msgr2=0x559971fda280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x559971fd7e30 0x559971fda280 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559971e449b0 msgr2=0x559971fd1650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x559971e449b0 0x559971fd1650 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559971fd3ea0 msgr2=0x559971fd6290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x559971fd3ea0 0x559971fd6290 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac4c036900 msgr2=0x7fac4c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fac4c036900 0x7fac4c038dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad58054000 tx=0x7fad5804e000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 msgr2=0x559971fca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 --2- 172.21.15.50:0/1526547303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559971e435d0 0x559971fca410 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fad54001dd0 tx=0x7fad54000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad652a9640 1 -- 172.21.15.50:0/1526547303 reap_dead start 2024-05-07T13:57:55.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 shutdown_connections 2024-05-07T13:57:55.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 >> 172.21.15.50:0/1526547303 conn(0x559971eca780 msgr2=0x559971fbc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 shutdown_connections 2024-05-07T13:57:55.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.268+0000 7fad66fa2800 1 -- 172.21.15.50:0/1526547303 wait complete. 2024-05-07T13:57:55.264 INFO:teuthology.orchestra.run.smithi050.stdout:{"entries":[],"summary":[]} 2024-05-07T13:57:55.265 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-07T13:57:55.265 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-07T13:57:55.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-07T13:57:55.265 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-05-07T13:57:55.311 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:55.312 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.325+0000 7f7ae9333800 1 Processor -- start 2024-05-07T13:57:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.325+0000 7f7ae9333800 1 -- start start 2024-05-07T13:57:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.325+0000 7f7ae9333800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55cbeaa2e580 0x55cbeaa37080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.325+0000 7f7ae9333800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cbea9a1060 con 0x55cbeaa2ca40 2024-05-07T13:57:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.325+0000 7f7ae9333800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55cbea8bf050 con 0x55cbeaa2e580 2024-05-07T13:57:55.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.326+0000 7f7ae47f4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55cbeaa2e580 0x55cbeaa37080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.326+0000 7f7ae4ff5640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55cbeaa2ca40 0x55cbeaa2ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56758/0 (socket says 172.21.15.50:56758) 2024-05-07T13:57:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.326+0000 7f7ae47f4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55cbeaa2e580 0x55cbeaa37080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58270/0 (socket says 172.21.15.50:58270) 2024-05-07T13:57:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.326+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/213700848 learned_addr learned my addr 172.21.15.50:0/213700848 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.326+0000 7f7ae47f4640 1 -- 172.21.15.50:0/213700848 >> v1:172.21.15.22:6789/0 conn(0x55cbeaa2ca40 legacy=0x55cbeaa2ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.326+0000 7f7ae3ff3640 1 -- 172.21.15.50:0/213700848 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105674031 0 0) 0x55cbea9a1060 con 0x55cbeaa2ca40 2024-05-07T13:57:55.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.326+0000 7f7ae47f4640 1 -- 172.21.15.50:0/213700848 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbea9a1230 con 0x55cbeaa2e580 2024-05-07T13:57:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.328+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/213700848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2e580 0x55cbeaa37080 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800a470 tx=0x7f7ad801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5241469d2ea19d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.328+0000 7f7ae3ff3640 1 -- 172.21.15.50:0/213700848 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad8057070 con 0x55cbeaa2e580 2024-05-07T13:57:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.328+0000 7f7ae3ff3640 1 -- 172.21.15.50:0/213700848 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad8052570 con 0x55cbeaa2e580 2024-05-07T13:57:55.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.328+0000 7f7ae3ff3640 1 -- 172.21.15.50:0/213700848 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad8052870 con 0x55cbeaa2e580 2024-05-07T13:57:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.329+0000 7f7ae9333800 1 -- 172.21.15.50:0/213700848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2e580 msgr2=0x55cbeaa37080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.329+0000 7f7ae9333800 1 --2- 172.21.15.50:0/213700848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2e580 0x55cbeaa37080 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800a470 tx=0x7f7ad801ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.329+0000 7f7ae9333800 1 -- 172.21.15.50:0/213700848 shutdown_connections 2024-05-07T13:57:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.329+0000 7f7ae9333800 1 --2- 172.21.15.50:0/213700848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2e580 0x55cbeaa37080 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.329+0000 7f7ae9333800 1 -- 172.21.15.50:0/213700848 >> 172.21.15.50:0/213700848 conn(0x55cbeaa285c0 msgr2=0x55cbeaa2a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.329+0000 7f7ae9333800 1 -- 172.21.15.50:0/213700848 shutdown_connections 2024-05-07T13:57:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.329+0000 7f7ae9333800 1 -- 172.21.15.50:0/213700848 wait complete. 2024-05-07T13:57:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.343+0000 7f7ae9333800 1 Processor -- start 2024-05-07T13:57:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.343+0000 7f7ae9333800 1 -- start start 2024-05-07T13:57:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.343+0000 7f7ae9333800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab21680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.343+0000 7f7ae9333800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbea9791c0 con 0x55cbeaa2ca40 2024-05-07T13:57:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.344+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab21680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.344+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab21680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58282/0 (socket says 172.21.15.50:58282) 2024-05-07T13:57:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.344+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/2804493228 learned_addr learned my addr 172.21.15.50:0/2804493228 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.344+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/2804493228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeab21c50 con 0x55cbeaa2ca40 2024-05-07T13:57:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.344+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/2804493228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab21680 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400b210 tx=0x7f7ad400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb803396cd81bad server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.344+0000 7f79d2e0d640 1 -- 172.21.15.50:0/2804493228 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad4008070 con 0x55cbeaa2ca40 2024-05-07T13:57:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.344+0000 7f79d2e0d640 1 -- 172.21.15.50:0/2804493228 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad400d500 con 0x55cbeaa2ca40 2024-05-07T13:57:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.344+0000 7f79d2e0d640 1 -- 172.21.15.50:0/2804493228 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad400d840 con 0x55cbeaa2ca40 2024-05-07T13:57:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.345+0000 7f7ae9333800 1 -- 172.21.15.50:0/2804493228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 msgr2=0x55cbeab21680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.345+0000 7f7ae9333800 1 --2- 172.21.15.50:0/2804493228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab21680 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400b210 tx=0x7f7ad400b6d0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.345+0000 7f7ae9333800 1 -- 172.21.15.50:0/2804493228 shutdown_connections 2024-05-07T13:57:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.345+0000 7f7ae9333800 1 --2- 172.21.15.50:0/2804493228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab21680 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.345+0000 7f7ae9333800 1 -- 172.21.15.50:0/2804493228 >> 172.21.15.50:0/2804493228 conn(0x55cbeaa285c0 msgr2=0x55cbeab1cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.345+0000 7f7ae9333800 1 -- 172.21.15.50:0/2804493228 shutdown_connections 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.345+0000 7f7ae9333800 1 -- 172.21.15.50:0/2804493228 wait complete. 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.345+0000 7f7ae9333800 1 Processor -- start 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.346+0000 7f7ae9333800 1 -- start start 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.346+0000 7f7ae9333800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab29250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.346+0000 7f7ae9333800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbeaa37890 con 0x55cbeaa2ca40 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.346+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab29250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.346+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab29250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58286/0 (socket says 172.21.15.50:58286) 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.346+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/1771824844 learned_addr learned my addr 172.21.15.50:0/1771824844 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.346+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/1771824844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeab29790 con 0x55cbeaa2ca40 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.346+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab29250 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4001e60 tx=0x7f7ad4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.347+0000 7f79d160a640 1 -- 172.21.15.50:0/1771824844 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad4019870 con 0x55cbeaa2ca40 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.347+0000 7f79d160a640 1 -- 172.21.15.50:0/1771824844 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad4019a10 con 0x55cbeaa2ca40 2024-05-07T13:57:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.347+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbeab29a20 con 0x55cbeaa2ca40 2024-05-07T13:57:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.347+0000 7f79d160a640 1 -- 172.21.15.50:0/1771824844 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad4019cf0 con 0x55cbeaa2ca40 2024-05-07T13:57:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.347+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbeab2c6d0 con 0x55cbeaa2ca40 2024-05-07T13:57:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.347+0000 7f79d160a640 1 -- 172.21.15.50:0/1771824844 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7ad4017040 con 0x55cbeaa2ca40 2024-05-07T13:57:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.348+0000 7f79d160a640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79cc036950 0x7f79cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.348+0000 7f79d160a640 1 -- 172.21.15.50:0/1771824844 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7ad4015020 con 0x55cbeaa2ca40 2024-05-07T13:57:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.348+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79cc036950 0x7f79cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.348+0000 7f7ae9333800 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeaa2e580 0x55cbeab30490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.348+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab30a20 con 0x55cbeaa2e580 2024-05-07T13:57:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.348+0000 7f7ae57f6640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeaa2e580 0x55cbeab30490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.348+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79cc036950 0x7f79cc038e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8054000 tx=0x7f7ad804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.348+0000 7f7ae57f6640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeaa2e580 0x55cbeab30490 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.349+0000 7f7ae57f6640 1 -- 172.21.15.50:0/1771824844 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeaa2e580 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.349+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab2da60 con 0x55cbeaa2e580 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.349+0000 7f7ae57f6640 1 -- 172.21.15.50:0/1771824844 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeaa2e580 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.349+0000 7f7ae9333800 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab32d50 0x55cbeab35140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.349+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab357e0 con 0x55cbeab32d50 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.349+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab32d50 0x55cbeab35140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.349+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab32d50 0x55cbeab35140 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.350+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/1771824844 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7ad402d070 con 0x55cbeab32d50 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.350+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab31d00 con 0x55cbeaa2e580 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.350+0000 7f7ae57f6640 1 -- 172.21.15.50:0/1771824844 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeaa2e580 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.350+0000 7f7ae9333800 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeab36c90 0x55cbeab390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.350+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab39840 con 0x55cbeab36c90 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.350+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeab36c90 0x55cbeab390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.351+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeab36c90 0x55cbeab390e0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.351+0000 7f7ae47f4640 1 -- 172.21.15.50:0/1771824844 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7ad805a040 con 0x55cbeab36c90 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.351+0000 7f7ae9333800 1 Processor -- start 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.351+0000 7f7ae9333800 1 -- start start 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f7ae9333800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab47ca0 0x55cbeab480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f7ae9333800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbea91fcf0 con 0x55cbeab47ca0 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab47ca0 0x55cbeab480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab47ca0 0x55cbeab480c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58300/0 (socket says 172.21.15.50:58300) 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3987809539 learned_addr learned my addr 172.21.15.50:0/3987809539 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3987809539 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeab48600 con 0x55cbeab47ca0 2024-05-07T13:57:55.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/3987809539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab47ca0 0x55cbeab480c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7ad404b340 tx=0x7f7ad401aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f79ca7fc640 1 -- 172.21.15.50:0/3987809539 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad401c900 con 0x55cbeab47ca0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f79ca7fc640 1 -- 172.21.15.50:0/3987809539 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad40449d0 con 0x55cbeab47ca0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f79ca7fc640 1 -- 172.21.15.50:0/3987809539 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad4044cf0 con 0x55cbeab47ca0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f7ae9333800 1 -- 172.21.15.50:0/3987809539 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbeab49070 con 0x55cbeab47ca0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.352+0000 7f7ae9333800 1 -- 172.21.15.50:0/3987809539 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbeab49570 con 0x55cbeab47ca0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.353+0000 7f79ca7fc640 1 -- 172.21.15.50:0/3987809539 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7ad403f250 con 0x55cbeab47ca0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.353+0000 7f79ca7fc640 1 --2- 172.21.15.50:0/3987809539 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79bc036900 0x7f79bc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.353+0000 7f79ca7fc640 1 -- 172.21.15.50:0/3987809539 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7ad403ad50 con 0x55cbeab47ca0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.354+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/3987809539 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79bc036900 0x7f79bc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.354+0000 7f7ae9333800 1 Processor -- start 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.354+0000 7f7ae9333800 1 -- start start 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.354+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/3987809539 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79bc036900 0x7f79bc038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55cbeab2d980 tx=0x7f7ad8005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.354+0000 7f7ae9333800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab55460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.354+0000 7f7ae9333800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbeab21fd0 con 0x55cbeab55040 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.354+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab55460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.354+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab55460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58314/0 (socket says 172.21.15.50:58314) 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.354+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/2202715308 learned_addr learned my addr 172.21.15.50:0/2202715308 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.355+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/2202715308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeab55a30 con 0x55cbeab55040 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.355+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/2202715308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab55460 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7ad401dfd0 tx=0x7f7ad4026430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3935a07e7aa1de0c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.355+0000 7f79bbfff640 1 -- 172.21.15.50:0/2202715308 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad405a070 con 0x55cbeab55040 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.355+0000 7f79bbfff640 1 -- 172.21.15.50:0/2202715308 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad403f540 con 0x55cbeab55040 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.355+0000 7f79bbfff640 1 -- 172.21.15.50:0/2202715308 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad403e040 con 0x55cbeab55040 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.355+0000 7f7ae9333800 1 -- 172.21.15.50:0/2202715308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 msgr2=0x55cbeab55460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.355+0000 7f7ae9333800 1 --2- 172.21.15.50:0/2202715308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab55460 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7ad401dfd0 tx=0x7f7ad4026430 comp rx=0 tx=0).stop 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae9333800 1 -- 172.21.15.50:0/2202715308 shutdown_connections 2024-05-07T13:57:55.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae9333800 1 --2- 172.21.15.50:0/2202715308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab55460 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae9333800 1 -- 172.21.15.50:0/2202715308 >> 172.21.15.50:0/2202715308 conn(0x55cbeab512c0 msgr2=0x55cbeab4f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae9333800 1 -- 172.21.15.50:0/2202715308 shutdown_connections 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae9333800 1 -- 172.21.15.50:0/2202715308 wait complete. 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae9333800 1 Processor -- start 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae9333800 1 -- start start 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae9333800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab5c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae9333800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbeab560a0 con 0x55cbeab55040 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab5c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae4ff5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab5c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58322/0 (socket says 172.21.15.50:58322) 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.356+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 learned_addr learned my addr 172.21.15.50:0/3160322669 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.357+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeab5c940 con 0x55cbeab55040 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.357+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab5c400 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40450c0 tx=0x7f7ad4044820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.357+0000 7f79ba7fc640 1 -- 172.21.15.50:0/3160322669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad403e050 con 0x55cbeab55040 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.357+0000 7f79ba7fc640 1 -- 172.21.15.50:0/3160322669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad4069030 con 0x55cbeab55040 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.357+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbeab5c940 con 0x55cbeab55040 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.357+0000 7f79ba7fc640 1 -- 172.21.15.50:0/3160322669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad4030980 con 0x55cbeab55040 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.357+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbeab5c940 con 0x55cbeab55040 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.358+0000 7f79ba7fc640 1 -- 172.21.15.50:0/3160322669 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7ad405d070 con 0x55cbeab55040 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.358+0000 7f79ba7fc640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79b0036900 0x7f79b0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.358+0000 7f79ba7fc640 1 -- 172.21.15.50:0/3160322669 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7ad406fd40 con 0x55cbeab55040 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.358+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79b0036900 0x7f79b0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.359+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79b0036900 0x7f79b0038dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7ad801ced0 tx=0x7f7ad804f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.359+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.359+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeab679e0 0x55cbeab69ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.359+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6a5f0 con 0x55cbeab679e0 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.359+0000 7f7ae57f6640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeab679e0 0x55cbeab69ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.359+0000 7f7ae57f6640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeab679e0 0x55cbeab69ea0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 20 realm 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6aa00 con 0x55cbeab679e0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b2d0 con 0x55cbeab679e0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab6c3d0 0x55cbeab6e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6edd0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.360+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab6c3d0 0x55cbeab6e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.361+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab6c3d0 0x55cbeab6e7c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.361+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.361+0000 7f7ae9333800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.361+0000 7f7ae9333800 20 searching for the correct realm 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.361+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab70720 con 0x55cbeab6c3d0 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.361+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.361+0000 7f7ae4ff5640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7ad405f070 0x7f7ad402b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.361+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab70720 con 0x7f7ad405f070 2024-05-07T13:57:55.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.362+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7ad405f070 0x7f7ad402b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.362+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7ad405f070 0x7f7ad402b6d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.362+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.362+0000 7f7ae47f4640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7ad8083040 0x7f7ad8075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.362+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab70720 con 0x7f7ad8083040 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.363+0000 7f7ae57f6640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7ad8083040 0x7f7ad8075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.363+0000 7f7ae57f6640 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7ad8083040 0x7f7ad8075430 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.363+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.363+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.364+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.364+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.364+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.364+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.364+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.364+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad8083040 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.364+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.364+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad405f070 2024-05-07T13:57:55.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.365+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.365+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad405f070 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.365+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.365+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.365+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.365+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad8083040 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.365+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.365+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.366+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.366+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad405f070 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.366+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.366+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab6c3d0 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.366+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.366+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab6c3d0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.366+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.366+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad8083040 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.367+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.367+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab6c3d0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.367+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.367+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab6c3d0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.367+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.367+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.367+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.367+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.368+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.368+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad8083040 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.368+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.368+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab6c3d0 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.368+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.368+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad405f070 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.369+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.369+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.369+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.369+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad8083040 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.369+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.369+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab6c3d0 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.370+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.370+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad8083040 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.370+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.370+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad405f070 2024-05-07T13:57:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.370+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.370+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab6c3d0 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.371+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.371+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad405f070 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.371+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.371+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x55cbeab679e0 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.371+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.371+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6b670 con 0x7f7ad405f070 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:55.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6f690 con 0x55cbeab679e0 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6fa80 con 0x55cbeab679e0 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6fa80 con 0x7f7ad8083040 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.372+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 zone default found 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 4 Realm: () 2024-05-07T13:57:55.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 zonegroup default 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab6f270 con 0x7f7ad8083040 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab72550 con 0x55cbeab6c3d0 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab728f0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 started sync module instance, tier type = 2024-05-07T13:57:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.373+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab719f0 con 0x7f7ad405f070 2024-05-07T13:57:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.375+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.375+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94334304591328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab71650 con 0x7f7ad405f070 2024-05-07T13:57:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.375+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab735f0 con 0x55cbeab679e0 2024-05-07T13:57:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.376+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94334304591328] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.376+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.376+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94334304595568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab739e0 con 0x55cbeab679e0 2024-05-07T13:57:55.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.376+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab74410 con 0x55cbeab6c3d0 2024-05-07T13:57:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.377+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.377+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94334304595568] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.378+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94334304599840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab74ca0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.378+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab73370 con 0x7f7ad405f070 2024-05-07T13:57:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.379+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.379+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94334304606048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab76030 con 0x7f7ad405f070 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.379+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab769f0 con 0x55cbeab679e0 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.379+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94334304599840] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.380+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94334304606048] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.380+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.380+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94334304602032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab769f0 con 0x55cbeab679e0 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.380+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab77240 con 0x7f7ad8083040 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.381+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.381+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94334304611312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab77690 con 0x7f7ad8083040 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.381+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94334304602032] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.381+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab76540 con 0x7f7ad8083040 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.382+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94334304611312] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.382+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.382+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94334304609600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab77c80 con 0x7f7ad8083040 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.382+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab78640 con 0x7f7ad8083040 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94334304609600] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94334304612496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab78640 con 0x7f7ad8083040 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae9333800 20 add_watcher() i=0 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae9333800 20 add_watcher() i=1 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae9333800 20 add_watcher() i=2 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae9333800 20 add_watcher() i=3 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae9333800 20 add_watcher() i=4 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae9333800 20 add_watcher() i=5 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.383+0000 7f7ae9333800 20 add_watcher() i=6 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.384+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94334304612496] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.385+0000 7f7ae9333800 20 add_watcher() i=7 2024-05-07T13:57:55.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.385+0000 7f7ae9333800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.385+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab7b9a0 con 0x55cbeab679e0 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.385+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.385+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94334304629664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab787b0 con 0x55cbeab679e0 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.386+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94334304629664] v29'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.386+0000 7f799afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.386+0000 7f7ae9333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.386+0000 7f7ae9333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.386+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab7aca0 con 0x55cbeab679e0 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.387+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.387+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab84a60 con 0x7f7ad8083040 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.388+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.388+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab84a60 con 0x55cbeab6c3d0 2024-05-07T13:57:55.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.389+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.389+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab84f10 con 0x55cbeab679e0 2024-05-07T13:57:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.390+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.390+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab84f10 con 0x7f7ad405f070 2024-05-07T13:57:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.391+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.391+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab85990 con 0x55cbeab6c3d0 2024-05-07T13:57:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.392+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.392+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab85990 con 0x55cbeab679e0 2024-05-07T13:57:55.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.394+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.394+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab85a20 con 0x7f7ad8083040 2024-05-07T13:57:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.395+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.395+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab85a20 con 0x7f7ad405f070 2024-05-07T13:57:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.396+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.396+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab85ff0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.397+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.397+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab864a0 con 0x7f7ad405f070 2024-05-07T13:57:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.398+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.398+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab864a0 con 0x7f7ad8083040 2024-05-07T13:57:55.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.399+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.399+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab86530 con 0x7f7ad405f070 2024-05-07T13:57:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.400+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.400+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x7f7ad8083040 2024-05-07T13:57:55.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.402+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.402+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab679e0 2024-05-07T13:57:55.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.403+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.403+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.404+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'68 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.404+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x7f7ad405f070 2024-05-07T13:57:55.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.405+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.405+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.406+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.406+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab679e0 2024-05-07T13:57:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.407+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'37 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.407+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab679e0 2024-05-07T13:57:55.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.408+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.408+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.409+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'69 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.409+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x7f7ad405f070 2024-05-07T13:57:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.410+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.410+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.411+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.411+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.412+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.412+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.413+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.413+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.414+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.414+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab86620 con 0x7f7ad8083040 2024-05-07T13:57:55.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.415+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.415+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab86620 con 0x55cbeab6c3d0 2024-05-07T13:57:55.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.416+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.403 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.416+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x7f7ad8083040 2024-05-07T13:57:55.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.417+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.417+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab865c0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.418+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'70 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.418+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab86620 con 0x7f7ad8083040 2024-05-07T13:57:55.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.420+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.420+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeab86620 con 0x7f7ad405f070 2024-05-07T13:57:55.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.421+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.421+0000 7f7999fe3640 20 reqs_thread_entry: start 2024-05-07T13:57:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.421+0000 7f7ae9333800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.421+0000 7f7ae9333800 20 Filter name: none 2024-05-07T13:57:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.421+0000 7f790b7fe640 20 reqs_thread_entry: start 2024-05-07T13:57:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.421+0000 7f7ae9333800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-07T13:57:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.421+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.421+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb1610 con 0x55cbeab679e0 2024-05-07T13:57:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 20 rados_obj.operate() r=0 bl.length=391 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb11a0 con 0x7f7ad405f070 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 : miss 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:96 8.f 8:f730938e:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb3a80 con 0x55cbeab6c3d0 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(96 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 20 rados_obj.operate() r=0 bl.length=379 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 info.flags=0x17 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 to cache LRU end 2024-05-07T13:57:55.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.422+0000 7f7ae9333800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.423+0000 7f7ae9333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.423+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 4.0 4:01b5f58e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x55cbeab6c3d0 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.423+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(97 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.423+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 4.1d 4:b88e2bfc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x55cbeab6c3d0 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.423+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(98 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.423+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:99 4.20 4:04d9c817:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x55cbeab679e0 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.424+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(99 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.424+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:100 4.25 4:a52481ea:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x55cbeab6c3d0 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.424+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(100 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.424+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:101 4.5 4:a33ae272:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x7f7ad405f070 2024-05-07T13:57:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.424+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(101 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4 [call out=425b] v0'0 uv11 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.424+0000 7f7ae9333800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-05-07T13:57:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.424+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 4.1e 4:79fc0890:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x7f7ad8083040 2024-05-07T13:57:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.425+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(102 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc00a4a0 con 0x7f7ad8083040 2024-05-07T13:57:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.425+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:103 4.16 4:6b9aeff3:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x55cbeab6c3d0 2024-05-07T13:57:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.425+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== osd_op_reply(103 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.425+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:104 4.32 4:4ded6cf2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x55cbeab679e0 2024-05-07T13:57:55.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.426+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(104 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.7 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.426+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:105 4.31 4:8cc28e46:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x55cbeab679e0 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.426+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(105 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.426+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:106 4.27 4:e62ccd62:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x55cbeab679e0 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.426+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(106 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc00a4a0 con 0x55cbeab679e0 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.426+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:107 4.33 4:cfc84ad4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31360 con 0x7f7ad8083040 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(107 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae9333800 20 get_obj_state: octx=0x7f7adc00aaf0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55cbeac2f758 s->prefetch_data=0 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:108 3.28s0 3:15189f1b:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac30700 con 0x55cbeab6c3d0 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(108 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae9333800 10 manifest: total_size = 6 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae9333800 20 get_obj_state: setting s->obj_tag to 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.6018475610350913168 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae9333800 20 get_obj_state: octx=0x7f7adc00aaf0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55cbeac2f758 s->prefetch_data=0 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae9333800 20 prepare_atomic_modification: state is not atomic. state=0x55cbeac2f758 2024-05-07T13:57:55.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae9333800 20 bucket index object: :.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4 2024-05-07T13:57:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.427+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:109 4.5 4:a33ae272:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31210 con 0x7f7ad405f070 2024-05-07T13:57:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.428+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(109 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4 [stat,call,call] v29'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.428+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:110 3.28s0 3:15189f1b:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac31210 con 0x55cbeab6c3d0 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.430+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 32 ==== osd_op_reply(110 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7_15f6f8dc036519d7fe15b39338f6e5db [call] v29'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.430+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:111 4.5 4:a33ae272:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb8c10 con 0x7f7ad405f070 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.430+0000 7f7ae9333800 20 list_objects_ordered: starting attempt 1 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.430+0000 7f7ae9333800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.430+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:112 4.0 4:01b5f58e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb8c10 con 0x55cbeab6c3d0 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.430+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:113 4.1d 4:b88e2bfc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb8c10 con 0x55cbeab6c3d0 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.430+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:114 4.20 4:04d9c817:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb8c10 con 0x55cbeab679e0 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.430+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:115 4.25 4:a52481ea:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb8c10 con 0x55cbeab6c3d0 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.430+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:116 4.5 4:a33ae272:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d30 con 0x7f7ad405f070 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:117 4.1e 4:79fc0890:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc66b0 con 0x7f7ad8083040 2024-05-07T13:57:55.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:118 4.16 4:6b9aeff3:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc9070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:119 4.32 4:4ded6cf2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabcba50 con 0x55cbeab679e0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:120 4.31 4:8cc28e46:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabce420 con 0x55cbeab679e0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 33 ==== osd_op_reply(112 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 34 ==== osd_op_reply(113 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 35 ==== osd_op_reply(115 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:121 4.27 4:e62ccd62:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc1450 con 0x55cbeab679e0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(114 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(117 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:122 4.33 4:cfc84ad4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc1450 con 0x7f7ad8083040 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.431+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(119 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.7 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 36 ==== osd_op_reply(118 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 35 ==== osd_op_reply(120 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 36 ==== osd_op_reply(121 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(111 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4 [stat,call,call] v29'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f79bb7fe640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== osd_op_reply(116 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(122 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7])"; uploads.size()=0; is_truncated=0 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:123 4.0 4:01b5f58e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f060 con 0x55cbeab6c3d0 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:124 4.1d 4:b88e2bfc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f800 con 0x55cbeab6c3d0 2024-05-07T13:57:55.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:125 4.20 4:04d9c817:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2fc30 con 0x55cbeab679e0 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:126 4.25 4:a52481ea:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f060 con 0x55cbeab6c3d0 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:127 4.5 4:a33ae272:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f800 con 0x7f7ad405f070 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:128 4.1e 4:79fc0890:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2fc30 con 0x7f7ad8083040 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.432+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:129 4.16 4:6b9aeff3:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f060 con 0x55cbeab6c3d0 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:130 4.32 4:4ded6cf2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2fc30 con 0x55cbeab679e0 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:131 4.31 4:8cc28e46:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2fc30 con 0x55cbeab679e0 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(128 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:132 4.27 4:e62ccd62:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f060 con 0x55cbeab679e0 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 37 ==== osd_op_reply(123 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== osd_op_reply(127 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:133 4.33 4:cfc84ad4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x7f7ad8083040 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 37 ==== osd_op_reply(125 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 38 ==== osd_op_reply(130 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.7 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 38 ==== osd_op_reply(124 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 39 ==== osd_op_reply(126 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 40 ==== osd_op_reply(129 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 39 ==== osd_op_reply(131 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 40 ==== osd_op_reply(132 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(133 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.433+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x7f7ad405f070 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.435+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 26 ==== osd_op_reply(134 foo.buckets [call] v29'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.435+0000 7f7ae9333800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.435+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.435+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x7f7ad405f070 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.435+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 27 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.435+0000 7f7ae9333800 20 rados_obj.operate() r=0 bl.length=165 2024-05-07T13:57:55.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.435+0000 7f7ae9333800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.435+0000 7f7ae9333800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.435+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x7f7ad405f070 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.436+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 28 ==== osd_op_reply(136 myfoo [call,call,delete] v29'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.436+0000 7f7ae9333800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.436+0000 7f7ae9333800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.436+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94334305366112 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x7f7ad8083040 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.436+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== watch-notify(notify (1) cookie 94334304609600 notify 124554051612 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55cbeab856b0 con 0x7f7ad8083040 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.437+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(137 notify.6 [notify cookie 94334305366112 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.437+0000 7f79bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051612 cookie 94334304609600 notifier 4775 bl.length()=149 2024-05-07T13:57:55.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.437+0000 7f79bb7fe640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f79180032c0 con 0x7f7ad8083040 2024-05-07T13:57:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.437+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== watch-notify(notify_complete (2) cookie 94334305366112 notify 124554051612 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cbeab7ac60 con 0x7f7ad8083040 2024-05-07T13:57:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.437+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.437+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:139 8.f 8:f730938e:root::.bucket.meta.myfoo%3a2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.438+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 41 ==== osd_op_reply(139 .bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 [call,call,delete] v29'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.438+0000 7f7ae9333800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 from cache 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.438+0000 7f7ae9333800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7, ofs0, ns] 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.438+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94334305366112 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x7f7ad405f070 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.438+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 29 ==== watch-notify(notify (1) cookie 94334304591328 notify 124554051628 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55cbeab854e0 con 0x7f7ad405f070 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.438+0000 7f79bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051628 cookie 94334304591328 notifier 4775 bl.length()=206 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.438+0000 7f79bb7fe640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f79180032c0 con 0x7f7ad405f070 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.438+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 30 ==== osd_op_reply(140 notify.0 [notify cookie 94334305366112 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 31 ==== watch-notify(notify_complete (2) cookie 94334305366112 notify 124554051628 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cbeab85dc0 con 0x7f7ad405f070 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 32 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:142 4.0 4:01b5f58e:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:143 4.1d 4:b88e2bfc:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f060 con 0x55cbeab6c3d0 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:144 4.20 4:04d9c817:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb41f0 con 0x55cbeab679e0 2024-05-07T13:57:55.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:145 4.25 4:a52481ea:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb4b10 con 0x55cbeab6c3d0 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:146 4.5 4:a33ae272:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x7f7ad405f070 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:147 4.1e 4:79fc0890:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb58a0 con 0x7f7ad8083040 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:148 4.16 4:6b9aeff3:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb41f0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:149 4.32 4:4ded6cf2:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb4b10 con 0x55cbeab679e0 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:150 4.31 4:8cc28e46:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabb58a0 con 0x55cbeab679e0 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:151 4.27 4:e62ccd62:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f060 con 0x55cbeab679e0 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.439+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:152 4.33 4:cfc84ad4:::.dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc8270 con 0x7f7ad8083040 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 41 ==== osd_op_reply(144 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.2 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 42 ==== osd_op_reply(145 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.3 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 43 ==== osd_op_reply(148 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.6 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== osd_op_reply(152 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.10 [delete] v29'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 42 ==== osd_op_reply(149 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.7 [delete] v29'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 43 ==== osd_op_reply(150 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.8 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 44 ==== osd_op_reply(151 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.9 [delete] v29'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== osd_op_reply(147 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.5 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 44 ==== osd_op_reply(142 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.0 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 45 ==== osd_op_reply(143 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.1 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 33 ==== osd_op_reply(146 .dir.2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7.4 [delete] v29'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae9333800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 : miss 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae9333800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.441+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:153 6.1c 6:3a07c230:::pubsub..bucket.myfoo%2f2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeac2f7e0 con 0x55cbeab6c3d0 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.442+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 46 ==== osd_op_reply(153 pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.442+0000 7f7ae9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.442+0000 7f7ae9333800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 info.flags=0x0 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.442+0000 7f7ae9333800 10 adding default.rgw.log++pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 to cache LRU end 2024-05-07T13:57:55.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.442+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:154 6.1c 6:3a07c230:::pubsub..bucket.myfoo%2f2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x55cbeab6c3d0 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.443+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 47 ==== osd_op_reply(154 pubsub..bucket.myfoo/2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.7 [delete] v29'35 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.443+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad405f070 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.444+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 34 ==== osd_op_reply(155 foo.buckets [call] v29'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.444+0000 7f7ae9333800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.444+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad8083040 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.445+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v29'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.445+0000 7f7ae9333800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.445+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94334305366112 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad405f070 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.445+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 35 ==== watch-notify(notify (1) cookie 94334304606048 notify 124554051629 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55cbeab85dc0 con 0x7f7ad405f070 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.445+0000 7f79bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051629 cookie 94334304606048 notifier 4775 bl.length()=170 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.445+0000 7f79bb7fe640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f79180032c0 con 0x7f7ad405f070 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.445+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 36 ==== osd_op_reply(157 notify.3 [notify cookie 94334305366112 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.445+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 37 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.445+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 38 ==== watch-notify(notify_complete (2) cookie 94334305366112 notify 124554051629 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cbeab7a660 con 0x7f7ad405f070 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.446+0000 7f7ae9333800 10 removing email index: foo@foo.com 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.446+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x55cbeab679e0 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 45 ==== osd_op_reply(159 foo@foo.com [delete] v29'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f7ae9333800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94334305366112 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad405f070 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 39 ==== watch-notify(notify (1) cookie 94334304606048 notify 124554051630 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55cbeab7a660 con 0x7f7ad405f070 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f79bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051630 cookie 94334304606048 notifier 4775 bl.length()=162 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 40 ==== osd_op_reply(160 notify.3 [notify cookie 94334305366112 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f79bbfff640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f79a8003d60 con 0x7f7ad405f070 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 41 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 42 ==== watch-notify(notify_complete (2) cookie 94334305366112 notify 124554051630 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cbeab852b0 con 0x7f7ad405f070 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f7ae9333800 10 removing user buckets index 2024-05-07T13:57:55.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.447+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad405f070 2024-05-07T13:57:55.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.448+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 43 ==== osd_op_reply(162 foo.buckets [delete] v29'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.448+0000 7f7ae9333800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-05-07T13:57:55.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.448+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94334305366112 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad8083040 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.449+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== watch-notify(notify (1) cookie 94334304611312 notify 124554051613 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55cbeab7ac60 con 0x7f7ad8083040 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.449+0000 7f79bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 94334304611312 notifier 4775 bl.length()=160 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.449+0000 7f79bb7fe640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f79180032c0 con 0x7f7ad8083040 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.449+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== osd_op_reply(163 notify.5 [notify cookie 94334305366112 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.449+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 38 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.449+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 39 ==== watch-notify(notify_complete (2) cookie 94334305366112 notify 124554051613 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cbeab7b040 con 0x7f7ad8083040 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.449+0000 7f7ae9333800 10 removing user index: foo 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.449+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x55cbeab679e0 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.450+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 46 ==== osd_op_reply(165 foo [call,call,delete] v29'21 uv21 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.450+0000 7f7ae9333800 10 removing default.rgw.meta+users.uid+foo from cache 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.450+0000 7f7ae9333800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-07T13:57:55.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.450+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94334305366112 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x55cbeab679e0 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.450+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 47 ==== watch-notify(notify (1) cookie 94334304602032 notify 124554051602 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55cbeab7b040 con 0x55cbeab679e0 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.450+0000 7f79bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94334304602032 notifier 4775 bl.length()=152 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.450+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 48 ==== osd_op_reply(166 notify.4 [notify cookie 94334305366112 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.450+0000 7f79bbfff640 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f79a8003d60 con 0x55cbeab679e0 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.451+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 49 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.451+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 50 ==== watch-notify(notify_complete (2) cookie 94334305366112 notify 124554051602 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cbeab7a3d0 con 0x55cbeab679e0 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.452+0000 7f799afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.452+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94334304629664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x55cbeab679e0 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.453+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 51 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94334304629664] v29'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.453+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94334304591328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad405f070 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.454+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 44 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94334304591328] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.454+0000 7f7ae9333800 20 remove_watcher() i=0 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.454+0000 7f7ae9333800 2 removed watcher, disabling cache 2024-05-07T13:57:55.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.454+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94334304595568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x55cbeab679e0 2024-05-07T13:57:55.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.455+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 52 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94334304595568] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.455+0000 7f7ae9333800 20 remove_watcher() i=1 2024-05-07T13:57:55.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.455+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94334304599840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x55cbeab6c3d0 2024-05-07T13:57:55.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.456+0000 7f7ae4ff5640 1 -- 172.21.15.50:0/3160322669 <== osd.3 v2:172.21.15.50:6814/3553060046 48 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94334304599840] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad4075070 con 0x55cbeab6c3d0 2024-05-07T13:57:55.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.456+0000 7f7ae9333800 20 remove_watcher() i=2 2024-05-07T13:57:55.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.456+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94334304606048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad405f070 2024-05-07T13:57:55.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.457+0000 7f7ae47f4640 1 -- 172.21.15.50:0/3160322669 <== osd.2 v2:172.21.15.50:6808/2034796854 45 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94334304606048] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad8070030 con 0x7f7ad405f070 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.457+0000 7f7ae9333800 20 remove_watcher() i=3 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.457+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94334304602032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x55cbeab679e0 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.458+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.1 v2:172.21.15.50:6800/3441257969 53 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94334304602032] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x55cbeab679e0 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.458+0000 7f7ae9333800 20 remove_watcher() i=4 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.458+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94334304611312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad8083040 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.459+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 40 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94334304611312] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.459+0000 7f7ae9333800 20 remove_watcher() i=5 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.459+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94334304609600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad8083040 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.460+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 41 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94334304609600] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.460+0000 7f7ae9333800 20 remove_watcher() i=6 2024-05-07T13:57:55.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.460+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94334304612496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeabc3d90 con 0x7f7ad8083040 2024-05-07T13:57:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.461+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 <== osd.0 v2:172.21.15.22:6800/2215278347 42 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94334304612496] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7adc04c060 con 0x7f7ad8083040 2024-05-07T13:57:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.461+0000 7f7ae9333800 20 remove_watcher() i=7 2024-05-07T13:57:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7ad8083040 msgr2=0x7f7ad8075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f7ad8083040 0x7f7ad8075430 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeab679e0 msgr2=0x55cbeab69ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeab679e0 0x55cbeab69ea0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7ad405f070 msgr2=0x7f7ad402b6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f7ad405f070 0x7f7ad402b6d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab6c3d0 msgr2=0x55cbeab6e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab6c3d0 0x55cbeab6e7c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79b0036900 msgr2=0x7f79b0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79b0036900 0x7f79b0038dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7ad801ced0 tx=0x7f7ad804f000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 msgr2=0x55cbeab5c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae57f6640 1 -- 172.21.15.50:0/3160322669 reap_dead start 2024-05-07T13:57:55.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab5c400 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40450c0 tx=0x7f7ad4044820 comp rx=0 tx=0).stop 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 shutdown_connections 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3160322669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab55040 0x55cbeab5c400 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 >> 172.21.15.50:0/3160322669 conn(0x55cbeab512c0 msgr2=0x55cbeab4e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 shutdown_connections 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3160322669 wait complete. 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3987809539 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79bc036900 msgr2=0x7f79bc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3987809539 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79bc036900 0x7f79bc038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55cbeab2d980 tx=0x7f7ad8005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3987809539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab47ca0 msgr2=0x55cbeab480c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3987809539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab47ca0 0x55cbeab480c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7ad404b340 tx=0x7f7ad401aa10 comp rx=0 tx=0).stop 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3987809539 shutdown_connections 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3987809539 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79bc036900 0x7f79bc038dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 --2- 172.21.15.50:0/3987809539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeab47ca0 0x55cbeab480c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3987809539 >> 172.21.15.50:0/3987809539 conn(0x55cbeab3bd40 msgr2=0x55cbeab3c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3987809539 shutdown_connections 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.462+0000 7f7ae9333800 1 -- 172.21.15.50:0/3987809539 wait complete. 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeab36c90 msgr2=0x55cbeab390e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeab36c90 0x55cbeab390e0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeaa2e580 msgr2=0x55cbeab30490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeaa2e580 0x55cbeab30490 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab32d50 msgr2=0x55cbeab35140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeab32d50 0x55cbeab35140 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79cc036950 msgr2=0x7f79cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f79cc036950 0x7f79cc038e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8054000 tx=0x7f7ad804e000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 msgr2=0x55cbeab29250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 --2- 172.21.15.50:0/1771824844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeaa2ca40 0x55cbeab29250 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4001e60 tx=0x7f7ad4000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae57f6640 1 -- 172.21.15.50:0/1771824844 reap_dead start 2024-05-07T13:57:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 shutdown_connections 2024-05-07T13:57:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 >> 172.21.15.50:0/1771824844 conn(0x55cbeaa285c0 msgr2=0x55cbeab1b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 shutdown_connections 2024-05-07T13:57:55.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.463+0000 7f7ae9333800 1 -- 172.21.15.50:0/1771824844 wait complete. 2024-05-07T13:57:55.459 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-07T13:57:55.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-07T13:57:55.459 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-07T13:57:55.505 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:55.505 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.518+0000 7fb135e12800 1 Processor -- start 2024-05-07T13:57:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.518+0000 7fb135e12800 1 -- start start 2024-05-07T13:57:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.519+0000 7fb135e12800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5637ab9833e0 0x5637ab9858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.519+0000 7fb135e12800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5637ab985f50 con 0x5637ab8f2010 2024-05-07T13:57:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.519+0000 7fb135e12800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5637ab810050 con 0x5637ab9833e0 2024-05-07T13:57:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.519+0000 7fb130bed640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5637ab9833e0 0x5637ab9858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.519+0000 7fb130bed640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5637ab9833e0 0x5637ab9858a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58332/0 (socket says 172.21.15.50:58332) 2024-05-07T13:57:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.519+0000 7fb1313ee640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5637ab8f2010 0x5637ab981c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56760/0 (socket says 172.21.15.50:56760) 2024-05-07T13:57:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.519+0000 7fb130bed640 1 -- 172.21.15.50:0/400381587 learned_addr learned my addr 172.21.15.50:0/400381587 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.519+0000 7fb130bed640 1 -- 172.21.15.50:0/400381587 >> v1:172.21.15.22:6789/0 conn(0x5637ab8f2010 legacy=0x5637ab981c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.519+0000 7fb130bed640 1 -- 172.21.15.50:0/400381587 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ab987180 con 0x5637ab9833e0 2024-05-07T13:57:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.521+0000 7fb130bed640 1 --2- 172.21.15.50:0/400381587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab9833e0 0x5637ab9858a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb12800a520 tx=0x7fb12801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f14dcb3a9164a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.521+0000 7fb123fff640 1 -- 172.21.15.50:0/400381587 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb128057070 con 0x5637ab9833e0 2024-05-07T13:57:55.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.521+0000 7fb123fff640 1 -- 172.21.15.50:0/400381587 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb128052570 con 0x5637ab9833e0 2024-05-07T13:57:55.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.521+0000 7fb123fff640 1 -- 172.21.15.50:0/400381587 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12804ae60 con 0x5637ab9833e0 2024-05-07T13:57:55.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.522+0000 7fb135e12800 1 -- 172.21.15.50:0/400381587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab9833e0 msgr2=0x5637ab9858a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.522+0000 7fb135e12800 1 --2- 172.21.15.50:0/400381587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab9833e0 0x5637ab9858a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb12800a520 tx=0x7fb12801d010 comp rx=0 tx=0).stop 2024-05-07T13:57:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.522+0000 7fb135e12800 1 -- 172.21.15.50:0/400381587 shutdown_connections 2024-05-07T13:57:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.522+0000 7fb135e12800 1 --2- 172.21.15.50:0/400381587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab9833e0 0x5637ab9858a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.522+0000 7fb135e12800 1 -- 172.21.15.50:0/400381587 >> 172.21.15.50:0/400381587 conn(0x5637ab9795b0 msgr2=0x5637ab97b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.522+0000 7fb135e12800 1 -- 172.21.15.50:0/400381587 shutdown_connections 2024-05-07T13:57:55.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.522+0000 7fb135e12800 1 -- 172.21.15.50:0/400381587 wait complete. 2024-05-07T13:57:55.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.537+0000 7fb135e12800 1 Processor -- start 2024-05-07T13:57:55.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.537+0000 7fb135e12800 1 -- start start 2024-05-07T13:57:55.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.537+0000 7fb135e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba70700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.537+0000 7fb135e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5637ab8ca1d0 con 0x5637ab8f2010 2024-05-07T13:57:55.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.538+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba70700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.538+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba70700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58342/0 (socket says 172.21.15.50:58342) 2024-05-07T13:57:55.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.538+0000 7fb1313ee640 1 -- 172.21.15.50:0/1755555415 learned_addr learned my addr 172.21.15.50:0/1755555415 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.538+0000 7fb1313ee640 1 -- 172.21.15.50:0/1755555415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637aba70cd0 con 0x5637ab8f2010 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.538+0000 7fb1313ee640 1 --2- 172.21.15.50:0/1755555415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba70700 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb124001e90 tx=0x7fb12400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32078f7654d6991 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.538+0000 7fb01f606640 1 -- 172.21.15.50:0/1755555415 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12400e5c0 con 0x5637ab8f2010 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.538+0000 7fb01f606640 1 -- 172.21.15.50:0/1755555415 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb124006070 con 0x5637ab8f2010 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.538+0000 7fb01f606640 1 -- 172.21.15.50:0/1755555415 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12400e890 con 0x5637ab8f2010 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 -- 172.21.15.50:0/1755555415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 msgr2=0x5637aba70700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 --2- 172.21.15.50:0/1755555415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba70700 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb124001e90 tx=0x7fb12400b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 -- 172.21.15.50:0/1755555415 shutdown_connections 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 --2- 172.21.15.50:0/1755555415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba70700 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 -- 172.21.15.50:0/1755555415 >> 172.21.15.50:0/1755555415 conn(0x5637ab9795b0 msgr2=0x5637aba6c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 -- 172.21.15.50:0/1755555415 shutdown_connections 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 -- 172.21.15.50:0/1755555415 wait complete. 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 Processor -- start 2024-05-07T13:57:55.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 -- start start 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba78270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.539+0000 7fb135e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5637ab986420 con 0x5637ab8f2010 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.540+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba78270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.540+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba78270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58344/0 (socket says 172.21.15.50:58344) 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.540+0000 7fb1313ee640 1 -- 172.21.15.50:0/3062863698 learned_addr learned my addr 172.21.15.50:0/3062863698 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.540+0000 7fb1313ee640 1 -- 172.21.15.50:0/3062863698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637aba787b0 con 0x5637ab8f2010 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.540+0000 7fb1313ee640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba78270 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb124001ed0 tx=0x7fb124000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.540+0000 7fb01de03640 1 -- 172.21.15.50:0/3062863698 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12401a880 con 0x5637ab8f2010 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.540+0000 7fb01de03640 1 -- 172.21.15.50:0/3062863698 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12401aa20 con 0x5637ab8f2010 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.540+0000 7fb01de03640 1 -- 172.21.15.50:0/3062863698 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12401ad40 con 0x5637ab8f2010 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.540+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637aba78a40 con 0x5637ab8f2010 2024-05-07T13:57:55.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.541+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637aba7b6f0 con 0x5637ab8f2010 2024-05-07T13:57:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.541+0000 7fb01de03640 1 -- 172.21.15.50:0/3062863698 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb124017070 con 0x5637ab8f2010 2024-05-07T13:57:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.541+0000 7fb01de03640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb018036900 0x7fb018038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.541+0000 7fb01de03640 1 -- 172.21.15.50:0/3062863698 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb124015020 con 0x5637ab8f2010 2024-05-07T13:57:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.542+0000 7fb130bed640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb018036900 0x7fb018038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.542+0000 7fb135e12800 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637ab9833e0 0x5637aba7f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.542+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637aba7fa80 con 0x5637ab9833e0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.542+0000 7fb131bef640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637ab9833e0 0x5637aba7f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.542+0000 7fb130bed640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb018036900 0x7fb018038dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb128054000 tx=0x7fb12804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.542+0000 7fb131bef640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637ab9833e0 0x5637aba7f4b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.542+0000 7fb131bef640 1 -- 172.21.15.50:0/3062863698 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637ab9833e0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.542+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637aba7ca80 con 0x5637ab9833e0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.543+0000 7fb131bef640 1 -- 172.21.15.50:0/3062863698 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637ab9833e0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.543+0000 7fb135e12800 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637aba81d90 0x5637aba84180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.543+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637aba84820 con 0x5637aba81d90 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.543+0000 7fb1313ee640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637aba81d90 0x5637aba84180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.543+0000 7fb1313ee640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637aba81d90 0x5637aba84180 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.543+0000 7fb1313ee640 1 -- 172.21.15.50:0/3062863698 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb12402e070 con 0x5637aba81d90 2024-05-07T13:57:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.543+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637aba80d40 con 0x5637ab9833e0 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.544+0000 7fb131bef640 1 -- 172.21.15.50:0/3062863698 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637ab9833e0 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.544+0000 7fb135e12800 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5637aba85cd0 0x5637aba88120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.544+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637aba88880 con 0x5637aba85cd0 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.544+0000 7fb130bed640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5637aba85cd0 0x5637aba88120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.544+0000 7fb130bed640 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5637aba85cd0 0x5637aba88120 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.545+0000 7fb130bed640 1 -- 172.21.15.50:0/3062863698 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb12805a040 con 0x5637aba85cd0 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.545+0000 7fb135e12800 1 Processor -- start 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.545+0000 7fb135e12800 1 -- start start 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.545+0000 7fb135e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637aba96ce0 0x5637aba97100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.545+0000 7fb135e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5637ab870cf0 con 0x5637aba96ce0 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.545+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637aba96ce0 0x5637aba97100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.545+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637aba96ce0 0x5637aba97100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58348/0 (socket says 172.21.15.50:58348) 2024-05-07T13:57:55.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.545+0000 7fb1313ee640 1 -- 172.21.15.50:0/70182173 learned_addr learned my addr 172.21.15.50:0/70182173 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.546+0000 7fb1313ee640 1 -- 172.21.15.50:0/70182173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637aba97640 con 0x5637aba96ce0 2024-05-07T13:57:55.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.546+0000 7fb1313ee640 1 --2- 172.21.15.50:0/70182173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637aba96ce0 0x5637aba97100 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb1240178f0 tx=0x7fb124017d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.546+0000 7fb016ffd640 1 -- 172.21.15.50:0/70182173 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1240174a0 con 0x5637aba96ce0 2024-05-07T13:57:55.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.546+0000 7fb016ffd640 1 -- 172.21.15.50:0/70182173 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1240408e0 con 0x5637aba96ce0 2024-05-07T13:57:55.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.546+0000 7fb016ffd640 1 -- 172.21.15.50:0/70182173 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb124040bc0 con 0x5637aba96ce0 2024-05-07T13:57:55.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.546+0000 7fb135e12800 1 -- 172.21.15.50:0/70182173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637aba980b0 con 0x5637aba96ce0 2024-05-07T13:57:55.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.546+0000 7fb135e12800 1 -- 172.21.15.50:0/70182173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637aba985b0 con 0x5637aba96ce0 2024-05-07T13:57:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.547+0000 7fb016ffd640 1 -- 172.21.15.50:0/70182173 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb12404f070 con 0x5637aba96ce0 2024-05-07T13:57:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.547+0000 7fb016ffd640 1 --2- 172.21.15.50:0/70182173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb00c036950 0x7fb00c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.547+0000 7fb016ffd640 1 -- 172.21.15.50:0/70182173 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb12403bd50 con 0x5637aba96ce0 2024-05-07T13:57:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.547+0000 7fb130bed640 1 --2- 172.21.15.50:0/70182173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb00c036950 0x7fb00c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.547+0000 7fb135e12800 1 Processor -- start 2024-05-07T13:57:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.547+0000 7fb135e12800 1 -- start start 2024-05-07T13:57:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.547+0000 7fb130bed640 1 --2- 172.21.15.50:0/70182173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb00c036950 0x7fb00c038e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5637aba7c9a0 tx=0x7fb128005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.547+0000 7fb135e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaa4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.547+0000 7fb135e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5637aba71050 con 0x5637abaa3e90 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.548+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaa4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.548+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaa4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58364/0 (socket says 172.21.15.50:58364) 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.548+0000 7fb1313ee640 1 -- 172.21.15.50:0/1854433853 learned_addr learned my addr 172.21.15.50:0/1854433853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.548+0000 7fb1313ee640 1 -- 172.21.15.50:0/1854433853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637abaa4840 con 0x5637abaa3e90 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.548+0000 7fb1313ee640 1 --2- 172.21.15.50:0/1854433853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaa4270 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb12401dac0 tx=0x7fb124031bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becb694c3db16683 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.548+0000 7fb014ff9640 1 -- 172.21.15.50:0/1854433853 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb124055030 con 0x5637abaa3e90 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.548+0000 7fb014ff9640 1 -- 172.21.15.50:0/1854433853 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12401e040 con 0x5637abaa3e90 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.548+0000 7fb014ff9640 1 -- 172.21.15.50:0/1854433853 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12403f050 con 0x5637abaa3e90 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 -- 172.21.15.50:0/1854433853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 msgr2=0x5637abaa4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 --2- 172.21.15.50:0/1854433853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaa4270 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb12401dac0 tx=0x7fb124031bd0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 -- 172.21.15.50:0/1854433853 shutdown_connections 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 --2- 172.21.15.50:0/1854433853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaa4270 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 -- 172.21.15.50:0/1854433853 >> 172.21.15.50:0/1854433853 conn(0x5637abaa0160 msgr2=0x5637aba9e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 -- 172.21.15.50:0/1854433853 shutdown_connections 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 -- 172.21.15.50:0/1854433853 wait complete. 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 Processor -- start 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 -- start start 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb135e12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5637abaa4f50 con 0x5637abaa3e90 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb1313ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaab1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58378/0 (socket says 172.21.15.50:58378) 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.549+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 learned_addr learned my addr 172.21.15.50:0/3069588793 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.550+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637abaab730 con 0x5637abaa3e90 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.550+0000 7fb1313ee640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaab1f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb124031ca0 tx=0x7fb12401e230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.550+0000 7fb002ffd640 1 -- 172.21.15.50:0/3069588793 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb12406d070 con 0x5637abaa3e90 2024-05-07T13:57:55.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.550+0000 7fb002ffd640 1 -- 172.21.15.50:0/3069588793 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb124031480 con 0x5637abaa3e90 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.550+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637abaab730 con 0x5637abaa3e90 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.550+0000 7fb002ffd640 1 -- 172.21.15.50:0/3069588793 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb124044130 con 0x5637abaa3e90 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.550+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637abaab730 con 0x5637abaa3e90 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.551+0000 7fb002ffd640 1 -- 172.21.15.50:0/3069588793 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb124070070 con 0x5637abaa3e90 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.551+0000 7fb002ffd640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7faffc036900 0x7faffc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.551+0000 7fb002ffd640 1 -- 172.21.15.50:0/3069588793 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb124059070 con 0x5637abaa3e90 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.551+0000 7fb130bed640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7faffc036900 0x7faffc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb135e12800 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637abab6980 0x5637abab8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637abab9590 con 0x5637abab6980 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb130bed640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7faffc036900 0x7faffc038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb128052fd0 tx=0x7fb12804f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb131bef640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637abab6980 0x5637abab8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb131bef640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637abab6980 0x5637abab8e40 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb135e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb135e12800 20 realm 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.552+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637abab99a0 con 0x5637abab6980 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637ababa270 con 0x5637abab6980 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637ababa610 con 0x5637abab6980 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637ababb100 0x5637ababd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637ababdc50 con 0x5637ababb100 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.553+0000 7fb1313ee640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637ababb100 0x5637ababd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.554+0000 7fb1313ee640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637ababb100 0x5637ababd4f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.554+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.554+0000 7fb135e12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.554+0000 7fb135e12800 20 searching for the correct realm 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.554+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5637ababf630 con 0x5637ababb100 2024-05-07T13:57:55.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.554+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.554+0000 7fb1313ee640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb124072060 0x7fb1240487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.554+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5637ababf630 con 0x7fb124072060 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.554+0000 7fb130bed640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb124072060 0x7fb1240487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.555+0000 7fb130bed640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb124072060 0x7fb1240487c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.555+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.555+0000 7fb130bed640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb128074040 0x7fb128081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.555+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5637ababf630 con 0x7fb128074040 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.555+0000 7fb131bef640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb128074040 0x7fb128081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.556+0000 7fb131bef640 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb128074040 0x7fb128081410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.556+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.556+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5637ababa610 con 0x5637abab6980 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.556+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.556+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5637ababa610 con 0x5637abab6980 2024-05-07T13:57:55.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.556+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.556+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5637ababa610 con 0x5637abab6980 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.557+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.557+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5637ababa610 con 0x7fb128074040 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.557+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.557+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5637ababa610 con 0x7fb124072060 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.557+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.557+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5637ababa610 con 0x7fb124072060 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.557+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.557+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637abab6980 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.558+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.558+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb128074040 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.558+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.558+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637abab6980 2024-05-07T13:57:55.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.558+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.558+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb124072060 2024-05-07T13:57:55.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.558+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.558+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637ababb100 2024-05-07T13:57:55.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.559+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.559+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637ababb100 2024-05-07T13:57:55.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.559+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.559+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb128074040 2024-05-07T13:57:55.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.559+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.559+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637ababb100 2024-05-07T13:57:55.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.559+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.559+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637ababb100 2024-05-07T13:57:55.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.560+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.560+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637abab6980 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.560+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.560+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637abab6980 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.560+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.560+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb128074040 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.561+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.561+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637ababb100 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.561+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.561+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb124072060 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.561+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.561+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637abab6980 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.561+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.561+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb128074040 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.562+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.562+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637ababb100 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.562+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.562+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb128074040 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.562+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.562+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb124072060 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.563+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.563+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637ababb100 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.563+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.563+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb124072060 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.563+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.563+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x5637abab6980 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.563+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.563+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb12808e040 con 0x7fb124072060 2024-05-07T13:57:55.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637ababe600 con 0x5637abab6980 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637ababe9f0 con 0x5637abab6980 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.564+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637ababe9f0 con 0x7fb128074040 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 zone default found 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 4 Realm: () 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 zonegroup default 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637ababee10 con 0x7fb128074040 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637ababee10 con 0x5637ababb100 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637abac14e0 con 0x5637ababb100 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.565+0000 7fb135e12800 20 started sync module instance, tier type = 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.566+0000 7fb135e12800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.566+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac0980 con 0x7fb124072060 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.567+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.567+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94797103369584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac1d30 con 0x7fb124072060 2024-05-07T13:57:55.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.567+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac2580 con 0x5637abab6980 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.568+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94797103369584] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.568+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.568+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94797103372416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac2640 con 0x5637abab6980 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.568+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac3160 con 0x5637ababb100 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.569+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.569+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94797103377456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac3a00 con 0x5637ababb100 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.569+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac44d0 con 0x7fb124072060 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.569+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94797103372416] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.570+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94797103377456] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.570+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.570+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94797103382464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac48c0 con 0x7fb124072060 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.570+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac5150 con 0x5637abab6980 2024-05-07T13:57:55.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.571+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.571+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94797103384768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac4d20 con 0x5637abab6980 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.571+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac6140 con 0x7fb128074040 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.571+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94797103382464] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.572+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94797103384768] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.572+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.572+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94797103389712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac6100 con 0x7fb128074040 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.572+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac69e0 con 0x7fb128074040 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.573+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94797103389712] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.573+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.574+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94797103374544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac6100 con 0x7fb128074040 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.574+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac6fb0 con 0x7fb128074040 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94797103374544] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94797103391968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac6fb0 con 0x7fb128074040 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb135e12800 20 add_watcher() i=0 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb135e12800 20 add_watcher() i=1 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb135e12800 20 add_watcher() i=2 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb135e12800 20 add_watcher() i=3 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb135e12800 20 add_watcher() i=4 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb135e12800 20 add_watcher() i=5 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.575+0000 7fb135e12800 20 add_watcher() i=6 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.576+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94797103391968] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.576+0000 7fb135e12800 20 add_watcher() i=7 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.576+0000 7fb135e12800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.576+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637abaca330 con 0x5637abab6980 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.576+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.576+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94797103393904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac7540 con 0x5637abab6980 2024-05-07T13:57:55.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.577+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94797103393904] v29'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.577+0000 7fafe7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:55.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.577+0000 7fb135e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:55.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.577+0000 7fb135e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:55.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.577+0000 7fb135e12800 5 note: GC not initialized 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.577+0000 7fafe6fe5640 20 reqs_thread_entry: start 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.577+0000 7fb135e12800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.578+0000 7fb135e12800 20 Filter name: none 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.578+0000 7fafe4fe1640 20 reqs_thread_entry: start 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.578+0000 7fb135e12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.578+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5637abafd3c0 con 0x5637abab6980 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.578+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.578+0000 7fb135e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:could not fetch user info: no user info saved 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.579+0000 7fafe7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.579+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94797103393904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abafd380 con 0x5637abab6980 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.580+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94797103393904] v29'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.580+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94797103369584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abafd380 con 0x7fb124072060 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.581+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94797103369584] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.581+0000 7fb135e12800 20 remove_watcher() i=0 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.581+0000 7fb135e12800 2 removed watcher, disabling cache 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.581+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94797103372416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abafd380 con 0x5637abab6980 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.582+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94797103372416] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.582+0000 7fb135e12800 20 remove_watcher() i=1 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.582+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94797103377456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abafd380 con 0x5637ababb100 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.583+0000 7fb1313ee640 1 -- 172.21.15.50:0/3069588793 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94797103377456] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12406f030 con 0x5637ababb100 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.583+0000 7fb135e12800 20 remove_watcher() i=2 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.583+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94797103382464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac0d70 con 0x7fb124072060 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.584+0000 7fb130bed640 1 -- 172.21.15.50:0/3069588793 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94797103382464] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12807f070 con 0x7fb124072060 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.584+0000 7fb135e12800 20 remove_watcher() i=3 2024-05-07T13:57:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.584+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94797103384768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac2c30 con 0x5637abab6980 2024-05-07T13:57:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.585+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94797103384768] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x5637abab6980 2024-05-07T13:57:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.586+0000 7fb135e12800 20 remove_watcher() i=4 2024-05-07T13:57:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.586+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94797103389712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac3fc0 con 0x7fb128074040 2024-05-07T13:57:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.587+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94797103389712] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.587+0000 7fb135e12800 20 remove_watcher() i=5 2024-05-07T13:57:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.587+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94797103374544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac0d70 con 0x7fb128074040 2024-05-07T13:57:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.588+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94797103374544] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.588+0000 7fb135e12800 20 remove_watcher() i=6 2024-05-07T13:57:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.588+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94797103391968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5637abac2c30 con 0x7fb128074040 2024-05-07T13:57:55.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94797103391968] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb12c00a4a0 con 0x7fb128074040 2024-05-07T13:57:55.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 20 remove_watcher() i=7 2024-05-07T13:57:55.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb128074040 msgr2=0x7fb128081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb128074040 0x7fb128081410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637abab6980 msgr2=0x5637abab8e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637abab6980 0x5637abab8e40 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb124072060 msgr2=0x7fb1240487c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb124072060 0x7fb1240487c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637ababb100 msgr2=0x5637ababd4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637ababb100 0x5637ababd4f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7faffc036900 msgr2=0x7faffc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7faffc036900 0x7faffc038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb128052fd0 tx=0x7fb12804f000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 msgr2=0x5637abaab1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 --2- 172.21.15.50:0/3069588793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637abaa3e90 0x5637abaab1f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb124031ca0 tx=0x7fb12401e230 comp rx=0 tx=0).stop 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 reap_dead start 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb131bef640 1 -- 172.21.15.50:0/3069588793 reap_dead start 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 shutdown_connections 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 >> 172.21.15.50:0/3069588793 conn(0x5637abaa0160 msgr2=0x5637aba9d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 shutdown_connections 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.589+0000 7fb135e12800 1 -- 172.21.15.50:0/3069588793 wait complete. 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/70182173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb00c036950 msgr2=0x7fb00c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 --2- 172.21.15.50:0/70182173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb00c036950 0x7fb00c038e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5637aba7c9a0 tx=0x7fb128005ac0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/70182173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637aba96ce0 msgr2=0x5637aba97100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 --2- 172.21.15.50:0/70182173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637aba96ce0 0x5637aba97100 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb1240178f0 tx=0x7fb124017d30 comp rx=0 tx=0).stop 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/70182173 shutdown_connections 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 --2- 172.21.15.50:0/70182173 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb00c036950 0x7fb00c038e10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 --2- 172.21.15.50:0/70182173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637aba96ce0 0x5637aba97100 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/70182173 >> 172.21.15.50:0/70182173 conn(0x5637aba8ad80 msgr2=0x5637aba8b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/70182173 shutdown_connections 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/70182173 wait complete. 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5637aba85cd0 msgr2=0x5637aba88120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5637aba85cd0 0x5637aba88120 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637ab9833e0 msgr2=0x5637aba7f4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5637ab9833e0 0x5637aba7f4b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637aba81d90 msgr2=0x5637aba84180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5637aba81d90 0x5637aba84180 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb018036900 msgr2=0x7fb018038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb018036900 0x7fb018038dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb128054000 tx=0x7fb12804e000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 msgr2=0x5637aba78270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 --2- 172.21.15.50:0/3062863698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637ab8f2010 0x5637aba78270 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb124001ed0 tx=0x7fb124000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb131bef640 1 -- 172.21.15.50:0/3062863698 reap_dead start 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 shutdown_connections 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 >> 172.21.15.50:0/3062863698 conn(0x5637ab9795b0 msgr2=0x5637aba6a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 shutdown_connections 2024-05-07T13:57:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.590+0000 7fb135e12800 1 -- 172.21.15.50:0/3062863698 wait complete. 2024-05-07T13:57:55.588 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-07T13:57:55.589 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-05-07T13:57:55.589 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-05-07T13:57:55.589 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-05-07T13:57:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:55.633 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.647+0000 7f746252b800 1 Processor -- start 2024-05-07T13:57:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.647+0000 7f746252b800 1 -- start start 2024-05-07T13:57:55.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.647+0000 7f746252b800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a3d711b5b0 0x55a3d711d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.647+0000 7f746252b800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a3d711df70 con 0x55a3d7117210 2024-05-07T13:57:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.647+0000 7f746252b800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55a3d6fa8050 con 0x55a3d711b5b0 2024-05-07T13:57:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.647+0000 7f7455951640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55a3d711b5b0 0x55a3d711d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.647+0000 7f745e152640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55a3d7117210 0x55a3d7117630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56774/0 (socket says 172.21.15.50:56774) 2024-05-07T13:57:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.647+0000 7f745e152640 1 -- 172.21.15.50:0/4074756335 learned_addr learned my addr 172.21.15.50:0/4074756335 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.648+0000 7f7455951640 1 -- 172.21.15.50:0/4074756335 >> v1:172.21.15.22:6789/0 conn(0x55a3d7117210 legacy=0x55a3d7117630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.648+0000 7f7455951640 1 -- 172.21.15.50:0/4074756335 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d711f1a0 con 0x55a3d711b5b0 2024-05-07T13:57:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f7455951640 1 --2- 172.21.15.50:0/4074756335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d711b5b0 0x55a3d711d9a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f744800a470 tx=0x7f744801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd5c23b762ff030 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f745d951640 1 -- 172.21.15.50:0/4074756335 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7448057070 con 0x55a3d711b5b0 2024-05-07T13:57:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f745d951640 1 -- 172.21.15.50:0/4074756335 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7448052570 con 0x55a3d711b5b0 2024-05-07T13:57:55.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f745d951640 1 -- 172.21.15.50:0/4074756335 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7448052870 con 0x55a3d711b5b0 2024-05-07T13:57:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f746252b800 1 -- 172.21.15.50:0/4074756335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d711b5b0 msgr2=0x55a3d711d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f746252b800 1 --2- 172.21.15.50:0/4074756335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d711b5b0 0x55a3d711d9a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f744800a470 tx=0x7f744801ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f746252b800 1 -- 172.21.15.50:0/4074756335 shutdown_connections 2024-05-07T13:57:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f746252b800 1 --2- 172.21.15.50:0/4074756335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d711b5b0 0x55a3d711d9a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f746252b800 1 -- 172.21.15.50:0/4074756335 >> 172.21.15.50:0/4074756335 conn(0x55a3d7112870 msgr2=0x55a3d7114c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f746252b800 1 -- 172.21.15.50:0/4074756335 shutdown_connections 2024-05-07T13:57:55.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.650+0000 7f746252b800 1 -- 172.21.15.50:0/4074756335 wait complete. 2024-05-07T13:57:55.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.665+0000 7f746252b800 1 Processor -- start 2024-05-07T13:57:55.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.665+0000 7f746252b800 1 -- start start 2024-05-07T13:57:55.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.665+0000 7f746252b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d7208780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.665+0000 7f746252b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a3d70621d0 con 0x55a3d7117210 2024-05-07T13:57:55.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.666+0000 7f745e152640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d7208780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.666+0000 7f745e152640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d7208780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58386/0 (socket says 172.21.15.50:58386) 2024-05-07T13:57:55.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.666+0000 7f745e152640 1 -- 172.21.15.50:0/2233056396 learned_addr learned my addr 172.21.15.50:0/2233056396 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.666+0000 7f745e152640 1 -- 172.21.15.50:0/2233056396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d7208d50 con 0x55a3d7117210 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.666+0000 7f745e152640 1 --2- 172.21.15.50:0/2233056396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d7208780 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7450001e10 tx=0x7f745000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d2c10155b30609 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.666+0000 7f734c608640 1 -- 172.21.15.50:0/2233056396 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450012020 con 0x55a3d7117210 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.666+0000 7f734c608640 1 -- 172.21.15.50:0/2233056396 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745000e5a0 con 0x55a3d7117210 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.666+0000 7f734c608640 1 -- 172.21.15.50:0/2233056396 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745000e8e0 con 0x55a3d7117210 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.667+0000 7f746252b800 1 -- 172.21.15.50:0/2233056396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 msgr2=0x55a3d7208780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.667+0000 7f746252b800 1 --2- 172.21.15.50:0/2233056396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d7208780 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7450001e10 tx=0x7f745000b780 comp rx=0 tx=0).stop 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.667+0000 7f746252b800 1 -- 172.21.15.50:0/2233056396 shutdown_connections 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.667+0000 7f746252b800 1 --2- 172.21.15.50:0/2233056396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d7208780 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.667+0000 7f746252b800 1 -- 172.21.15.50:0/2233056396 >> 172.21.15.50:0/2233056396 conn(0x55a3d7112870 msgr2=0x55a3d72040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.667+0000 7f746252b800 1 -- 172.21.15.50:0/2233056396 shutdown_connections 2024-05-07T13:57:55.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.667+0000 7f746252b800 1 -- 172.21.15.50:0/2233056396 wait complete. 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.667+0000 7f746252b800 1 Processor -- start 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.667+0000 7f746252b800 1 -- start start 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.668+0000 7f746252b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d72102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.668+0000 7f746252b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a3d711e440 con 0x55a3d7117210 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.668+0000 7f745e152640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d72102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.668+0000 7f745e152640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d72102f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58394/0 (socket says 172.21.15.50:58394) 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.668+0000 7f745e152640 1 -- 172.21.15.50:0/1039797105 learned_addr learned my addr 172.21.15.50:0/1039797105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.668+0000 7f745e152640 1 -- 172.21.15.50:0/1039797105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d7210830 con 0x55a3d7117210 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.668+0000 7f745e152640 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d72102f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f745000b7c0 tx=0x7f7450000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.668+0000 7f734ae05640 1 -- 172.21.15.50:0/1039797105 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450012030 con 0x55a3d7117210 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.669+0000 7f734ae05640 1 -- 172.21.15.50:0/1039797105 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7450001470 con 0x55a3d7117210 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.669+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3d7210ac0 con 0x55a3d7117210 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.669+0000 7f734ae05640 1 -- 172.21.15.50:0/1039797105 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745001a8d0 con 0x55a3d7117210 2024-05-07T13:57:55.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.669+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3d7213770 con 0x55a3d7117210 2024-05-07T13:57:55.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.669+0000 7f746252b800 1 Processor -- start 2024-05-07T13:57:55.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.669+0000 7f746252b800 1 -- start start 2024-05-07T13:57:55.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.669+0000 7f746252b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d721dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.669+0000 7f746252b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a3d7008cf0 con 0x55a3d721dba0 2024-05-07T13:57:55.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.669+0000 7f734ae05640 1 -- 172.21.15.50:0/1039797105 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7450015020 con 0x55a3d7117210 2024-05-07T13:57:55.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f745e953640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d721dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f745e953640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d721dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58404/0 (socket says 172.21.15.50:58404) 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f745e953640 1 -- 172.21.15.50:0/4262614543 learned_addr learned my addr 172.21.15.50:0/4262614543 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f734ae05640 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7344036900 0x7f7344038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f734ae05640 1 -- 172.21.15.50:0/1039797105 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7450020030 con 0x55a3d7117210 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f745e152640 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7344036900 0x7f7344038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f745e953640 1 -- 172.21.15.50:0/4262614543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d721e500 con 0x55a3d721dba0 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f745e953640 1 --2- 172.21.15.50:0/4262614543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d721dfc0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f745800a430 tx=0x7f745800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c308e4d9edb7b87 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f7348e01640 1 -- 172.21.15.50:0/4262614543 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7458015070 con 0x55a3d721dba0 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f745e152640 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7344036900 0x7f7344038dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f745000c010 tx=0x7f7450016e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f7348e01640 1 -- 172.21.15.50:0/4262614543 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7458001670 con 0x55a3d721dba0 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.670+0000 7f7348e01640 1 -- 172.21.15.50:0/4262614543 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7458001990 con 0x55a3d721dba0 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 -- 172.21.15.50:0/4262614543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 msgr2=0x55a3d721dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 --2- 172.21.15.50:0/4262614543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d721dfc0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f745800a430 tx=0x7f745800a8f0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 -- 172.21.15.50:0/4262614543 shutdown_connections 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 --2- 172.21.15.50:0/4262614543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d721dfc0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 -- 172.21.15.50:0/4262614543 >> 172.21.15.50:0/4262614543 conn(0x55a3d711b5b0 msgr2=0x55a3d721a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 -- 172.21.15.50:0/4262614543 shutdown_connections 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 -- 172.21.15.50:0/4262614543 wait complete. 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 Processor -- start 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 -- start start 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d7224fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f746252b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a3d721ee90 con 0x55a3d721dba0 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f745e953640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d7224fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f745e953640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d7224fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58408/0 (socket says 172.21.15.50:58408) 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.671+0000 7f745e953640 1 -- 172.21.15.50:0/4010451627 learned_addr learned my addr 172.21.15.50:0/4010451627 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.672+0000 7f745e953640 1 -- 172.21.15.50:0/4010451627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d7225510 con 0x55a3d721dba0 2024-05-07T13:57:55.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.672+0000 7f745e953640 1 --2- 172.21.15.50:0/4010451627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d7224fd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7458013040 tx=0x7f7458003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.672+0000 7f7342ffd640 1 -- 172.21.15.50:0/4010451627 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7458020020 con 0x55a3d721dba0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.672+0000 7f7342ffd640 1 -- 172.21.15.50:0/4010451627 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74580108e0 con 0x55a3d721dba0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.672+0000 7f7342ffd640 1 -- 172.21.15.50:0/4010451627 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7458015040 con 0x55a3d721dba0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.672+0000 7f746252b800 1 -- 172.21.15.50:0/4010451627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3d72257a0 con 0x55a3d721dba0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.672+0000 7f746252b800 1 -- 172.21.15.50:0/4010451627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3d7228450 con 0x55a3d721dba0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.673+0000 7f7342ffd640 1 -- 172.21.15.50:0/4010451627 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7458023020 con 0x55a3d721dba0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.673+0000 7f7342ffd640 1 --2- 172.21.15.50:0/4010451627 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7338036900 0x7f7338038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.673+0000 7f7342ffd640 1 -- 172.21.15.50:0/4010451627 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f745804c0e0 con 0x55a3d721dba0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.673+0000 7f7455951640 1 --2- 172.21.15.50:0/4010451627 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7338036900 0x7f7338038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.674+0000 7f7455951640 1 --2- 172.21.15.50:0/4010451627 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7338036900 0x7f7338038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7448054000 tx=0x7f744804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.674+0000 7f746252b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.674+0000 7f746252b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.674+0000 7f746252b800 1 Processor -- start 2024-05-07T13:57:55.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.674+0000 7f746252b800 1 -- start start 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.674+0000 7f746252b800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d723f6f0 0x55a3d723fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.674+0000 7f746252b800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a3d72090d0 con 0x55a3d723f6f0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f745e152640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d723f6f0 0x55a3d723fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f745e152640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d723f6f0 0x55a3d723fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58420/0 (socket says 172.21.15.50:58420) 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f745e152640 1 -- 172.21.15.50:0/3077022777 learned_addr learned my addr 172.21.15.50:0/3077022777 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f745e152640 1 -- 172.21.15.50:0/3077022777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d7240050 con 0x55a3d723f6f0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f745e152640 1 --2- 172.21.15.50:0/3077022777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d723f6f0 0x55a3d723fb10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7450000fd0 tx=0x7f745004c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f7322fe5640 1 -- 172.21.15.50:0/3077022777 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745004a070 con 0x55a3d723f6f0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f7322fe5640 1 -- 172.21.15.50:0/3077022777 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7450017e30 con 0x55a3d723f6f0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f746252b800 1 -- 172.21.15.50:0/3077022777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3d7240ac0 con 0x55a3d723f6f0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f7322fe5640 1 -- 172.21.15.50:0/3077022777 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7450024820 con 0x55a3d723f6f0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.675+0000 7f746252b800 1 -- 172.21.15.50:0/3077022777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3d7240fc0 con 0x55a3d723f6f0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.676+0000 7f7322fe5640 1 -- 172.21.15.50:0/3077022777 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7450018430 con 0x55a3d723f6f0 2024-05-07T13:57:55.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.676+0000 7f7322fe5640 1 --2- 172.21.15.50:0/3077022777 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f72a00368b0 0x7f72a0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.676+0000 7f7322fe5640 1 -- 172.21.15.50:0/3077022777 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7450035040 con 0x55a3d723f6f0 2024-05-07T13:57:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.676+0000 7f7455951640 1 --2- 172.21.15.50:0/3077022777 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f72a00368b0 0x7f72a0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.677+0000 7f7320fe1640 20 reqs_thread_entry: start 2024-05-07T13:57:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.677+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a3d724d0f0 0x55a3d724f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.677+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a3d724fc30 con 0x55a3d724d0f0 2024-05-07T13:57:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.677+0000 7f7455951640 1 --2- 172.21.15.50:0/3077022777 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f72a00368b0 0x7f72a0038d70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f744801ced0 tx=0x7f7448005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.677+0000 7f745e953640 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a3d724d0f0 0x55a3d724f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.677+0000 7f745e953640 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a3d724d0f0 0x55a3d724f560 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.678+0000 7f745e953640 1 -- 172.21.15.50:0/1039797105 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f745800e070 con 0x55a3d724d0f0 2024-05-07T13:57:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.678+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a3d7251aa0 0x55a3d7253e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.678+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:2 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a3d7254580 con 0x55a3d7251aa0 2024-05-07T13:57:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.678+0000 7f745e152640 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a3d7251aa0 0x55a3d7253e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.678+0000 7f745e152640 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a3d7251aa0 0x55a3d7253e90 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.678+0000 7f745e152640 1 -- 172.21.15.50:0/1039797105 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(2 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7450043070 con 0x55a3d7251aa0 2024-05-07T13:57:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 -- 172.21.15.50:0/4010451627 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7338036900 msgr2=0x7f7338038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 --2- 172.21.15.50:0/4010451627 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7338036900 0x7f7338038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7448054000 tx=0x7f744804e000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 -- 172.21.15.50:0/4010451627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 msgr2=0x55a3d7224fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 --2- 172.21.15.50:0/4010451627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d7224fd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7458013040 tx=0x7f7458003370 comp rx=0 tx=0).stop 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 -- 172.21.15.50:0/4010451627 shutdown_connections 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 --2- 172.21.15.50:0/4010451627 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7338036900 0x7f7338038dc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 --2- 172.21.15.50:0/4010451627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d721dba0 0x55a3d7224fd0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 -- 172.21.15.50:0/4010451627 >> 172.21.15.50:0/4010451627 conn(0x55a3d711b5b0 msgr2=0x55a3d7217c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 -- 172.21.15.50:0/4010451627 shutdown_connections 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.679+0000 7f746252b800 1 -- 172.21.15.50:0/4010451627 wait complete. 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/3077022777 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f72a00368b0 msgr2=0x7f72a0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/3077022777 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f72a00368b0 0x7f72a0038d70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f744801ced0 tx=0x7f7448005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/3077022777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d723f6f0 msgr2=0x55a3d723fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/3077022777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d723f6f0 0x55a3d723fb10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7450000fd0 tx=0x7f745004c320 comp rx=0 tx=0).stop 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/3077022777 shutdown_connections 2024-05-07T13:57:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/3077022777 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f72a00368b0 0x7f72a0038d70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/3077022777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d723f6f0 0x55a3d723fb10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/3077022777 >> 172.21.15.50:0/3077022777 conn(0x55a3d7234180 msgr2=0x55a3d7234ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/3077022777 shutdown_connections 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/3077022777 wait complete. 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a3d724d0f0 msgr2=0x55a3d724f560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a3d724d0f0 0x55a3d724f560 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a3d7251aa0 msgr2=0x55a3d7253e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a3d7251aa0 0x55a3d7253e90 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7344036900 msgr2=0x7f7344038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7344036900 0x7f7344038dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f745000c010 tx=0x7f7450016e90 comp rx=0 tx=0).stop 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 msgr2=0x55a3d72102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d72102f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f745000b7c0 tx=0x7f7450000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 shutdown_connections 2024-05-07T13:57:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55a3d7251aa0 0x55a3d7253e90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55a3d724d0f0 0x55a3d724f560 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7344036900 0x7f7344038dc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 --2- 172.21.15.50:0/1039797105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a3d7117210 0x55a3d72102f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 >> 172.21.15.50:0/1039797105 conn(0x55a3d7112870 msgr2=0x55a3d72028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 shutdown_connections 2024-05-07T13:57:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.680+0000 7f746252b800 1 -- 172.21.15.50:0/1039797105 wait complete. 2024-05-07T13:57:55.677 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-07T13:57:55.678 DEBUG:tasks.util.rgw: json result: {'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-07T13:57:55.678 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-05-07T13:57:55.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-05-07T13:57:55.678 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-05-07T13:57:55.721 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:55.722 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:55.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.735+0000 7fdb01919800 1 Processor -- start 2024-05-07T13:57:55.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.735+0000 7fdb01919800 1 -- start start 2024-05-07T13:57:55.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.735+0000 7fdb01919800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556ade4a8470 0x556ade4aa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.735+0000 7fdb01919800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ade4aae30 con 0x556ade4a44c0 2024-05-07T13:57:55.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.735+0000 7fdb01919800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x556ade336050 con 0x556ade4a8470 2024-05-07T13:57:55.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.736+0000 7fdafec17640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556ade4a8470 0x556ade4aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.736+0000 7fdafec17640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556ade4a8470 0x556ade4aa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58436/0 (socket says 172.21.15.50:58436) 2024-05-07T13:57:55.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.736+0000 7fdafec17640 1 -- 172.21.15.50:0/629663053 learned_addr learned my addr 172.21.15.50:0/629663053 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.736+0000 7fdafec17640 1 -- 172.21.15.50:0/629663053 >> v1:172.21.15.22:6789/0 conn(0x556ade4a44c0 legacy=0x556ade4a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.736+0000 7fdafe416640 1 -- 172.21.15.50:0/629663053 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225638178 0 0) 0x556ade4aae30 con 0x556ade4a44c0 2024-05-07T13:57:55.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.736+0000 7fdafec17640 1 -- 172.21.15.50:0/629663053 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ade4ac010 con 0x556ade4a8470 2024-05-07T13:57:55.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.738+0000 7fdafec17640 1 --2- 172.21.15.50:0/629663053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a8470 0x556ade4aa860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400a520 tx=0x7fdaf401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c75ee893330fae server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.738+0000 7fdafe416640 1 -- 172.21.15.50:0/629663053 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf4057070 con 0x556ade4a8470 2024-05-07T13:57:55.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.738+0000 7fdafe416640 1 -- 172.21.15.50:0/629663053 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf4052570 con 0x556ade4a8470 2024-05-07T13:57:55.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.738+0000 7fdafe416640 1 -- 172.21.15.50:0/629663053 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf404ae60 con 0x556ade4a8470 2024-05-07T13:57:55.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.739+0000 7fdb01919800 1 -- 172.21.15.50:0/629663053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a8470 msgr2=0x556ade4aa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.739+0000 7fdb01919800 1 --2- 172.21.15.50:0/629663053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a8470 0x556ade4aa860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400a520 tx=0x7fdaf401d010 comp rx=0 tx=0).stop 2024-05-07T13:57:55.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.739+0000 7fdb01919800 1 -- 172.21.15.50:0/629663053 shutdown_connections 2024-05-07T13:57:55.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.739+0000 7fdb01919800 1 --2- 172.21.15.50:0/629663053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a8470 0x556ade4aa860 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.739+0000 7fdb01919800 1 -- 172.21.15.50:0/629663053 >> 172.21.15.50:0/629663053 conn(0x556ade49ed20 msgr2=0x556ade4a1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.739+0000 7fdb01919800 1 -- 172.21.15.50:0/629663053 shutdown_connections 2024-05-07T13:57:55.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.739+0000 7fdb01919800 1 -- 172.21.15.50:0/629663053 wait complete. 2024-05-07T13:57:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.754+0000 7fdb01919800 1 Processor -- start 2024-05-07T13:57:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.754+0000 7fdb01919800 1 -- start start 2024-05-07T13:57:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.754+0000 7fdb01919800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade4afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.754+0000 7fdb01919800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556ade3f01c0 con 0x556ade4a44c0 2024-05-07T13:57:55.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.754+0000 7fdaff418640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade4afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.755+0000 7fdaff418640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade4afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58446/0 (socket says 172.21.15.50:58446) 2024-05-07T13:57:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.755+0000 7fdaff418640 1 -- 172.21.15.50:0/1556313057 learned_addr learned my addr 172.21.15.50:0/1556313057 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.755+0000 7fdaff418640 1 -- 172.21.15.50:0/1556313057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ade4ae3e0 con 0x556ade4a44c0 2024-05-07T13:57:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.755+0000 7fdaff418640 1 --2- 172.21.15.50:0/1556313057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade4afe20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0001e00 tx=0x7fdaf000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c013dd58b0059a98 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.755+0000 7fd9ed60a640 1 -- 172.21.15.50:0/1556313057 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0016070 con 0x556ade4a44c0 2024-05-07T13:57:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.755+0000 7fd9ed60a640 1 -- 172.21.15.50:0/1556313057 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf000d4b0 con 0x556ade4a44c0 2024-05-07T13:57:55.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.755+0000 7fd9ed60a640 1 -- 172.21.15.50:0/1556313057 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf000d810 con 0x556ade4a44c0 2024-05-07T13:57:55.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 -- 172.21.15.50:0/1556313057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 msgr2=0x556ade4afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 --2- 172.21.15.50:0/1556313057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade4afe20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0001e00 tx=0x7fdaf000b650 comp rx=0 tx=0).stop 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 -- 172.21.15.50:0/1556313057 shutdown_connections 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 --2- 172.21.15.50:0/1556313057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade4afe20 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 -- 172.21.15.50:0/1556313057 >> 172.21.15.50:0/1556313057 conn(0x556ade49ed20 msgr2=0x556ade591d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 -- 172.21.15.50:0/1556313057 shutdown_connections 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 -- 172.21.15.50:0/1556313057 wait complete. 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 Processor -- start 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 -- start start 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade5a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.756+0000 7fdb01919800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556ade4ab300 con 0x556ade4a44c0 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fdaff418640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade5a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fdaff418640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade5a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58448/0 (socket says 172.21.15.50:58448) 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 learned_addr learned my addr 172.21.15.50:0/724110409 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ade5a0770 con 0x556ade4a44c0 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fdaff418640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade5a0230 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000bba0 tx=0x7fdaf0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fd9ebe07640 1 -- 172.21.15.50:0/724110409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0016070 con 0x556ade4a44c0 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fd9ebe07640 1 -- 172.21.15.50:0/724110409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf0017040 con 0x556ade4a44c0 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ade5a0a00 con 0x556ade4a44c0 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fd9ebe07640 1 -- 172.21.15.50:0/724110409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0011930 con 0x556ade4a44c0 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.757+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ade5a36b0 con 0x556ade4a44c0 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fdb01919800 1 Processor -- start 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fdb01919800 1 -- start start 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fd9ebe07640 1 -- 172.21.15.50:0/724110409 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdaf0025020 con 0x556ade4a44c0 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fdb01919800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fdb01919800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556ade396cf0 con 0x556ade5adae0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fdaffc19640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fd9ebe07640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e40368b0 0x7fd9e4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fdaffc19640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5adf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58458/0 (socket says 172.21.15.50:58458) 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fdaffc19640 1 -- 172.21.15.50:0/3705664787 learned_addr learned my addr 172.21.15.50:0/3705664787 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fd9ebe07640 1 -- 172.21.15.50:0/724110409 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fdaf0023020 con 0x556ade4a44c0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.758+0000 7fdaff418640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e40368b0 0x7fd9e4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fdaffc19640 1 -- 172.21.15.50:0/3705664787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ade5ae440 con 0x556ade5adae0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fdaffc19640 1 --2- 172.21.15.50:0/3705664787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5adf00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800a430 tx=0x7fdaf800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6fb74383143b7c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fdaff418640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e40368b0 0x7fd9e4038d70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0001050 tx=0x7fdaf000ee90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fd9e9e03640 1 -- 172.21.15.50:0/3705664787 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf8015070 con 0x556ade5adae0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fd9e9e03640 1 -- 172.21.15.50:0/3705664787 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf8001670 con 0x556ade5adae0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fd9e9e03640 1 -- 172.21.15.50:0/3705664787 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf8001990 con 0x556ade5adae0 2024-05-07T13:57:55.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fdb01919800 1 -- 172.21.15.50:0/3705664787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 msgr2=0x556ade5adf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fdb01919800 1 --2- 172.21.15.50:0/3705664787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5adf00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800a430 tx=0x7fdaf800a8f0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fdb01919800 1 -- 172.21.15.50:0/3705664787 shutdown_connections 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fdb01919800 1 --2- 172.21.15.50:0/3705664787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5adf00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fdb01919800 1 -- 172.21.15.50:0/3705664787 >> 172.21.15.50:0/3705664787 conn(0x556ade4a8470 msgr2=0x556ade5aa580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.759+0000 7fdb01919800 1 -- 172.21.15.50:0/3705664787 shutdown_connections 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.760+0000 7fdb01919800 1 -- 172.21.15.50:0/3705664787 wait complete. 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.760+0000 7fdb01919800 1 Processor -- start 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.760+0000 7fdb01919800 1 -- start start 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.760+0000 7fdb01919800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.760+0000 7fdb01919800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556ade5aedd0 con 0x556ade5adae0 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.760+0000 7fdaffc19640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.760+0000 7fdaffc19640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58472/0 (socket says 172.21.15.50:58472) 2024-05-07T13:57:55.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.760+0000 7fdaffc19640 1 -- 172.21.15.50:0/2755396754 learned_addr learned my addr 172.21.15.50:0/2755396754 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.760+0000 7fdaffc19640 1 -- 172.21.15.50:0/2755396754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ade5b5510 con 0x556ade5adae0 2024-05-07T13:57:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.761+0000 7fdaffc19640 1 --2- 172.21.15.50:0/2755396754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5b4fd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800a930 tx=0x7fdaf8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.761+0000 7fd9dbfff640 1 -- 172.21.15.50:0/2755396754 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf8020020 con 0x556ade5adae0 2024-05-07T13:57:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.761+0000 7fd9dbfff640 1 -- 172.21.15.50:0/2755396754 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf80108b0 con 0x556ade5adae0 2024-05-07T13:57:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.761+0000 7fdb01919800 1 -- 172.21.15.50:0/2755396754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ade5b57a0 con 0x556ade5adae0 2024-05-07T13:57:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.761+0000 7fd9dbfff640 1 -- 172.21.15.50:0/2755396754 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf8015040 con 0x556ade5adae0 2024-05-07T13:57:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.761+0000 7fdb01919800 1 -- 172.21.15.50:0/2755396754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ade5b8450 con 0x556ade5adae0 2024-05-07T13:57:55.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.762+0000 7fd9dbfff640 1 -- 172.21.15.50:0/2755396754 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdaf8023020 con 0x556ade5adae0 2024-05-07T13:57:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.762+0000 7fd9dbfff640 1 --2- 172.21.15.50:0/2755396754 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e0036900 0x7fd9e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.762+0000 7fd9dbfff640 1 -- 172.21.15.50:0/2755396754 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fdaf804c050 con 0x556ade5adae0 2024-05-07T13:57:55.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.762+0000 7fdafec17640 1 --2- 172.21.15.50:0/2755396754 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e0036900 0x7fd9e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.762+0000 7fdb01919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.762+0000 7fdb01919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.762+0000 7fdafec17640 1 --2- 172.21.15.50:0/2755396754 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e0036900 0x7fd9e0038dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4054000 tx=0x7fdaf404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.763+0000 7fdb01919800 1 Processor -- start 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.763+0000 7fdb01919800 1 -- start start 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.763+0000 7fdb01919800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5cf6e0 0x556ade5cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.763+0000 7fdb01919800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556ade4ae760 con 0x556ade5cf6e0 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.763+0000 7fdaff418640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5cf6e0 0x556ade5cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.763+0000 7fdaff418640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5cf6e0 0x556ade5cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58476/0 (socket says 172.21.15.50:58476) 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.763+0000 7fdaff418640 1 -- 172.21.15.50:0/1749131327 learned_addr learned my addr 172.21.15.50:0/1749131327 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.763+0000 7fdaff418640 1 -- 172.21.15.50:0/1749131327 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ade5d0040 con 0x556ade5cf6e0 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.764+0000 7fdaff418640 1 --2- 172.21.15.50:0/1749131327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5cf6e0 0x556ade5cfb00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdaf004a300 tx=0x7fdaf0026740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.764+0000 7fd97ffff640 1 -- 172.21.15.50:0/1749131327 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0044070 con 0x556ade5cf6e0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.764+0000 7fd97ffff640 1 -- 172.21.15.50:0/1749131327 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf0040450 con 0x556ade5cf6e0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.764+0000 7fdb01919800 1 -- 172.21.15.50:0/1749131327 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ade5d0ab0 con 0x556ade5cf6e0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.764+0000 7fd97ffff640 1 -- 172.21.15.50:0/1749131327 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0040730 con 0x556ade5cf6e0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.764+0000 7fdb01919800 1 -- 172.21.15.50:0/1749131327 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ade5d0fb0 con 0x556ade5cf6e0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.765+0000 7fd97ffff640 1 -- 172.21.15.50:0/1749131327 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdaf0047070 con 0x556ade5cf6e0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.765+0000 7fd97ffff640 1 --2- 172.21.15.50:0/1749131327 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd940036900 0x7fd940038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.765+0000 7fd97ffff640 1 -- 172.21.15.50:0/1749131327 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fdaf0054d40 con 0x556ade5cf6e0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.765+0000 7fdafec17640 1 --2- 172.21.15.50:0/1749131327 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd940036900 0x7fd940038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.765+0000 7fd97dffb640 20 reqs_thread_entry: start 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.765+0000 7fdb01919800 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556ade5dd2f0 0x556ade5df720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.765+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ade5dfdd0 con 0x556ade5dd2f0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.765+0000 7fdafec17640 1 --2- 172.21.15.50:0/1749131327 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd940036900 0x7fd940038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4055040 tx=0x7fdaf4005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.765+0000 7fdaffc19640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556ade5dd2f0 0x556ade5df720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.766+0000 7fdaffc19640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556ade5dd2f0 0x556ade5df720 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.766+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.766+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e06b0 con 0x556ade5dd2f0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.766+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.766+0000 7fdb01919800 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556ade5e1fc0 0x556ade5e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.766+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e4bc0 con 0x556ade5e1fc0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.766+0000 7fdaff418640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556ade5e1fc0 0x556ade5e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.767+0000 7fdaff418640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556ade5e1fc0 0x556ade5e4430 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.767+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.767+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ade5f1d00 con 0x556ade5dd2f0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.767+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:NOTICE: set zone's realm_id= 2024-05-07T13:57:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.767+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5e1fc0 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.768+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(5 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.768+0000 7fdaff418640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdaf0049070 0x7fdaf00408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.768+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf0049070 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.768+0000 7fdafec17640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdaf0049070 0x7fdaf00408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.768+0000 7fdafec17640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdaf0049070 0x7fdaf00408d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.768+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf4066030 con 0x7fdaf0049070 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.769+0000 7fdafec17640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdaf406a040 0x7fdaf405d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.769+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf406a040 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.769+0000 7fdaffc19640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdaf406a040 0x7fdaf405d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.769+0000 7fdaffc19640 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdaf406a040 0x7fdaf405d440 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.769+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x7fdaf406a040 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.769+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5dd2f0 2024-05-07T13:57:55.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.770+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.770+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5dd2f0 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.770+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.770+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5dd2f0 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.770+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.770+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf406a040 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.770+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdaf800e070 con 0x7fdaf406a040 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.770+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf0049070 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.771+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf4066030 con 0x7fdaf0049070 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.771+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf0049070 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.771+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf4066030 con 0x7fdaf0049070 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.771+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5dd2f0 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.771+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.771+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf406a040 2024-05-07T13:57:55.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.771+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x7fdaf406a040 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.771+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5dd2f0 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.772+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.772+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf0049070 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.772+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(17 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdaf4066030 con 0x7fdaf0049070 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.772+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5e1fc0 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.772+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.772+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5e1fc0 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.772+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.772+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf406a040 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.773+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x7fdaf406a040 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.773+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5e1fc0 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.773+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.773+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5e1fc0 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.773+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.773+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5dd2f0 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.773+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.773+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5dd2f0 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.774+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.774+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf406a040 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.774+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(25 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x7fdaf406a040 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.774+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5e1fc0 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.774+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.774+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf0049070 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.774+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf4066030 con 0x7fdaf0049070 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.774+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5dd2f0 2024-05-07T13:57:55.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.775+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.775+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf406a040 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.775+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x7fdaf406a040 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.775+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5e1fc0 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.775+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.775+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf406a040 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.775+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf800e070 con 0x7fdaf406a040 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.775+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf0049070 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.776+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf4066030 con 0x7fdaf0049070 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.776+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5e1fc0 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.776+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.776+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf0049070 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.776+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf4066030 con 0x7fdaf0049070 2024-05-07T13:57:55.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.776+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x556ade5dd2f0 2024-05-07T13:57:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.777+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(35 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.777+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e90c0 con 0x7fdaf0049070 2024-05-07T13:57:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.777+0000 7fdafec17640 1 -- 172.21.15.50:0/724110409 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(36 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf4066030 con 0x7fdaf0049070 2024-05-07T13:57:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.777+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ade5ebb70 con 0x556ade5dd2f0 2024-05-07T13:57:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.777+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.777+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:38 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556ade5efbd0 con 0x556ade5e1fc0 2024-05-07T13:57:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.777+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(38 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.777+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:39 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ade5e12d0 con 0x556ade5e1fc0 2024-05-07T13:57:55.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.779+0000 7fdaff418640 1 -- 172.21.15.50:0/724110409 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(39 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [create,call,writefull 0~1155] v29'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fdaf005c040 con 0x556ade5e1fc0 2024-05-07T13:57:55.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.779+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ade5ee550 con 0x556ade5dd2f0 2024-05-07T13:57:55.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.780+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v29'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.780+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556ade5ebff0 con 0x556ade5dd2f0 2024-05-07T13:57:55.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.781+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v29'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fdaf800e070 con 0x556ade5dd2f0 2024-05-07T13:57:55.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/2755396754 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e0036900 msgr2=0x7fd9e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 --2- 172.21.15.50:0/2755396754 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e0036900 0x7fd9e0038dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4054000 tx=0x7fdaf404e000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/2755396754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 msgr2=0x556ade5b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 --2- 172.21.15.50:0/2755396754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5b4fd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800a930 tx=0x7fdaf8003370 comp rx=0 tx=0).stop 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/2755396754 shutdown_connections 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 --2- 172.21.15.50:0/2755396754 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e0036900 0x7fd9e0038dc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 --2- 172.21.15.50:0/2755396754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5adae0 0x556ade5b4fd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/2755396754 >> 172.21.15.50:0/2755396754 conn(0x556ade4a8470 msgr2=0x556ade5a7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/2755396754 shutdown_connections 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/2755396754 wait complete. 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/1749131327 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd940036900 msgr2=0x7fd940038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 --2- 172.21.15.50:0/1749131327 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd940036900 0x7fd940038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4055040 tx=0x7fdaf4005ac0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/1749131327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5cf6e0 msgr2=0x556ade5cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 --2- 172.21.15.50:0/1749131327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5cf6e0 0x556ade5cfb00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdaf004a300 tx=0x7fdaf0026740 comp rx=0 tx=0).stop 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/1749131327 shutdown_connections 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 --2- 172.21.15.50:0/1749131327 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd940036900 0x7fd940038dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 --2- 172.21.15.50:0/1749131327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade5cf6e0 0x556ade5cfb00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/1749131327 >> 172.21.15.50:0/1749131327 conn(0x556ade5c4170 msgr2=0x556ade5c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/1749131327 shutdown_connections 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.782+0000 7fdb01919800 1 -- 172.21.15.50:0/1749131327 wait complete. 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdaf406a040 msgr2=0x7fdaf405d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fdaf406a040 0x7fdaf405d440 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556ade5dd2f0 msgr2=0x556ade5df720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556ade5dd2f0 0x556ade5df720 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdaf0049070 msgr2=0x7fdaf00408d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fdaf0049070 0x7fdaf00408d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556ade5e1fc0 msgr2=0x556ade5e4430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556ade5e1fc0 0x556ade5e4430 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e40368b0 msgr2=0x7fd9e4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd9e40368b0 0x7fd9e4038d70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0001050 tx=0x7fdaf000ee90 comp rx=0 tx=0).stop 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 msgr2=0x556ade5a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdaffc19640 1 -- 172.21.15.50:0/724110409 reap_dead start 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade5a0230 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000bba0 tx=0x7fdaf0000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 shutdown_connections 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 --2- 172.21.15.50:0/724110409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ade4a44c0 0x556ade5a0230 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 >> 172.21.15.50:0/724110409 conn(0x556ade49ed20 msgr2=0x556ade4aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 shutdown_connections 2024-05-07T13:57:55.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.783+0000 7fdb01919800 1 -- 172.21.15.50:0/724110409 wait complete. 2024-05-07T13:57:55.782 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-07T13:57:55.782 DEBUG:tasks.util.rgw: json result: {'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-07T13:57:55.782 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-05-07T13:57:55.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-05-07T13:57:55.783 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-05-07T13:57:55.865 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:55.866 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.879+0000 7fa96751f800 1 Processor -- start 2024-05-07T13:57:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.879+0000 7fa96751f800 1 -- start start 2024-05-07T13:57:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.879+0000 7fa96751f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561775fc4650 0x561775fc6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.879+0000 7fa96751f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561775fc6f80 con 0x561775fc0b40 2024-05-07T13:57:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.879+0000 7fa96751f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x561775e51050 con 0x561775fc4650 2024-05-07T13:57:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.880+0000 7fa9629c9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561775fc4650 0x561775fc6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.880+0000 7fa9629c9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561775fc4650 0x561775fc6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58480/0 (socket says 172.21.15.50:58480) 2024-05-07T13:57:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.880+0000 7fa9629c9640 1 -- 172.21.15.50:0/298539365 learned_addr learned my addr 172.21.15.50:0/298539365 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.880+0000 7fa9631ca640 1 --1- 172.21.15.50:0/298539365 >> v1:172.21.15.22:6789/0 conn(0x561775fc0b40 0x561775fc2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56784/0 (socket says 172.21.15.50:56784) 2024-05-07T13:57:55.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.880+0000 7fa9629c9640 1 -- 172.21.15.50:0/298539365 >> v1:172.21.15.22:6789/0 conn(0x561775fc0b40 legacy=0x561775fc2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.880+0000 7fa9629c9640 1 -- 172.21.15.50:0/298539365 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561775fc8160 con 0x561775fc4650 2024-05-07T13:57:55.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa9629c9640 1 --2- 172.21.15.50:0/298539365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc4650 0x561775fc6a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa95800a520 tx=0x7fa95801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49640dc36a2adbb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa9621c8640 1 -- 172.21.15.50:0/298539365 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958057070 con 0x561775fc4650 2024-05-07T13:57:55.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa9621c8640 1 -- 172.21.15.50:0/298539365 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa958052570 con 0x561775fc4650 2024-05-07T13:57:55.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa9621c8640 1 -- 172.21.15.50:0/298539365 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95804ae60 con 0x561775fc4650 2024-05-07T13:57:55.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa96751f800 1 -- 172.21.15.50:0/298539365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc4650 msgr2=0x561775fc6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa96751f800 1 --2- 172.21.15.50:0/298539365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc4650 0x561775fc6a40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa95800a520 tx=0x7fa95801d010 comp rx=0 tx=0).stop 2024-05-07T13:57:55.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa96751f800 1 -- 172.21.15.50:0/298539365 shutdown_connections 2024-05-07T13:57:55.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa96751f800 1 --2- 172.21.15.50:0/298539365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc4650 0x561775fc6a40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa96751f800 1 -- 172.21.15.50:0/298539365 >> 172.21.15.50:0/298539365 conn(0x561775fba550 msgr2=0x561775fbc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa96751f800 1 -- 172.21.15.50:0/298539365 shutdown_connections 2024-05-07T13:57:55.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.882+0000 7fa96751f800 1 -- 172.21.15.50:0/298539365 wait complete. 2024-05-07T13:57:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.898+0000 7fa96751f800 1 Processor -- start 2024-05-07T13:57:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.898+0000 7fa96751f800 1 -- start start 2024-05-07T13:57:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.898+0000 7fa96751f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x561775fc0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.898+0000 7fa96751f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561775f0b1c0 con 0x561775fc0b40 2024-05-07T13:57:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.898+0000 7fa9631ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x561775fc0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.898+0000 7fa9631ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x561775fc0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58482/0 (socket says 172.21.15.50:58482) 2024-05-07T13:57:55.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.898+0000 7fa9631ca640 1 -- 172.21.15.50:0/3366212797 learned_addr learned my addr 172.21.15.50:0/3366212797 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.898+0000 7fa9631ca640 1 -- 172.21.15.50:0/3366212797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561775fbea40 con 0x561775fc0b40 2024-05-07T13:57:55.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.899+0000 7fa9631ca640 1 --2- 172.21.15.50:0/3366212797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x561775fc0480 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa954001e90 tx=0x7fa95400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901b0150797cf221 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.899+0000 7fa85160a640 1 -- 172.21.15.50:0/3366212797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95400e5c0 con 0x561775fc0b40 2024-05-07T13:57:55.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.899+0000 7fa85160a640 1 -- 172.21.15.50:0/3366212797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa954006070 con 0x561775fc0b40 2024-05-07T13:57:55.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.899+0000 7fa85160a640 1 -- 172.21.15.50:0/3366212797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95400e890 con 0x561775fc0b40 2024-05-07T13:57:55.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 -- 172.21.15.50:0/3366212797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 msgr2=0x561775fc0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 --2- 172.21.15.50:0/3366212797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x561775fc0480 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa954001e90 tx=0x7fa95400b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 -- 172.21.15.50:0/3366212797 shutdown_connections 2024-05-07T13:57:55.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 --2- 172.21.15.50:0/3366212797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x561775fc0480 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 -- 172.21.15.50:0/3366212797 >> 172.21.15.50:0/3366212797 conn(0x561775fba550 msgr2=0x5617760acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 -- 172.21.15.50:0/3366212797 shutdown_connections 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 -- 172.21.15.50:0/3366212797 wait complete. 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 Processor -- start 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 -- start start 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x5617760bb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa96751f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561775fc7450 con 0x561775fc0b40 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.900+0000 7fa9631ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x5617760bb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.901+0000 7fa9631ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x5617760bb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58488/0 (socket says 172.21.15.50:58488) 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.901+0000 7fa9631ca640 1 -- 172.21.15.50:0/2167640797 learned_addr learned my addr 172.21.15.50:0/2167640797 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.901+0000 7fa9631ca640 1 -- 172.21.15.50:0/2167640797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617760bb9c0 con 0x561775fc0b40 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.901+0000 7fa9631ca640 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x5617760bb480 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa954001ed0 tx=0x7fa954000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.901+0000 7fa84fe07640 1 -- 172.21.15.50:0/2167640797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95401a880 con 0x561775fc0b40 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.901+0000 7fa84fe07640 1 -- 172.21.15.50:0/2167640797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95401aa20 con 0x561775fc0b40 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.901+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617760bbc50 con 0x561775fc0b40 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.901+0000 7fa84fe07640 1 -- 172.21.15.50:0/2167640797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95401ad40 con 0x561775fc0b40 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.901+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617760be900 con 0x561775fc0b40 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa96751f800 1 Processor -- start 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa96751f800 1 -- start start 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa84fe07640 1 -- 172.21.15.50:0/2167640797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa954017070 con 0x561775fc0b40 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa96751f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760c9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa96751f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561775eb1cf0 con 0x5617760c8d30 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa84fe07640 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa848036900 0x7fa848038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa84fe07640 1 -- 172.21.15.50:0/2167640797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fa954015020 con 0x561775fc0b40 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa9631ca640 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa848036900 0x7fa848038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa9639cb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa9639cb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58494/0 (socket says 172.21.15.50:58494) 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.902+0000 7fa9639cb640 1 -- 172.21.15.50:0/615579799 learned_addr learned my addr 172.21.15.50:0/615579799 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.903+0000 7fa9639cb640 1 -- 172.21.15.50:0/615579799 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617760c9690 con 0x5617760c8d30 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.903+0000 7fa9631ca640 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa848036900 0x7fa848038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa95401c5c0 tx=0x7fa95401c4d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.903+0000 7fa9639cb640 1 --2- 172.21.15.50:0/615579799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760c9150 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00a430 tx=0x7fa95c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfe27e7afe6101d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.903+0000 7fa84de03640 1 -- 172.21.15.50:0/615579799 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c015070 con 0x5617760c8d30 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.903+0000 7fa84de03640 1 -- 172.21.15.50:0/615579799 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c001670 con 0x5617760c8d30 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.903+0000 7fa84de03640 1 -- 172.21.15.50:0/615579799 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c001990 con 0x5617760c8d30 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 -- 172.21.15.50:0/615579799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 msgr2=0x5617760c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 --2- 172.21.15.50:0/615579799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760c9150 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00a430 tx=0x7fa95c00a8f0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 -- 172.21.15.50:0/615579799 shutdown_connections 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 --2- 172.21.15.50:0/615579799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760c9150 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 -- 172.21.15.50:0/615579799 >> 172.21.15.50:0/615579799 conn(0x561775fc4650 msgr2=0x5617760c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 -- 172.21.15.50:0/615579799 shutdown_connections 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 -- 172.21.15.50:0/615579799 wait complete. 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 Processor -- start 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 -- start start 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa96751f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5617760ca020 con 0x5617760c8d30 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa9639cb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa9639cb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58506/0 (socket says 172.21.15.50:58506) 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.904+0000 7fa9639cb640 1 -- 172.21.15.50:0/3970564446 learned_addr learned my addr 172.21.15.50:0/3970564446 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.905+0000 7fa9639cb640 1 -- 172.21.15.50:0/3970564446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617760d0710 con 0x5617760c8d30 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.905+0000 7fa9639cb640 1 --2- 172.21.15.50:0/3970564446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760d01d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa95c013040 tx=0x7fa95c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.905+0000 7fa83ffff640 1 -- 172.21.15.50:0/3970564446 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c020020 con 0x5617760c8d30 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.905+0000 7fa83ffff640 1 -- 172.21.15.50:0/3970564446 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c0108e0 con 0x5617760c8d30 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.905+0000 7fa96751f800 1 -- 172.21.15.50:0/3970564446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617760d09a0 con 0x5617760c8d30 2024-05-07T13:57:55.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.905+0000 7fa83ffff640 1 -- 172.21.15.50:0/3970564446 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c015040 con 0x5617760c8d30 2024-05-07T13:57:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.905+0000 7fa96751f800 1 -- 172.21.15.50:0/3970564446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617760d3650 con 0x5617760c8d30 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.906+0000 7fa83ffff640 1 -- 172.21.15.50:0/3970564446 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa95c023020 con 0x5617760c8d30 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.906+0000 7fa83ffff640 1 --2- 172.21.15.50:0/3970564446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa844036900 0x7fa844038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.906+0000 7fa83ffff640 1 -- 172.21.15.50:0/3970564446 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fa95c04c0e0 con 0x5617760c8d30 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.906+0000 7fa9629c9640 1 --2- 172.21.15.50:0/3970564446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa844036900 0x7fa844038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.906+0000 7fa96751f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.906+0000 7fa96751f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.907+0000 7fa9629c9640 1 --2- 172.21.15.50:0/3970564446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa844036900 0x7fa844038dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa958054000 tx=0x7fa95804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.907+0000 7fa96751f800 1 Processor -- start 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.907+0000 7fa96751f800 1 -- start start 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.907+0000 7fa96751f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760ea8e0 0x5617760ead00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.907+0000 7fa96751f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561775fbedc0 con 0x5617760ea8e0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.907+0000 7fa9631ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760ea8e0 0x5617760ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.907+0000 7fa9631ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760ea8e0 0x5617760ead00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58512/0 (socket says 172.21.15.50:58512) 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.907+0000 7fa9631ca640 1 -- 172.21.15.50:0/3159229846 learned_addr learned my addr 172.21.15.50:0/3159229846 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.908+0000 7fa9631ca640 1 -- 172.21.15.50:0/3159229846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617760eb240 con 0x5617760ea8e0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.908+0000 7fa9631ca640 1 --2- 172.21.15.50:0/3159229846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760ea8e0 0x5617760ead00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa95404b430 tx=0x7fa954019c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.908+0000 7fa7e3fff640 1 -- 172.21.15.50:0/3159229846 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95400faf0 con 0x5617760ea8e0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.908+0000 7fa7e3fff640 1 -- 172.21.15.50:0/3159229846 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa954043030 con 0x5617760ea8e0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.908+0000 7fa96751f800 1 -- 172.21.15.50:0/3159229846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617760ebcb0 con 0x5617760ea8e0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.908+0000 7fa7e3fff640 1 -- 172.21.15.50:0/3159229846 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95400fdc0 con 0x5617760ea8e0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.908+0000 7fa96751f800 1 -- 172.21.15.50:0/3159229846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617760ec1b0 con 0x5617760ea8e0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.909+0000 7fa7e3fff640 1 -- 172.21.15.50:0/3159229846 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa95404b510 con 0x5617760ea8e0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.909+0000 7fa7e3fff640 1 --2- 172.21.15.50:0/3159229846 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa79c0368b0 0x7fa79c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.909+0000 7fa7e3fff640 1 -- 172.21.15.50:0/3159229846 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fa95404e020 con 0x5617760ea8e0 2024-05-07T13:57:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.909+0000 7fa9629c9640 1 --2- 172.21.15.50:0/3159229846 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa79c0368b0 0x7fa79c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.909+0000 7fa9629c9640 1 --2- 172.21.15.50:0/3159229846 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa79c0368b0 0x7fa79c038d70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa958000c00 tx=0x7fa958005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.909+0000 7fa7e1ffb640 20 reqs_thread_entry: start 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.909+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617760f82e0 0x5617760fa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.909+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617760fadd0 con 0x5617760f82e0 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.910+0000 7fa9639cb640 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617760f82e0 0x5617760fa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.910+0000 7fa9639cb640 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617760f82e0 0x5617760fa750 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.910+0000 7fa9639cb640 1 -- 172.21.15.50:0/2167640797 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa95c00e070 con 0x5617760f82e0 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.910+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617760fb700 con 0x5617760f82e0 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.910+0000 7fa9639cb640 1 -- 172.21.15.50:0/2167640797 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa95c00e070 con 0x5617760f82e0 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.910+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617760fd010 0x5617760ff480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.910+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617760ffc10 con 0x5617760fd010 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.911+0000 7fa9631ca640 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617760fd010 0x5617760ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.911+0000 7fa9631ca640 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617760fd010 0x5617760ff480 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.911+0000 7fa9631ca640 1 -- 172.21.15.50:0/2167640797 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fa95402e070 con 0x5617760fd010 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3970564446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa844036900 msgr2=0x7fa844038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 --2- 172.21.15.50:0/3970564446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa844036900 0x7fa844038dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa958054000 tx=0x7fa95804e000 comp rx=0 tx=0).stop 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3970564446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 msgr2=0x5617760d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 --2- 172.21.15.50:0/3970564446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760d01d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa95c013040 tx=0x7fa95c003370 comp rx=0 tx=0).stop 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3970564446 shutdown_connections 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 --2- 172.21.15.50:0/3970564446 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa844036900 0x7fa844038dc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 --2- 172.21.15.50:0/3970564446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760c8d30 0x5617760d01d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3970564446 >> 172.21.15.50:0/3970564446 conn(0x561775fc4650 msgr2=0x5617760c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3970564446 shutdown_connections 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3970564446 wait complete. 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3159229846 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa79c0368b0 msgr2=0x7fa79c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 --2- 172.21.15.50:0/3159229846 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa79c0368b0 0x7fa79c038d70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa958000c00 tx=0x7fa958005ac0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3159229846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760ea8e0 msgr2=0x5617760ead00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 --2- 172.21.15.50:0/3159229846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760ea8e0 0x5617760ead00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa95404b430 tx=0x7fa954019c10 comp rx=0 tx=0).stop 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3159229846 shutdown_connections 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 --2- 172.21.15.50:0/3159229846 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa79c0368b0 0x7fa79c038d70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 --2- 172.21.15.50:0/3159229846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5617760ea8e0 0x5617760ead00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.912+0000 7fa96751f800 1 -- 172.21.15.50:0/3159229846 >> 172.21.15.50:0/3159229846 conn(0x5617760df390 msgr2=0x5617760dfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/3159229846 shutdown_connections 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/3159229846 wait complete. 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617760f82e0 msgr2=0x5617760fa750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617760f82e0 0x5617760fa750 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617760fd010 msgr2=0x5617760ff480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617760fd010 0x5617760ff480 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa848036900 msgr2=0x7fa848038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa848036900 0x7fa848038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa95401c5c0 tx=0x7fa95401c4d0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 msgr2=0x5617760bb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x5617760bb480 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa954001ed0 tx=0x7fa954000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 shutdown_connections 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5617760fd010 0x5617760ff480 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5617760f82e0 0x5617760fa750 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fa848036900 0x7fa848038dc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 --2- 172.21.15.50:0/2167640797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561775fc0b40 0x5617760bb480 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 >> 172.21.15.50:0/2167640797 conn(0x561775fba550 msgr2=0x561775fbf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 shutdown_connections 2024-05-07T13:57:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:55.913+0000 7fa96751f800 1 -- 172.21.15.50:0/2167640797 wait complete. 2024-05-07T13:57:55.909 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-07T13:57:55.910 DEBUG:tasks.util.rgw: json result: {'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-07T13:57:55.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-07T13:57:55.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-07T13:57:55.910 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-07T13:57:55.998 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:55.998 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:55.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.011+0000 7f572661f800 1 Processor -- start 2024-05-07T13:57:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.011+0000 7f572661f800 1 -- start start 2024-05-07T13:57:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.012+0000 7f572661f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ed920e9050 0x55ed920e9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.012+0000 7f572661f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed920e9af0 con 0x55ed920ea2b0 2024-05-07T13:57:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.012+0000 7f572661f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55ed91f7b050 con 0x55ed920e9050 2024-05-07T13:57:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.012+0000 7f5724125640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ed920e9050 0x55ed920e9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.012+0000 7f5724125640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55ed920e9050 0x55ed920e9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58526/0 (socket says 172.21.15.50:58526) 2024-05-07T13:57:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.012+0000 7f5724125640 1 -- 172.21.15.50:0/3539562813 learned_addr learned my addr 172.21.15.50:0/3539562813 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.012+0000 7f5724125640 1 -- 172.21.15.50:0/3539562813 >> v1:172.21.15.22:6789/0 conn(0x55ed920ea2b0 legacy=0x55ed920ea730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.012+0000 7f5724125640 1 -- 172.21.15.50:0/3539562813 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed920eae70 con 0x55ed920e9050 2024-05-07T13:57:56.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.014+0000 7f5724125640 1 --2- 172.21.15.50:0/3539562813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed920e9470 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f571400a520 tx=0x7f571401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7647bb59e59cf796 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.014+0000 7f5723924640 1 -- 172.21.15.50:0/3539562813 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5714057070 con 0x55ed920e9050 2024-05-07T13:57:56.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.014+0000 7f5723924640 1 -- 172.21.15.50:0/3539562813 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5714052570 con 0x55ed920e9050 2024-05-07T13:57:56.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.014+0000 7f5723924640 1 -- 172.21.15.50:0/3539562813 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5714052870 con 0x55ed920e9050 2024-05-07T13:57:56.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.015+0000 7f572661f800 1 -- 172.21.15.50:0/3539562813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 msgr2=0x55ed920e9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.015+0000 7f572661f800 1 --2- 172.21.15.50:0/3539562813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed920e9470 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f571400a520 tx=0x7f571401d010 comp rx=0 tx=0).stop 2024-05-07T13:57:56.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.015+0000 7f572661f800 1 -- 172.21.15.50:0/3539562813 shutdown_connections 2024-05-07T13:57:56.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.015+0000 7f572661f800 1 --2- 172.21.15.50:0/3539562813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed920e9470 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.015+0000 7f572661f800 1 -- 172.21.15.50:0/3539562813 >> 172.21.15.50:0/3539562813 conn(0x55ed920e4670 msgr2=0x55ed920e6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.015+0000 7f572661f800 1 -- 172.21.15.50:0/3539562813 shutdown_connections 2024-05-07T13:57:56.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.015+0000 7f572661f800 1 -- 172.21.15.50:0/3539562813 wait complete. 2024-05-07T13:57:56.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.030+0000 7f572661f800 1 Processor -- start 2024-05-07T13:57:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.030+0000 7f572661f800 1 -- start start 2024-05-07T13:57:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.030+0000 7f572661f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed9205cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.030+0000 7f572661f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ed920351f0 con 0x55ed920e9050 2024-05-07T13:57:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.031+0000 7f5724125640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed9205cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.031+0000 7f5724125640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed9205cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58530/0 (socket says 172.21.15.50:58530) 2024-05-07T13:57:56.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.031+0000 7f5724125640 1 -- 172.21.15.50:0/3032984168 learned_addr learned my addr 172.21.15.50:0/3032984168 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.031+0000 7f5724125640 1 -- 172.21.15.50:0/3032984168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed921dc3c0 con 0x55ed920e9050 2024-05-07T13:57:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.031+0000 7f5724125640 1 --2- 172.21.15.50:0/3032984168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed9205cf50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f571401d050 tx=0x7f571404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a82bc779041a23 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.031+0000 7f561260c640 1 -- 172.21.15.50:0/3032984168 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5714057040 con 0x55ed920e9050 2024-05-07T13:57:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.031+0000 7f561260c640 1 -- 172.21.15.50:0/3032984168 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5714052850 con 0x55ed920e9050 2024-05-07T13:57:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.031+0000 7f561260c640 1 -- 172.21.15.50:0/3032984168 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5714052b70 con 0x55ed920e9050 2024-05-07T13:57:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.032+0000 7f572661f800 1 -- 172.21.15.50:0/3032984168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 msgr2=0x55ed9205cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.032+0000 7f572661f800 1 --2- 172.21.15.50:0/3032984168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed9205cf50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f571401d050 tx=0x7f571404c000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.032+0000 7f572661f800 1 -- 172.21.15.50:0/3032984168 shutdown_connections 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.032+0000 7f572661f800 1 --2- 172.21.15.50:0/3032984168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed9205cf50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.032+0000 7f572661f800 1 -- 172.21.15.50:0/3032984168 >> 172.21.15.50:0/3032984168 conn(0x55ed920e4670 msgr2=0x55ed921d60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.032+0000 7f572661f800 1 -- 172.21.15.50:0/3032984168 shutdown_connections 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.032+0000 7f572661f800 1 -- 172.21.15.50:0/3032984168 wait complete. 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.032+0000 7f572661f800 1 Processor -- start 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.032+0000 7f572661f800 1 -- start start 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.033+0000 7f572661f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed921e5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.033+0000 7f572661f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ed920f2780 con 0x55ed920e9050 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.033+0000 7f5724125640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed921e5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.033+0000 7f5724125640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed921e5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58536/0 (socket says 172.21.15.50:58536) 2024-05-07T13:57:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.033+0000 7f5724125640 1 -- 172.21.15.50:0/445084929 learned_addr learned my addr 172.21.15.50:0/445084929 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.033+0000 7f5724125640 1 -- 172.21.15.50:0/445084929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed921e5a80 con 0x55ed920e9050 2024-05-07T13:57:56.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.033+0000 7f5724125640 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed921e5540 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5714000c00 tx=0x7f5714003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.034+0000 7f5610e09640 1 -- 172.21.15.50:0/445084929 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5714073070 con 0x55ed920e9050 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.034+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed921e5d10 con 0x55ed920e9050 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.034+0000 7f5610e09640 1 -- 172.21.15.50:0/445084929 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f571405d650 con 0x55ed920e9050 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.034+0000 7f5610e09640 1 -- 172.21.15.50:0/445084929 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5714057070 con 0x55ed920e9050 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.034+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed921e89c0 con 0x55ed920e9050 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.034+0000 7f572661f800 1 Processor -- start 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.034+0000 7f572661f800 1 -- start start 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5610e09640 1 -- 172.21.15.50:0/445084929 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5714076070 con 0x55ed920e9050 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f572661f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921f3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f572661f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ed91fdbcf0 con 0x55ed921f2e40 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5610e09640 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f560c036950 0x7f560c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5724926640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5610e09640 1 -- 172.21.15.50:0/445084929 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f571408dfd0 con 0x55ed920e9050 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5724926640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921f3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58542/0 (socket says 172.21.15.50:58542) 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5724926640 1 -- 172.21.15.50:0/4111105170 learned_addr learned my addr 172.21.15.50:0/4111105170 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5724125640 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f560c036950 0x7f560c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5724926640 1 -- 172.21.15.50:0/4111105170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed921f37a0 con 0x55ed921f2e40 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5724125640 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f560c036950 0x7f560c038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f571408c360 tx=0x7f571401d010 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f5724926640 1 --2- 172.21.15.50:0/4111105170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921f3260 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f571c00a430 tx=0x7f571c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ddccaa69dc3304 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.035+0000 7f560a7fc640 1 -- 172.21.15.50:0/4111105170 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f571c015070 con 0x55ed921f2e40 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f560a7fc640 1 -- 172.21.15.50:0/4111105170 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f571c001670 con 0x55ed921f2e40 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f560a7fc640 1 -- 172.21.15.50:0/4111105170 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f571c001990 con 0x55ed921f2e40 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f572661f800 1 -- 172.21.15.50:0/4111105170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 msgr2=0x55ed921f3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f572661f800 1 --2- 172.21.15.50:0/4111105170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921f3260 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f571c00a430 tx=0x7f571c00a8f0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f572661f800 1 -- 172.21.15.50:0/4111105170 shutdown_connections 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f572661f800 1 --2- 172.21.15.50:0/4111105170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921f3260 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f572661f800 1 -- 172.21.15.50:0/4111105170 >> 172.21.15.50:0/4111105170 conn(0x55ed920ea2b0 msgr2=0x55ed921ef8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f572661f800 1 -- 172.21.15.50:0/4111105170 shutdown_connections 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f572661f800 1 -- 172.21.15.50:0/4111105170 wait complete. 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f572661f800 1 Processor -- start 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.036+0000 7f572661f800 1 -- start start 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f572661f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921fa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f572661f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ed921f4130 con 0x55ed921f2e40 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f5724926640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f5724926640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921fa300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58546/0 (socket says 172.21.15.50:58546) 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f5724926640 1 -- 172.21.15.50:0/3275028593 learned_addr learned my addr 172.21.15.50:0/3275028593 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f5724926640 1 -- 172.21.15.50:0/3275028593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed921fa840 con 0x55ed921f2e40 2024-05-07T13:57:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f5724926640 1 --2- 172.21.15.50:0/3275028593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921fa300 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f571c013040 tx=0x7f571c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f5608ff9640 1 -- 172.21.15.50:0/3275028593 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f571c020020 con 0x55ed921f2e40 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f5608ff9640 1 -- 172.21.15.50:0/3275028593 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f571c0108e0 con 0x55ed921f2e40 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f572661f800 1 -- 172.21.15.50:0/3275028593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed921faad0 con 0x55ed921f2e40 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f5608ff9640 1 -- 172.21.15.50:0/3275028593 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f571c015040 con 0x55ed921f2e40 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.037+0000 7f572661f800 1 -- 172.21.15.50:0/3275028593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed921fd780 con 0x55ed921f2e40 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.038+0000 7f5608ff9640 1 -- 172.21.15.50:0/3275028593 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f571c023020 con 0x55ed921f2e40 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.039+0000 7f5608ff9640 1 --2- 172.21.15.50:0/3275028593 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55fc036900 0x7f55fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.039+0000 7f5608ff9640 1 -- 172.21.15.50:0/3275028593 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f571c04c160 con 0x55ed921f2e40 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.039+0000 7f571bfff640 1 --2- 172.21.15.50:0/3275028593 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55fc036900 0x7f55fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.039+0000 7f572661f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.039+0000 7f572661f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.039+0000 7f571bfff640 1 --2- 172.21.15.50:0/3275028593 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55fc036900 0x7f55fc038dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55ed921eed60 tx=0x7f570c001310 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.039+0000 7f572661f800 1 Processor -- start 2024-05-07T13:57:56.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.040+0000 7f572661f800 1 -- start start 2024-05-07T13:57:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.040+0000 7f572661f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed922149a0 0x55ed92214dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.040+0000 7f572661f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ed921e0a90 con 0x55ed922149a0 2024-05-07T13:57:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.040+0000 7f5724125640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed922149a0 0x55ed92214dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.040+0000 7f5724125640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed922149a0 0x55ed92214dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58556/0 (socket says 172.21.15.50:58556) 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.040+0000 7f5724125640 1 -- 172.21.15.50:0/2033591778 learned_addr learned my addr 172.21.15.50:0/2033591778 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.041+0000 7f5724125640 1 -- 172.21.15.50:0/2033591778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed92215300 con 0x55ed922149a0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.041+0000 7f5724125640 1 --2- 172.21.15.50:0/2033591778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed922149a0 0x55ed92214dc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f571408c2a0 tx=0x7f5714066b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.041+0000 7f55e97e2640 1 -- 172.21.15.50:0/2033591778 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5714089050 con 0x55ed922149a0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.041+0000 7f572661f800 1 -- 172.21.15.50:0/2033591778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed92215d70 con 0x55ed922149a0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.041+0000 7f55e97e2640 1 -- 172.21.15.50:0/2033591778 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f571408a040 con 0x55ed922149a0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.041+0000 7f55e97e2640 1 -- 172.21.15.50:0/2033591778 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5714077840 con 0x55ed922149a0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.041+0000 7f572661f800 1 -- 172.21.15.50:0/2033591778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed92216270 con 0x55ed922149a0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.042+0000 7f55e97e2640 1 -- 172.21.15.50:0/2033591778 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5714006380 con 0x55ed922149a0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.042+0000 7f55e97e2640 1 --2- 172.21.15.50:0/2033591778 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f555c036900 0x7f555c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.042+0000 7f55e97e2640 1 -- 172.21.15.50:0/2033591778 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f571408f070 con 0x55ed922149a0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.042+0000 7f571bfff640 1 --2- 172.21.15.50:0/2033591778 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f555c036900 0x7f555c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.042+0000 7f55e2ffd640 20 reqs_thread_entry: start 2024-05-07T13:57:56.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.042+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ed92222460 0x55ed922248b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.042+0000 7f571bfff640 1 --2- 172.21.15.50:0/2033591778 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f555c036900 0x7f555c038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f570c003f10 tx=0x7f570c006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.042+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ed92224f80 con 0x55ed92222460 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.043+0000 7f5724926640 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ed92222460 0x55ed922248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.043+0000 7f5724926640 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ed92222460 0x55ed922248b0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.043+0000 7f5724926640 1 -- 172.21.15.50:0/445084929 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f571c00e070 con 0x55ed92222460 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.043+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ed92226d50 0x55ed92229140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.043+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:2 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ed92229840 con 0x55ed92226d50 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.043+0000 7f5724125640 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ed92226d50 0x55ed92229140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.043+0000 7f5724125640 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ed92226d50 0x55ed92229140 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.044+0000 7f5724125640 1 -- 172.21.15.50:0/445084929 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(2 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f5714075030 con 0x55ed92226d50 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.044+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ed92226420 con 0x55ed92226d50 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.045+0000 7f5724125640 1 -- 172.21.15.50:0/445084929 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [stat,call,call,writefull 0~993] v29'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f5714075030 con 0x55ed92226d50 2024-05-07T13:57:56.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/3275028593 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55fc036900 msgr2=0x7f55fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 --2- 172.21.15.50:0/3275028593 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55fc036900 0x7f55fc038dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55ed921eed60 tx=0x7f570c001310 comp rx=0 tx=0).stop 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/3275028593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 msgr2=0x55ed921fa300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 --2- 172.21.15.50:0/3275028593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921fa300 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f571c013040 tx=0x7f571c003370 comp rx=0 tx=0).stop 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/3275028593 shutdown_connections 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 --2- 172.21.15.50:0/3275028593 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f55fc036900 0x7f55fc038dc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 --2- 172.21.15.50:0/3275028593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed921f2e40 0x55ed921fa300 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/3275028593 >> 172.21.15.50:0/3275028593 conn(0x55ed920ea2b0 msgr2=0x55ed921ecf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/3275028593 shutdown_connections 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/3275028593 wait complete. 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/2033591778 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f555c036900 msgr2=0x7f555c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 --2- 172.21.15.50:0/2033591778 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f555c036900 0x7f555c038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f570c003f10 tx=0x7f570c006000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/2033591778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed922149a0 msgr2=0x55ed92214dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 --2- 172.21.15.50:0/2033591778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed922149a0 0x55ed92214dc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f571408c2a0 tx=0x7f5714066b40 comp rx=0 tx=0).stop 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/2033591778 shutdown_connections 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 --2- 172.21.15.50:0/2033591778 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f555c036900 0x7f555c038dc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 --2- 172.21.15.50:0/2033591778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed922149a0 0x55ed92214dc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.046+0000 7f572661f800 1 -- 172.21.15.50:0/2033591778 >> 172.21.15.50:0/2033591778 conn(0x55ed92209430 msgr2=0x55ed92209e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 -- 172.21.15.50:0/2033591778 shutdown_connections 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 -- 172.21.15.50:0/2033591778 wait complete. 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ed92222460 msgr2=0x55ed922248b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ed92222460 0x55ed922248b0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ed92226d50 msgr2=0x55ed92229140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ed92226d50 0x55ed92229140 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f560c036950 msgr2=0x7f560c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f560c036950 0x7f560c038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f571408c360 tx=0x7f571401d010 comp rx=0 tx=0).stop 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 msgr2=0x55ed921e5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.047+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed921e5540 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5714000c00 tx=0x7f5714003020 comp rx=0 tx=0).stop 2024-05-07T13:57:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.048+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 shutdown_connections 2024-05-07T13:57:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.048+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55ed92226d50 0x55ed92229140 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.048+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55ed92222460 0x55ed922248b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.048+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f560c036950 0x7f560c038e10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.048+0000 7f572661f800 1 --2- 172.21.15.50:0/445084929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed920e9050 0x55ed921e5540 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.048+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 >> 172.21.15.50:0/445084929 conn(0x55ed920e4670 msgr2=0x55ed921d48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.048+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 shutdown_connections 2024-05-07T13:57:56.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.048+0000 7f572661f800 1 -- 172.21.15.50:0/445084929 wait complete. 2024-05-07T13:57:56.044 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-07T13:57:56.044 DEBUG:tasks.util.rgw: json result: {'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-07T13:57:56.044 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-05-07T13:57:56.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-05-07T13:57:56.045 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-05-07T13:57:56.088 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:56.089 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:56.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.102+0000 7f2a568df800 1 Processor -- start 2024-05-07T13:57:56.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.102+0000 7f2a568df800 1 -- start start 2024-05-07T13:57:56.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.102+0000 7f2a568df800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e47d828540 0x55e47d831040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.102+0000 7f2a568df800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e47d79b060 con 0x55e47d826a00 2024-05-07T13:57:56.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.102+0000 7f2a568df800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55e47d6b9050 con 0x55e47d828540 2024-05-07T13:57:56.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.102+0000 7f2a53be4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e47d828540 0x55e47d831040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.102+0000 7f2a53be4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55e47d828540 0x55e47d831040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58572/0 (socket says 172.21.15.50:58572) 2024-05-07T13:57:56.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.102+0000 7f2a543e5640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55e47d826a00 0x55e47d826e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56806/0 (socket says 172.21.15.50:56806) 2024-05-07T13:57:56.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.102+0000 7f2a53be4640 1 -- 172.21.15.50:0/1122886880 learned_addr learned my addr 172.21.15.50:0/1122886880 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.103+0000 7f2a53be4640 1 -- 172.21.15.50:0/1122886880 >> v1:172.21.15.22:6789/0 conn(0x55e47d826a00 legacy=0x55e47d826e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.103+0000 7f2a53be4640 1 -- 172.21.15.50:0/1122886880 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47d79b230 con 0x55e47d828540 2024-05-07T13:57:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a53be4640 1 --2- 172.21.15.50:0/1122886880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d828540 0x55e47d831040 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800a520 tx=0x7f2a4801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af319e89087aaf7f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a533e3640 1 -- 172.21.15.50:0/1122886880 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a48057070 con 0x55e47d828540 2024-05-07T13:57:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a533e3640 1 -- 172.21.15.50:0/1122886880 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a48052570 con 0x55e47d828540 2024-05-07T13:57:56.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a533e3640 1 -- 172.21.15.50:0/1122886880 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4804ae60 con 0x55e47d828540 2024-05-07T13:57:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a568df800 1 -- 172.21.15.50:0/1122886880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d828540 msgr2=0x55e47d831040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a568df800 1 --2- 172.21.15.50:0/1122886880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d828540 0x55e47d831040 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800a520 tx=0x7f2a4801d010 comp rx=0 tx=0).stop 2024-05-07T13:57:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a568df800 1 -- 172.21.15.50:0/1122886880 shutdown_connections 2024-05-07T13:57:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a568df800 1 --2- 172.21.15.50:0/1122886880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d828540 0x55e47d831040 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a568df800 1 -- 172.21.15.50:0/1122886880 >> 172.21.15.50:0/1122886880 conn(0x55e47d8225a0 msgr2=0x55e47d8249c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a568df800 1 -- 172.21.15.50:0/1122886880 shutdown_connections 2024-05-07T13:57:56.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.105+0000 7f2a568df800 1 -- 172.21.15.50:0/1122886880 wait complete. 2024-05-07T13:57:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.120+0000 7f2a568df800 1 Processor -- start 2024-05-07T13:57:56.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.120+0000 7f2a568df800 1 -- start start 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.120+0000 7f2a568df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d91b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.120+0000 7f2a568df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e47d7731c0 con 0x55e47d826a00 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.121+0000 7f2a543e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d91b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.121+0000 7f2a543e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d91b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58574/0 (socket says 172.21.15.50:58574) 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.121+0000 7f2a543e5640 1 -- 172.21.15.50:0/4140577029 learned_addr learned my addr 172.21.15.50:0/4140577029 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.121+0000 7f2a543e5640 1 -- 172.21.15.50:0/4140577029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47d91bed0 con 0x55e47d826a00 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.121+0000 7f2a543e5640 1 --2- 172.21.15.50:0/4140577029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d91b900 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2a44001e90 tx=0x7f2a4400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7608244c4acde9 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.121+0000 7f294260c640 1 -- 172.21.15.50:0/4140577029 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4400e5c0 con 0x55e47d826a00 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.121+0000 7f294260c640 1 -- 172.21.15.50:0/4140577029 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a44006070 con 0x55e47d826a00 2024-05-07T13:57:56.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.121+0000 7f294260c640 1 -- 172.21.15.50:0/4140577029 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4400e890 con 0x55e47d826a00 2024-05-07T13:57:56.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.122+0000 7f2a568df800 1 -- 172.21.15.50:0/4140577029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 msgr2=0x55e47d91b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.122+0000 7f2a568df800 1 --2- 172.21.15.50:0/4140577029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d91b900 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2a44001e90 tx=0x7f2a4400b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.122+0000 7f2a568df800 1 -- 172.21.15.50:0/4140577029 shutdown_connections 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.122+0000 7f2a568df800 1 --2- 172.21.15.50:0/4140577029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d91b900 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.122+0000 7f2a568df800 1 -- 172.21.15.50:0/4140577029 >> 172.21.15.50:0/4140577029 conn(0x55e47d8225a0 msgr2=0x55e47d917220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.122+0000 7f2a568df800 1 -- 172.21.15.50:0/4140577029 shutdown_connections 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.122+0000 7f2a568df800 1 -- 172.21.15.50:0/4140577029 wait complete. 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.122+0000 7f2a568df800 1 Processor -- start 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.122+0000 7f2a568df800 1 -- start start 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.123+0000 7f2a568df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d923470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.123+0000 7f2a568df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e47d831850 con 0x55e47d826a00 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.123+0000 7f2a543e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d923470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.123+0000 7f2a543e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d923470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58588/0 (socket says 172.21.15.50:58588) 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.123+0000 7f2a543e5640 1 -- 172.21.15.50:0/1582305908 learned_addr learned my addr 172.21.15.50:0/1582305908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.123+0000 7f2a543e5640 1 -- 172.21.15.50:0/1582305908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47d9239b0 con 0x55e47d826a00 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.123+0000 7f2a543e5640 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d923470 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2a44001ed0 tx=0x7f2a44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.124+0000 7f2940e09640 1 -- 172.21.15.50:0/1582305908 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4401a880 con 0x55e47d826a00 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.124+0000 7f2940e09640 1 -- 172.21.15.50:0/1582305908 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4401aa20 con 0x55e47d826a00 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.124+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e47d923c40 con 0x55e47d826a00 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.124+0000 7f2940e09640 1 -- 172.21.15.50:0/1582305908 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4401ad40 con 0x55e47d826a00 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.124+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e47d9268f0 con 0x55e47d826a00 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.124+0000 7f2a568df800 1 Processor -- start 2024-05-07T13:57:56.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.124+0000 7f2a568df800 1 -- start start 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.124+0000 7f2a568df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d931140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.124+0000 7f2a568df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e47d719cf0 con 0x55e47d930d20 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2940e09640 1 -- 172.21.15.50:0/1582305908 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2a44017070 con 0x55e47d826a00 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2a54be6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d931140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2a54be6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d931140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58596/0 (socket says 172.21.15.50:58596) 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2a54be6640 1 -- 172.21.15.50:0/1963302491 learned_addr learned my addr 172.21.15.50:0/1963302491 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2940e09640 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f293c036900 0x7f293c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2940e09640 1 -- 172.21.15.50:0/1582305908 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2a44015020 con 0x55e47d826a00 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2a543e5640 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f293c036900 0x7f293c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2a54be6640 1 -- 172.21.15.50:0/1963302491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47d931680 con 0x55e47d930d20 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2a54be6640 1 --2- 172.21.15.50:0/1963302491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d931140 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00a430 tx=0x7f2a4c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ba7dbbae430460 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f2a543e5640 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f293c036900 0x7f293c038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2a4401afd0 tx=0x7f2a44035040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f293a7fc640 1 -- 172.21.15.50:0/1963302491 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4c015070 con 0x55e47d930d20 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f293a7fc640 1 -- 172.21.15.50:0/1963302491 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c001670 con 0x55e47d930d20 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.125+0000 7f293a7fc640 1 -- 172.21.15.50:0/1963302491 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4c001990 con 0x55e47d930d20 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 -- 172.21.15.50:0/1963302491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 msgr2=0x55e47d931140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 --2- 172.21.15.50:0/1963302491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d931140 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00a430 tx=0x7f2a4c00a8f0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 -- 172.21.15.50:0/1963302491 shutdown_connections 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 --2- 172.21.15.50:0/1963302491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d931140 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 -- 172.21.15.50:0/1963302491 >> 172.21.15.50:0/1963302491 conn(0x55e47d828540 msgr2=0x55e47d92d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 -- 172.21.15.50:0/1963302491 shutdown_connections 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 -- 172.21.15.50:0/1963302491 wait complete. 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 Processor -- start 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 -- start start 2024-05-07T13:57:56.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d938280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.126+0000 7f2a568df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e47d932010 con 0x55e47d930d20 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2a54be6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d938280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2a54be6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d938280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58602/0 (socket says 172.21.15.50:58602) 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2a54be6640 1 -- 172.21.15.50:0/4028161580 learned_addr learned my addr 172.21.15.50:0/4028161580 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2a54be6640 1 -- 172.21.15.50:0/4028161580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47d9387c0 con 0x55e47d930d20 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2a54be6640 1 --2- 172.21.15.50:0/4028161580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d938280 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00a930 tx=0x7f2a4c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2938ff9640 1 -- 172.21.15.50:0/4028161580 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4c020020 con 0x55e47d930d20 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2938ff9640 1 -- 172.21.15.50:0/4028161580 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c0108b0 con 0x55e47d930d20 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2a568df800 1 -- 172.21.15.50:0/4028161580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e47d938a50 con 0x55e47d930d20 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2938ff9640 1 -- 172.21.15.50:0/4028161580 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4c015040 con 0x55e47d930d20 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.127+0000 7f2a568df800 1 -- 172.21.15.50:0/4028161580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e47d93b700 con 0x55e47d930d20 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.128+0000 7f2938ff9640 1 -- 172.21.15.50:0/4028161580 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2a4c023020 con 0x55e47d930d20 2024-05-07T13:57:56.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.128+0000 7f2938ff9640 1 --2- 172.21.15.50:0/4028161580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f292c036900 0x7f292c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.128+0000 7f2938ff9640 1 -- 172.21.15.50:0/4028161580 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2a4c04c110 con 0x55e47d930d20 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.129+0000 7f2a53be4640 1 --2- 172.21.15.50:0/4028161580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f292c036900 0x7f292c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.129+0000 7f2a568df800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.129+0000 7f2a568df800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.129+0000 7f2a568df800 1 Processor -- start 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.129+0000 7f2a53be4640 1 --2- 172.21.15.50:0/4028161580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f292c036900 0x7f292c038dc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a48054000 tx=0x7f2a4804e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.129+0000 7f2a568df800 1 -- start start 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.129+0000 7f2a568df800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d952990 0x55e47d952db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.129+0000 7f2a568df800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e47d91c250 con 0x55e47d952990 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f2a543e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d952990 0x55e47d952db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f2a543e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d952990 0x55e47d952db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58610/0 (socket says 172.21.15.50:58610) 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f2a543e5640 1 -- 172.21.15.50:0/2524311796 learned_addr learned my addr 172.21.15.50:0/2524311796 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f2a543e5640 1 -- 172.21.15.50:0/2524311796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47d9532f0 con 0x55e47d952990 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f2a543e5640 1 --2- 172.21.15.50:0/2524311796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d952990 0x55e47d952db0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2a440178a0 tx=0x7f2a4401df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f29197e2640 1 -- 172.21.15.50:0/2524311796 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a44017490 con 0x55e47d952990 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f29197e2640 1 -- 172.21.15.50:0/2524311796 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4400fa40 con 0x55e47d952990 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f2a568df800 1 -- 172.21.15.50:0/2524311796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e47d953d60 con 0x55e47d952990 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f29197e2640 1 -- 172.21.15.50:0/2524311796 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a4400fd60 con 0x55e47d952990 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.130+0000 7f2a568df800 1 -- 172.21.15.50:0/2524311796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e47d954260 con 0x55e47d952990 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.131+0000 7f29197e2640 1 -- 172.21.15.50:0/2524311796 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2a44050060 con 0x55e47d952990 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.131+0000 7f29197e2640 1 --2- 172.21.15.50:0/2524311796 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f288c036900 0x7f288c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.131+0000 7f29197e2640 1 -- 172.21.15.50:0/2524311796 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2a4404e070 con 0x55e47d952990 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.131+0000 7f2a53be4640 1 --2- 172.21.15.50:0/2524311796 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f288c036900 0x7f288c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.132+0000 7f2a53be4640 1 --2- 172.21.15.50:0/2524311796 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f288c036900 0x7f288c038dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2a48000c00 tx=0x7f2a48005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.132+0000 7f2912ffd640 20 reqs_thread_entry: start 2024-05-07T13:57:56.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.132+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e47d960390 0x55e47d9627c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.132+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e47d962e70 con 0x55e47d960390 2024-05-07T13:57:56.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.132+0000 7f2a54be6640 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e47d960390 0x55e47d9627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.132+0000 7f2a54be6640 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e47d960390 0x55e47d9627c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.133+0000 7f2a54be6640 1 -- 172.21.15.50:0/1582305908 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a4c00e070 con 0x55e47d960390 2024-05-07T13:57:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.133+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e47d963750 con 0x55e47d960390 2024-05-07T13:57:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.133+0000 7f2a54be6640 1 -- 172.21.15.50:0/1582305908 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a4c00e070 con 0x55e47d960390 2024-05-07T13:57:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.133+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e47d965060 0x55e47d9674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.133+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:3 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e47d967c50 con 0x55e47d965060 2024-05-07T13:57:56.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.133+0000 7f2a543e5640 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e47d965060 0x55e47d9674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.134+0000 7f2a543e5640 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e47d965060 0x55e47d9674f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.134+0000 7f2a543e5640 1 -- 172.21.15.50:0/1582305908 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(3 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a44046020 con 0x55e47d965060 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 -- 172.21.15.50:0/4028161580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f292c036900 msgr2=0x7f292c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 --2- 172.21.15.50:0/4028161580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f292c036900 0x7f292c038dc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a48054000 tx=0x7f2a4804e000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 -- 172.21.15.50:0/4028161580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 msgr2=0x55e47d938280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 --2- 172.21.15.50:0/4028161580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d938280 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00a930 tx=0x7f2a4c003370 comp rx=0 tx=0).stop 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 -- 172.21.15.50:0/4028161580 shutdown_connections 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 --2- 172.21.15.50:0/4028161580 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f292c036900 0x7f292c038dc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 --2- 172.21.15.50:0/4028161580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d930d20 0x55e47d938280 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 -- 172.21.15.50:0/4028161580 >> 172.21.15.50:0/4028161580 conn(0x55e47d828540 msgr2=0x55e47d92ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 -- 172.21.15.50:0/4028161580 shutdown_connections 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 -- 172.21.15.50:0/4028161580 wait complete. 2024-05-07T13:57:56.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 -- 172.21.15.50:0/2524311796 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f288c036900 msgr2=0x7f288c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 --2- 172.21.15.50:0/2524311796 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f288c036900 0x7f288c038dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2a48000c00 tx=0x7f2a48005ac0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 -- 172.21.15.50:0/2524311796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d952990 msgr2=0x55e47d952db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.135+0000 7f2a568df800 1 --2- 172.21.15.50:0/2524311796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d952990 0x55e47d952db0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2a440178a0 tx=0x7f2a4401df20 comp rx=0 tx=0).stop 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/2524311796 shutdown_connections 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/2524311796 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f288c036900 0x7f288c038dc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/2524311796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d952990 0x55e47d952db0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/2524311796 >> 172.21.15.50:0/2524311796 conn(0x55e47d947440 msgr2=0x55e47d947e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/2524311796 shutdown_connections 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/2524311796 wait complete. 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e47d965060 msgr2=0x55e47d9674f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e47d965060 0x55e47d9674f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e47d960390 msgr2=0x55e47d9627c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e47d960390 0x55e47d9627c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f293c036900 msgr2=0x7f293c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f293c036900 0x7f293c038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2a4401afd0 tx=0x7f2a44035040 comp rx=0 tx=0).stop 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 msgr2=0x55e47d923470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d923470 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2a44001ed0 tx=0x7f2a44000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 shutdown_connections 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55e47d965060 0x55e47d9674f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55e47d960390 0x55e47d9627c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f293c036900 0x7f293c038dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 --2- 172.21.15.50:0/1582305908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e47d826a00 0x55e47d923470 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 >> 172.21.15.50:0/1582305908 conn(0x55e47d8225a0 msgr2=0x55e47d915a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 shutdown_connections 2024-05-07T13:57:56.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.136+0000 7f2a568df800 1 -- 172.21.15.50:0/1582305908 wait complete. 2024-05-07T13:57:56.134 INFO:teuthology.orchestra.run.smithi050.stdout:{"id":"02b45de7-8fca-4685-ae50-761ba20a02e2","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5","zones":[{"id":"2bb55b15-c5ac-4d27-90e2-375e6d1786e5","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-05-07T13:57:56.134 DEBUG:tasks.util.rgw: json result: {'id': '02b45de7-8fca-4685-ae50-761ba20a02e2', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5', 'zones': [{'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-05-07T13:57:56.137 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-05-07T13:57:56.175 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-07T13:57:56.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-07T13:57:56.175 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-05-07T13:57:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:56.232 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.245+0000 7f285ab3f800 1 Processor -- start 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.245+0000 7f285ab3f800 1 -- start start 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.245+0000 7f285ab3f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f7a02a1980 0x55f7a02a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.245+0000 7f285ab3f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7a0216a00 con 0x55f7a02a22e0 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.245+0000 7f285ab3f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55f7a0134050 con 0x55f7a02a1980 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.246+0000 7f285689b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f7a02a1980 0x55f7a02a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.246+0000 7f285609a640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55f7a02a22e0 0x55f7a02a2790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56810/0 (socket says 172.21.15.50:56810) 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.246+0000 7f285609a640 1 -- 172.21.15.50:0/3961968990 learned_addr learned my addr 172.21.15.50:0/3961968990 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.246+0000 7f285689b640 1 -- 172.21.15.50:0/3961968990 >> v1:172.21.15.22:6789/0 conn(0x55f7a02a22e0 legacy=0x55f7a02a2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.246+0000 7f285689b640 1 -- 172.21.15.50:0/3961968990 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a02a2ea0 con 0x55f7a02a1980 2024-05-07T13:57:56.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.248+0000 7f285689b640 1 --2- 172.21.15.50:0/3961968990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a02a1da0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f284800a470 tx=0x7f284801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf1fb3a51823fd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.248+0000 7f2855899640 1 -- 172.21.15.50:0/3961968990 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848057070 con 0x55f7a02a1980 2024-05-07T13:57:56.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.248+0000 7f2855899640 1 -- 172.21.15.50:0/3961968990 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2848052570 con 0x55f7a02a1980 2024-05-07T13:57:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.248+0000 7f2855899640 1 -- 172.21.15.50:0/3961968990 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848052870 con 0x55f7a02a1980 2024-05-07T13:57:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.249+0000 7f285ab3f800 1 -- 172.21.15.50:0/3961968990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 msgr2=0x55f7a02a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.249+0000 7f285ab3f800 1 --2- 172.21.15.50:0/3961968990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a02a1da0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f284800a470 tx=0x7f284801ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.249+0000 7f285ab3f800 1 -- 172.21.15.50:0/3961968990 shutdown_connections 2024-05-07T13:57:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.249+0000 7f285ab3f800 1 --2- 172.21.15.50:0/3961968990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a02a1da0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.249+0000 7f285ab3f800 1 -- 172.21.15.50:0/3961968990 >> 172.21.15.50:0/3961968990 conn(0x55f7a029d500 msgr2=0x55f7a029f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.249+0000 7f285ab3f800 1 -- 172.21.15.50:0/3961968990 shutdown_connections 2024-05-07T13:57:56.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.249+0000 7f285ab3f800 1 -- 172.21.15.50:0/3961968990 wait complete. 2024-05-07T13:57:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.264+0000 7f285ab3f800 1 Processor -- start 2024-05-07T13:57:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.264+0000 7f285ab3f800 1 -- start start 2024-05-07T13:57:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.264+0000 7f285ab3f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a0396c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.264+0000 7f285ab3f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7a01ee170 con 0x55f7a02a1980 2024-05-07T13:57:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.265+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a0396c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.265+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a0396c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58618/0 (socket says 172.21.15.50:58618) 2024-05-07T13:57:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.265+0000 7f285689b640 1 -- 172.21.15.50:0/4040706405 learned_addr learned my addr 172.21.15.50:0/4040706405 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.265+0000 7f285689b640 1 -- 172.21.15.50:0/4040706405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a03971f0 con 0x55f7a02a1980 2024-05-07T13:57:56.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.265+0000 7f285689b640 1 --2- 172.21.15.50:0/4040706405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a0396c20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2848055040 tx=0x7f284804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c39489a78b66ac3 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.265+0000 7f2744e09640 1 -- 172.21.15.50:0/4040706405 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848057040 con 0x55f7a02a1980 2024-05-07T13:57:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.265+0000 7f2744e09640 1 -- 172.21.15.50:0/4040706405 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2848052990 con 0x55f7a02a1980 2024-05-07T13:57:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.265+0000 7f2744e09640 1 -- 172.21.15.50:0/4040706405 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848052c70 con 0x55f7a02a1980 2024-05-07T13:57:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 -- 172.21.15.50:0/4040706405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 msgr2=0x55f7a0396c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 --2- 172.21.15.50:0/4040706405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a0396c20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2848055040 tx=0x7f284804c000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 -- 172.21.15.50:0/4040706405 shutdown_connections 2024-05-07T13:57:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 --2- 172.21.15.50:0/4040706405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a0396c20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 -- 172.21.15.50:0/4040706405 >> 172.21.15.50:0/4040706405 conn(0x55f7a029d500 msgr2=0x55f7a0392540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 -- 172.21.15.50:0/4040706405 shutdown_connections 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 -- 172.21.15.50:0/4040706405 wait complete. 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 Processor -- start 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 -- start start 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a039e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.266+0000 7f285ab3f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7a02a33d0 con 0x55f7a02a1980 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a039e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a039e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58622/0 (socket says 172.21.15.50:58622) 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f285689b640 1 -- 172.21.15.50:0/49688773 learned_addr learned my addr 172.21.15.50:0/49688773 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f285689b640 1 -- 172.21.15.50:0/49688773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a039eb50 con 0x55f7a02a1980 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f285689b640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a039e610 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f284800a470 tx=0x7f2848003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f2743606640 1 -- 172.21.15.50:0/49688773 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848073070 con 0x55f7a02a1980 2024-05-07T13:57:56.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f2743606640 1 -- 172.21.15.50:0/49688773 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284805d780 con 0x55f7a02a1980 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7a039ede0 con 0x55f7a02a1980 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f2743606640 1 -- 172.21.15.50:0/49688773 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848057070 con 0x55f7a02a1980 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.267+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7a03a1a90 con 0x55f7a02a1980 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.268+0000 7f2743606640 1 -- 172.21.15.50:0/49688773 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2848076070 con 0x55f7a02a1980 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.268+0000 7f2743606640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f273c036900 0x7f273c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.268+0000 7f2743606640 1 -- 172.21.15.50:0/49688773 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f284808e150 con 0x55f7a02a1980 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.269+0000 7f285609a640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f273c036900 0x7f273c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.269+0000 7f285ab3f800 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a02a22e0 0x55f7a03a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.269+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03a5e20 con 0x55f7a02a22e0 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.269+0000 7f285709c640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a02a22e0 0x55f7a03a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.269+0000 7f285609a640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f273c036900 0x7f273c038dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f284c000f60 tx=0x7f284c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.269+0000 7f285709c640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a02a22e0 0x55f7a03a5850 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.269+0000 7f285709c640 1 -- 172.21.15.50:0/49688773 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a02a22e0 2024-05-07T13:57:56.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.269+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03a2e20 con 0x55f7a02a22e0 2024-05-07T13:57:56.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.270+0000 7f285709c640 1 -- 172.21.15.50:0/49688773 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a02a22e0 2024-05-07T13:57:56.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.270+0000 7f285ab3f800 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03a8130 0x55f7a03aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.270+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03aabc0 con 0x55f7a03a8130 2024-05-07T13:57:56.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.270+0000 7f285689b640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03a8130 0x55f7a03aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.270+0000 7f285689b640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03a8130 0x55f7a03aa520 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.270+0000 7f285689b640 1 -- 172.21.15.50:0/49688773 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2848075030 con 0x55f7a03a8130 2024-05-07T13:57:56.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.270+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03a70e0 con 0x55f7a02a22e0 2024-05-07T13:57:56.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.271+0000 7f285709c640 1 -- 172.21.15.50:0/49688773 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a02a22e0 2024-05-07T13:57:56.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.271+0000 7f285ab3f800 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7a03ac070 0x55f7a03ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.271+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03aec20 con 0x55f7a03ac070 2024-05-07T13:57:56.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.271+0000 7f285609a640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7a03ac070 0x55f7a03ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.271+0000 7f285609a640 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7a03ac070 0x55f7a03ae4c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.272+0000 7f285609a640 1 -- 172.21.15.50:0/49688773 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f284c009050 con 0x55f7a03ac070 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.272+0000 7f285ab3f800 1 Processor -- start 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.272+0000 7f285ab3f800 1 -- start start 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.272+0000 7f285ab3f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03bd080 0x55f7a03bd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.272+0000 7f285ab3f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7a0194cf0 con 0x55f7a03bd080 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03bd080 0x55f7a03bd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03bd080 0x55f7a03bd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58624/0 (socket says 172.21.15.50:58624) 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f285689b640 1 -- 172.21.15.50:0/1618486192 learned_addr learned my addr 172.21.15.50:0/1618486192 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f285689b640 1 -- 172.21.15.50:0/1618486192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a03bd9e0 con 0x55f7a03bd080 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f285689b640 1 --2- 172.21.15.50:0/1618486192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03bd080 0x55f7a03bd4a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2848006d80 tx=0x7f2848066bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f2740e01640 1 -- 172.21.15.50:0/1618486192 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284805ce10 con 0x55f7a03bd080 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f2740e01640 1 -- 172.21.15.50:0/1618486192 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2848006700 con 0x55f7a03bd080 2024-05-07T13:57:56.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f285ab3f800 1 -- 172.21.15.50:0/1618486192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7a03be450 con 0x55f7a03bd080 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f2740e01640 1 -- 172.21.15.50:0/1618486192 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848006a20 con 0x55f7a03bd080 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.273+0000 7f285ab3f800 1 -- 172.21.15.50:0/1618486192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7a03be950 con 0x55f7a03bd080 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.274+0000 7f2740e01640 1 -- 172.21.15.50:0/1618486192 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2848095060 con 0x55f7a03bd080 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.274+0000 7f2740e01640 1 --2- 172.21.15.50:0/1618486192 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2730036a50 0x7f2730038f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.274+0000 7f2740e01640 1 -- 172.21.15.50:0/1618486192 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f284808fd90 con 0x55f7a03bd080 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.274+0000 7f285609a640 1 --2- 172.21.15.50:0/1618486192 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2730036a50 0x7f2730038f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.275+0000 7f285ab3f800 1 Processor -- start 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.275+0000 7f285609a640 1 --2- 172.21.15.50:0/1618486192 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2730036a50 0x7f2730038f10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f284c00bf50 tx=0x7f284c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.275+0000 7f285ab3f800 1 -- start start 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.275+0000 7f285ab3f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.275+0000 7f285ab3f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7a03974b0 con 0x55f7a03ca170 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.275+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.275+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58630/0 (socket says 172.21.15.50:58630) 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.275+0000 7f285689b640 1 -- 172.21.15.50:0/665876992 learned_addr learned my addr 172.21.15.50:0/665876992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.275+0000 7f285689b640 1 -- 172.21.15.50:0/665876992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a03cab60 con 0x55f7a03ca170 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f285689b640 1 --2- 172.21.15.50:0/665876992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03ca590 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f284805af70 tx=0x7f2848073fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0c7ce62b88da29 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f273a7fc640 1 -- 172.21.15.50:0/665876992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848097ab0 con 0x55f7a03ca170 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f273a7fc640 1 -- 172.21.15.50:0/665876992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284808cd10 con 0x55f7a03ca170 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f273a7fc640 1 -- 172.21.15.50:0/665876992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284808c7f0 con 0x55f7a03ca170 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f285ab3f800 1 -- 172.21.15.50:0/665876992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 msgr2=0x55f7a03ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f285ab3f800 1 --2- 172.21.15.50:0/665876992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03ca590 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f284805af70 tx=0x7f2848073fa0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f285ab3f800 1 -- 172.21.15.50:0/665876992 shutdown_connections 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f285ab3f800 1 --2- 172.21.15.50:0/665876992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03ca590 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f285ab3f800 1 -- 172.21.15.50:0/665876992 >> 172.21.15.50:0/665876992 conn(0x55f7a03c64d0 msgr2=0x55f7a03c4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f285ab3f800 1 -- 172.21.15.50:0/665876992 shutdown_connections 2024-05-07T13:57:56.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.276+0000 7f285ab3f800 1 -- 172.21.15.50:0/665876992 wait complete. 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.277+0000 7f285ab3f800 1 Processor -- start 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.277+0000 7f285ab3f800 1 -- start start 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.277+0000 7f285ab3f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03d1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.277+0000 7f285ab3f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f7a03cb210 con 0x55f7a03ca170 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.277+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.277+0000 7f285689b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03d1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58638/0 (socket says 172.21.15.50:58638) 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.277+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 learned_addr learned my addr 172.21.15.50:0/2801162540 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.277+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a03d1ad0 con 0x55f7a03ca170 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.277+0000 7f285689b640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03d1590 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f284805cfd0 tx=0x7f284805af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.278+0000 7f2738ff9640 1 -- 172.21.15.50:0/2801162540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848078b50 con 0x55f7a03ca170 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.278+0000 7f2738ff9640 1 -- 172.21.15.50:0/2801162540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2848078cf0 con 0x55f7a03ca170 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.278+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7a03d1ad0 con 0x55f7a03ca170 2024-05-07T13:57:56.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.278+0000 7f2738ff9640 1 -- 172.21.15.50:0/2801162540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2848082730 con 0x55f7a03ca170 2024-05-07T13:57:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.278+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7a03d1ad0 con 0x55f7a03ca170 2024-05-07T13:57:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.279+0000 7f2738ff9640 1 -- 172.21.15.50:0/2801162540 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f28480a0070 con 0x55f7a03ca170 2024-05-07T13:57:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.279+0000 7f2738ff9640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2720036900 0x7f2720038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.279+0000 7f2738ff9640 1 -- 172.21.15.50:0/2801162540 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f28480b6d50 con 0x55f7a03ca170 2024-05-07T13:57:56.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.279+0000 7f285609a640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2720036900 0x7f2720038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.279+0000 7f285609a640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2720036900 0x7f2720038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f284c001b60 tx=0x7f284c010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.279+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.279+0000 7f285ab3f800 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a03dcd30 0x55f7a03df1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.279+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03df940 con 0x55f7a03dcd30 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285709c640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a03dcd30 0x55f7a03df1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285709c640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a03dcd30 0x55f7a03df1f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285ab3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285ab3f800 20 realm 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03dfd50 con 0x55f7a03dcd30 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285ab3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285ab3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.280+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e0620 con 0x55f7a03dcd30 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285ab3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285ab3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285ab3f800 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03e1720 0x55f7a03e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e4120 con 0x55f7a03e1720 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285689b640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03e1720 0x55f7a03e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.281+0000 7f285689b640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03e1720 0x55f7a03e3b10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.282+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.282+0000 7f285ab3f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.282+0000 7f285ab3f800 20 searching for the correct realm 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.282+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e5a50 con 0x55f7a03e1720 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.282+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.282+0000 7f285689b640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f28480ac040 0x7f284808e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.282+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e5a50 con 0x7f28480ac040 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.282+0000 7f285609a640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f28480ac040 0x7f284808e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.282+0000 7f285609a640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f28480ac040 0x7f284808e470 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.283+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c009050 con 0x7f28480ac040 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.283+0000 7f285609a640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f284c038040 0x7f284c01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.283+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e5a50 con 0x7f284c038040 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.283+0000 7f285709c640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f284c038040 0x7f284c01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.284+0000 7f285709c640 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f284c038040 0x7f284c01bab0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.284+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.284+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.284+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.284+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.284+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.284+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.284+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.284+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f284c038040 2024-05-07T13:57:56.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.285+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.285+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f28480ac040 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.285+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c009050 con 0x7f28480ac040 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.285+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f28480ac040 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.285+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c009050 con 0x7f28480ac040 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.285+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.286+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.286+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f284c038040 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.286+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.286+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.286+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.286+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f28480ac040 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.286+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f284c009050 con 0x7f28480ac040 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.286+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03e1720 2024-05-07T13:57:56.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.287+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.287+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03e1720 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.287+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.287+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f284c038040 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.287+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.287+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03e1720 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.288+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.288+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03e1720 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.288+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.288+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.288+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.288+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.288+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.288+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f284c038040 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.289+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.289+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03e1720 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.289+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.289+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f28480ac040 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.289+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c009050 con 0x7f28480ac040 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.289+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.289+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.289+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f284c038040 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.290+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.290+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03e1720 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.290+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.290+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f284c038040 2024-05-07T13:57:56.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.290+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.290+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f28480ac040 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.291+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c045040 con 0x7f28480ac040 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.291+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03e1720 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.291+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.291+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f28480ac040 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.291+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c045040 con 0x7f28480ac040 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.291+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x55f7a03dcd30 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.291+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.291+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e09c0 con 0x7f28480ac040 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c045040 con 0x7f28480ac040 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:56.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e49e0 con 0x55f7a03dcd30 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e4dd0 con 0x55f7a03dcd30 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.292+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e4dd0 con 0x7f284c038040 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 20 zone default found 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 4 Realm: () 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 20 zonegroup default 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e4560 con 0x7f284c038040 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e4560 con 0x55f7a03e1720 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.293+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e7a30 con 0x55f7a03e1720 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.294+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.294+0000 7f285ab3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.294+0000 7f285ab3f800 20 started sync module instance, tier type = 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.294+0000 7f285ab3f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.294+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e6d50 con 0x7f28480ac040 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.295+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c045040 con 0x7f28480ac040 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.295+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522033729856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e8340 con 0x7f28480ac040 2024-05-07T13:57:56.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.295+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e8b90 con 0x55f7a03dcd30 2024-05-07T13:57:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.296+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522033729856] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c045040 con 0x7f28480ac040 2024-05-07T13:57:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.296+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.296+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522033733264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e8bf0 con 0x55f7a03dcd30 2024-05-07T13:57:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.296+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e96e0 con 0x55f7a03e1720 2024-05-07T13:57:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.297+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.297+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522033738160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e9fb0 con 0x55f7a03e1720 2024-05-07T13:57:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.297+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03eaa90 con 0x7f28480ac040 2024-05-07T13:57:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.298+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522033733264] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.298+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c045040 con 0x7f28480ac040 2024-05-07T13:57:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.299+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522033735392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03eb330 con 0x7f28480ac040 2024-05-07T13:57:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.299+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03ebcf0 con 0x55f7a03dcd30 2024-05-07T13:57:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.299+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522033738160] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.300+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522033735392] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c045040 con 0x7f28480ac040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.300+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.300+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522033740544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03ebcf0 con 0x55f7a03dcd30 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.300+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03ec580 con 0x7f284c038040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.301+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522033740544] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.301+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.301+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522033748032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03ec110 con 0x7f284c038040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.301+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03ecf90 con 0x7f284c038040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.302+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522033748032] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.302+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.302+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522033749568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03ecf90 con 0x7f284c038040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.302+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03ed950 con 0x7f284c038040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522033749568] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522033752800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03edb30 con 0x7f284c038040 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285ab3f800 20 add_watcher() i=0 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285ab3f800 20 add_watcher() i=1 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285ab3f800 20 add_watcher() i=2 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285ab3f800 20 add_watcher() i=3 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285ab3f800 20 add_watcher() i=4 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285ab3f800 20 add_watcher() i=5 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.304+0000 7f285ab3f800 20 add_watcher() i=6 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.305+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522033752800] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.305+0000 7f285ab3f800 20 add_watcher() i=7 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.305+0000 7f285ab3f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.305+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03f0d00 con 0x55f7a03dcd30 2024-05-07T13:57:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.305+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.305+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522033755872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03edfb0 con 0x55f7a03dcd30 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.306+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522033755872] v29'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.306+0000 7f270d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.306+0000 7f285ab3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.307+0000 7f285ab3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.307+0000 7f285ab3f800 5 note: GC not initialized 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.307+0000 7f2687fff640 20 reqs_thread_entry: start 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.307+0000 7f285ab3f800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.307+0000 7f285ab3f800 20 Filter name: none 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.307+0000 7f2685ffb640 20 reqs_thread_entry: start 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.307+0000 7f285ab3f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.307+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.307+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a0424310 con 0x7f284c038040 2024-05-07T13:57:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a0422ab0 con 0x55f7a03dcd30 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-07T13:57:56.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.308+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a04233a0 con 0x7f284c038040 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.309+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v29'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.309+0000 7f285ab3f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.309+0000 7f285ab3f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.309+0000 7f285ab3f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.309+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94522033975024 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a0427c50 con 0x55f7a03dcd30 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.309+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== watch-notify(notify (1) cookie 94522033740544 notify 124554051603 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55f7a0423740 con 0x55f7a03dcd30 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.309+0000 7f273a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051603 cookie 94522033740544 notifier 4824 bl.length()=649 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.310+0000 7f273a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.310+0000 7f273a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.310+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify cookie 94522033975024 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.310+0000 7f273a7fc640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f271c003ea0 con 0x55f7a03dcd30 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.310+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94522033975024 notify 124554051603 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7a0423d60 con 0x55f7a03dcd30 2024-05-07T13:57:56.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.310+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.310+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a0422ea0 con 0x55f7a03dcd30 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v29'22 uv22 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f285ab3f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f285ab3f800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f285ab3f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94522033974944 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f7a0427c50 con 0x55f7a03e1720 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== watch-notify(notify (1) cookie 94522033738160 notify 124554051594 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f7a03be450 con 0x55f7a03e1720 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f273a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94522033738160 notifier 4824 bl.length()=177 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f273a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f273a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(68 notify.2 [notify cookie 94522033974944 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.311+0000 7f273a7fc640 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f271c003ea0 con 0x55f7a03e1720 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.312+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== watch-notify(notify_complete (2) cookie 94522033974944 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7a03bd9e0 con 0x55f7a03e1720 2024-05-07T13:57:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.312+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.309 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:56.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.313+0000 7f270d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:56.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.313+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522033755872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03f03a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.314+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94522033755872] v29'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.314+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522033729856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03ed6e0 con 0x7f28480ac040 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.315+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94522033729856] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c045040 con 0x7f28480ac040 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.315+0000 7f285ab3f800 20 remove_watcher() i=0 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.315+0000 7f285ab3f800 2 removed watcher, disabling cache 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.315+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522033733264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e7140 con 0x55f7a03dcd30 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.316+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94522033733264] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.316+0000 7f285ab3f800 20 remove_watcher() i=1 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.316+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522033738160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e7140 con 0x55f7a03e1720 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.317+0000 7f285689b640 1 -- 172.21.15.50:0/2801162540 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94522033738160] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480bb020 con 0x55f7a03e1720 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.317+0000 7f285ab3f800 20 remove_watcher() i=2 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.317+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522033735392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e7140 con 0x7f28480ac040 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.318+0000 7f285609a640 1 -- 172.21.15.50:0/2801162540 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94522033735392] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c045040 con 0x7f28480ac040 2024-05-07T13:57:56.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.318+0000 7f285ab3f800 20 remove_watcher() i=3 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.318+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522033740544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e7140 con 0x55f7a03dcd30 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.320+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94522033740544] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x55f7a03dcd30 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.320+0000 7f285ab3f800 20 remove_watcher() i=4 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.320+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522033748032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e9b00 con 0x7f284c038040 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.321+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94522033748032] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.321+0000 7f285ab3f800 20 remove_watcher() i=5 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.321+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522033749568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03eb840 con 0x7f284c038040 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.322+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94522033749568] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.322+0000 7f285ab3f800 20 remove_watcher() i=6 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.322+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522033752800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f7a03e9b00 con 0x7f284c038040 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94522033752800] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285000a4a0 con 0x7f284c038040 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 20 remove_watcher() i=7 2024-05-07T13:57:56.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f284c038040 msgr2=0x7f284c01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f284c038040 0x7f284c01bab0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a03dcd30 msgr2=0x55f7a03df1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a03dcd30 0x55f7a03df1f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f28480ac040 msgr2=0x7f284808e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f28480ac040 0x7f284808e470 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03e1720 msgr2=0x55f7a03e3b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03e1720 0x55f7a03e3b10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2720036900 msgr2=0x7f2720038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2720036900 0x7f2720038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f284c001b60 tx=0x7f284c010000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 msgr2=0x55f7a03d1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03d1590 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f284805cfd0 tx=0x7f284805af00 comp rx=0 tx=0).stop 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285709c640 1 -- 172.21.15.50:0/2801162540 reap_dead start 2024-05-07T13:57:56.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 shutdown_connections 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 --2- 172.21.15.50:0/2801162540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03ca170 0x55f7a03d1590 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.323+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 >> 172.21.15.50:0/2801162540 conn(0x55f7a03c64d0 msgr2=0x55f7a03c3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 shutdown_connections 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/2801162540 wait complete. 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/1618486192 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2730036a50 msgr2=0x7f2730038f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 --2- 172.21.15.50:0/1618486192 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2730036a50 0x7f2730038f10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f284c00bf50 tx=0x7f284c00f000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/1618486192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03bd080 msgr2=0x55f7a03bd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 --2- 172.21.15.50:0/1618486192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03bd080 0x55f7a03bd4a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2848006d80 tx=0x7f2848066bd0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/1618486192 shutdown_connections 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 --2- 172.21.15.50:0/1618486192 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2730036a50 0x7f2730038f10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 --2- 172.21.15.50:0/1618486192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a03bd080 0x55f7a03bd4a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/1618486192 >> 172.21.15.50:0/1618486192 conn(0x55f7a03b1120 msgr2=0x55f7a03b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/1618486192 shutdown_connections 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/1618486192 wait complete. 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7a03ac070 msgr2=0x55f7a03ae4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f7a03ac070 0x55f7a03ae4c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a02a22e0 msgr2=0x55f7a03a5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f7a02a22e0 0x55f7a03a5850 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03a8130 msgr2=0x55f7a03aa520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f7a03a8130 0x55f7a03aa520 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f273c036900 msgr2=0x7f273c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f273c036900 0x7f273c038dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f284c000f60 tx=0x7f284c0012b0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 msgr2=0x55f7a039e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 --2- 172.21.15.50:0/49688773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f7a02a1980 0x55f7a039e610 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f284800a470 tx=0x7f2848003020 comp rx=0 tx=0).stop 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285709c640 1 -- 172.21.15.50:0/49688773 reap_dead start 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 shutdown_connections 2024-05-07T13:57:56.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.324+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 >> 172.21.15.50:0/49688773 conn(0x55f7a029d500 msgr2=0x55f7a0390d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.325+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 shutdown_connections 2024-05-07T13:57:56.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.325+0000 7f285ab3f800 1 -- 172.21.15.50:0/49688773 wait complete. 2024-05-07T13:57:56.322 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:56.322 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:56.323 ERROR:root:0 2024-05-07T13:57:56.324 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:56.330 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000001c147e9a9ab64842-00663a3364-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:57:56.330 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-05-07T13:57:56.342 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:56.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-05-07T13:57:56.356 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-05-07T13:57:56.356 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-05-07T13:57:56.372 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-07T13:57:56.372 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-07T13:57:56.380 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-05-07T13:57:56.381 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:56.384 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:56.385 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-05-07T13:57:56.388 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:56.389 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-07T13:57:56.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-07T13:57:56.389 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-05-07T13:57:56.436 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:56.437 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.450+0000 7fb1ad72e800 1 Processor -- start 2024-05-07T13:57:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.450+0000 7fb1ad72e800 1 -- start start 2024-05-07T13:57:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.450+0000 7fb1ad72e800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55859af0bfe0 0x55859af0c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.450+0000 7fb1ad72e800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55859af0ca80 con 0x55859af0d240 2024-05-07T13:57:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.450+0000 7fb1ad72e800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55859ad9e050 con 0x55859af0bfe0 2024-05-07T13:57:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.451+0000 7fb1a9467640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55859af0bfe0 0x55859af0c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.451+0000 7fb1a8c66640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55859af0d240 0x55859af0d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56816/0 (socket says 172.21.15.50:56816) 2024-05-07T13:57:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.451+0000 7fb1a8c66640 1 -- 172.21.15.50:0/3202700967 learned_addr learned my addr 172.21.15.50:0/3202700967 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:56.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.451+0000 7fb1a9467640 1 -- 172.21.15.50:0/3202700967 >> v1:172.21.15.22:6789/0 conn(0x55859af0d240 legacy=0x55859af0d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.451+0000 7fb1a9467640 1 -- 172.21.15.50:0/3202700967 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859af0de00 con 0x55859af0bfe0 2024-05-07T13:57:56.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.453+0000 7fb1a9467640 1 --2- 172.21.15.50:0/3202700967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859af0c400 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00a470 tx=0x7fb19c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5f78316e1b67bf server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.453+0000 7fb19bfff640 1 -- 172.21.15.50:0/3202700967 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c057070 con 0x55859af0bfe0 2024-05-07T13:57:56.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.453+0000 7fb19bfff640 1 -- 172.21.15.50:0/3202700967 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c04adc0 con 0x55859af0bfe0 2024-05-07T13:57:56.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.453+0000 7fb19bfff640 1 -- 172.21.15.50:0/3202700967 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c052590 con 0x55859af0bfe0 2024-05-07T13:57:56.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.454+0000 7fb1ad72e800 1 -- 172.21.15.50:0/3202700967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 msgr2=0x55859af0c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.454+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/3202700967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859af0c400 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00a470 tx=0x7fb19c01ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:56.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.454+0000 7fb1ad72e800 1 -- 172.21.15.50:0/3202700967 shutdown_connections 2024-05-07T13:57:56.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.454+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/3202700967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859af0c400 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.454+0000 7fb1ad72e800 1 -- 172.21.15.50:0/3202700967 >> 172.21.15.50:0/3202700967 conn(0x55859af075c0 msgr2=0x55859af099e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.454+0000 7fb1ad72e800 1 -- 172.21.15.50:0/3202700967 shutdown_connections 2024-05-07T13:57:56.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.454+0000 7fb1ad72e800 1 -- 172.21.15.50:0/3202700967 wait complete. 2024-05-07T13:57:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.469+0000 7fb1ad72e800 1 Processor -- start 2024-05-07T13:57:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.469+0000 7fb1ad72e800 1 -- start start 2024-05-07T13:57:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.469+0000 7fb1ad72e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859ae7fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.469+0000 7fb1ad72e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55859ae581c0 con 0x55859af0bfe0 2024-05-07T13:57:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.469+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859ae7fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.470+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859ae7fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58664/0 (socket says 172.21.15.50:58664) 2024-05-07T13:57:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.470+0000 7fb1a9467640 1 -- 172.21.15.50:0/2682785871 learned_addr learned my addr 172.21.15.50:0/2682785871 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.470+0000 7fb1a9467640 1 -- 172.21.15.50:0/2682785871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859b0015e0 con 0x55859af0bfe0 2024-05-07T13:57:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.470+0000 7fb1a9467640 1 --2- 172.21.15.50:0/2682785871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859ae7fe50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb19c055040 tx=0x7fb19c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badfbc8582279bf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.470+0000 7fb097606640 1 -- 172.21.15.50:0/2682785871 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c057040 con 0x55859af0bfe0 2024-05-07T13:57:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.470+0000 7fb097606640 1 -- 172.21.15.50:0/2682785871 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c063070 con 0x55859af0bfe0 2024-05-07T13:57:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.470+0000 7fb097606640 1 -- 172.21.15.50:0/2682785871 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c05d790 con 0x55859af0bfe0 2024-05-07T13:57:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.471+0000 7fb1ad72e800 1 -- 172.21.15.50:0/2682785871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 msgr2=0x55859ae7fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.471+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/2682785871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859ae7fe50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb19c055040 tx=0x7fb19c04c000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.471+0000 7fb1ad72e800 1 -- 172.21.15.50:0/2682785871 shutdown_connections 2024-05-07T13:57:56.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.471+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/2682785871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859ae7fe50 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.471+0000 7fb1ad72e800 1 -- 172.21.15.50:0/2682785871 >> 172.21.15.50:0/2682785871 conn(0x55859af075c0 msgr2=0x55859aff90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.471+0000 7fb1ad72e800 1 -- 172.21.15.50:0/2682785871 shutdown_connections 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.471+0000 7fb1ad72e800 1 -- 172.21.15.50:0/2682785871 wait complete. 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.471+0000 7fb1ad72e800 1 Processor -- start 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.471+0000 7fb1ad72e800 1 -- start start 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb1ad72e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859b006330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb1ad72e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55859af15710 con 0x55859af0bfe0 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859b006330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859b006330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58676/0 (socket says 172.21.15.50:58676) 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb1a9467640 1 -- 172.21.15.50:0/507688648 learned_addr learned my addr 172.21.15.50:0/507688648 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb1a9467640 1 -- 172.21.15.50:0/507688648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859b006870 con 0x55859af0bfe0 2024-05-07T13:57:56.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb1a9467640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859b006330 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00a470 tx=0x7fb19c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb095e03640 1 -- 172.21.15.50:0/507688648 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c057050 con 0x55859af0bfe0 2024-05-07T13:57:56.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb095e03640 1 -- 172.21.15.50:0/507688648 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c05dc90 con 0x55859af0bfe0 2024-05-07T13:57:56.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55859b006b00 con 0x55859af0bfe0 2024-05-07T13:57:56.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.472+0000 7fb095e03640 1 -- 172.21.15.50:0/507688648 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c052440 con 0x55859af0bfe0 2024-05-07T13:57:56.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.473+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55859b0097b0 con 0x55859af0bfe0 2024-05-07T13:57:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.473+0000 7fb095e03640 1 -- 172.21.15.50:0/507688648 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb19c052670 con 0x55859af0bfe0 2024-05-07T13:57:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.474+0000 7fb095e03640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090036900 0x7fb090038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.474+0000 7fb095e03640 1 -- 172.21.15.50:0/507688648 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb19c08ddd0 con 0x55859af0bfe0 2024-05-07T13:57:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.474+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090036900 0x7fb090038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.474+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859af0d240 0x55859b00d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.474+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b00daf0 con 0x55859af0d240 2024-05-07T13:57:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.474+0000 7fb1a9c68640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859af0d240 0x55859b00d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.474+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090036900 0x7fb090038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000f60 tx=0x7fb1a00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.474+0000 7fb1a9c68640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859af0d240 0x55859b00d570 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.475+0000 7fb1a9c68640 1 -- 172.21.15.50:0/507688648 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859af0d240 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.475+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b00ab40 con 0x55859af0d240 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.475+0000 7fb1a9c68640 1 -- 172.21.15.50:0/507688648 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859af0d240 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.475+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b00fe50 0x55859b012240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.475+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b012910 con 0x55859b00fe50 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.475+0000 7fb1a9467640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b00fe50 0x55859b012240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.475+0000 7fb1a9467640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b00fe50 0x55859b012240 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.476+0000 7fb1a9467640 1 -- 172.21.15.50:0/507688648 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb19c078070 con 0x55859b00fe50 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.476+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b00ee00 con 0x55859af0d240 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.476+0000 7fb1a9c68640 1 -- 172.21.15.50:0/507688648 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859af0d240 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.476+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55859b013d50 0x55859b016210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.476+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b0169a0 con 0x55859b013d50 2024-05-07T13:57:56.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.476+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55859b013d50 0x55859b016210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.477+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55859b013d50 0x55859b016210 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.477+0000 7fb1a8c66640 1 -- 172.21.15.50:0/507688648 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1a0009050 con 0x55859b013d50 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.477+0000 7fb1ad72e800 1 Processor -- start 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.477+0000 7fb1ad72e800 1 -- start start 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb1ad72e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859afff170 0x55859affd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb1ad72e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55859adfecf0 con 0x55859afff170 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859afff170 0x55859affd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859afff170 0x55859affd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58690/0 (socket says 172.21.15.50:58690) 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb1a9467640 1 -- 172.21.15.50:0/290215823 learned_addr learned my addr 172.21.15.50:0/290215823 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb1a9467640 1 -- 172.21.15.50:0/290215823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859affdb20 con 0x55859afff170 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb1a9467640 1 --2- 172.21.15.50:0/290215823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859afff170 0x55859affd5e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb19c08c090 tx=0x7fb19c052a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb08effd640 1 -- 172.21.15.50:0/290215823 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c08c990 con 0x55859afff170 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb08effd640 1 -- 172.21.15.50:0/290215823 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c08cb30 con 0x55859afff170 2024-05-07T13:57:56.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.478+0000 7fb08effd640 1 -- 172.21.15.50:0/290215823 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c08ce10 con 0x55859afff170 2024-05-07T13:57:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.479+0000 7fb1ad72e800 1 -- 172.21.15.50:0/290215823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55859affddb0 con 0x55859afff170 2024-05-07T13:57:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.479+0000 7fb1ad72e800 1 -- 172.21.15.50:0/290215823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55859affddb0 con 0x55859afff170 2024-05-07T13:57:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.479+0000 7fb08effd640 1 -- 172.21.15.50:0/290215823 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb19c086480 con 0x55859afff170 2024-05-07T13:57:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.479+0000 7fb08effd640 1 --2- 172.21.15.50:0/290215823 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb080036970 0x7fb080038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb08effd640 1 -- 172.21.15.50:0/290215823 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb19c096d30 con 0x55859afff170 2024-05-07T13:57:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/290215823 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb080036970 0x7fb080038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb1ad72e800 1 Processor -- start 2024-05-07T13:57:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb1ad72e800 1 -- start start 2024-05-07T13:57:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/290215823 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb080036970 0x7fb080038e30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000bf50 tx=0x7fb1a000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb1ad72e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b034340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb1ad72e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55859b001870 con 0x55859b033f20 2024-05-07T13:57:56.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b034340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b034340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58704/0 (socket says 172.21.15.50:58704) 2024-05-07T13:57:56.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.480+0000 7fb1a9467640 1 -- 172.21.15.50:0/1858727045 learned_addr learned my addr 172.21.15.50:0/1858727045 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb1a9467640 1 -- 172.21.15.50:0/1858727045 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859b034910 con 0x55859b033f20 2024-05-07T13:57:56.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb1a9467640 1 --2- 172.21.15.50:0/1858727045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b034340 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb19c094b30 tx=0x7fb19c06a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32491addf20992f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb08cff9640 1 -- 172.21.15.50:0/1858727045 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c0a3070 con 0x55859b033f20 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb08cff9640 1 -- 172.21.15.50:0/1858727045 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c07c460 con 0x55859b033f20 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb08cff9640 1 -- 172.21.15.50:0/1858727045 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c0943c0 con 0x55859b033f20 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb1ad72e800 1 -- 172.21.15.50:0/1858727045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 msgr2=0x55859b034340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/1858727045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b034340 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb19c094b30 tx=0x7fb19c06a530 comp rx=0 tx=0).stop 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb1ad72e800 1 -- 172.21.15.50:0/1858727045 shutdown_connections 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/1858727045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b034340 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.481+0000 7fb1ad72e800 1 -- 172.21.15.50:0/1858727045 >> 172.21.15.50:0/1858727045 conn(0x55859b030280 msgr2=0x55859b02e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1ad72e800 1 -- 172.21.15.50:0/1858727045 shutdown_connections 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1ad72e800 1 -- 172.21.15.50:0/1858727045 wait complete. 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1ad72e800 1 Processor -- start 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1ad72e800 1 -- start start 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1ad72e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b03b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1ad72e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55859b034fc0 con 0x55859b033f20 2024-05-07T13:57:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b03b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1a9467640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b03b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58706/0 (socket says 172.21.15.50:58706) 2024-05-07T13:57:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 learned_addr learned my addr 172.21.15.50:0/855103260 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.482+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859b03b850 con 0x55859b033f20 2024-05-07T13:57:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.483+0000 7fb1a9467640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b03b310 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb19c094b30 tx=0x7fb19c096fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.483+0000 7fb07effd640 1 -- 172.21.15.50:0/855103260 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c086a20 con 0x55859b033f20 2024-05-07T13:57:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.483+0000 7fb07effd640 1 -- 172.21.15.50:0/855103260 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c0516e0 con 0x55859b033f20 2024-05-07T13:57:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.483+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55859b03b850 con 0x55859b033f20 2024-05-07T13:57:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.483+0000 7fb07effd640 1 -- 172.21.15.50:0/855103260 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c0519c0 con 0x55859b033f20 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.483+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55859b03b850 con 0x55859b033f20 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.484+0000 7fb07effd640 1 -- 172.21.15.50:0/855103260 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb19c0b5020 con 0x55859b033f20 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.484+0000 7fb07effd640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb074036900 0x7fb074038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.484+0000 7fb07effd640 1 -- 172.21.15.50:0/855103260 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb19c0b8d30 con 0x55859b033f20 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.484+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb074036900 0x7fb074038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.485+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb074036900 0x7fb074038dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0001b60 tx=0x7fb1a0010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.485+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.485+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859b046ab0 0x55859b048f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.485+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b0496c0 con 0x55859b046ab0 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.485+0000 7fb1a9c68640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859b046ab0 0x55859b048f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.485+0000 7fb1a9c68640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859b046ab0 0x55859b048f70 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.485+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 20 realm 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b049ad0 con 0x55859b046ab0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a3a0 con 0x55859b046ab0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b04b4a0 0x55859b04d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b04de50 con 0x55859b04b4a0 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.486+0000 7fb1a9467640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b04b4a0 0x55859b04d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.487+0000 7fb1a9467640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b04b4a0 0x55859b04d890 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.487+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.487+0000 7fb1ad72e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.487+0000 7fb1ad72e800 20 searching for the correct realm 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.487+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04f780 con 0x55859b04b4a0 2024-05-07T13:57:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.487+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.487+0000 7fb1a9467640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb19c0713f0 0x7fb19c0c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.487+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04f780 con 0x7fb19c0713f0 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.488+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb19c0713f0 0x7fb19c0c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.488+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb19c0713f0 0x7fb19c0c0a30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.488+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.488+0000 7fb1a8c66640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb1a0037040 0x7fb1a0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.488+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04f780 con 0x7fb1a0037040 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.489+0000 7fb1a9c68640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb1a0037040 0x7fb1a0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.489+0000 7fb1a9c68640 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb1a0037040 0x7fb1a0036410 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.489+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.489+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.490+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.490+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.490+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.490+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.490+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.490+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb1a0037040 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.490+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.490+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb19c0713f0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.491+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.491+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb19c0713f0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.491+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.491+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.491+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.491+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb1a0037040 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.491+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.491+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.492+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.492+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb19c0713f0 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.492+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.492+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b04b4a0 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.492+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.492+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b04b4a0 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.492+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.492+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb1a0037040 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.493+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.493+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b04b4a0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.493+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.493+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b04b4a0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.493+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.493+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.493+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.494+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.494+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.494+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb1a0037040 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.494+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.494+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b04b4a0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.494+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.494+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb19c0713f0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.495+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.495+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.495+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.495+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb1a0037040 2024-05-07T13:57:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.495+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.495+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b04b4a0 2024-05-07T13:57:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.495+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.496+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb1a0037040 2024-05-07T13:57:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.496+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.496+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb19c0713f0 2024-05-07T13:57:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.496+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.496+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b04b4a0 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.496+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.496+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb19c0713f0 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x55859b046ab0 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55859b04a740 con 0x7fb19c0713f0 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:56.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b04e710 con 0x55859b046ab0 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b04eb00 con 0x55859b046ab0 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.497+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b04eb00 con 0x7fb1a0037040 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 20 zone default found 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 4 Realm: () 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 20 zonegroup default 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.498+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b04e290 con 0x7fb1a0037040 2024-05-07T13:57:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b04e2e0 con 0x55859b04b4a0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b051750 con 0x55859b04b4a0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 20 started sync module instance, tier type = 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.499+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b050a80 con 0x7fb19c0713f0 2024-05-07T13:57:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.500+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.500+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94032319811184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b052060 con 0x7fb19c0713f0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.500+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b0528b0 con 0x55859b046ab0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.501+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94032319811184] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.502+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.502+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94032319814576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b0528f0 con 0x55859b046ab0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.502+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b0533e0 con 0x55859b04b4a0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.503+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94032319814576] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.503+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.503+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94032319819440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b053780 con 0x55859b04b4a0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.503+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b054230 con 0x7fb19c0713f0 2024-05-07T13:57:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.504+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.504+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94032319823120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b054ad0 con 0x7fb19c0713f0 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.504+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b0555b0 con 0x55859b046ab0 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.504+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94032319819440] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.505+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94032319823120] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.505+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.505+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94032319825440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b0550c0 con 0x55859b046ab0 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.505+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b055ec0 con 0x7fb1a0037040 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.507+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94032319825440] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.507+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.507+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94032319816704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b055e30 con 0x7fb1a0037040 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.507+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b056850 con 0x7fb1a0037040 2024-05-07T13:57:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.508+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(56 notify.6 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.508+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94032319832896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b056810 con 0x7fb1a0037040 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.508+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b0577b0 con 0x7fb1a0037040 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.508+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94032319816704] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94032319832896] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94032319836864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b0569f0 con 0x7fb1a0037040 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1ad72e800 20 add_watcher() i=0 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1ad72e800 20 add_watcher() i=1 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1ad72e800 20 add_watcher() i=2 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1ad72e800 20 add_watcher() i=3 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1ad72e800 20 add_watcher() i=4 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1ad72e800 20 add_watcher() i=5 2024-05-07T13:57:56.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.509+0000 7fb1ad72e800 20 add_watcher() i=6 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.510+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94032319836864] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.510+0000 7fb1ad72e800 20 add_watcher() i=7 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.510+0000 7fb1ad72e800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.510+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b055980 con 0x55859b046ab0 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.510+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.510+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94032319834336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b057ef0 con 0x55859b046ab0 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.511+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94032319834336] v29'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.511+0000 7fb05ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.511+0000 7fb1ad72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.511+0000 7fb1ad72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.512+0000 7fb1ad72e800 5 note: GC not initialized 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.512+0000 7fb05efe5640 20 reqs_thread_entry: start 2024-05-07T13:57:56.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.512+0000 7fb1ad72e800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.512+0000 7fb1ad72e800 20 Filter name: none 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.512+0000 7fb05cfe1640 20 reqs_thread_entry: start 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.512+0000 7fb1ad72e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.512+0000 7fb1ad72e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.512+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b08dbd0 con 0x7fb1a0037040 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.513+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.513+0000 7fb1ad72e800 20 rados_obj.operate() r=0 bl.length=473 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.513+0000 7fb1ad72e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.513+0000 7fb1ad72e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.513+0000 7fb1ad72e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:56.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.513+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b0941b0 con 0x7fb1a0037040 2024-05-07T13:57:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.514+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.514+0000 7fb1ad72e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.514+0000 7fb1ad72e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.514+0000 7fb1ad72e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.514+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94032320085024 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55859b08f9e0 con 0x55859b046ab0 2024-05-07T13:57:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.515+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 94032319825440 notify 124554051605 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fb1a403d040 con 0x55859b046ab0 2024-05-07T13:57:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.515+0000 7fb08cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94032319825440 notifier 4831 bl.length()=636 2024-05-07T13:57:56.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.515+0000 7fb08cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.515+0000 7fb08cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.515+0000 7fb08cff9640 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fb06c003ea0 con 0x55859b046ab0 2024-05-07T13:57:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.515+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 notify.4 [notify cookie 94032320085024 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.515+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.515+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94032320085024 notify 124554051605 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb1a402f040 con 0x55859b046ab0 2024-05-07T13:57:56.513 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:56.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.516+0000 7fb05ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:56.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.516+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94032319834336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b08c760 con 0x55859b046ab0 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.517+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94032319834336] v29'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.517+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94032319811184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b0568e0 con 0x7fb19c0713f0 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.518+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94032319811184] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.518+0000 7fb1ad72e800 20 remove_watcher() i=0 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.518+0000 7fb1ad72e800 2 removed watcher, disabling cache 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.518+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94032319814576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b050e70 con 0x55859b046ab0 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.519+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94032319814576] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.519+0000 7fb1ad72e800 20 remove_watcher() i=1 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.519+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94032319819440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b051bb0 con 0x55859b04b4a0 2024-05-07T13:57:56.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.520+0000 7fb1a9467640 1 -- 172.21.15.50:0/855103260 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94032319819440] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c0a5030 con 0x55859b04b4a0 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.520+0000 7fb1ad72e800 20 remove_watcher() i=2 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.520+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94032319823120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b051bb0 con 0x7fb19c0713f0 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.521+0000 7fb1a8c66640 1 -- 172.21.15.50:0/855103260 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94032319823120] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0009050 con 0x7fb19c0713f0 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.521+0000 7fb1ad72e800 20 remove_watcher() i=3 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.521+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94032319825440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b053d10 con 0x55859b046ab0 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.522+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94032319825440] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55859b046ab0 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.522+0000 7fb1ad72e800 20 remove_watcher() i=4 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.522+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94032319816704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b051bb0 con 0x7fb1a0037040 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.523+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94032319816704] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.523+0000 7fb1ad72e800 20 remove_watcher() i=5 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.523+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94032319832896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b054620 con 0x7fb1a0037040 2024-05-07T13:57:56.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.525+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94032319832896] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.525+0000 7fb1ad72e800 20 remove_watcher() i=6 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.525+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94032319836864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55859b053d10 con 0x7fb1a0037040 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94032319836864] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb1a0037040 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 20 remove_watcher() i=7 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb1a0037040 msgr2=0x7fb1a0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fb1a0037040 0x7fb1a0036410 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859b046ab0 msgr2=0x55859b048f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859b046ab0 0x55859b048f70 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb19c0713f0 msgr2=0x7fb19c0c0a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fb19c0713f0 0x7fb19c0c0a30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b04b4a0 msgr2=0x55859b04d890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b04b4a0 0x55859b04d890 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb074036900 msgr2=0x7fb074038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb074036900 0x7fb074038dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0001b60 tx=0x7fb1a0010000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 msgr2=0x55859b03b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b03b310 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb19c094b30 tx=0x7fb19c096fd0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1a9c68640 1 -- 172.21.15.50:0/855103260 reap_dead start 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 shutdown_connections 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/855103260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859b033f20 0x55859b03b310 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 >> 172.21.15.50:0/855103260 conn(0x55859b030280 msgr2=0x55859b02d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 shutdown_connections 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.526+0000 7fb1ad72e800 1 -- 172.21.15.50:0/855103260 wait complete. 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/290215823 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb080036970 msgr2=0x7fb080038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/290215823 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb080036970 0x7fb080038e30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000bf50 tx=0x7fb1a000f000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/290215823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859afff170 msgr2=0x55859affd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/290215823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859afff170 0x55859affd5e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb19c08c090 tx=0x7fb19c052a20 comp rx=0 tx=0).stop 2024-05-07T13:57:56.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/290215823 shutdown_connections 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/290215823 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb080036970 0x7fb080038e30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/290215823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859afff170 0x55859affd5e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/290215823 >> 172.21.15.50:0/290215823 conn(0x55859b018ea0 msgr2=0x55859b0192a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/290215823 shutdown_connections 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/290215823 wait complete. 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55859b013d50 msgr2=0x55859b016210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55859b013d50 0x55859b016210 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859af0d240 msgr2=0x55859b00d570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55859af0d240 0x55859b00d570 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b00fe50 msgr2=0x55859b012240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55859b00fe50 0x55859b012240 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090036900 msgr2=0x7fb090038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fb090036900 0x7fb090038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000f60 tx=0x7fb1a00012b0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 msgr2=0x55859b006330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 --2- 172.21.15.50:0/507688648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55859af0bfe0 0x55859b006330 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00a470 tx=0x7fb19c002fb0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1a9c68640 1 -- 172.21.15.50:0/507688648 reap_dead start 2024-05-07T13:57:56.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 shutdown_connections 2024-05-07T13:57:56.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 >> 172.21.15.50:0/507688648 conn(0x55859af075c0 msgr2=0x55859aff78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 shutdown_connections 2024-05-07T13:57:56.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.527+0000 7fb1ad72e800 1 -- 172.21.15.50:0/507688648 wait complete. 2024-05-07T13:57:56.525 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:56.525 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:56.525 ERROR:root:0 2024-05-07T13:57:56.525 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-07T13:57:56.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-07T13:57:56.526 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-05-07T13:57:56.580 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:56.581 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:56.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.594+0000 7f50a3b08800 1 Processor -- start 2024-05-07T13:57:56.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.594+0000 7f50a3b08800 1 -- start start 2024-05-07T13:57:56.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.594+0000 7f50a3b08800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d4625b64f0 0x55d4625beff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.594+0000 7f50a3b08800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d462529010 con 0x55d4625b49b0 2024-05-07T13:57:56.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.594+0000 7f50a3b08800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55d462447050 con 0x55d4625b64f0 2024-05-07T13:57:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.594+0000 7f50a0e06640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55d4625b64f0 0x55d4625beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.594+0000 7f50a1607640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55d4625b49b0 0x55d4625b4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56832/0 (socket says 172.21.15.50:56832) 2024-05-07T13:57:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.594+0000 7f50a1607640 1 -- 172.21.15.50:0/4031965374 learned_addr learned my addr 172.21.15.50:0/4031965374 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.595+0000 7f509bfff640 1 -- 172.21.15.50:0/4031965374 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680851902 0 0) 0x55d462529010 con 0x55d4625b49b0 2024-05-07T13:57:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.595+0000 7f509bfff640 1 -- 172.21.15.50:0/4031965374 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5090001e10 con 0x55d4625b49b0 2024-05-07T13:57:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.595+0000 7f50a0e06640 1 -- 172.21.15.50:0/4031965374 >> v1:172.21.15.22:6789/0 conn(0x55d4625b49b0 legacy=0x55d4625b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.595+0000 7f50a0e06640 1 -- 172.21.15.50:0/4031965374 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4625291e0 con 0x55d4625b64f0 2024-05-07T13:57:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.597+0000 7f50a0e06640 1 --2- 172.21.15.50:0/4031965374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b64f0 0x55d4625beff0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f508c00a470 tx=0x7f508c01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960b9dd4d1220406 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.597+0000 7f509bfff640 1 -- 172.21.15.50:0/4031965374 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c057070 con 0x55d4625b64f0 2024-05-07T13:57:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.597+0000 7f509bfff640 1 -- 172.21.15.50:0/4031965374 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c052570 con 0x55d4625b64f0 2024-05-07T13:57:56.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.597+0000 7f509bfff640 1 -- 172.21.15.50:0/4031965374 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c052870 con 0x55d4625b64f0 2024-05-07T13:57:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.597+0000 7f50a3b08800 1 -- 172.21.15.50:0/4031965374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b64f0 msgr2=0x55d4625beff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.597+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4031965374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b64f0 0x55d4625beff0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f508c00a470 tx=0x7f508c01cdb0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.598+0000 7f50a3b08800 1 -- 172.21.15.50:0/4031965374 shutdown_connections 2024-05-07T13:57:56.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.598+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4031965374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b64f0 0x55d4625beff0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.598+0000 7f50a3b08800 1 -- 172.21.15.50:0/4031965374 >> 172.21.15.50:0/4031965374 conn(0x55d4625b0550 msgr2=0x55d4625b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.598+0000 7f50a3b08800 1 -- 172.21.15.50:0/4031965374 shutdown_connections 2024-05-07T13:57:56.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.598+0000 7f50a3b08800 1 -- 172.21.15.50:0/4031965374 wait complete. 2024-05-07T13:57:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.612+0000 7f50a3b08800 1 Processor -- start 2024-05-07T13:57:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.613+0000 7f50a3b08800 1 -- start start 2024-05-07T13:57:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.613+0000 7f50a3b08800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626a9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.613+0000 7f50a3b08800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d462501170 con 0x55d4625b49b0 2024-05-07T13:57:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.613+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.613+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626a9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58714/0 (socket says 172.21.15.50:58714) 2024-05-07T13:57:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.613+0000 7f50a1607640 1 -- 172.21.15.50:0/453656775 learned_addr learned my addr 172.21.15.50:0/453656775 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.613+0000 7f50a1607640 1 -- 172.21.15.50:0/453656775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4626a9c40 con 0x55d4625b49b0 2024-05-07T13:57:56.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f50a1607640 1 --2- 172.21.15.50:0/453656775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626a9670 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5094006f60 tx=0x7f5094006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2e12e364fda5d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f4f8f606640 1 -- 172.21.15.50:0/453656775 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094004520 con 0x55d4625b49b0 2024-05-07T13:57:56.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f4f8f606640 1 -- 172.21.15.50:0/453656775 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50940046e0 con 0x55d4625b49b0 2024-05-07T13:57:56.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f4f8f606640 1 -- 172.21.15.50:0/453656775 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094004a80 con 0x55d4625b49b0 2024-05-07T13:57:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f50a3b08800 1 -- 172.21.15.50:0/453656775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 msgr2=0x55d4626a9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f50a3b08800 1 --2- 172.21.15.50:0/453656775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626a9670 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5094006f60 tx=0x7f5094006f90 comp rx=0 tx=0).stop 2024-05-07T13:57:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f50a3b08800 1 -- 172.21.15.50:0/453656775 shutdown_connections 2024-05-07T13:57:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f50a3b08800 1 --2- 172.21.15.50:0/453656775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626a9670 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f50a3b08800 1 -- 172.21.15.50:0/453656775 >> 172.21.15.50:0/453656775 conn(0x55d4625b0550 msgr2=0x55d4626a4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.614+0000 7f50a3b08800 1 -- 172.21.15.50:0/453656775 shutdown_connections 2024-05-07T13:57:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.615+0000 7f50a3b08800 1 -- 172.21.15.50:0/453656775 wait complete. 2024-05-07T13:57:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.615+0000 7f50a3b08800 1 Processor -- start 2024-05-07T13:57:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.615+0000 7f50a3b08800 1 -- start start 2024-05-07T13:57:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.615+0000 7f50a3b08800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.615+0000 7f50a3b08800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d4625bf800 con 0x55d4625b49b0 2024-05-07T13:57:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.615+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.615+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58730/0 (socket says 172.21.15.50:58730) 2024-05-07T13:57:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.615+0000 7f50a1607640 1 -- 172.21.15.50:0/625610764 learned_addr learned my addr 172.21.15.50:0/625610764 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.615+0000 7f50a1607640 1 -- 172.21.15.50:0/625610764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4626b1760 con 0x55d4625b49b0 2024-05-07T13:57:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.616+0000 7f50a1607640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626b1220 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x55d4626aa400 tx=0x7f5094000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.616+0000 7f4f8de03640 1 -- 172.21.15.50:0/625610764 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094022030 con 0x55d4625b49b0 2024-05-07T13:57:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.616+0000 7f4f8de03640 1 -- 172.21.15.50:0/625610764 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5094019040 con 0x55d4625b49b0 2024-05-07T13:57:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.616+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4626b19f0 con 0x55d4625b49b0 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.616+0000 7f4f8de03640 1 -- 172.21.15.50:0/625610764 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094014b80 con 0x55d4625b49b0 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.616+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4626b46a0 con 0x55d4625b49b0 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.617+0000 7f4f8de03640 1 -- 172.21.15.50:0/625610764 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5094025070 con 0x55d4625b49b0 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.617+0000 7f4f8de03640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f88036900 0x7f4f88038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.617+0000 7f4f8de03640 1 -- 172.21.15.50:0/625610764 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5094023070 con 0x55d4625b49b0 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.617+0000 7f50a0e06640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f88036900 0x7f4f88038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.617+0000 7f50a3b08800 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4625b64f0 0x55d4626b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.617+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626b89a0 con 0x55d4625b64f0 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.617+0000 7f50a1e08640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4625b64f0 0x55d4626b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.618+0000 7f50a0e06640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f88036900 0x7f4f88038dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f508c054000 tx=0x7f508c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.618+0000 7f50a1e08640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4625b64f0 0x55d4626b8460 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.618+0000 7f50a1e08640 1 -- 172.21.15.50:0/625610764 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4625b64f0 2024-05-07T13:57:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.618+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626b5a10 con 0x55d4625b64f0 2024-05-07T13:57:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.618+0000 7f50a1e08640 1 -- 172.21.15.50:0/625610764 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4625b64f0 2024-05-07T13:57:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.618+0000 7f50a3b08800 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626bacb0 0x55d4626bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.618+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626bd790 con 0x55d4626bacb0 2024-05-07T13:57:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.618+0000 7f50a1607640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626bacb0 0x55d4626bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.619+0000 7f50a1607640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626bacb0 0x55d4626bd0a0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.619+0000 7f50a1607640 1 -- 172.21.15.50:0/625610764 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f509400f030 con 0x55d4626bacb0 2024-05-07T13:57:56.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.619+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626b9c60 con 0x55d4625b64f0 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.619+0000 7f50a1e08640 1 -- 172.21.15.50:0/625610764 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4625b64f0 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.619+0000 7f50a3b08800 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d4626bec40 0x55d4626c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.619+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626c1800 con 0x55d4626bec40 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.619+0000 7f50a0e06640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d4626bec40 0x55d4626c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.620+0000 7f50a0e06640 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d4626bec40 0x55d4626c1070 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.620+0000 7f50a0e06640 1 -- 172.21.15.50:0/625610764 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f508c05a040 con 0x55d4626bec40 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.621+0000 7f50a3b08800 1 Processor -- start 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.621+0000 7f50a3b08800 1 -- start start 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.621+0000 7f50a3b08800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626cfbf0 0x55d4626d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.621+0000 7f50a3b08800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d4624a7cf0 con 0x55d4626cfbf0 2024-05-07T13:57:56.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.621+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626cfbf0 0x55d4626d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.621+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626cfbf0 0x55d4626d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58736/0 (socket says 172.21.15.50:58736) 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.621+0000 7f50a1607640 1 -- 172.21.15.50:0/3461021324 learned_addr learned my addr 172.21.15.50:0/3461021324 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.622+0000 7f50a1607640 1 -- 172.21.15.50:0/3461021324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4626d0550 con 0x55d4626cfbf0 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.622+0000 7f50a1607640 1 --2- 172.21.15.50:0/3461021324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626cfbf0 0x55d4626d0010 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f509401d700 tx=0x7f509401ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.622+0000 7f4f86ffd640 1 -- 172.21.15.50:0/3461021324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509401d9a0 con 0x55d4626cfbf0 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.622+0000 7f4f86ffd640 1 -- 172.21.15.50:0/3461021324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509401db40 con 0x55d4626cfbf0 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.622+0000 7f50a3b08800 1 -- 172.21.15.50:0/3461021324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4626d0fc0 con 0x55d4626cfbf0 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.622+0000 7f4f86ffd640 1 -- 172.21.15.50:0/3461021324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509401de60 con 0x55d4626cfbf0 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.622+0000 7f50a3b08800 1 -- 172.21.15.50:0/3461021324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4626d0fc0 con 0x55d4626cfbf0 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.623+0000 7f4f86ffd640 1 -- 172.21.15.50:0/3461021324 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5094010070 con 0x55d4626cfbf0 2024-05-07T13:57:56.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.623+0000 7f4f86ffd640 1 --2- 172.21.15.50:0/3461021324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f78036900 0x7f4f78038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.623+0000 7f4f86ffd640 1 -- 172.21.15.50:0/3461021324 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5094037070 con 0x55d4626cfbf0 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.623+0000 7f50a0e06640 1 --2- 172.21.15.50:0/3461021324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f78036900 0x7f4f78038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.623+0000 7f50a3b08800 1 Processor -- start 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.624+0000 7f50a3b08800 1 -- start start 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.624+0000 7f50a0e06640 1 --2- 172.21.15.50:0/3461021324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f78036900 0x7f4f78038dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55d4626b8e50 tx=0x7f508c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.624+0000 7f50a3b08800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.624+0000 7f50a3b08800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d4626a9fc0 con 0x55d4626dcc80 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.624+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.624+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626dd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58752/0 (socket says 172.21.15.50:58752) 2024-05-07T13:57:56.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.624+0000 7f50a1607640 1 -- 172.21.15.50:0/667482275 learned_addr learned my addr 172.21.15.50:0/667482275 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.624+0000 7f50a1607640 1 -- 172.21.15.50:0/667482275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4626dd670 con 0x55d4626dcc80 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.624+0000 7f50a1607640 1 --2- 172.21.15.50:0/667482275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626dd0a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5094004280 tx=0x7f5094012ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c18ca62cebc8eaf server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f4f84ff9640 1 -- 172.21.15.50:0/667482275 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094029e00 con 0x55d4626dcc80 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f4f84ff9640 1 -- 172.21.15.50:0/667482275 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5094029440 con 0x55d4626dcc80 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f4f84ff9640 1 -- 172.21.15.50:0/667482275 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940123c0 con 0x55d4626dcc80 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f50a3b08800 1 -- 172.21.15.50:0/667482275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 msgr2=0x55d4626dd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f50a3b08800 1 --2- 172.21.15.50:0/667482275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626dd0a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5094004280 tx=0x7f5094012ab0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f50a3b08800 1 -- 172.21.15.50:0/667482275 shutdown_connections 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f50a3b08800 1 --2- 172.21.15.50:0/667482275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626dd0a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f50a3b08800 1 -- 172.21.15.50:0/667482275 >> 172.21.15.50:0/667482275 conn(0x55d4626d8f00 msgr2=0x55d4626d6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f50a3b08800 1 -- 172.21.15.50:0/667482275 shutdown_connections 2024-05-07T13:57:56.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f50a3b08800 1 -- 172.21.15.50:0/667482275 wait complete. 2024-05-07T13:57:56.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f50a3b08800 1 Processor -- start 2024-05-07T13:57:56.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.625+0000 7f50a3b08800 1 -- start start 2024-05-07T13:57:56.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f50a3b08800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626e4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f50a3b08800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d4626ddce0 con 0x55d4626dcc80 2024-05-07T13:57:56.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f50a1607640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626e4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58760/0 (socket says 172.21.15.50:58760) 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 learned_addr learned my addr 172.21.15.50:0/4231966882 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4626e4550 con 0x55d4626dcc80 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f50a1607640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626e4010 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5094049ab0 tx=0x7f5094018e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f4f76ffd640 1 -- 172.21.15.50:0/4231966882 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094071070 con 0x55d4626dcc80 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f4f76ffd640 1 -- 172.21.15.50:0/4231966882 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5094029e00 con 0x55d4626dcc80 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4626e4550 con 0x55d4626dcc80 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.626+0000 7f4f76ffd640 1 -- 172.21.15.50:0/4231966882 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509404cbf0 con 0x55d4626dcc80 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.627+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4626e4550 con 0x55d4626dcc80 2024-05-07T13:57:56.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.627+0000 7f4f76ffd640 1 -- 172.21.15.50:0/4231966882 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5094074070 con 0x55d4626dcc80 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.628+0000 7f4f76ffd640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f6c036900 0x7f4f6c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.628+0000 7f4f76ffd640 1 -- 172.21.15.50:0/4231966882 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5094077d60 con 0x55d4626dcc80 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.628+0000 7f50a0e06640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f6c036900 0x7f4f6c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.628+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.628+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4626ef5a0 0x55d4626f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.628+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f21b0 con 0x55d4626ef5a0 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.628+0000 7f50a0e06640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f6c036900 0x7f4f6c038dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55d4626c1c00 tx=0x7f508c04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.628+0000 7f50a1e08640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4626ef5a0 0x55d4626f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a1e08640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4626ef5a0 0x55d4626f1a60 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 20 realm 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f25c0 con 0x55d4626ef5a0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f2e90 con 0x55d4626ef5a0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.629+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f3230 con 0x55d4626ef5a0 2024-05-07T13:57:56.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a3b08800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626f3bf0 0x55d4626f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f6630 con 0x55d4626f3bf0 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a1607640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626f3bf0 0x55d4626f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a1607640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626f3bf0 0x55d4626f5fe0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5094073030 con 0x55d4626f3bf0 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a3b08800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a3b08800 20 searching for the correct realm 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.630+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f7f40 con 0x55d4626f3bf0 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.631+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094073030 con 0x55d4626f3bf0 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.631+0000 7f50a1607640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5094076060 0x7f5094016980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.631+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f7f40 con 0x7f5094076060 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.631+0000 7f50a0e06640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5094076060 0x7f5094016980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.631+0000 7f50a0e06640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5094076060 0x7f5094016980 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.632+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.632+0000 7f50a0e06640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f508c074040 0x7f508c081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.632+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f7f40 con 0x7f508c074040 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.632+0000 7f50a1e08640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f508c074040 0x7f508c081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.632+0000 7f50a1e08640 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f508c074040 0x7f508c081410 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.633+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.633+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f2e90 con 0x55d4626ef5a0 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.633+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.633+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f2e90 con 0x55d4626ef5a0 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.633+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.633+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f2e90 con 0x55d4626ef5a0 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.633+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.633+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f2e90 con 0x7f508c074040 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.634+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.634+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f2e90 con 0x7f5094076060 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.634+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.634+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f2e90 con 0x7f5094076060 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.634+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.634+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626ef5a0 2024-05-07T13:57:56.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.635+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.635+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f508c074040 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.635+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.635+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626ef5a0 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.635+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.635+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f5094076060 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.635+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.635+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626f3bf0 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.636+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.636+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626f3bf0 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.636+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.636+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f508c074040 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.636+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.636+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626f3bf0 2024-05-07T13:57:56.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.637+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.637+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626f3bf0 2024-05-07T13:57:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.637+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.637+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626ef5a0 2024-05-07T13:57:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.637+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.637+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626ef5a0 2024-05-07T13:57:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.637+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.637+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f508c074040 2024-05-07T13:57:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.638+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.638+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626f3bf0 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.638+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.638+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f5094076060 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.638+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.638+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626ef5a0 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.639+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.639+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f508c074040 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.639+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.639+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626f3bf0 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.639+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.639+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f508c074040 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.640+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.640+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f5094076060 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.640+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.640+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626f3bf0 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.640+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.640+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f5094076060 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.640+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.640+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x55d4626ef5a0 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f508c08e040 con 0x7f5094076060 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:56.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f69d0 con 0x55d4626ef5a0 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f6dc0 con 0x55d4626ef5a0 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.641+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f6dc0 con 0x7f508c074040 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 20 zone default found 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 4 Realm: () 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 20 zonegroup default 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f7a70 con 0x7f508c074040 2024-05-07T13:57:56.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f9da0 con 0x55d4626f3bf0 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.642+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.643+0000 7f50a3b08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.643+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.643+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fa140 con 0x55d4626f3bf0 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.643+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.643+0000 7f50a3b08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.643+0000 7f50a3b08800 20 started sync module instance, tier type = 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.643+0000 7f50a3b08800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.643+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626f9240 con 0x7f5094076060 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.644+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.644+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94370672905616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fa4e0 con 0x7f5094076060 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.644+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fad70 con 0x55d4626ef5a0 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.645+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94370672905616] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.645+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.645+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94370672907824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fb160 con 0x55d4626ef5a0 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.645+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fbbc0 con 0x55d4626f3bf0 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.646+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.646+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94370672916128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fc460 con 0x55d4626f3bf0 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.647+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fcf40 con 0x7f5094076060 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.647+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94370672907824] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.648+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94370672916128] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.648+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.648+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94370672912512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fc460 con 0x7f5094076060 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.648+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fd820 con 0x55d4626ef5a0 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.649+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94370672912512] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.649+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.649+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94370672923440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fc460 con 0x55d4626ef5a0 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.649+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fe290 con 0x7f508c074040 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.650+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94370672923440] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.650+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.650+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94370672926080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fc460 con 0x7f508c074040 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.650+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626feca0 con 0x7f508c074040 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.651+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(56 notify.6 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.651+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94370672928752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626ff0c0 con 0x7f508c074040 2024-05-07T13:57:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.651+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626ffbc0 con 0x7f508c074040 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.651+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94370672926080] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94370672928752] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94370672932528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fec10 con 0x7f508c074040 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a3b08800 20 add_watcher() i=0 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a3b08800 20 add_watcher() i=1 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a3b08800 20 add_watcher() i=2 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a3b08800 20 add_watcher() i=3 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a3b08800 20 add_watcher() i=4 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a3b08800 20 add_watcher() i=5 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.652+0000 7f50a3b08800 20 add_watcher() i=6 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.653+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94370672932528] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.653+0000 7f50a3b08800 20 add_watcher() i=7 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.653+0000 7f50a3b08800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.653+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d462702cc0 con 0x55d4626ef5a0 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.654+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.654+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94370672918448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d462700140 con 0x55d4626ef5a0 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94370672918448] v29'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f4f577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f50a3b08800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f50a3b08800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f50a3b08800 5 note: GC not initialized 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f4f567e4640 20 reqs_thread_entry: start 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f50a3b08800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f50a3b08800 20 Filter name: none 2024-05-07T13:57:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f4ec7fff640 20 reqs_thread_entry: start 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f50a3b08800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.655+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d462735f60 con 0x7f508c074040 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.656+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.656+0000 7f50a3b08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.656+0000 7f50a3b08800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.656+0000 7f50a3b08800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.656+0000 7f50a3b08800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.656+0000 7f50a3b08800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.656+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d462734700 con 0x55d4626f3bf0 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.657+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.657+0000 7f50a3b08800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.657+0000 7f50a3b08800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-05-07T13:57:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.657+0000 7f50a3b08800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.657+0000 7f50a3b08800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.657+0000 7f50a3b08800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.657+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d462734fa0 con 0x7f508c074040 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v29'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f50a3b08800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f50a3b08800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f50a3b08800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94370673150704 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4627398a0 con 0x7f5094076060 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== watch-notify(notify (1) cookie 94370672905616 notify 124554051633 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f508c088040 con 0x7f5094076060 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f4f84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051633 cookie 94370672905616 notifier 4838 bl.length()=533 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f4f84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-07T13:57:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f4f84ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(65 notify.0 [notify cookie 94370673150704 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.658+0000 7f4f84ff9640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4f64003ea0 con 0x7f5094076060 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.659+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.659+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== watch-notify(notify_complete (2) cookie 94370673150704 notify 124554051633 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d4625291e0 con 0x7f5094076060 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.659+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4627373d0 con 0x55d4626f3bf0 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v29'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f50a3b08800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f50a3b08800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f50a3b08800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94370673150704 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4627398a0 con 0x55d4626ef5a0 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 94370672907824 notify 124554051606 ret 0) ==== 218+0+0 (crc 0 0 0) 0x55d462735340 con 0x55d4626ef5a0 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f4f77fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 94370672907824 notifier 4838 bl.length()=176 2024-05-07T13:57:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f4f77fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-07T13:57:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f4f77fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-07T13:57:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(68 notify.1 [notify cookie 94370673150704 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f4f77fff640 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4ed4003400 con 0x55d4626ef5a0 2024-05-07T13:57:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.660+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.661+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94370673150704 notify 124554051606 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d462734850 con 0x55d4626ef5a0 2024-05-07T13:57:56.663 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-05-07T13:57:56.657427Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.657412Z","tags":[],"group_ids":[]} 2024-05-07T13:57:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.662+0000 7f4f577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.662+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94370672918448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626ec6d0 con 0x55d4626ef5a0 2024-05-07T13:57:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.662+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94370672918448] v29'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.663+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94370672905616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fbfb0 con 0x7f5094076060 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.664+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94370672905616] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.664+0000 7f50a3b08800 20 remove_watcher() i=0 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.664+0000 7f50a3b08800 2 removed watcher, disabling cache 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.664+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94370672907824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fbfb0 con 0x55d4626ef5a0 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.665+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94370672907824] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.665+0000 7f50a3b08800 20 remove_watcher() i=1 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.665+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94370672916128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fbfb0 con 0x55d4626f3bf0 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.666+0000 7f50a1607640 1 -- 172.21.15.50:0/4231966882 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94370672916128] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094085040 con 0x55d4626f3bf0 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.666+0000 7f50a3b08800 20 remove_watcher() i=2 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.666+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94370672912512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fb6a0 con 0x7f5094076060 2024-05-07T13:57:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.667+0000 7f50a0e06640 1 -- 172.21.15.50:0/4231966882 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94370672912512] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c07f070 con 0x7f5094076060 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.667+0000 7f50a3b08800 20 remove_watcher() i=3 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.667+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94370672923440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fbfb0 con 0x55d4626ef5a0 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.668+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94370672923440] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x55d4626ef5a0 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.668+0000 7f50a3b08800 20 remove_watcher() i=4 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.668+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94370672926080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fa880 con 0x7f508c074040 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.669+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94370672926080] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.669+0000 7f50a3b08800 20 remove_watcher() i=5 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.670+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94370672928752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fb6a0 con 0x7f508c074040 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.671+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94370672928752] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.671+0000 7f50a3b08800 20 remove_watcher() i=6 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.671+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94370672932528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4626fbfb0 con 0x7f508c074040 2024-05-07T13:57:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94370672932528] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f509c0083e0 con 0x7f508c074040 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 20 remove_watcher() i=7 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f508c074040 msgr2=0x7f508c081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f508c074040 0x7f508c081410 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4626ef5a0 msgr2=0x55d4626f1a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4626ef5a0 0x55d4626f1a60 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5094076060 msgr2=0x7f5094016980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f5094076060 0x7f5094016980 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626f3bf0 msgr2=0x55d4626f5fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626f3bf0 0x55d4626f5fe0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f6c036900 msgr2=0x7f4f6c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f6c036900 0x7f4f6c038dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55d4626c1c00 tx=0x7f508c04f000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 msgr2=0x55d4626e4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626e4010 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5094049ab0 tx=0x7f5094018e70 comp rx=0 tx=0).stop 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a1e08640 1 -- 172.21.15.50:0/4231966882 reap_dead start 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 shutdown_connections 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 --2- 172.21.15.50:0/4231966882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626dcc80 0x55d4626e4010 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 >> 172.21.15.50:0/4231966882 conn(0x55d4626d8f00 msgr2=0x55d4626d6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 shutdown_connections 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.672+0000 7f50a3b08800 1 -- 172.21.15.50:0/4231966882 wait complete. 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/3461021324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f78036900 msgr2=0x7f4f78038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 --2- 172.21.15.50:0/3461021324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f78036900 0x7f4f78038dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55d4626b8e50 tx=0x7f508c005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/3461021324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626cfbf0 msgr2=0x55d4626d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 --2- 172.21.15.50:0/3461021324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626cfbf0 0x55d4626d0010 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f509401d700 tx=0x7f509401ef80 comp rx=0 tx=0).stop 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/3461021324 shutdown_connections 2024-05-07T13:57:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 --2- 172.21.15.50:0/3461021324 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f78036900 0x7f4f78038dc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 --2- 172.21.15.50:0/3461021324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4626cfbf0 0x55d4626d0010 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/3461021324 >> 172.21.15.50:0/3461021324 conn(0x55d4626c3c90 msgr2=0x55d4626c4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/3461021324 shutdown_connections 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/3461021324 wait complete. 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d4626bec40 msgr2=0x55d4626c1070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55d4626bec40 0x55d4626c1070 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4625b64f0 msgr2=0x55d4626b8460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55d4625b64f0 0x55d4626b8460 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626bacb0 msgr2=0x55d4626bd0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55d4626bacb0 0x55d4626bd0a0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f88036900 msgr2=0x7f4f88038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4f88036900 0x7f4f88038dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f508c054000 tx=0x7f508c04e000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 msgr2=0x55d4626b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 --2- 172.21.15.50:0/625610764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d4625b49b0 0x55d4626b1220 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x55d4626aa400 tx=0x7f5094000f40 comp rx=0 tx=0).stop 2024-05-07T13:57:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a1e08640 1 -- 172.21.15.50:0/625610764 reap_dead start 2024-05-07T13:57:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 shutdown_connections 2024-05-07T13:57:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 >> 172.21.15.50:0/625610764 conn(0x55d4625b0550 msgr2=0x55d4626a3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 shutdown_connections 2024-05-07T13:57:56.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.673+0000 7f50a3b08800 1 -- 172.21.15.50:0/625610764 wait complete. 2024-05-07T13:57:56.675 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-07T13:57:56.657427Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.657412Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:56.675 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-07T13:57:56.657427Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.657412Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:56.675 ERROR:root:0 2024-05-07T13:57:56.676 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:56.681 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:56.681 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-05-07T13:57:56.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-05-07T13:57:56.681 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:56.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.741+0000 7f9829c10800 1 Processor -- start 2024-05-07T13:57:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.741+0000 7f9829c10800 1 -- start start 2024-05-07T13:57:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.741+0000 7f9829c10800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f90c4324c0 0x55f90c4348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.741+0000 7f9829c10800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f90c434e80 con 0x55f90c42e510 2024-05-07T13:57:56.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.741+0000 7f9829c10800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55f90c2c0050 con 0x55f90c4324c0 2024-05-07T13:57:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.742+0000 7f9824bbf640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f90c4324c0 0x55f90c4348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.742+0000 7f98253c0640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55f90c42e510 0x55f90c42e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56842/0 (socket says 172.21.15.50:56842) 2024-05-07T13:57:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.742+0000 7f98253c0640 1 -- 172.21.15.50:0/3077760329 learned_addr learned my addr 172.21.15.50:0/3077760329 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.742+0000 7f9817fff640 1 -- 172.21.15.50:0/3077760329 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677039832 0 0) 0x55f90c434e80 con 0x55f90c42e510 2024-05-07T13:57:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.742+0000 7f9817fff640 1 -- 172.21.15.50:0/3077760329 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9810001e10 con 0x55f90c42e510 2024-05-07T13:57:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.742+0000 7f9824bbf640 1 -- 172.21.15.50:0/3077760329 >> v1:172.21.15.22:6789/0 conn(0x55f90c42e510 legacy=0x55f90c42e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.742+0000 7f9824bbf640 1 -- 172.21.15.50:0/3077760329 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f90c4360b0 con 0x55f90c4324c0 2024-05-07T13:57:56.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.744+0000 7f9824bbf640 1 --2- 172.21.15.50:0/3077760329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c4324c0 0x55f90c4348b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f981c00a470 tx=0x7f981c01ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5e224514c1e381 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.744+0000 7f9817fff640 1 -- 172.21.15.50:0/3077760329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981c057070 con 0x55f90c4324c0 2024-05-07T13:57:56.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.744+0000 7f9817fff640 1 -- 172.21.15.50:0/3077760329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981c04add0 con 0x55f90c4324c0 2024-05-07T13:57:56.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.744+0000 7f9817fff640 1 -- 172.21.15.50:0/3077760329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981c052590 con 0x55f90c4324c0 2024-05-07T13:57:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.745+0000 7f9829c10800 1 -- 172.21.15.50:0/3077760329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c4324c0 msgr2=0x55f90c4348b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.745+0000 7f9829c10800 1 --2- 172.21.15.50:0/3077760329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c4324c0 0x55f90c4348b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f981c00a470 tx=0x7f981c01ce40 comp rx=0 tx=0).stop 2024-05-07T13:57:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.745+0000 7f9829c10800 1 -- 172.21.15.50:0/3077760329 shutdown_connections 2024-05-07T13:57:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.745+0000 7f9829c10800 1 --2- 172.21.15.50:0/3077760329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c4324c0 0x55f90c4348b0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.745+0000 7f9829c10800 1 -- 172.21.15.50:0/3077760329 >> 172.21.15.50:0/3077760329 conn(0x55f90c428d30 msgr2=0x55f90c42b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.745+0000 7f9829c10800 1 -- 172.21.15.50:0/3077760329 shutdown_connections 2024-05-07T13:57:56.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.745+0000 7f9829c10800 1 -- 172.21.15.50:0/3077760329 wait complete. 2024-05-07T13:57:56.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.760+0000 7f9829c10800 1 Processor -- start 2024-05-07T13:57:56.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.760+0000 7f9829c10800 1 -- start start 2024-05-07T13:57:56.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.760+0000 7f9829c10800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c51f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.760+0000 7f9829c10800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f90c37a1d0 con 0x55f90c42e510 2024-05-07T13:57:56.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.761+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c51f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.761+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c51f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58780/0 (socket says 172.21.15.50:58780) 2024-05-07T13:57:56.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.761+0000 7f98253c0640 1 -- 172.21.15.50:0/3696845693 learned_addr learned my addr 172.21.15.50:0/3696845693 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.761+0000 7f98253c0640 1 -- 172.21.15.50:0/3696845693 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f90c51f9a0 con 0x55f90c42e510 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.761+0000 7f98253c0640 1 --2- 172.21.15.50:0/3696845693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c51f3d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9818001e30 tx=0x7f981800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f0faf232135d41 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.761+0000 7f9713606640 1 -- 172.21.15.50:0/3696845693 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9818012020 con 0x55f90c42e510 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.761+0000 7f9713606640 1 -- 172.21.15.50:0/3696845693 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981800e5a0 con 0x55f90c42e510 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.761+0000 7f9713606640 1 -- 172.21.15.50:0/3696845693 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981800e8e0 con 0x55f90c42e510 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.762+0000 7f9829c10800 1 -- 172.21.15.50:0/3696845693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 msgr2=0x55f90c51f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.762+0000 7f9829c10800 1 --2- 172.21.15.50:0/3696845693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c51f3d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9818001e30 tx=0x7f981800b780 comp rx=0 tx=0).stop 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.762+0000 7f9829c10800 1 -- 172.21.15.50:0/3696845693 shutdown_connections 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.762+0000 7f9829c10800 1 --2- 172.21.15.50:0/3696845693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c51f3d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.762+0000 7f9829c10800 1 -- 172.21.15.50:0/3696845693 >> 172.21.15.50:0/3696845693 conn(0x55f90c428d30 msgr2=0x55f90c51acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.762+0000 7f9829c10800 1 -- 172.21.15.50:0/3696845693 shutdown_connections 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.762+0000 7f9829c10800 1 -- 172.21.15.50:0/3696845693 wait complete. 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.762+0000 7f9829c10800 1 Processor -- start 2024-05-07T13:57:56.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.762+0000 7f9829c10800 1 -- start start 2024-05-07T13:57:56.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.763+0000 7f9829c10800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c526f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.763+0000 7f9829c10800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f90c435350 con 0x55f90c42e510 2024-05-07T13:57:56.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.763+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c526f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.763+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c526f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58796/0 (socket says 172.21.15.50:58796) 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.763+0000 7f98253c0640 1 -- 172.21.15.50:0/2023283080 learned_addr learned my addr 172.21.15.50:0/2023283080 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.763+0000 7f98253c0640 1 -- 172.21.15.50:0/2023283080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f90c527450 con 0x55f90c42e510 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.763+0000 7f98253c0640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c526f10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9818001e30 tx=0x7f9818000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.763+0000 7f9711e03640 1 -- 172.21.15.50:0/2023283080 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9818012030 con 0x55f90c42e510 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.764+0000 7f9711e03640 1 -- 172.21.15.50:0/2023283080 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9818001490 con 0x55f90c42e510 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.764+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f90c5276e0 con 0x55f90c42e510 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.764+0000 7f9711e03640 1 -- 172.21.15.50:0/2023283080 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981801a8f0 con 0x55f90c42e510 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.764+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f90c52a390 con 0x55f90c42e510 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.764+0000 7f9711e03640 1 -- 172.21.15.50:0/2023283080 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9818015020 con 0x55f90c42e510 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.765+0000 7f9711e03640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f970c036950 0x7f970c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.765+0000 7f9711e03640 1 -- 172.21.15.50:0/2023283080 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9818020030 con 0x55f90c42e510 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.765+0000 7f9824bbf640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f970c036950 0x7f970c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.765+0000 7f9829c10800 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c4324c0 0x55f90c52e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.765+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c52e690 con 0x55f90c4324c0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.765+0000 7f9825bc1640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c4324c0 0x55f90c52e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.765+0000 7f9824bbf640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f970c036950 0x7f970c038e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f981c054000 tx=0x7f981c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.765+0000 7f9825bc1640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c4324c0 0x55f90c52e150 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.766+0000 7f9825bc1640 1 -- 172.21.15.50:0/2023283080 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c4324c0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.766+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c52b720 con 0x55f90c4324c0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.766+0000 7f9825bc1640 1 -- 172.21.15.50:0/2023283080 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c4324c0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.766+0000 7f9829c10800 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c5309e0 0x55f90c532dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.766+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5334c0 con 0x55f90c5309e0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.766+0000 7f98253c0640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c5309e0 0x55f90c532dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.766+0000 7f98253c0640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c5309e0 0x55f90c532dd0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.767+0000 7f98253c0640 1 -- 172.21.15.50:0/2023283080 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f981801ac70 con 0x55f90c5309e0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.767+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c52f990 con 0x55f90c4324c0 2024-05-07T13:57:56.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.767+0000 7f9825bc1640 1 -- 172.21.15.50:0/2023283080 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c4324c0 2024-05-07T13:57:56.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.767+0000 7f9829c10800 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f90c534970 0x55f90c536dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.767+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c537520 con 0x55f90c534970 2024-05-07T13:57:56.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.767+0000 7f9824bbf640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f90c534970 0x55f90c536dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.768+0000 7f9824bbf640 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f90c534970 0x55f90c536dc0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.768+0000 7f9824bbf640 1 -- 172.21.15.50:0/2023283080 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f981c05a040 con 0x55f90c534970 2024-05-07T13:57:56.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.768+0000 7f9829c10800 1 Processor -- start 2024-05-07T13:57:56.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.769+0000 7f9829c10800 1 -- start start 2024-05-07T13:57:56.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.769+0000 7f9829c10800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c546a80 0x55f90c546ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.769+0000 7f9829c10800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f90c320cf0 con 0x55f90c546a80 2024-05-07T13:57:56.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.769+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c546a80 0x55f90c546ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.769+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c546a80 0x55f90c546ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58806/0 (socket says 172.21.15.50:58806) 2024-05-07T13:57:56.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.769+0000 7f98253c0640 1 -- 172.21.15.50:0/2241862438 learned_addr learned my addr 172.21.15.50:0/2241862438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.769+0000 7f98253c0640 1 -- 172.21.15.50:0/2241862438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f90c5473e0 con 0x55f90c546a80 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.769+0000 7f98253c0640 1 --2- 172.21.15.50:0/2241862438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c546a80 0x55f90c546ea0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f981804adf0 tx=0x7f9818016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.770+0000 7f970affd640 1 -- 172.21.15.50:0/2241862438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981803b070 con 0x55f90c546a80 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.770+0000 7f970affd640 1 -- 172.21.15.50:0/2241862438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9818017e40 con 0x55f90c546a80 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.770+0000 7f9829c10800 1 -- 172.21.15.50:0/2241862438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f90c547e50 con 0x55f90c546a80 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.770+0000 7f970affd640 1 -- 172.21.15.50:0/2241862438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981800f1a0 con 0x55f90c546a80 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.770+0000 7f9829c10800 1 -- 172.21.15.50:0/2241862438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f90c547e50 con 0x55f90c546a80 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.770+0000 7f970affd640 1 -- 172.21.15.50:0/2241862438 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f981803e070 con 0x55f90c546a80 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.771+0000 7f970affd640 1 --2- 172.21.15.50:0/2241862438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96fc036950 0x7f96fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.771+0000 7f970affd640 1 -- 172.21.15.50:0/2241862438 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9818048050 con 0x55f90c546a80 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.771+0000 7f9824bbf640 1 --2- 172.21.15.50:0/2241862438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96fc036950 0x7f96fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.771+0000 7f9829c10800 1 Processor -- start 2024-05-07T13:57:56.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.771+0000 7f9829c10800 1 -- start start 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.771+0000 7f9824bbf640 1 --2- 172.21.15.50:0/2241862438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96fc036950 0x7f96fc038e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55f90c52ef90 tx=0x7f981c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.771+0000 7f9829c10800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c553dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.771+0000 7f9829c10800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f90c51fd20 con 0x55f90c5539b0 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.772+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c553dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.772+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c553dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58810/0 (socket says 172.21.15.50:58810) 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.772+0000 7f98253c0640 1 -- 172.21.15.50:0/3157389713 learned_addr learned my addr 172.21.15.50:0/3157389713 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.772+0000 7f98253c0640 1 -- 172.21.15.50:0/3157389713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f90c5543a0 con 0x55f90c5539b0 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.772+0000 7f98253c0640 1 --2- 172.21.15.50:0/3157389713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c553dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9818026040 tx=0x7f9818049780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60c1afd1152b02e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.772+0000 7f9708ff9640 1 -- 172.21.15.50:0/3157389713 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9818049480 con 0x55f90c5539b0 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.772+0000 7f9708ff9640 1 -- 172.21.15.50:0/3157389713 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9818037df0 con 0x55f90c5539b0 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.772+0000 7f9708ff9640 1 -- 172.21.15.50:0/3157389713 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981800fd20 con 0x55f90c5539b0 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 -- 172.21.15.50:0/3157389713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 msgr2=0x55f90c553dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 --2- 172.21.15.50:0/3157389713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c553dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9818026040 tx=0x7f9818049780 comp rx=0 tx=0).stop 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 -- 172.21.15.50:0/3157389713 shutdown_connections 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 --2- 172.21.15.50:0/3157389713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c553dd0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 -- 172.21.15.50:0/3157389713 >> 172.21.15.50:0/3157389713 conn(0x55f90c54fd10 msgr2=0x55f90c54dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 -- 172.21.15.50:0/3157389713 shutdown_connections 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 -- 172.21.15.50:0/3157389713 wait complete. 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 Processor -- start 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 -- start start 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c55ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f9829c10800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f90c554a50 con 0x55f90c5539b0 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c55ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f98253c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c55ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58812/0 (socket says 172.21.15.50:58812) 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.773+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 learned_addr learned my addr 172.21.15.50:0/1879988462 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.774+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f90c55b2b0 con 0x55f90c5539b0 2024-05-07T13:57:56.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.774+0000 7f98253c0640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c55ad70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f981800bcd0 tx=0x7f981801df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.774+0000 7f96faffd640 1 -- 172.21.15.50:0/1879988462 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f981806e020 con 0x55f90c5539b0 2024-05-07T13:57:56.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.774+0000 7f96faffd640 1 -- 172.21.15.50:0/1879988462 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981800f800 con 0x55f90c5539b0 2024-05-07T13:57:56.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.774+0000 7f96faffd640 1 -- 172.21.15.50:0/1879988462 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9818066040 con 0x55f90c5539b0 2024-05-07T13:57:56.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.774+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f90c55b2b0 con 0x55f90c5539b0 2024-05-07T13:57:56.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.774+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f90c55b2b0 con 0x55f90c5539b0 2024-05-07T13:57:56.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.775+0000 7f96faffd640 1 -- 172.21.15.50:0/1879988462 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9818071020 con 0x55f90c5539b0 2024-05-07T13:57:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.775+0000 7f96faffd640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96f00368b0 0x7f96f0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.775+0000 7f96faffd640 1 -- 172.21.15.50:0/1879988462 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9818074d20 con 0x55f90c5539b0 2024-05-07T13:57:56.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.775+0000 7f9824bbf640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96f00368b0 0x7f96f0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.776+0000 7f9824bbf640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96f00368b0 0x7f96f0038d70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55f90c537920 tx=0x7f981c060040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.776+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.776+0000 7f9829c10800 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c5664b0 0x55f90c568970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.776+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5690c0 con 0x55f90c5664b0 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.776+0000 7f9825bc1640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c5664b0 0x55f90c568970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.776+0000 7f9825bc1640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c5664b0 0x55f90c568970 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 20 realm 2024-05-07T13:57:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5694d0 con 0x55f90c5664b0 2024-05-07T13:57:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c569da0 con 0x55f90c5664b0 2024-05-07T13:57:56.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c56aea0 0x55f90c56d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.777+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56d8a0 con 0x55f90c56aea0 2024-05-07T13:57:56.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.778+0000 7f98253c0640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c56aea0 0x55f90c56d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.778+0000 7f98253c0640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c56aea0 0x55f90c56d290 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.778+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.778+0000 7f9829c10800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.778+0000 7f9829c10800 20 searching for the correct realm 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.778+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56f1d0 con 0x55f90c56aea0 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.779+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.779+0000 7f98253c0640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9818073020 0x7f9818077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.779+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56f1d0 con 0x7f9818073020 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.779+0000 7f9824bbf640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9818073020 0x7f9818077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.779+0000 7f9824bbf640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9818073020 0x7f9818077960 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.779+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.779+0000 7f9824bbf640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f981c083040 0x7f981c075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.779+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56f1d0 con 0x7f981c083040 2024-05-07T13:57:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.780+0000 7f9825bc1640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f981c083040 0x7f981c075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.780+0000 7f9825bc1640 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f981c083040 0x7f981c075430 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.780+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.780+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.781+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.781+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.781+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.781+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.781+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.781+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f981c083040 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.781+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.781+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f9818073020 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.782+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.782+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f9818073020 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.782+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.782+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.782+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.782+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f981c083040 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.782+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.782+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.783+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.783+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f9818073020 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.783+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.783+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c56aea0 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.783+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.783+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c56aea0 2024-05-07T13:57:56.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.783+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.783+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f981c083040 2024-05-07T13:57:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.784+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.784+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c56aea0 2024-05-07T13:57:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.784+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.784+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c56aea0 2024-05-07T13:57:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.784+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.784+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.784+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.784+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.785+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.785+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f981c083040 2024-05-07T13:57:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.785+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.785+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c56aea0 2024-05-07T13:57:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.785+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.785+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f9818073020 2024-05-07T13:57:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.785+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.785+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.786+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.786+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f981c083040 2024-05-07T13:57:56.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.786+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.786+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c56aea0 2024-05-07T13:57:56.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.786+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.786+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f981c083040 2024-05-07T13:57:56.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.787+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.787+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f9818073020 2024-05-07T13:57:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.787+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.787+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c56aea0 2024-05-07T13:57:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.787+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.787+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f9818073020 2024-05-07T13:57:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x55f90c5664b0 2024-05-07T13:57:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56a140 con 0x7f9818073020 2024-05-07T13:57:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56e160 con 0x55f90c5664b0 2024-05-07T13:57:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.788+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56e550 con 0x55f90c5664b0 2024-05-07T13:57:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56e550 con 0x7f981c083040 2024-05-07T13:57:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 20 zone default found 2024-05-07T13:57:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 4 Realm: () 2024-05-07T13:57:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:56.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 20 zonegroup default 2024-05-07T13:57:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.789+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c56f650 con 0x7f981c083040 2024-05-07T13:57:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c571030 con 0x55f90c56aea0 2024-05-07T13:57:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5713d0 con 0x55f90c56aea0 2024-05-07T13:57:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 20 started sync module instance, tier type = 2024-05-07T13:57:56.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.790+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5704d0 con 0x7f9818073020 2024-05-07T13:57:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.791+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.791+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94528142245920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c571770 con 0x7f9818073020 2024-05-07T13:57:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.791+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c572040 con 0x55f90c5664b0 2024-05-07T13:57:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.792+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94528142245920] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.793+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.793+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94528142252816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c572430 con 0x55f90c5664b0 2024-05-07T13:57:56.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.793+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c572e30 con 0x55f90c56aea0 2024-05-07T13:57:56.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.794+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94528142252816] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.794+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.794+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94528142248176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c573220 con 0x55f90c56aea0 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.794+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c573c60 con 0x7f9818073020 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.795+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94528142248176] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.795+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.795+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94528142256448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c574500 con 0x7f9818073020 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.795+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c574ec0 con 0x55f90c5664b0 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.796+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94528142256448] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.796+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.796+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94528142264848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5752e0 con 0x55f90c5664b0 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.796+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c575ca0 con 0x7f981c083040 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.797+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94528142264848] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.797+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.797+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94528142266384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c575ca0 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.798+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c576660 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.799+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94528142266384] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.799+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.799+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94528142268880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c576660 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.799+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c577020 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94528142268880] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94528142270896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c577200 con 0x7f981c083040 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9829c10800 20 add_watcher() i=0 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9829c10800 20 add_watcher() i=1 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9829c10800 20 add_watcher() i=2 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9829c10800 20 add_watcher() i=3 2024-05-07T13:57:56.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9829c10800 20 add_watcher() i=4 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9829c10800 20 add_watcher() i=5 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.800+0000 7f9829c10800 20 add_watcher() i=6 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.801+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94528142270896] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.801+0000 7f9829c10800 20 add_watcher() i=7 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.801+0000 7f9829c10800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.801+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c57a4c0 con 0x55f90c5664b0 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.801+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.801+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94528142286416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c577260 con 0x55f90c5664b0 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.802+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94528142286416] v29'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.803+0000 7f96db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.803+0000 7f9829c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.803+0000 7f9829c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:56.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.803+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c579660 con 0x55f90c5664b0 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.804+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.804+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c583580 con 0x7f981c083040 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.806+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.806+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c583580 con 0x55f90c56aea0 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.807+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.807+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c583fa0 con 0x55f90c5664b0 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.808+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.808+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c583dd0 con 0x7f9818073020 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.809+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.809+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c584340 con 0x55f90c56aea0 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.810+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.810+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5843d0 con 0x55f90c5664b0 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.811+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.811+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c584460 con 0x7f981c083040 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.812+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.812+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c584590 con 0x7f9818073020 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.813+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.813+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c584bc0 con 0x55f90c56aea0 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.814+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.814+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c584bc0 con 0x7f9818073020 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.815+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.815+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x7f981c083040 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.816+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.816+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x7f9818073020 2024-05-07T13:57:56.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.817+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.817+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x7f981c083040 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.818+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.818+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c5664b0 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.819+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.819+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c56aea0 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.820+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'71 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.820+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x7f9818073020 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.821+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.821+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c56aea0 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.822+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.822+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c5664b0 2024-05-07T13:57:56.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.823+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'38 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.823+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c5664b0 2024-05-07T13:57:56.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.824+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.824+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c56aea0 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.825+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'72 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.825+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x7f9818073020 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.826+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.826+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c56aea0 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.827+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.827+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c56aea0 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.828+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.828+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c56aea0 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.829+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.829+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c56aea0 2024-05-07T13:57:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.830+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.830+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x7f981c083040 2024-05-07T13:57:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.831+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.831+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c56aea0 2024-05-07T13:57:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.832+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.832+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x7f981c083040 2024-05-07T13:57:56.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.833+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.833+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x55f90c56aea0 2024-05-07T13:57:56.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.834+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'73 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.834+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x7f981c083040 2024-05-07T13:57:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.836+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.836+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c585070 con 0x7f9818073020 2024-05-07T13:57:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.837+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.837+0000 7f96da7e4640 20 reqs_thread_entry: start 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.837+0000 7f9829c10800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.837+0000 7f9829c10800 20 Filter name: none 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.837+0000 7f964bfff640 20 reqs_thread_entry: start 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.837+0000 7f9829c10800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.837+0000 7f9829c10800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.837+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5b0140 con 0x7f981c083040 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.838+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.838+0000 7f9829c10800 20 rados_obj.operate() r=0 bl.length=349 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.838+0000 7f9829c10800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.838+0000 7f9829c10800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.838+0000 7f9829c10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.838+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5b0170 con 0x7f981c083040 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.838+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.838+0000 7f9829c10800 10 removing key index: system_akey 2024-05-07T13:57:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.838+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5b0170 con 0x55f90c56aea0 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.839+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(96 system_akey [delete] v29'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.839+0000 7f9829c10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.839+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94528142513584 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5b2f90 con 0x55f90c5664b0 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.839+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== watch-notify(notify (1) cookie 94528142252816 notify 124554051607 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55f90c583b40 con 0x55f90c5664b0 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.839+0000 7f9708ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94528142252816 notifier 4845 bl.length()=161 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.839+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(97 notify.1 [notify cookie 94528142513584 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.839+0000 7f9708ff9640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f96e8003d60 con 0x55f90c5664b0 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.839+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.840+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== watch-notify(notify_complete (2) cookie 94528142513584 notify 124554051607 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f90c579620 con 0x55f90c5664b0 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.840+0000 7f9829c10800 10 removing email index: 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.840+0000 7f9829c10800 10 removing user buckets index 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.840+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5b0a00 con 0x7f981c083040 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.841+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(99 system_user.buckets [delete] v29'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.841+0000 7f9829c10800 10 removing user index: system_user 2024-05-07T13:57:56.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.841+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5b0a00 con 0x7f981c083040 2024-05-07T13:57:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(100 system_user [call,call,delete] v29'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9829c10800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-05-07T13:57:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9829c10800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-07T13:57:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94528142509392 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5b0970 con 0x7f9818073020 2024-05-07T13:57:56.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== watch-notify(notify (1) cookie 94528142245920 notify 124554051634 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55f90c583970 con 0x7f9818073020 2024-05-07T13:57:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9708ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051634 cookie 94528142245920 notifier 4845 bl.length()=160 2024-05-07T13:57:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(101 notify.0 [notify cookie 94528142509392 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9708ff9640 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f96e8003d60 con 0x7f9818073020 2024-05-07T13:57:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.842+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== watch-notify(notify_complete (2) cookie 94528142509392 notify 124554051634 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f90c5849f0 con 0x7f9818073020 2024-05-07T13:57:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.843+0000 7f96db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.843+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94528142286416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5b08b0 con 0x55f90c5664b0 2024-05-07T13:57:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.844+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94528142286416] v29'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.844+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94528142245920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c5b08b0 con 0x7f9818073020 2024-05-07T13:57:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.845+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94528142245920] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.845+0000 7f9829c10800 20 remove_watcher() i=0 2024-05-07T13:57:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.845+0000 7f9829c10800 2 removed watcher, disabling cache 2024-05-07T13:57:56.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.845+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94528142252816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c570020 con 0x55f90c5664b0 2024-05-07T13:57:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.846+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94528142252816] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.847+0000 7f9829c10800 20 remove_watcher() i=1 2024-05-07T13:57:56.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.847+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94528142248176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c571b10 con 0x55f90c56aea0 2024-05-07T13:57:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.848+0000 7f98253c0640 1 -- 172.21.15.50:0/1879988462 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94528142248176] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981803d030 con 0x55f90c56aea0 2024-05-07T13:57:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.848+0000 7f9829c10800 20 remove_watcher() i=2 2024-05-07T13:57:56.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.848+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94528142256448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c571b10 con 0x7f9818073020 2024-05-07T13:57:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.848+0000 7f9824bbf640 1 -- 172.21.15.50:0/1879988462 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94528142256448] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f981c070030 con 0x7f9818073020 2024-05-07T13:57:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.849+0000 7f9829c10800 20 remove_watcher() i=3 2024-05-07T13:57:56.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.849+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94528142264848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c572940 con 0x55f90c5664b0 2024-05-07T13:57:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.850+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94528142264848] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x55f90c5664b0 2024-05-07T13:57:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.850+0000 7f9829c10800 20 remove_watcher() i=4 2024-05-07T13:57:56.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.850+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94528142266384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c571b10 con 0x7f981c083040 2024-05-07T13:57:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.851+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94528142266384] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.851+0000 7f9829c10800 20 remove_watcher() i=5 2024-05-07T13:57:56.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.851+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94528142268880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c574a10 con 0x7f981c083040 2024-05-07T13:57:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.852+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94528142268880] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.852+0000 7f9829c10800 20 remove_watcher() i=6 2024-05-07T13:57:56.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.852+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94528142270896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f90c572940 con 0x7f981c083040 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94528142270896] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f982000a4a0 con 0x7f981c083040 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 20 remove_watcher() i=7 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f981c083040 msgr2=0x7f981c075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f981c083040 0x7f981c075430 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c5664b0 msgr2=0x55f90c568970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c5664b0 0x55f90c568970 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9818073020 msgr2=0x7f9818077960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f9818073020 0x7f9818077960 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c56aea0 msgr2=0x55f90c56d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c56aea0 0x55f90c56d290 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96f00368b0 msgr2=0x7f96f0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96f00368b0 0x7f96f0038d70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55f90c537920 tx=0x7f981c060040 comp rx=0 tx=0).stop 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 msgr2=0x55f90c55ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9825bc1640 1 -- 172.21.15.50:0/1879988462 reap_dead start 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c55ad70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f981800bcd0 tx=0x7f981801df60 comp rx=0 tx=0).stop 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 shutdown_connections 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 --2- 172.21.15.50:0/1879988462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c5539b0 0x55f90c55ad70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.853+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 >> 172.21.15.50:0/1879988462 conn(0x55f90c54fd10 msgr2=0x55f90c54d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 shutdown_connections 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/1879988462 wait complete. 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/2241862438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96fc036950 msgr2=0x7f96fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 --2- 172.21.15.50:0/2241862438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96fc036950 0x7f96fc038e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55f90c52ef90 tx=0x7f981c005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/2241862438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c546a80 msgr2=0x55f90c546ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 --2- 172.21.15.50:0/2241862438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c546a80 0x55f90c546ea0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f981804adf0 tx=0x7f9818016b00 comp rx=0 tx=0).stop 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/2241862438 shutdown_connections 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 --2- 172.21.15.50:0/2241862438 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f96fc036950 0x7f96fc038e10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 --2- 172.21.15.50:0/2241862438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c546a80 0x55f90c546ea0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/2241862438 >> 172.21.15.50:0/2241862438 conn(0x55f90c53c030 msgr2=0x55f90c53e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/2241862438 shutdown_connections 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/2241862438 wait complete. 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f90c534970 msgr2=0x55f90c536dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f90c534970 0x55f90c536dc0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c4324c0 msgr2=0x55f90c52e150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f90c4324c0 0x55f90c52e150 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c5309e0 msgr2=0x55f90c532dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.854+0000 7f9829c10800 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f90c5309e0 0x55f90c532dd0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.855+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f970c036950 msgr2=0x7f970c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.855+0000 7f9829c10800 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f970c036950 0x7f970c038e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f981c054000 tx=0x7f981c04e000 comp rx=0 tx=0).stop 2024-05-07T13:57:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.855+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 msgr2=0x55f90c526f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.855+0000 7f9829c10800 1 --2- 172.21.15.50:0/2023283080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f90c42e510 0x55f90c526f10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9818001e30 tx=0x7f9818000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.855+0000 7f9825bc1640 1 -- 172.21.15.50:0/2023283080 reap_dead start 2024-05-07T13:57:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.855+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 shutdown_connections 2024-05-07T13:57:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.855+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 >> 172.21.15.50:0/2023283080 conn(0x55f90c428d30 msgr2=0x55f90c519510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.855+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 shutdown_connections 2024-05-07T13:57:56.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.855+0000 7f9829c10800 1 -- 172.21.15.50:0/2023283080 wait complete. 2024-05-07T13:57:56.851 ERROR:root:None 2024-05-07T13:57:56.851 ERROR:root:0 2024-05-07T13:57:56.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-07T13:57:56.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-07T13:57:56.852 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-05-07T13:57:56.906 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:56.907 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.920+0000 7f05fa416800 1 Processor -- start 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.920+0000 7f05fa416800 1 -- start start 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.920+0000 7f05fa416800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55684c7864e0 0x55684c7888d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.920+0000 7f05fa416800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55684c788e10 con 0x55684c782540 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.920+0000 7f05fa416800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55684c614050 con 0x55684c7864e0 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.920+0000 7f05f535b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55684c7864e0 0x55684c7888d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.920+0000 7f05f5b5c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55684c782540 0x55684c782960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56858/0 (socket says 172.21.15.50:56858) 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.920+0000 7f05f5b5c640 1 -- 172.21.15.50:0/4074849234 learned_addr learned my addr 172.21.15.50:0/4074849234 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.921+0000 7f05f535b640 1 -- 172.21.15.50:0/4074849234 >> v1:172.21.15.22:6789/0 conn(0x55684c782540 legacy=0x55684c782960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.921+0000 7f05f535b640 1 -- 172.21.15.50:0/4074849234 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684c789ff0 con 0x55684c7864e0 2024-05-07T13:57:56.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05f535b640 1 --2- 172.21.15.50:0/4074849234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c7864e0 0x55684c7888d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f05e000a470 tx=0x7f05e001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2606486c37bab1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05f4b5a640 1 -- 172.21.15.50:0/4074849234 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e0057070 con 0x55684c7864e0 2024-05-07T13:57:56.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05f4b5a640 1 -- 172.21.15.50:0/4074849234 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e0052570 con 0x55684c7864e0 2024-05-07T13:57:56.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05f4b5a640 1 -- 172.21.15.50:0/4074849234 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e0052870 con 0x55684c7864e0 2024-05-07T13:57:56.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05fa416800 1 -- 172.21.15.50:0/4074849234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c7864e0 msgr2=0x55684c7888d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05fa416800 1 --2- 172.21.15.50:0/4074849234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c7864e0 0x55684c7888d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f05e000a470 tx=0x7f05e001ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:56.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05fa416800 1 -- 172.21.15.50:0/4074849234 shutdown_connections 2024-05-07T13:57:56.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05fa416800 1 --2- 172.21.15.50:0/4074849234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c7864e0 0x55684c7888d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05fa416800 1 -- 172.21.15.50:0/4074849234 >> 172.21.15.50:0/4074849234 conn(0x55684c77ccd0 msgr2=0x55684c77f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05fa416800 1 -- 172.21.15.50:0/4074849234 shutdown_connections 2024-05-07T13:57:56.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.923+0000 7f05fa416800 1 -- 172.21.15.50:0/4074849234 wait complete. 2024-05-07T13:57:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.938+0000 7f05fa416800 1 Processor -- start 2024-05-07T13:57:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.939+0000 7f05fa416800 1 -- start start 2024-05-07T13:57:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.939+0000 7f05fa416800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c8735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.939+0000 7f05fa416800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55684c6ce170 con 0x55684c782540 2024-05-07T13:57:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.939+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c8735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.939+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c8735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58830/0 (socket says 172.21.15.50:58830) 2024-05-07T13:57:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.939+0000 7f05f5b5c640 1 -- 172.21.15.50:0/184551274 learned_addr learned my addr 172.21.15.50:0/184551274 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.939+0000 7f05f5b5c640 1 -- 172.21.15.50:0/184551274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684c873b90 con 0x55684c782540 2024-05-07T13:57:56.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.940+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/184551274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c8735c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f05e8001e10 tx=0x7f05e800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d018f6336d36eb55 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.940+0000 7f04e3e07640 1 -- 172.21.15.50:0/184551274 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e8012020 con 0x55684c782540 2024-05-07T13:57:56.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.940+0000 7f04e3e07640 1 -- 172.21.15.50:0/184551274 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e800e5a0 con 0x55684c782540 2024-05-07T13:57:56.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.940+0000 7f04e3e07640 1 -- 172.21.15.50:0/184551274 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e800e8e0 con 0x55684c782540 2024-05-07T13:57:56.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 -- 172.21.15.50:0/184551274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 msgr2=0x55684c8735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 --2- 172.21.15.50:0/184551274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c8735c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f05e8001e10 tx=0x7f05e800b780 comp rx=0 tx=0).stop 2024-05-07T13:57:56.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 -- 172.21.15.50:0/184551274 shutdown_connections 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 --2- 172.21.15.50:0/184551274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c8735c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 -- 172.21.15.50:0/184551274 >> 172.21.15.50:0/184551274 conn(0x55684c77ccd0 msgr2=0x55684c86eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 -- 172.21.15.50:0/184551274 shutdown_connections 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 -- 172.21.15.50:0/184551274 wait complete. 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 Processor -- start 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 -- start start 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c879ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05fa416800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55684c7892e0 con 0x55684c782540 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c879ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c879ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58846/0 (socket says 172.21.15.50:58846) 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.941+0000 7f05f5b5c640 1 -- 172.21.15.50:0/1039172081 learned_addr learned my addr 172.21.15.50:0/1039172081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.942+0000 7f05f5b5c640 1 -- 172.21.15.50:0/1039172081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684c87a530 con 0x55684c782540 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.942+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c879ff0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f05e8001e10 tx=0x7f05e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.942+0000 7f04e2604640 1 -- 172.21.15.50:0/1039172081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e8012030 con 0x55684c782540 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.942+0000 7f04e2604640 1 -- 172.21.15.50:0/1039172081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e801a7a0 con 0x55684c782540 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.942+0000 7f04e2604640 1 -- 172.21.15.50:0/1039172081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e801aac0 con 0x55684c782540 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.942+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55684c87a7c0 con 0x55684c782540 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.942+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55684c87d470 con 0x55684c782540 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.943+0000 7f04e2604640 1 -- 172.21.15.50:0/1039172081 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f05e8015020 con 0x55684c782540 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.943+0000 7f04e2604640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04dc038b60 0x7f04dc03b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.943+0000 7f04e2604640 1 -- 172.21.15.50:0/1039172081 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f05e8020030 con 0x55684c782540 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.943+0000 7f05f535b640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04dc038b60 0x7f04dc03b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.943+0000 7f05fa416800 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c7864e0 0x55684c881230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.943+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c881770 con 0x55684c7864e0 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.944+0000 7f05f635d640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c7864e0 0x55684c881230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.944+0000 7f05f535b640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04dc038b60 0x7f04dc03b020 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f05e000a470 tx=0x7f05e004e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.944+0000 7f05f635d640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c7864e0 0x55684c881230 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.944+0000 7f05f635d640 1 -- 172.21.15.50:0/1039172081 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c7864e0 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.944+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c87e7e0 con 0x55684c7864e0 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.944+0000 7f05f635d640 1 -- 172.21.15.50:0/1039172081 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c7864e0 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.944+0000 7f05fa416800 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c883a10 0x55684c885e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.944+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8864f0 con 0x55684c883a10 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.945+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c883a10 0x55684c885e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.945+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c883a10 0x55684c885e00 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.945+0000 7f05f5b5c640 1 -- 172.21.15.50:0/1039172081 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05e800dcd0 con 0x55684c883a10 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.945+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8829c0 con 0x55684c7864e0 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.945+0000 7f05f635d640 1 -- 172.21.15.50:0/1039172081 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c7864e0 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.946+0000 7f05fa416800 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55684c8879a0 0x55684c889df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.946+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c88a550 con 0x55684c8879a0 2024-05-07T13:57:56.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.946+0000 7f05f535b640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55684c8879a0 0x55684c889df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.946+0000 7f05f535b640 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55684c8879a0 0x55684c889df0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.947+0000 7f05f535b640 1 -- 172.21.15.50:0/1039172081 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05e005a040 con 0x55684c8879a0 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.947+0000 7f05fa416800 1 Processor -- start 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.947+0000 7f05fa416800 1 -- start start 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.947+0000 7f05fa416800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8989b0 0x55684c898dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.947+0000 7f05fa416800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55684c674cf0 con 0x55684c8989b0 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.947+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8989b0 0x55684c898dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.947+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8989b0 0x55684c898dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58860/0 (socket says 172.21.15.50:58860) 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.947+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3320989482 learned_addr learned my addr 172.21.15.50:0/3320989482 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.948+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3320989482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684c899310 con 0x55684c8989b0 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.948+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/3320989482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8989b0 0x55684c898dd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f05e800dfd0 tx=0x7f05e8016470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.948+0000 7f04db7fe640 1 -- 172.21.15.50:0/3320989482 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e8031070 con 0x55684c8989b0 2024-05-07T13:57:56.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.948+0000 7f04db7fe640 1 -- 172.21.15.50:0/3320989482 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e8044bb0 con 0x55684c8989b0 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.948+0000 7f04db7fe640 1 -- 172.21.15.50:0/3320989482 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e8044320 con 0x55684c8989b0 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.948+0000 7f05fa416800 1 -- 172.21.15.50:0/3320989482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55684c899d80 con 0x55684c8989b0 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.948+0000 7f05fa416800 1 -- 172.21.15.50:0/3320989482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55684c89a280 con 0x55684c8989b0 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.949+0000 7f04db7fe640 1 -- 172.21.15.50:0/3320989482 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f05e80444c0 con 0x55684c8989b0 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.949+0000 7f04db7fe640 1 --2- 172.21.15.50:0/3320989482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04d0036900 0x7f04d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.949+0000 7f04db7fe640 1 -- 172.21.15.50:0/3320989482 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f05e8036d20 con 0x55684c8989b0 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.949+0000 7f05f535b640 1 --2- 172.21.15.50:0/3320989482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04d0036900 0x7f04d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.949+0000 7f05fa416800 1 Processor -- start 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.949+0000 7f05fa416800 1 -- start start 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.949+0000 7f05f535b640 1 --2- 172.21.15.50:0/3320989482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04d0036900 0x7f04d0038dc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55684c881fc0 tx=0x7f05e0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.949+0000 7f05fa416800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.949+0000 7f05fa416800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55684c873ee0 con 0x55684c8a5a70 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.950+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.950+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58862/0 (socket says 172.21.15.50:58862) 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.950+0000 7f05f5b5c640 1 -- 172.21.15.50:0/2140769069 learned_addr learned my addr 172.21.15.50:0/2140769069 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.950+0000 7f05f5b5c640 1 -- 172.21.15.50:0/2140769069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684c8a6460 con 0x55684c8a5a70 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.950+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/2140769069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8a5e90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f05e802ffa0 tx=0x7f05e8034a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f273d7f55d02d84c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.950+0000 7f04d97fa640 1 -- 172.21.15.50:0/2140769069 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e802d910 con 0x55684c8a5a70 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.950+0000 7f04d97fa640 1 -- 172.21.15.50:0/2140769069 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e80447b0 con 0x55684c8a5a70 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.950+0000 7f04d97fa640 1 -- 172.21.15.50:0/2140769069 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e8024d40 con 0x55684c8a5a70 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 -- 172.21.15.50:0/2140769069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 msgr2=0x55684c8a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 --2- 172.21.15.50:0/2140769069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8a5e90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f05e802ffa0 tx=0x7f05e8034a60 comp rx=0 tx=0).stop 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 -- 172.21.15.50:0/2140769069 shutdown_connections 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 --2- 172.21.15.50:0/2140769069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8a5e90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:56.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 -- 172.21.15.50:0/2140769069 >> 172.21.15.50:0/2140769069 conn(0x55684c8a1dd0 msgr2=0x55684c89fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 -- 172.21.15.50:0/2140769069 shutdown_connections 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 -- 172.21.15.50:0/2140769069 wait complete. 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 Processor -- start 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 -- start start 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05fa416800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55684c8a6b10 con 0x55684c8a5a70 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.951+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.952+0000 7f05f5b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58868/0 (socket says 172.21.15.50:58868) 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.952+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 learned_addr learned my addr 172.21.15.50:0/3504581747 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.952+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684c8ad380 con 0x55684c8a5a70 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.952+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8ace40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f05e800a3b0 tx=0x7f05e800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.952+0000 7f04c77fe640 1 -- 172.21.15.50:0/3504581747 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e804c4b0 con 0x55684c8a5a70 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.952+0000 7f04c77fe640 1 -- 172.21.15.50:0/3504581747 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e804c650 con 0x55684c8a5a70 2024-05-07T13:57:56.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.952+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55684c8ad380 con 0x55684c8a5a70 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.952+0000 7f04c77fe640 1 -- 172.21.15.50:0/3504581747 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e804cb10 con 0x55684c8a5a70 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.952+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55684c8ad380 con 0x55684c8a5a70 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.953+0000 7f04c77fe640 1 -- 172.21.15.50:0/3504581747 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f05e8064070 con 0x55684c8a5a70 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.953+0000 7f04c77fe640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04c0036900 0x7f04c0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.953+0000 7f04c77fe640 1 -- 172.21.15.50:0/3504581747 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f05e8068d40 con 0x55684c8a5a70 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.953+0000 7f05f535b640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04c0036900 0x7f04c0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.954+0000 7f05f535b640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04c0036900 0x7f04c0038dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000c00 tx=0x7f05e004f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.954+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.954+0000 7f05fa416800 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c8b8560 0x55684c8baa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.954+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bb170 con 0x55684c8b8560 2024-05-07T13:57:56.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.954+0000 7f05f635d640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c8b8560 0x55684c8baa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.954+0000 7f05f635d640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c8b8560 0x55684c8baa20 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 20 realm 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bb580 con 0x55684c8b8560 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bbe50 con 0x55684c8b8560 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bc1f0 con 0x55684c8b8560 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c8bcf50 0x55684c8bf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bf950 con 0x55684c8bcf50 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.955+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c8bcf50 0x55684c8bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.956+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c8bcf50 0x55684c8bf340 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.956+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05e806d020 con 0x55684c8bcf50 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.956+0000 7f05fa416800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.956+0000 7f05fa416800 20 searching for the correct realm 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.956+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c1260 con 0x55684c8bcf50 2024-05-07T13:57:56.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.957+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e806d020 con 0x55684c8bcf50 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.957+0000 7f05f5b5c640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05e8035020 0x7f05e8035880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.957+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c1260 con 0x7f05e8035020 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.957+0000 7f05f535b640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05e8035020 0x7f05e8035880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.957+0000 7f05f535b640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05e8035020 0x7f05e8035880 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.957+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.957+0000 7f05f535b640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f05e0074040 0x7f05e0081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.957+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c1260 con 0x7f05e0074040 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.958+0000 7f05f635d640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f05e0074040 0x7f05e0081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.958+0000 7f05f635d640 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f05e0074040 0x7f05e0081410 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:56.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.958+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.958+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bc1f0 con 0x55684c8b8560 2024-05-07T13:57:56.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.958+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.958+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bc1f0 con 0x55684c8b8560 2024-05-07T13:57:56.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.959+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.959+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bc1f0 con 0x55684c8b8560 2024-05-07T13:57:56.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.959+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.959+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bc1f0 con 0x7f05e0074040 2024-05-07T13:57:56.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.959+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.959+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bc1f0 con 0x7f05e8035020 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.959+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.959+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55684c8bc1f0 con 0x7f05e8035020 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.960+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.960+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8b8560 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.960+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.960+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e0074040 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.960+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.960+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8b8560 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.960+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.960+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e8035020 2024-05-07T13:57:56.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.961+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.961+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8bcf50 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.961+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e806d020 con 0x55684c8bcf50 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.961+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8bcf50 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.961+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05e806d020 con 0x55684c8bcf50 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.961+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e0074040 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.962+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.962+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8bcf50 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.962+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e806d020 con 0x55684c8bcf50 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.962+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8bcf50 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.962+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.962+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8b8560 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.962+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.962+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8b8560 2024-05-07T13:57:56.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.963+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.963+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e0074040 2024-05-07T13:57:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.963+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.963+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8bcf50 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.964+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.964+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e8035020 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.964+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.964+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8b8560 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.964+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.964+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e0074040 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.965+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.965+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8bcf50 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.965+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.965+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e0074040 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.965+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.965+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e8035020 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.966+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.966+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8bcf50 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.966+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.966+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e8035020 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.966+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.966+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x55684c8b8560 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.966+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.966+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f05e008e040 con 0x7f05e8035020 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c0210 con 0x55684c8b8560 2024-05-07T13:57:56.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c0600 con 0x55684c8b8560 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.967+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c0600 con 0x7f05e0074040 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 20 zone default found 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 4 Realm: () 2024-05-07T13:57:56.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 20 zonegroup default 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c16e0 con 0x7f05e0074040 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c30c0 con 0x55684c8bcf50 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.968+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c3460 con 0x55684c8bcf50 2024-05-07T13:57:56.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.969+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.969+0000 7f05fa416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.969+0000 7f05fa416800 20 started sync module instance, tier type = 2024-05-07T13:57:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.969+0000 7f05fa416800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.969+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c2560 con 0x7f05e8035020 2024-05-07T13:57:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.970+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.970+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93906449211568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c3800 con 0x7f05e8035020 2024-05-07T13:57:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.970+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c4090 con 0x55684c8b8560 2024-05-07T13:57:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.971+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93906449211568] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.971+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.971+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93906449213776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c4480 con 0x55684c8b8560 2024-05-07T13:57:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.971+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c4ee0 con 0x55684c8bcf50 2024-05-07T13:57:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.972+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.972+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93906449222080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c5780 con 0x55684c8bcf50 2024-05-07T13:57:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.972+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c6260 con 0x7f05e8035020 2024-05-07T13:57:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.972+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93906449213776] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.973+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93906449222080] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.973+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.973+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93906449227120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c6650 con 0x7f05e8035020 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.973+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c6ee0 con 0x55684c8b8560 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.974+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.974+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93906449229392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c6ad0 con 0x55684c8b8560 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.974+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93906449227120] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.974+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c3ba0 con 0x7f05e0074040 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.975+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93906449229392] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.975+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.975+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93906449232512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c3ba0 con 0x7f05e0074040 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.975+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c8340 con 0x7f05e0074040 2024-05-07T13:57:56.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.976+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(56 notify.6 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.976+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93906449235488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c8340 con 0x7f05e0074040 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.976+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c9280 con 0x7f05e0074040 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93906449232512] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(58 notify.7 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93906449235488] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93906449239376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c8520 con 0x7f05e0074040 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05fa416800 20 add_watcher() i=0 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05fa416800 20 add_watcher() i=1 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05fa416800 20 add_watcher() i=2 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05fa416800 20 add_watcher() i=3 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05fa416800 20 add_watcher() i=4 2024-05-07T13:57:56.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05fa416800 20 add_watcher() i=5 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.977+0000 7f05fa416800 20 add_watcher() i=6 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.978+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93906449239376] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.978+0000 7f05fa416800 20 add_watcher() i=7 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.978+0000 7f05fa416800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.978+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c8520 con 0x55684c8b8560 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.979+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.979+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93906449233872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c9a50 con 0x55684c8b8560 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.980+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93906449233872] v29'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.980+0000 7f04a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.980+0000 7f05fa416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.980+0000 7f05fa416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:56.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.980+0000 7f05fa416800 5 note: GC not initialized 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.980+0000 7f04a67fc640 20 reqs_thread_entry: start 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.980+0000 7f05fa416800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.980+0000 7f05fa416800 20 Filter name: none 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f041bfff640 20 reqs_thread_entry: start 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8ff6b0 con 0x55684c8bcf50 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 20 rados->read ofs=0 len=0 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8fde50 con 0x55684c8bcf50 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.981+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8fe6f0 con 0x55684c8bcf50 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.982+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v29'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.982+0000 7f05fa416800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.982+0000 7f05fa416800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.982+0000 7f05fa416800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-07T13:57:56.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.982+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 93906449457728 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c902b40 con 0x55684c8bcf50 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.983+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== watch-notify(notify (1) cookie 93906449222080 notify 124554051595 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55684c8fdfb0 con 0x55684c8bcf50 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.983+0000 7f04d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 93906449222080 notifier 4852 bl.length()=542 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.983+0000 7f04d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.983+0000 7f04d97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.983+0000 7f04d97fa640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f04b8003ea0 con 0x55684c8bcf50 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.983+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(65 notify.2 [notify cookie 93906449457728 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.983+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.983+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== watch-notify(notify_complete (2) cookie 93906449457728 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55684c899310 con 0x55684c8bcf50 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.983+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8fe6a0 con 0x55684c8bcf50 2024-05-07T13:57:56.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.984+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v29'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.984+0000 7f05fa416800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.984+0000 7f05fa416800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.984+0000 7f05fa416800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.984+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93906449457648 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55684c8fe610 con 0x7f05e0074040 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.985+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== watch-notify(notify (1) cookie 93906449232512 notify 124554051614 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f05f003d040 con 0x7f05e0074040 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.985+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(68 notify.5 [notify cookie 93906449457648 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.985+0000 7f04d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 93906449232512 notifier 4852 bl.length()=175 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.985+0000 7f04d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.985+0000 7f04d8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.985+0000 7f04d8ff9640 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0428003400 con 0x7f05e0074040 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.985+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:56.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.985+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== watch-notify(notify_complete (2) cookie 93906449457648 notify 124554051614 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f05f002f040 con 0x7f05e0074040 2024-05-07T13:57:56.995 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-05-07T13:57:56.982028Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.982014Z","tags":[],"group_ids":[]} 2024-05-07T13:57:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.986+0000 7f04a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.986+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93906449233872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8b49f0 con 0x55684c8b8560 2024-05-07T13:57:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.987+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93906449233872] v29'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.987+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93906449211568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c77d0 con 0x7f05e8035020 2024-05-07T13:57:57.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.988+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93906449211568] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.988+0000 7f05fa416800 20 remove_watcher() i=0 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.988+0000 7f05fa416800 2 removed watcher, disabling cache 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.988+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93906449213776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c20b0 con 0x55684c8b8560 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.989+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93906449213776] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.989+0000 7f05fa416800 20 remove_watcher() i=1 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.989+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93906449222080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c20b0 con 0x55684c8bcf50 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.990+0000 7f05f5b5c640 1 -- 172.21.15.50:0/3504581747 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93906449222080] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e8086040 con 0x55684c8bcf50 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.990+0000 7f05fa416800 20 remove_watcher() i=2 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.990+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93906449227120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c49c0 con 0x7f05e8035020 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.991+0000 7f05f535b640 1 -- 172.21.15.50:0/3504581747 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93906449227120] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05e007f070 con 0x7f05e8035020 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.991+0000 7f05fa416800 20 remove_watcher() i=3 2024-05-07T13:57:57.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.991+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93906449229392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c49c0 con 0x55684c8b8560 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.992+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93906449229392] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x55684c8b8560 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.992+0000 7f05fa416800 20 remove_watcher() i=4 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.992+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93906449232512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c49c0 con 0x7f05e0074040 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.993+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93906449232512] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.994+0000 7f05fa416800 20 remove_watcher() i=5 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.994+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93906449235488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c7280 con 0x7f05e0074040 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.995+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93906449235488] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.995+0000 7f05fa416800 20 remove_watcher() i=6 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.995+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93906449239376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55684c8c49c0 con 0x7f05e0074040 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93906449239376] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f000a4a0 con 0x7f05e0074040 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 20 remove_watcher() i=7 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f05e0074040 msgr2=0x7f05e0081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f05e0074040 0x7f05e0081410 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c8b8560 msgr2=0x55684c8baa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c8b8560 0x55684c8baa20 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05e8035020 msgr2=0x7f05e8035880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f05e8035020 0x7f05e8035880 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c8bcf50 msgr2=0x55684c8bf340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c8bcf50 0x55684c8bf340 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04c0036900 msgr2=0x7f04c0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04c0036900 0x7f04c0038dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000c00 tx=0x7f05e004f000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 msgr2=0x55684c8ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05f635d640 1 -- 172.21.15.50:0/3504581747 reap_dead start 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8ace40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f05e800a3b0 tx=0x7f05e800a340 comp rx=0 tx=0).stop 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 shutdown_connections 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 --2- 172.21.15.50:0/3504581747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8a5a70 0x55684c8ace40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 >> 172.21.15.50:0/3504581747 conn(0x55684c8a1dd0 msgr2=0x55684c89f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 shutdown_connections 2024-05-07T13:57:57.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.996+0000 7f05fa416800 1 -- 172.21.15.50:0/3504581747 wait complete. 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/3320989482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04d0036900 msgr2=0x7f04d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 --2- 172.21.15.50:0/3320989482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04d0036900 0x7f04d0038dc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55684c881fc0 tx=0x7f05e0005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/3320989482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8989b0 msgr2=0x55684c898dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 --2- 172.21.15.50:0/3320989482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8989b0 0x55684c898dd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f05e800dfd0 tx=0x7f05e8016470 comp rx=0 tx=0).stop 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/3320989482 shutdown_connections 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 --2- 172.21.15.50:0/3320989482 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04d0036900 0x7f04d0038dc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 --2- 172.21.15.50:0/3320989482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c8989b0 0x55684c898dd0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/3320989482 >> 172.21.15.50:0/3320989482 conn(0x55684c88ca50 msgr2=0x55684c88ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/3320989482 shutdown_connections 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/3320989482 wait complete. 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55684c8879a0 msgr2=0x55684c889df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55684c8879a0 0x55684c889df0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c7864e0 msgr2=0x55684c881230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55684c7864e0 0x55684c881230 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c883a10 msgr2=0x55684c885e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55684c883a10 0x55684c885e00 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04dc038b60 msgr2=0x7f04dc03b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f04dc038b60 0x7f04dc03b020 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f05e000a470 tx=0x7f05e004e000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 msgr2=0x55684c879ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 --2- 172.21.15.50:0/1039172081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55684c782540 0x55684c879ff0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f05e8001e10 tx=0x7f05e8000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05f635d640 1 -- 172.21.15.50:0/1039172081 reap_dead start 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 shutdown_connections 2024-05-07T13:57:57.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 >> 172.21.15.50:0/1039172081 conn(0x55684c77ccd0 msgr2=0x55684c781330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 shutdown_connections 2024-05-07T13:57:57.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:56.997+0000 7f05fa416800 1 -- 172.21.15.50:0/1039172081 wait complete. 2024-05-07T13:57:57.008 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-07T13:57:56.982028Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.982014Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.008 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-07T13:57:56.982028Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.982014Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.008 ERROR:root:0 2024-05-07T13:57:57.009 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:57.013 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:57.014 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-05-07T13:57:57.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-05-07T13:57:57.014 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-05-07T13:57:57.059 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:57.060 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.073+0000 7f60a4b46800 1 Processor -- start 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.073+0000 7f60a4b46800 1 -- start start 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.073+0000 7f60a4b46800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x557e6b2075e0 0x557e6b207a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.073+0000 7f60a4b46800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557e6b208080 con 0x557e6b2062a0 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.073+0000 7f60a4b46800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x557e6b098050 con 0x557e6b2075e0 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.074+0000 7f60a264c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x557e6b2075e0 0x557e6b207a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.074+0000 7f60a264c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x557e6b2075e0 0x557e6b207a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58874/0 (socket says 172.21.15.50:58874) 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.074+0000 7f60a264c640 1 -- 172.21.15.50:0/1995271394 learned_addr learned my addr 172.21.15.50:0/1995271394 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.074+0000 7f60a264c640 1 -- 172.21.15.50:0/1995271394 >> v1:172.21.15.22:6789/0 conn(0x557e6b2062a0 legacy=0x557e6b206750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.074+0000 7f60a264c640 1 -- 172.21.15.50:0/1995271394 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e6b206e60 con 0x557e6b2075e0 2024-05-07T13:57:57.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.076+0000 7f60a264c640 1 --2- 172.21.15.50:0/1995271394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2075e0 0x557e6b207a00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f609400a520 tx=0x7f609401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900718dc43c86485 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.076+0000 7f60a164a640 1 -- 172.21.15.50:0/1995271394 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094057070 con 0x557e6b2075e0 2024-05-07T13:57:57.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.076+0000 7f60a164a640 1 -- 172.21.15.50:0/1995271394 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094052570 con 0x557e6b2075e0 2024-05-07T13:57:57.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.076+0000 7f60a164a640 1 -- 172.21.15.50:0/1995271394 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609404ae60 con 0x557e6b2075e0 2024-05-07T13:57:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.076+0000 7f60a4b46800 1 -- 172.21.15.50:0/1995271394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2075e0 msgr2=0x557e6b207a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.076+0000 7f60a4b46800 1 --2- 172.21.15.50:0/1995271394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2075e0 0x557e6b207a00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f609400a520 tx=0x7f609401d010 comp rx=0 tx=0).stop 2024-05-07T13:57:57.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.077+0000 7f60a4b46800 1 -- 172.21.15.50:0/1995271394 shutdown_connections 2024-05-07T13:57:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.077+0000 7f60a4b46800 1 --2- 172.21.15.50:0/1995271394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2075e0 0x557e6b207a00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.077+0000 7f60a4b46800 1 -- 172.21.15.50:0/1995271394 >> 172.21.15.50:0/1995271394 conn(0x557e6b200d30 msgr2=0x557e6b203150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.077+0000 7f60a4b46800 1 -- 172.21.15.50:0/1995271394 shutdown_connections 2024-05-07T13:57:57.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.077+0000 7f60a4b46800 1 -- 172.21.15.50:0/1995271394 wait complete. 2024-05-07T13:57:57.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.092+0000 7f60a4b46800 1 Processor -- start 2024-05-07T13:57:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.092+0000 7f60a4b46800 1 -- start start 2024-05-07T13:57:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.092+0000 7f60a4b46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b2f88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.092+0000 7f60a4b46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e6b1521d0 con 0x557e6b2062a0 2024-05-07T13:57:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.092+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b2f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.092+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b2f88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58880/0 (socket says 172.21.15.50:58880) 2024-05-07T13:57:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.092+0000 7f60a264c640 1 -- 172.21.15.50:0/4238810321 learned_addr learned my addr 172.21.15.50:0/4238810321 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.093+0000 7f60a264c640 1 -- 172.21.15.50:0/4238810321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e6b2f8eb0 con 0x557e6b2062a0 2024-05-07T13:57:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.093+0000 7f60a264c640 1 --2- 172.21.15.50:0/4238810321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b2f88e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6094055040 tx=0x7f609404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58372f35bd1da8c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.093+0000 7f5f90608640 1 -- 172.21.15.50:0/4238810321 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094057040 con 0x557e6b2062a0 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.093+0000 7f5f90608640 1 -- 172.21.15.50:0/4238810321 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094052720 con 0x557e6b2062a0 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.093+0000 7f5f90608640 1 -- 172.21.15.50:0/4238810321 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094052a40 con 0x557e6b2062a0 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 -- 172.21.15.50:0/4238810321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 msgr2=0x557e6b2f88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 --2- 172.21.15.50:0/4238810321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b2f88e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6094055040 tx=0x7f609404c000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 -- 172.21.15.50:0/4238810321 shutdown_connections 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 --2- 172.21.15.50:0/4238810321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b2f88e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 -- 172.21.15.50:0/4238810321 >> 172.21.15.50:0/4238810321 conn(0x557e6b200d30 msgr2=0x557e6b2f6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 -- 172.21.15.50:0/4238810321 shutdown_connections 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 -- 172.21.15.50:0/4238810321 wait complete. 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 Processor -- start 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 -- start start 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b300310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a4b46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e6b20f7b0 con 0x557e6b2062a0 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.094+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b300310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.095+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b300310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58892/0 (socket says 172.21.15.50:58892) 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.095+0000 7f60a264c640 1 -- 172.21.15.50:0/3745990399 learned_addr learned my addr 172.21.15.50:0/3745990399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.095+0000 7f60a264c640 1 -- 172.21.15.50:0/3745990399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e6b300850 con 0x557e6b2062a0 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.095+0000 7f60a264c640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b300310 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6094000c00 tx=0x7f6094003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.095+0000 7f5f8ee05640 1 -- 172.21.15.50:0/3745990399 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094073070 con 0x557e6b2062a0 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.095+0000 7f5f8ee05640 1 -- 172.21.15.50:0/3745990399 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094052cd0 con 0x557e6b2062a0 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.095+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e6b300ae0 con 0x557e6b2062a0 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.095+0000 7f5f8ee05640 1 -- 172.21.15.50:0/3745990399 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094057070 con 0x557e6b2062a0 2024-05-07T13:57:57.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.095+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e6b303790 con 0x557e6b2062a0 2024-05-07T13:57:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.096+0000 7f5f8ee05640 1 -- 172.21.15.50:0/3745990399 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6094076070 con 0x557e6b2062a0 2024-05-07T13:57:57.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.096+0000 7f5f8ee05640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f88036900 0x7f5f88038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.096+0000 7f5f8ee05640 1 -- 172.21.15.50:0/3745990399 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f609408db80 con 0x557e6b2062a0 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.096+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f88036900 0x7f5f88038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.097+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b2075e0 0x557e6b307550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.097+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b307ae0 con 0x557e6b2075e0 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.097+0000 7f60a2e4d640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b2075e0 0x557e6b307550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.097+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f88036900 0x7f5f88038dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6098001e10 tx=0x7f6098001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.097+0000 7f60a2e4d640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b2075e0 0x557e6b307550 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.097+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3745990399 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b2075e0 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.097+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b304b20 con 0x557e6b2075e0 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.098+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3745990399 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b2075e0 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.098+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b309e30 0x557e6b30c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.098+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b30c8c0 con 0x557e6b309e30 2024-05-07T13:57:57.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.098+0000 7f60a264c640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b309e30 0x557e6b30c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.098+0000 7f60a264c640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b309e30 0x557e6b30c220 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.098+0000 7f60a264c640 1 -- 172.21.15.50:0/3745990399 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6094075030 con 0x557e6b309e30 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.099+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b308de0 con 0x557e6b2075e0 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.099+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3745990399 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b2075e0 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.099+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557e6b30dd70 0x557e6b3101c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.099+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b310920 con 0x557e6b30dd70 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.099+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557e6b30dd70 0x557e6b3101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.099+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557e6b30dd70 0x557e6b3101c0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.100+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3745990399 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f60980106a0 con 0x557e6b30dd70 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.100+0000 7f60a4b46800 1 Processor -- start 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.100+0000 7f60a4b46800 1 -- start start 2024-05-07T13:57:57.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.100+0000 7f60a4b46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b31ed80 0x557e6b31f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.100+0000 7f60a4b46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e6b0f8cf0 con 0x557e6b31ed80 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.100+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b31ed80 0x557e6b31f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.100+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b31ed80 0x557e6b31f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58896/0 (socket says 172.21.15.50:58896) 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.100+0000 7f60a264c640 1 -- 172.21.15.50:0/1760599129 learned_addr learned my addr 172.21.15.50:0/1760599129 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.101+0000 7f60a264c640 1 -- 172.21.15.50:0/1760599129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e6b31f6e0 con 0x557e6b31ed80 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.101+0000 7f60a264c640 1 --2- 172.21.15.50:0/1760599129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b31ed80 0x557e6b31f1a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6094005930 tx=0x7f6094076650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.101+0000 7f5f87fff640 1 -- 172.21.15.50:0/1760599129 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094091020 con 0x557e6b31ed80 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.101+0000 7f5f87fff640 1 -- 172.21.15.50:0/1760599129 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094076db0 con 0x557e6b31ed80 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.101+0000 7f60a4b46800 1 -- 172.21.15.50:0/1760599129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e6b320150 con 0x557e6b31ed80 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.101+0000 7f5f87fff640 1 -- 172.21.15.50:0/1760599129 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094076820 con 0x557e6b31ed80 2024-05-07T13:57:57.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.101+0000 7f60a4b46800 1 -- 172.21.15.50:0/1760599129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e6b320650 con 0x557e6b31ed80 2024-05-07T13:57:57.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.102+0000 7f5f87fff640 1 -- 172.21.15.50:0/1760599129 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f609405ea90 con 0x557e6b31ed80 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.102+0000 7f5f87fff640 1 --2- 172.21.15.50:0/1760599129 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f7c036950 0x7f5f7c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f5f87fff640 1 -- 172.21.15.50:0/1760599129 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f609408a050 con 0x557e6b31ed80 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/1760599129 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f7c036950 0x7f5f7c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f60a4b46800 1 Processor -- start 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f60a4b46800 1 -- start start 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/1760599129 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f7c036950 0x7f5f7c038e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x557e6b304a40 tx=0x7f6098006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f60a4b46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b32c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f60a4b46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e6b2f9170 con 0x557e6b32bec0 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b32c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b32c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58904/0 (socket says 172.21.15.50:58904) 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.103+0000 7f60a264c640 1 -- 172.21.15.50:0/1220386280 learned_addr learned my addr 172.21.15.50:0/1220386280 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f60a264c640 1 -- 172.21.15.50:0/1220386280 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e6b32c8b0 con 0x557e6b32bec0 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f60a264c640 1 --2- 172.21.15.50:0/1220386280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b32c2e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6094006ae0 tx=0x7f609408d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4c956b729ba17e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f5f85ffb640 1 -- 172.21.15.50:0/1220386280 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609405e6f0 con 0x557e6b32bec0 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f5f85ffb640 1 -- 172.21.15.50:0/1220386280 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60940a9070 con 0x557e6b32bec0 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f5f85ffb640 1 -- 172.21.15.50:0/1220386280 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6094077a90 con 0x557e6b32bec0 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f60a4b46800 1 -- 172.21.15.50:0/1220386280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 msgr2=0x557e6b32c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f60a4b46800 1 --2- 172.21.15.50:0/1220386280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b32c2e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6094006ae0 tx=0x7f609408d810 comp rx=0 tx=0).stop 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f60a4b46800 1 -- 172.21.15.50:0/1220386280 shutdown_connections 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f60a4b46800 1 --2- 172.21.15.50:0/1220386280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b32c2e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.104+0000 7f60a4b46800 1 -- 172.21.15.50:0/1220386280 >> 172.21.15.50:0/1220386280 conn(0x557e6b328220 msgr2=0x557e6b326280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.105+0000 7f60a4b46800 1 -- 172.21.15.50:0/1220386280 shutdown_connections 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.105+0000 7f60a4b46800 1 -- 172.21.15.50:0/1220386280 wait complete. 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.105+0000 7f60a4b46800 1 Processor -- start 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.105+0000 7f60a4b46800 1 -- start start 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.105+0000 7f60a4b46800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b333290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.105+0000 7f60a4b46800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e6b32cf60 con 0x557e6b32bec0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.105+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b333290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.105+0000 7f60a264c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b333290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58910/0 (socket says 172.21.15.50:58910) 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.105+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 learned_addr learned my addr 172.21.15.50:0/3089255697 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.106+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e6b3337d0 con 0x557e6b32bec0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.106+0000 7f60a264c640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b333290 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6094006ae0 tx=0x7f609407efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.106+0000 7f5f73fff640 1 -- 172.21.15.50:0/3089255697 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609408d200 con 0x557e6b32bec0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.106+0000 7f5f73fff640 1 -- 172.21.15.50:0/3089255697 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6094077a90 con 0x557e6b32bec0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.107+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e6b3337d0 con 0x557e6b32bec0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.107+0000 7f5f73fff640 1 -- 172.21.15.50:0/3089255697 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609408a6b0 con 0x557e6b32bec0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.107+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e6b3337d0 con 0x557e6b32bec0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.107+0000 7f5f73fff640 1 -- 172.21.15.50:0/3089255697 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f609408a850 con 0x557e6b32bec0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.108+0000 7f5f73fff640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f6c036900 0x7f5f6c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.108+0000 7f5f73fff640 1 -- 172.21.15.50:0/3089255697 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f609409a3c0 con 0x557e6b32bec0 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.108+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f6c036900 0x7f5f6c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.108+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.108+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f6c036900 0x7f5f6c038dc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557e6b310d20 tx=0x7f6098011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.108+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b33e950 0x557e6b340e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.108+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b341560 con 0x557e6b33e950 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.108+0000 7f60a2e4d640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b33e950 0x557e6b340e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a2e4d640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b33e950 0x557e6b340e10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 20 realm 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b341970 con 0x557e6b33e950 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b342240 con 0x557e6b33e950 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.109+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a4b46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b343340 0x557e6b345730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b345d40 con 0x557e6b343340 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a264c640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b343340 0x557e6b345730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a264c640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b343340 0x557e6b345730 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a4b46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a4b46800 20 searching for the correct realm 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.110+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b347670 con 0x557e6b343340 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.111+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.111+0000 7f60a264c640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6094096020 0x7f609405a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.111+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b347670 con 0x7f6094096020 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.111+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6094096020 0x7f609405a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.111+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6094096020 0x7f609405a2d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.111+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.111+0000 7f60a1e4b640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f60980393c0 0x7f60980397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.111+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b347670 con 0x7f60980393c0 2024-05-07T13:57:57.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.112+0000 7f60a2e4d640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f60980393c0 0x7f60980397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.112+0000 7f60a2e4d640 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f60980393c0 0x7f60980397e0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.112+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.112+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.113+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.113+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.113+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.113+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.113+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.113+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f60980393c0 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.113+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.113+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f6094096020 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.114+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.114+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f6094096020 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.114+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.114+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.114+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.114+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f60980393c0 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.114+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.114+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.115+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.115+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f6094096020 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.115+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.115+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b343340 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.115+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.115+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b343340 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.115+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.115+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f60980393c0 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.116+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.116+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b343340 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.116+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.116+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b343340 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.116+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.116+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.116+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.117+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.117+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.117+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f60980393c0 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.117+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.117+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b343340 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.117+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.117+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f6094096020 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.118+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.118+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.118+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.118+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f60980393c0 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.118+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.118+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b343340 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.118+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.118+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f60980393c0 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.119+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.119+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f6094096020 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.119+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.119+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b343340 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.119+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.119+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f6094096020 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x557e6b33e950 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3425e0 con 0x7f6094096020 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b346600 con 0x557e6b33e950 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.120+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3469f0 con 0x557e6b33e950 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3469f0 con 0x7f60980393c0 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 20 zone default found 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 4 Realm: () 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 20 zonegroup default 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b347af0 con 0x7f60980393c0 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.121+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3494d0 con 0x557e6b343340 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.122+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.122+0000 7f60a4b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.122+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.122+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b349870 con 0x557e6b343340 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.122+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.122+0000 7f60a4b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.122+0000 7f60a4b46800 20 started sync module instance, tier type = 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.122+0000 7f60a4b46800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.122+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b348970 con 0x7f6094096020 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.123+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.123+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94001452844224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b349c10 con 0x7f6094096020 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.123+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34a4e0 con 0x557e6b33e950 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.124+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94001452844224] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.124+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.124+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94001452851120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34a8d0 con 0x557e6b33e950 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.124+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34b350 con 0x557e6b343340 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.125+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94001452851120] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.125+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.126+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94001452854848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34b6f0 con 0x557e6b343340 2024-05-07T13:57:57.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.126+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34c1a0 con 0x7f6094096020 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.127+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94001452854848] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.127+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.127+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94001452846432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34ca40 con 0x7f6094096020 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.127+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34d400 con 0x557e6b33e950 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.128+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94001452846432] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.128+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.128+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94001452863312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34d820 con 0x557e6b33e950 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.128+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34e1e0 con 0x7f60980393c0 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.129+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94001452863312] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.129+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.129+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94001452864848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34e1e0 con 0x7f60980393c0 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.129+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34eba0 con 0x7f60980393c0 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.130+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(56 notify.6 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.130+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94001452869360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34efc0 con 0x7f60980393c0 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.130+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34fae0 con 0x7f60980393c0 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.131+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94001452864848] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.131+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94001452869360] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.132+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.132+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94001452873136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34eb10 con 0x7f60980393c0 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.132+0000 7f60a4b46800 20 add_watcher() i=0 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.132+0000 7f60a4b46800 20 add_watcher() i=1 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.132+0000 7f60a4b46800 20 add_watcher() i=2 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.132+0000 7f60a4b46800 20 add_watcher() i=3 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.132+0000 7f60a4b46800 20 add_watcher() i=4 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.132+0000 7f60a4b46800 20 add_watcher() i=5 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.132+0000 7f60a4b46800 20 add_watcher() i=6 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.133+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94001452873136] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.133+0000 7f60a4b46800 20 add_watcher() i=7 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.133+0000 7f60a4b46800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.133+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b352be0 con 0x557e6b33e950 2024-05-07T13:57:57.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.133+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.133+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94001452866864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b350060 con 0x557e6b33e950 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.134+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94001452866864] v29'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.134+0000 7f5f58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.134+0000 7f60a4b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.134+0000 7f60a4b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.135+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35b2c0 con 0x557e6b33e950 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.136+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.136+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35b990 con 0x7f60980393c0 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.137+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.137+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35bdb0 con 0x557e6b343340 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.138+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.138+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35c150 con 0x557e6b33e950 2024-05-07T13:57:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.139+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.139+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35c280 con 0x7f6094096020 2024-05-07T13:57:57.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.140+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.140+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35c8e0 con 0x557e6b343340 2024-05-07T13:57:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.142+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.142+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35c8e0 con 0x557e6b33e950 2024-05-07T13:57:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.143+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.143+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35c8e0 con 0x7f60980393c0 2024-05-07T13:57:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.144+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.144+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35c970 con 0x7f6094096020 2024-05-07T13:57:57.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.145+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.145+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35cf60 con 0x557e6b343340 2024-05-07T13:57:57.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.146+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.146+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35cf60 con 0x7f6094096020 2024-05-07T13:57:57.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.147+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.147+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d4d0 con 0x7f60980393c0 2024-05-07T13:57:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.149+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.149+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d4d0 con 0x7f6094096020 2024-05-07T13:57:57.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.150+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.150+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d730 con 0x7f60980393c0 2024-05-07T13:57:57.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.151+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.151+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d730 con 0x557e6b33e950 2024-05-07T13:57:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.152+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.152+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d670 con 0x557e6b343340 2024-05-07T13:57:57.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.153+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'74 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.153+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d670 con 0x7f6094096020 2024-05-07T13:57:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.154+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.154+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b343340 2024-05-07T13:57:57.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.155+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.155+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b33e950 2024-05-07T13:57:57.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.156+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'39 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.156+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b33e950 2024-05-07T13:57:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.157+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.157+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b343340 2024-05-07T13:57:57.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.158+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'75 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.158+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x7f6094096020 2024-05-07T13:57:57.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.159+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.159+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b343340 2024-05-07T13:57:57.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.160+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.160+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b343340 2024-05-07T13:57:57.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.161+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.161+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b343340 2024-05-07T13:57:57.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.162+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.162+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b343340 2024-05-07T13:57:57.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.163+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.163+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x7f60980393c0 2024-05-07T13:57:57.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.164+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.164+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b343340 2024-05-07T13:57:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.165+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.165+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x7f60980393c0 2024-05-07T13:57:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.166+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.166+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x557e6b343340 2024-05-07T13:57:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.167+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'76 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.167+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x7f60980393c0 2024-05-07T13:57:57.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.168+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.168+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b35d5e0 con 0x7f6094096020 2024-05-07T13:57:57.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.170+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.170+0000 7f5ed37fe640 20 reqs_thread_entry: start 2024-05-07T13:57:57.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.170+0000 7f60a4b46800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.170+0000 7f60a4b46800 20 Filter name: none 2024-05-07T13:57:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.170+0000 7f5ed17fa640 20 reqs_thread_entry: start 2024-05-07T13:57:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.170+0000 7f60a4b46800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-07T13:57:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.170+0000 7f60a4b46800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.170+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b388660 con 0x557e6b343340 2024-05-07T13:57:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.171+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.171+0000 7f60a4b46800 20 rados_obj.operate() r=0 bl.length=363 2024-05-07T13:57:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.171+0000 7f60a4b46800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-05-07T13:57:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.171+0000 7f60a4b46800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-07T13:57:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.171+0000 7f60a4b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.171+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b38af60 con 0x557e6b343340 2024-05-07T13:57:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.171+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.171+0000 7f60a4b46800 10 removing key index: true_admin_akey 2024-05-07T13:57:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.171+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b388f40 con 0x557e6b343340 2024-05-07T13:57:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.172+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(96 true_admin_akey [delete] v29'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.172+0000 7f60a4b46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.172+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94001453111888 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b38b4b0 con 0x7f60980393c0 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.172+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== watch-notify(notify (1) cookie 94001452864848 notify 124554051615 ret 0) ==== 207+0+0 (crc 0 0 0) 0x557e6b35cf60 con 0x7f60980393c0 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.172+0000 7f5f85ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051615 cookie 94001452864848 notifier 4859 bl.length()=165 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.172+0000 7f5f85ffb640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f5f68003d60 con 0x7f60980393c0 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.172+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(97 notify.5 [notify cookie 94001453111888 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.173+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.173+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== watch-notify(notify_complete (2) cookie 94001453111888 notify 124554051615 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557e6b35b280 con 0x7f60980393c0 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.173+0000 7f60a4b46800 10 removing email index: 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.173+0000 7f60a4b46800 10 removing user buckets index 2024-05-07T13:57:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.173+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b38b3b0 con 0x557e6b343340 2024-05-07T13:57:57.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.174+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(99 a_user.buckets [delete] v29'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.174+0000 7f60a4b46800 10 removing user index: a_user 2024-05-07T13:57:57.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.174+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b38b3b0 con 0x557e6b343340 2024-05-07T13:57:57.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== osd_op_reply(100 a_user [call,call,delete] v29'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f60a4b46800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-05-07T13:57:57.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f60a4b46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-07T13:57:57.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94001453117184 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557e6b38aa80 con 0x557e6b343340 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== watch-notify(notify (1) cookie 94001452854848 notify 124554051596 ret 0) ==== 197+0+0 (crc 0 0 0) 0x557e6b35c970 con 0x557e6b343340 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f5f857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94001452854848 notifier 4859 bl.length()=155 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f5f857fa640 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f5ed80032c0 con 0x557e6b343340 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 32 ==== osd_op_reply(101 notify.2 [notify cookie 94001453117184 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.175+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 34 ==== watch-notify(notify_complete (2) cookie 94001453117184 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557e6b31f6e0 con 0x557e6b343340 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.176+0000 7f5f58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.176+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94001452866864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b38b3b0 con 0x557e6b33e950 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.177+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94001452866864] v29'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.177+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94001452844224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34dd30 con 0x7f6094096020 2024-05-07T13:57:57.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.178+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94001452844224] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.178+0000 7f60a4b46800 20 remove_watcher() i=0 2024-05-07T13:57:57.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.178+0000 7f60a4b46800 2 removed watcher, disabling cache 2024-05-07T13:57:57.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.178+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94001452851120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b3484c0 con 0x557e6b33e950 2024-05-07T13:57:57.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.180+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94001452851120] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.180+0000 7f60a4b46800 20 remove_watcher() i=1 2024-05-07T13:57:57.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.180+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94001452854848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b349fb0 con 0x557e6b343340 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.181+0000 7f60a264c640 1 -- 172.21.15.50:0/3089255697 <== osd.3 v2:172.21.15.50:6814/3553060046 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94001452854848] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6094093020 con 0x557e6b343340 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.181+0000 7f60a4b46800 20 remove_watcher() i=2 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.181+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94001452846432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b349fb0 con 0x7f6094096020 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.182+0000 7f60a1e4b640 1 -- 172.21.15.50:0/3089255697 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94001452846432] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6098036040 con 0x7f6094096020 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.182+0000 7f60a4b46800 20 remove_watcher() i=3 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.182+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94001452863312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b349fb0 con 0x557e6b33e950 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.183+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94001452863312] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x557e6b33e950 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.183+0000 7f60a4b46800 20 remove_watcher() i=4 2024-05-07T13:57:57.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.183+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94001452864848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34cf50 con 0x7f60980393c0 2024-05-07T13:57:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.184+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94001452864848] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.184+0000 7f60a4b46800 20 remove_watcher() i=5 2024-05-07T13:57:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.184+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94001452869360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b349fb0 con 0x7f60980393c0 2024-05-07T13:57:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.185+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94001452869360] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.185+0000 7f60a4b46800 20 remove_watcher() i=6 2024-05-07T13:57:57.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.185+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94001452873136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557e6b34d550 con 0x7f60980393c0 2024-05-07T13:57:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94001452873136] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f609c00a4a0 con 0x7f60980393c0 2024-05-07T13:57:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 20 remove_watcher() i=7 2024-05-07T13:57:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f60980393c0 msgr2=0x7f60980397e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f60980393c0 0x7f60980397e0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b33e950 msgr2=0x557e6b340e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b33e950 0x557e6b340e10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6094096020 msgr2=0x7f609405a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f6094096020 0x7f609405a2d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b343340 msgr2=0x557e6b345730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b343340 0x557e6b345730 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f6c036900 msgr2=0x7f5f6c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f6c036900 0x7f5f6c038dc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557e6b310d20 tx=0x7f6098011000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 msgr2=0x557e6b333290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3089255697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b32bec0 0x557e6b333290 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6094006ae0 tx=0x7f609407efa0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 reap_dead start 2024-05-07T13:57:57.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3089255697 reap_dead start 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 shutdown_connections 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 >> 172.21.15.50:0/3089255697 conn(0x557e6b328220 msgr2=0x557e6b325880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 shutdown_connections 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/3089255697 wait complete. 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/1760599129 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f7c036950 msgr2=0x7f5f7c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 --2- 172.21.15.50:0/1760599129 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f7c036950 0x7f5f7c038e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x557e6b304a40 tx=0x7f6098006000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 -- 172.21.15.50:0/1760599129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b31ed80 msgr2=0x557e6b31f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.187+0000 7f60a4b46800 1 --2- 172.21.15.50:0/1760599129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b31ed80 0x557e6b31f1a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6094005930 tx=0x7f6094076650 comp rx=0 tx=0).stop 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/1760599129 shutdown_connections 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 --2- 172.21.15.50:0/1760599129 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f7c036950 0x7f5f7c038e10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 --2- 172.21.15.50:0/1760599129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b31ed80 0x557e6b31f1a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/1760599129 >> 172.21.15.50:0/1760599129 conn(0x557e6b312e20 msgr2=0x557e6b313220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/1760599129 shutdown_connections 2024-05-07T13:57:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/1760599129 wait complete. 2024-05-07T13:57:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557e6b30dd70 msgr2=0x557e6b3101c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x557e6b30dd70 0x557e6b3101c0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b2075e0 msgr2=0x557e6b307550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x557e6b2075e0 0x557e6b307550 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b309e30 msgr2=0x557e6b30c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x557e6b309e30 0x557e6b30c220 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f88036900 msgr2=0x7f5f88038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f5f88036900 0x7f5f88038dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6098001e10 tx=0x7f6098001390 comp rx=0 tx=0).stop 2024-05-07T13:57:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 msgr2=0x557e6b300310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 --2- 172.21.15.50:0/3745990399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e6b2062a0 0x557e6b300310 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6094000c00 tx=0x7f6094003020 comp rx=0 tx=0).stop 2024-05-07T13:57:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a2e4d640 1 -- 172.21.15.50:0/3745990399 reap_dead start 2024-05-07T13:57:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 shutdown_connections 2024-05-07T13:57:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 >> 172.21.15.50:0/3745990399 conn(0x557e6b200d30 msgr2=0x557e6b2f2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 shutdown_connections 2024-05-07T13:57:57.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.188+0000 7f60a4b46800 1 -- 172.21.15.50:0/3745990399 wait complete. 2024-05-07T13:57:57.185 ERROR:root:None 2024-05-07T13:57:57.185 ERROR:root:0 2024-05-07T13:57:57.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-07T13:57:57.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-07T13:57:57.186 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-05-07T13:57:57.233 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:57.233 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:57.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.247+0000 7f3f40b33800 1 Processor -- start 2024-05-07T13:57:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.247+0000 7f3f40b33800 1 -- start start 2024-05-07T13:57:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.247+0000 7f3f40b33800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55c9400ac4f0 0x55c9400ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.247+0000 7f3f40b33800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9400aeeb0 con 0x55c9400a95f0 2024-05-07T13:57:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.247+0000 7f3f40b33800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55c93ff3a050 con 0x55c9400ac4f0 2024-05-07T13:57:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.248+0000 7f3f3bfd7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55c9400ac4f0 0x55c9400ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.248+0000 7f3f3c7d8640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55c9400a95f0 0x55c9400a9a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56868/0 (socket says 172.21.15.50:56868) 2024-05-07T13:57:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.248+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/4113334226 learned_addr learned my addr 172.21.15.50:0/4113334226 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.248+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/4113334226 >> v1:172.21.15.22:6789/0 conn(0x55c9400a95f0 legacy=0x55c9400a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.248+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/4113334226 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9400b0090 con 0x55c9400ac4f0 2024-05-07T13:57:57.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/4113334226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400ac4f0 0x55c9400ae8e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400a470 tx=0x7f3f2401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef8f278980cd30f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f3b7d6640 1 -- 172.21.15.50:0/4113334226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f24057070 con 0x55c9400ac4f0 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f3b7d6640 1 -- 172.21.15.50:0/4113334226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f24052570 con 0x55c9400ac4f0 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f3b7d6640 1 -- 172.21.15.50:0/4113334226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f24052870 con 0x55c9400ac4f0 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f40b33800 1 -- 172.21.15.50:0/4113334226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400ac4f0 msgr2=0x55c9400ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f40b33800 1 --2- 172.21.15.50:0/4113334226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400ac4f0 0x55c9400ae8e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400a470 tx=0x7f3f2401ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f40b33800 1 -- 172.21.15.50:0/4113334226 shutdown_connections 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f40b33800 1 --2- 172.21.15.50:0/4113334226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400ac4f0 0x55c9400ae8e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f40b33800 1 -- 172.21.15.50:0/4113334226 >> 172.21.15.50:0/4113334226 conn(0x55c9400a2d40 msgr2=0x55c9400a5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f40b33800 1 -- 172.21.15.50:0/4113334226 shutdown_connections 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.250+0000 7f3f40b33800 1 -- 172.21.15.50:0/4113334226 wait complete. 2024-05-07T13:57:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.266+0000 7f3f40b33800 1 Processor -- start 2024-05-07T13:57:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.266+0000 7f3f40b33800 1 -- start start 2024-05-07T13:57:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.266+0000 7f3f40b33800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9400a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.266+0000 7f3f40b33800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c93fff41c0 con 0x55c9400a95f0 2024-05-07T13:57:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.266+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9400a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.266+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9400a7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58926/0 (socket says 172.21.15.50:58926) 2024-05-07T13:57:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.266+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/3337432497 learned_addr learned my addr 172.21.15.50:0/3337432497 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.267+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/3337432497 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94019d490 con 0x55c9400a95f0 2024-05-07T13:57:57.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.267+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/3337432497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9400a7ce0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c001de0 tx=0x7f3f2c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d8c18467b07ce0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.267+0000 7f3e2a60c640 1 -- 172.21.15.50:0/3337432497 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c012020 con 0x55c9400a95f0 2024-05-07T13:57:57.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.267+0000 7f3e2a60c640 1 -- 172.21.15.50:0/3337432497 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c00e5a0 con 0x55c9400a95f0 2024-05-07T13:57:57.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.267+0000 7f3e2a60c640 1 -- 172.21.15.50:0/3337432497 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c00e8c0 con 0x55c9400a95f0 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 -- 172.21.15.50:0/3337432497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 msgr2=0x55c9400a7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 --2- 172.21.15.50:0/3337432497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9400a7ce0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c001de0 tx=0x7f3f2c00b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 -- 172.21.15.50:0/3337432497 shutdown_connections 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 --2- 172.21.15.50:0/3337432497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9400a7ce0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 -- 172.21.15.50:0/3337432497 >> 172.21.15.50:0/3337432497 conn(0x55c9400a2d40 msgr2=0x55c940194f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 -- 172.21.15.50:0/3337432497 shutdown_connections 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 -- 172.21.15.50:0/3337432497 wait complete. 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 Processor -- start 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 -- start start 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9401a2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f40b33800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c9400af350 con 0x55c9400a95f0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9401a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9401a2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58940/0 (socket says 172.21.15.50:58940) 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.268+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/332895805 learned_addr learned my addr 172.21.15.50:0/332895805 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.269+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/332895805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9401a27c0 con 0x55c9400a95f0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.269+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9401a2280 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00c010 tx=0x7f3f2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.269+0000 7f3e28e09640 1 -- 172.21.15.50:0/332895805 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c012070 con 0x55c9400a95f0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.269+0000 7f3e28e09640 1 -- 172.21.15.50:0/332895805 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c01a7a0 con 0x55c9400a95f0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.269+0000 7f3e28e09640 1 -- 172.21.15.50:0/332895805 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c01aa80 con 0x55c9400a95f0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.269+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9401a2a50 con 0x55c9400a95f0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.269+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9401a5700 con 0x55c9400a95f0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.270+0000 7f3e28e09640 1 -- 172.21.15.50:0/332895805 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3f2c015020 con 0x55c9400a95f0 2024-05-07T13:57:57.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.270+0000 7f3e28e09640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e24036900 0x7f3e24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.270+0000 7f3e28e09640 1 -- 172.21.15.50:0/332895805 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3f2c020070 con 0x55c9400a95f0 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.270+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e24036900 0x7f3e24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.270+0000 7f3f40b33800 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9400ac4f0 0x55c9401a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.270+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401a9a00 con 0x55c9400ac4f0 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.271+0000 7f3f3cfd9640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9400ac4f0 0x55c9401a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.271+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e24036900 0x7f3e24038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3f24054000 tx=0x7f3f2404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.271+0000 7f3f3cfd9640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9400ac4f0 0x55c9401a94c0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.271+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/332895805 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9400ac4f0 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.271+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401a6a90 con 0x55c9400ac4f0 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.271+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/332895805 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9400ac4f0 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.272+0000 7f3f40b33800 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401abd40 0x55c9401ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.272+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ae7d0 con 0x55c9401abd40 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.272+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401abd40 0x55c9401ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.272+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401abd40 0x55c9401ae130 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.272+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/332895805 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f2c02b070 con 0x55c9401abd40 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.272+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401aacf0 con 0x55c9400ac4f0 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.272+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/332895805 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9400ac4f0 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.272+0000 7f3f40b33800 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55c9401afc80 0x55c9401b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.273+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401b2830 con 0x55c9401afc80 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.273+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55c9401afc80 0x55c9401b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.273+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55c9401afc80 0x55c9401b20d0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.274+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/332895805 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f2405a040 con 0x55c9401afc80 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.274+0000 7f3f40b33800 1 Processor -- start 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.274+0000 7f3f40b33800 1 -- start start 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.274+0000 7f3f40b33800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9401c0c40 0x55c9401c1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.274+0000 7f3f40b33800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c93ff9acf0 con 0x55c9401c0c40 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.274+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9401c0c40 0x55c9401c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.274+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9401c0c40 0x55c9401c1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58948/0 (socket says 172.21.15.50:58948) 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.274+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/2612141868 learned_addr learned my addr 172.21.15.50:0/2612141868 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.275+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/2612141868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9401c15a0 con 0x55c9401c0c40 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.275+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/2612141868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9401c0c40 0x55c9401c1060 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c04acf0 tx=0x7f3f2c02caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.275+0000 7f3e21ffb640 1 -- 172.21.15.50:0/2612141868 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c04c560 con 0x55c9401c0c40 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.275+0000 7f3e21ffb640 1 -- 172.21.15.50:0/2612141868 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c047260 con 0x55c9401c0c40 2024-05-07T13:57:57.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.275+0000 7f3e21ffb640 1 -- 172.21.15.50:0/2612141868 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c049230 con 0x55c9401c0c40 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.275+0000 7f3f40b33800 1 -- 172.21.15.50:0/2612141868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9401c2010 con 0x55c9401c0c40 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.275+0000 7f3f40b33800 1 -- 172.21.15.50:0/2612141868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9401c2510 con 0x55c9401c0c40 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.276+0000 7f3e21ffb640 1 -- 172.21.15.50:0/2612141868 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3f2c0493d0 con 0x55c9401c0c40 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.276+0000 7f3e21ffb640 1 --2- 172.21.15.50:0/2612141868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e14036970 0x7f3e14038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.276+0000 7f3e21ffb640 1 -- 172.21.15.50:0/2612141868 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3f2c039d50 con 0x55c9401c0c40 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.276+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/2612141868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e14036970 0x7f3e14038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.276+0000 7f3f40b33800 1 Processor -- start 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.276+0000 7f3f40b33800 1 -- start start 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.276+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/2612141868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e14036970 0x7f3e14038e30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55c9401a69b0 tx=0x7f3f24005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3f40b33800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c94019af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3f40b33800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c94019d7e0 con 0x55c94019ab30 2024-05-07T13:57:57.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c94019af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c94019af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58962/0 (socket says 172.21.15.50:58962) 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/3221308582 learned_addr learned my addr 172.21.15.50:0/3221308582 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/3221308582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c940199300 con 0x55c94019ab30 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/3221308582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c94019af30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c005fd0 tx=0x7f3f2c0441d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be41a2ea957b7fa server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3e137fe640 1 -- 172.21.15.50:0/3221308582 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c03d040 con 0x55c94019ab30 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3e137fe640 1 -- 172.21.15.50:0/3221308582 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c0448f0 con 0x55c94019ab30 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.277+0000 7f3e137fe640 1 -- 172.21.15.50:0/3221308582 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c044510 con 0x55c94019ab30 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 -- 172.21.15.50:0/3221308582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 msgr2=0x55c94019af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 --2- 172.21.15.50:0/3221308582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c94019af30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c005fd0 tx=0x7f3f2c0441d0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 -- 172.21.15.50:0/3221308582 shutdown_connections 2024-05-07T13:57:57.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 --2- 172.21.15.50:0/3221308582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c94019af30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 -- 172.21.15.50:0/3221308582 >> 172.21.15.50:0/3221308582 conn(0x55c9401ca090 msgr2=0x55c9401c80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 -- 172.21.15.50:0/3221308582 shutdown_connections 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 -- 172.21.15.50:0/3221308582 wait complete. 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 Processor -- start 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 -- start start 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c9401d7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f40b33800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c940199710 con 0x55c94019ab30 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c9401d7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f3c7d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c9401d7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58972/0 (socket says 172.21.15.50:58972) 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.278+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 learned_addr learned my addr 172.21.15.50:0/1906211193 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.279+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9401d7960 con 0x55c94019ab30 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.279+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c9401d7420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c02cd50 tx=0x7f3f2c04ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.279+0000 7f3e11ffb640 1 -- 172.21.15.50:0/1906211193 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c03d070 con 0x55c94019ab30 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.279+0000 7f3e11ffb640 1 -- 172.21.15.50:0/1906211193 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c066030 con 0x55c94019ab30 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.279+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9401d7960 con 0x55c94019ab30 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.279+0000 7f3e11ffb640 1 -- 172.21.15.50:0/1906211193 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c047b10 con 0x55c94019ab30 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.279+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9401d7960 con 0x55c94019ab30 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.280+0000 7f3e11ffb640 1 -- 172.21.15.50:0/1906211193 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3f2c05d040 con 0x55c94019ab30 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.280+0000 7f3e11ffb640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e04036900 0x7f3e04038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.280+0000 7f3e11ffb640 1 -- 172.21.15.50:0/1906211193 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3f2c05b020 con 0x55c94019ab30 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.280+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e04036900 0x7f3e04038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.281+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e04036900 0x7f3e04038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55c9401b2c30 tx=0x7f3f2404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.281+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.281+0000 7f3f40b33800 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9401e2aa0 0x55c9401e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.281+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e56b0 con 0x55c9401e2aa0 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.281+0000 7f3f3cfd9640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9401e2aa0 0x55c9401e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.281+0000 7f3f3cfd9640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9401e2aa0 0x55c9401e4f60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 20 realm 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e5ac0 con 0x55c9401e2aa0 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e6390 con 0x55c9401e2aa0 2024-05-07T13:57:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e6730 con 0x55c9401e2aa0 2024-05-07T13:57:57.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401e7490 0x55c9401e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.282+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e9e90 con 0x55c9401e7490 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.283+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401e7490 0x55c9401e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.283+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401e7490 0x55c9401e9880 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.283+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.283+0000 7f3f40b33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.283+0000 7f3f40b33800 20 searching for the correct realm 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.283+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c9401eb7c0 con 0x55c9401e7490 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.284+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.284+0000 7f3f3c7d8640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3f2c056070 0x7f3f2c0565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.284+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c9401eb7c0 con 0x7f3f2c056070 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.284+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3f2c056070 0x7f3f2c0565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.284+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3f2c056070 0x7f3f2c0565f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.284+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.284+0000 7f3f3bfd7640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3f24074040 0x7f3f24081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.284+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c9401eb7c0 con 0x7f3f24074040 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.285+0000 7f3f3cfd9640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3f24074040 0x7f3f24081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.285+0000 7f3f3cfd9640 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3f24074040 0x7f3f24081410 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.285+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.285+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e6730 con 0x55c9401e2aa0 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.286+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.286+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e6730 con 0x55c9401e2aa0 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.286+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.286+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e6730 con 0x55c9401e2aa0 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.286+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.286+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e6730 con 0x7f3f24074040 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.286+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.286+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e6730 con 0x7f3f2c056070 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.287+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.287+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c9401e6730 con 0x7f3f2c056070 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.287+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.287+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e2aa0 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.287+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.287+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f24074040 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.287+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.287+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e2aa0 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.288+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.288+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f2c056070 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.288+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.288+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e7490 2024-05-07T13:57:57.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.288+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.288+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e7490 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.288+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.288+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f24074040 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.289+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.289+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e7490 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.289+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.289+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e7490 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.289+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.289+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e2aa0 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.289+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.289+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e2aa0 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.290+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.290+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f24074040 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.290+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.290+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e7490 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.290+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.290+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f2c056070 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.291+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.291+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e2aa0 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.291+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.291+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f24074040 2024-05-07T13:57:57.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.291+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.291+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e7490 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.291+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.291+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f24074040 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.292+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.292+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f2c056070 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.292+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.292+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e7490 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.292+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.292+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f2c056070 2024-05-07T13:57:57.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.292+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.292+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x55c9401e2aa0 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3f2408e040 con 0x7f3f2c056070 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:57.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ea750 con 0x55c9401e2aa0 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.293+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401eab40 con 0x55c9401e2aa0 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401eab40 con 0x7f3f24074040 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:57.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 20 zone default found 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 4 Realm: () 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 20 zonegroup default 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ea2d0 con 0x7f3f24074040 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.294+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ed620 con 0x55c9401e7490 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.295+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.295+0000 7f3f40b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.295+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.295+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ed9c0 con 0x55c9401e7490 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.295+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.295+0000 7f3f40b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.295+0000 7f3f40b33800 20 started sync module instance, tier type = 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.295+0000 7f3f40b33800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.295+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ecac0 con 0x7f3f2c056070 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.296+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.296+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94322852546064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401edd60 con 0x7f3f2c056070 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.296+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ee5f0 con 0x55c9401e2aa0 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.297+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.297+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94322852552960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401eee90 con 0x55c9401e2aa0 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.297+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ef960 con 0x55c9401e7490 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.297+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94322852546064] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.299+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94322852552960] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.299+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.299+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94322852548320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401eee90 con 0x55c9401e7490 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.299+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f0260 con 0x7f3f2c056070 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.300+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94322852548320] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.300+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.300+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94322852555232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f0b00 con 0x7f3f2c056070 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.300+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f14c0 con 0x55c9401e2aa0 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.301+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94322852555232] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.301+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.301+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94322852562992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f14c0 con 0x55c9401e2aa0 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.301+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f1ec0 con 0x7f3f24074040 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.302+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94322852562992] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.302+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.302+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94322852567504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f14c0 con 0x7f3f24074040 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.302+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f28d0 con 0x7f3f24074040 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.303+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94322852567504] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.303+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.304+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94322852565008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f2ab0 con 0x7f3f24074040 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.304+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f3300 con 0x7f3f24074040 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94322852565008] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94322852571104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f3110 con 0x7f3f24074040 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f40b33800 20 add_watcher() i=0 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f40b33800 20 add_watcher() i=1 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f40b33800 20 add_watcher() i=2 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f40b33800 20 add_watcher() i=3 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f40b33800 20 add_watcher() i=4 2024-05-07T13:57:57.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f40b33800 20 add_watcher() i=5 2024-05-07T13:57:57.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.305+0000 7f3f40b33800 20 add_watcher() i=6 2024-05-07T13:57:57.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.306+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94322852571104] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.306+0000 7f3f40b33800 20 add_watcher() i=7 2024-05-07T13:57:57.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.306+0000 7f3f40b33800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:57.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.306+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f6650 con 0x55c9401e2aa0 2024-05-07T13:57:57.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.306+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.306+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94322852572160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f3b70 con 0x55c9401e2aa0 2024-05-07T13:57:57.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.307+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94322852572160] v29'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.307+0000 7f3df27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.307+0000 7f3f40b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:57.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.307+0000 7f3f40b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.307+0000 7f3f40b33800 5 note: GC not initialized 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.308+0000 7f3df17e2640 20 reqs_thread_entry: start 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.308+0000 7f3f40b33800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.308+0000 7f3f40b33800 20 Filter name: none 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.308+0000 7f3d62ffd640 20 reqs_thread_entry: start 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.308+0000 7f3f40b33800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.308+0000 7f3f40b33800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.308+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c940229bc0 con 0x7f3f24074040 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.309+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.309+0000 7f3f40b33800 20 rados_obj.operate() r=0 bl.length=460 2024-05-07T13:57:57.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.309+0000 7f3f40b33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.309+0000 7f3f40b33800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.309+0000 7f3f40b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.309+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c94022ff20 con 0x7f3f24074040 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3f40b33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3f40b33800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3f40b33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94322852821392 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c94022b730 con 0x55c9401e2aa0 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 94322852562992 notify 124554051608 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f3f3403d040 con 0x55c9401e2aa0 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3e137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 94322852562992 notifier 4866 bl.length()=666 2024-05-07T13:57:57.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3e137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3e137fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 notify.4 [notify cookie 94322852821392 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3e137fe640 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f3e00003ea0 con 0x55c9401e2aa0 2024-05-07T13:57:57.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.310+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.311+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94322852821392 notify 124554051608 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3f3402f040 con 0x55c9401e2aa0 2024-05-07T13:57:57.316 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:57.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.312+0000 7f3df27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.312+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94322852572160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c94022a0c0 con 0x55c9401e2aa0 2024-05-07T13:57:57.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.313+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94322852572160] v29'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.313+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94322852546064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c94022ed90 con 0x7f3f2c056070 2024-05-07T13:57:57.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.314+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94322852546064] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.314+0000 7f3f40b33800 20 remove_watcher() i=0 2024-05-07T13:57:57.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.314+0000 7f3f40b33800 2 removed watcher, disabling cache 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.314+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94322852552960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ec610 con 0x55c9401e2aa0 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.315+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94322852552960] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.315+0000 7f3f40b33800 20 remove_watcher() i=1 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.315+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94322852548320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ec610 con 0x55c9401e7490 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.316+0000 7f3f3c7d8640 1 -- 172.21.15.50:0/1906211193 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94322852548320] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2c072070 con 0x55c9401e7490 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.316+0000 7f3f40b33800 20 remove_watcher() i=2 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.316+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94322852555232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ec610 con 0x7f3f2c056070 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.317+0000 7f3f3bfd7640 1 -- 172.21.15.50:0/1906211193 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94322852555232] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2407f070 con 0x7f3f2c056070 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.317+0000 7f3f40b33800 20 remove_watcher() i=3 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.317+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94322852562992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ec610 con 0x55c9401e2aa0 2024-05-07T13:57:57.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.318+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94322852562992] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x55c9401e2aa0 2024-05-07T13:57:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.318+0000 7f3f40b33800 20 remove_watcher() i=4 2024-05-07T13:57:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.318+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94322852567504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ec610 con 0x7f3f24074040 2024-05-07T13:57:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.319+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94322852567504] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.319+0000 7f3f40b33800 20 remove_watcher() i=5 2024-05-07T13:57:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.319+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94322852565008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401f19d0 con 0x7f3f24074040 2024-05-07T13:57:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.320+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94322852565008] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.320+0000 7f3f40b33800 20 remove_watcher() i=6 2024-05-07T13:57:57.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.320+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94322852571104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c9401ec610 con 0x7f3f24074040 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.321+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94322852571104] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3400a4a0 con 0x7f3f24074040 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.321+0000 7f3f40b33800 20 remove_watcher() i=7 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3f24074040 msgr2=0x7f3f24081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3f24074040 0x7f3f24081410 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9401e2aa0 msgr2=0x55c9401e4f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9401e2aa0 0x55c9401e4f60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3f2c056070 msgr2=0x7f3f2c0565f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3f2c056070 0x7f3f2c0565f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401e7490 msgr2=0x55c9401e9880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401e7490 0x55c9401e9880 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e04036900 msgr2=0x7f3e04038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e04036900 0x7f3e04038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55c9401b2c30 tx=0x7f3f2404f000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 msgr2=0x55c9401d7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/1906211193 reap_dead start 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c9401d7420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c02cd50 tx=0x7f3f2c04ef70 comp rx=0 tx=0).stop 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 shutdown_connections 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/1906211193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c94019ab30 0x55c9401d7420 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 >> 172.21.15.50:0/1906211193 conn(0x55c9401ca090 msgr2=0x55c9401c76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 shutdown_connections 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/1906211193 wait complete. 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/2612141868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e14036970 msgr2=0x7f3e14038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/2612141868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e14036970 0x7f3e14038e30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55c9401a69b0 tx=0x7f3f24005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/2612141868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9401c0c40 msgr2=0x55c9401c1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/2612141868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9401c0c40 0x55c9401c1060 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c04acf0 tx=0x7f3f2c02caa0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/2612141868 shutdown_connections 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/2612141868 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e14036970 0x7f3e14038e30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 --2- 172.21.15.50:0/2612141868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9401c0c40 0x55c9401c1060 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.322+0000 7f3f40b33800 1 -- 172.21.15.50:0/2612141868 >> 172.21.15.50:0/2612141868 conn(0x55c9401b4ce0 msgr2=0x55c9401b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/2612141868 shutdown_connections 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/2612141868 wait complete. 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55c9401afc80 msgr2=0x55c9401b20d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55c9401afc80 0x55c9401b20d0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9400ac4f0 msgr2=0x55c9401a94c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55c9400ac4f0 0x55c9401a94c0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401abd40 msgr2=0x55c9401ae130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55c9401abd40 0x55c9401ae130 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e24036900 msgr2=0x7f3e24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3e24036900 0x7f3e24038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3f24054000 tx=0x7f3f2404e000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 msgr2=0x55c9401a2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 --2- 172.21.15.50:0/332895805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c9400a95f0 0x55c9401a2280 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00c010 tx=0x7f3f2c000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f3cfd9640 1 -- 172.21.15.50:0/332895805 reap_dead start 2024-05-07T13:57:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 shutdown_connections 2024-05-07T13:57:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 >> 172.21.15.50:0/332895805 conn(0x55c9400a2d40 msgr2=0x55c940193780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 shutdown_connections 2024-05-07T13:57:57.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.323+0000 7f3f40b33800 1 -- 172.21.15.50:0/332895805 wait complete. 2024-05-07T13:57:57.331 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.332 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.332 ERROR:root:0 2024-05-07T13:57:57.332 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:57.337 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:57.337 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-07T13:57:57.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-07T13:57:57.338 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-05-07T13:57:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:57.387 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:57.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.400+0000 7f315131f800 1 Processor -- start 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f315131f800 1 -- start start 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f315131f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f5f3a1e670 0x55f5f3a20a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f315131f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f5f3a20fa0 con 0x55f5f3a1ab60 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f315131f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55f5f38ab050 con 0x55f5f3a1e670 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f31447e6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f5f3a1e670 0x55f5f3a20a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f314cfe7640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55f5f3a1ab60 0x55f5f3a1cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56876/0 (socket says 172.21.15.50:56876) 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f314cfe7640 1 -- 172.21.15.50:0/2147405031 learned_addr learned my addr 172.21.15.50:0/2147405031 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f31447e6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55f5f3a1e670 0x55f5f3a20a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:58988/0 (socket says 172.21.15.50:58988) 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f31447e6640 1 -- 172.21.15.50:0/2147405031 >> v1:172.21.15.22:6789/0 conn(0x55f5f3a1ab60 legacy=0x55f5f3a1cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.401+0000 7f31447e6640 1 -- 172.21.15.50:0/2147405031 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f3a22180 con 0x55f5f3a1e670 2024-05-07T13:57:57.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.403+0000 7f31447e6640 1 --2- 172.21.15.50:0/2147405031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1e670 0x55f5f3a20a60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f313400a470 tx=0x7f313401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70a0b95ecd8da7c server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f3147fff640 1 -- 172.21.15.50:0/2147405031 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3134057070 con 0x55f5f3a1e670 2024-05-07T13:57:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f3147fff640 1 -- 172.21.15.50:0/2147405031 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3134052570 con 0x55f5f3a1e670 2024-05-07T13:57:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f3147fff640 1 -- 172.21.15.50:0/2147405031 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3134052870 con 0x55f5f3a1e670 2024-05-07T13:57:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f315131f800 1 -- 172.21.15.50:0/2147405031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1e670 msgr2=0x55f5f3a20a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f315131f800 1 --2- 172.21.15.50:0/2147405031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1e670 0x55f5f3a20a60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f313400a470 tx=0x7f313401ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f315131f800 1 -- 172.21.15.50:0/2147405031 shutdown_connections 2024-05-07T13:57:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f315131f800 1 --2- 172.21.15.50:0/2147405031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1e670 0x55f5f3a20a60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f315131f800 1 -- 172.21.15.50:0/2147405031 >> 172.21.15.50:0/2147405031 conn(0x55f5f3a14570 msgr2=0x55f5f3a16990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f315131f800 1 -- 172.21.15.50:0/2147405031 shutdown_connections 2024-05-07T13:57:57.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.404+0000 7f315131f800 1 -- 172.21.15.50:0/2147405031 wait complete. 2024-05-07T13:57:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.419+0000 7f315131f800 1 Processor -- start 2024-05-07T13:57:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.420+0000 7f315131f800 1 -- start start 2024-05-07T13:57:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.420+0000 7f315131f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3a1a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.420+0000 7f315131f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f5f39651c0 con 0x55f5f3a1ab60 2024-05-07T13:57:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.420+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3a1a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.420+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3a1a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59004/0 (socket says 172.21.15.50:59004) 2024-05-07T13:57:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.420+0000 7f314cfe7640 1 -- 172.21.15.50:0/1944179505 learned_addr learned my addr 172.21.15.50:0/1944179505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.420+0000 7f314cfe7640 1 -- 172.21.15.50:0/1944179505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f3a18a60 con 0x55f5f3a1ab60 2024-05-07T13:57:57.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.420+0000 7f314cfe7640 1 --2- 172.21.15.50:0/1944179505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3a1a4a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f313c001de0 tx=0x7f313c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7858fce4534b492 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f303ae0d640 1 -- 172.21.15.50:0/1944179505 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c012020 con 0x55f5f3a1ab60 2024-05-07T13:57:57.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f303ae0d640 1 -- 172.21.15.50:0/1944179505 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313c00e5a0 con 0x55f5f3a1ab60 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f303ae0d640 1 -- 172.21.15.50:0/1944179505 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c00e8c0 con 0x55f5f3a1ab60 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f315131f800 1 -- 172.21.15.50:0/1944179505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 msgr2=0x55f5f3a1a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f315131f800 1 --2- 172.21.15.50:0/1944179505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3a1a4a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f313c001de0 tx=0x7f313c00b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f315131f800 1 -- 172.21.15.50:0/1944179505 shutdown_connections 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f315131f800 1 --2- 172.21.15.50:0/1944179505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3a1a4a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f315131f800 1 -- 172.21.15.50:0/1944179505 >> 172.21.15.50:0/1944179505 conn(0x55f5f3a14570 msgr2=0x55f5f3b07060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f315131f800 1 -- 172.21.15.50:0/1944179505 shutdown_connections 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.421+0000 7f315131f800 1 -- 172.21.15.50:0/1944179505 wait complete. 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.422+0000 7f315131f800 1 Processor -- start 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.422+0000 7f315131f800 1 -- start start 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.422+0000 7f315131f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3b154c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.422+0000 7f315131f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f5f3a21470 con 0x55f5f3a1ab60 2024-05-07T13:57:57.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.422+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3b154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.422+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3b154c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59008/0 (socket says 172.21.15.50:59008) 2024-05-07T13:57:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.422+0000 7f314cfe7640 1 -- 172.21.15.50:0/2176881083 learned_addr learned my addr 172.21.15.50:0/2176881083 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.423+0000 7f314cfe7640 1 -- 172.21.15.50:0/2176881083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f3b15a00 con 0x55f5f3a1ab60 2024-05-07T13:57:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.423+0000 7f314cfe7640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3b154c0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f313c00c010 tx=0x7f313c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.423+0000 7f303960a640 1 -- 172.21.15.50:0/2176881083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c012070 con 0x55f5f3a1ab60 2024-05-07T13:57:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.423+0000 7f303960a640 1 -- 172.21.15.50:0/2176881083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313c01a7a0 con 0x55f5f3a1ab60 2024-05-07T13:57:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.423+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5f3b15c90 con 0x55f5f3a1ab60 2024-05-07T13:57:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.423+0000 7f303960a640 1 -- 172.21.15.50:0/2176881083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c01aa80 con 0x55f5f3a1ab60 2024-05-07T13:57:57.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.423+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f3b18940 con 0x55f5f3a1ab60 2024-05-07T13:57:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.424+0000 7f303960a640 1 -- 172.21.15.50:0/2176881083 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f313c015020 con 0x55f5f3a1ab60 2024-05-07T13:57:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.424+0000 7f303960a640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3034036950 0x7f3034038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.424+0000 7f303960a640 1 -- 172.21.15.50:0/2176881083 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f313c020070 con 0x55f5f3a1ab60 2024-05-07T13:57:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.424+0000 7f31447e6640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3034036950 0x7f3034038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.424+0000 7f315131f800 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3a1e670 0x55f5f3b1c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.424+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b1cc40 con 0x55f5f3a1e670 2024-05-07T13:57:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.424+0000 7f314d7e8640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3a1e670 0x55f5f3b1c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.425+0000 7f31447e6640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3034036950 0x7f3034038e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3134054000 tx=0x7f313404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.425+0000 7f314d7e8640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3a1e670 0x55f5f3b1c700 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.425+0000 7f314d7e8640 1 -- 172.21.15.50:0/2176881083 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3a1e670 2024-05-07T13:57:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.425+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b19cd0 con 0x55f5f3a1e670 2024-05-07T13:57:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.425+0000 7f314d7e8640 1 -- 172.21.15.50:0/2176881083 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3a1e670 2024-05-07T13:57:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.425+0000 7f315131f800 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b1ef90 0x55f5f3b21380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.425+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b21a70 con 0x55f5f3b1ef90 2024-05-07T13:57:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.425+0000 7f314cfe7640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b1ef90 0x55f5f3b21380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.426+0000 7f314cfe7640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b1ef90 0x55f5f3b21380 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.426+0000 7f314cfe7640 1 -- 172.21.15.50:0/2176881083 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b1ef90 2024-05-07T13:57:57.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.426+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b1df40 con 0x55f5f3a1e670 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.426+0000 7f314d7e8640 1 -- 172.21.15.50:0/2176881083 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3a1e670 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.426+0000 7f315131f800 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f5f3b22f20 0x55f5f3b25370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.426+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b25ad0 con 0x55f5f3b22f20 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.427+0000 7f31447e6640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f5f3b22f20 0x55f5f3b25370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.427+0000 7f31447e6640 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f5f3b22f20 0x55f5f3b25370 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.427+0000 7f31447e6640 1 -- 172.21.15.50:0/2176881083 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f313405a040 con 0x55f5f3b22f20 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.428+0000 7f315131f800 1 Processor -- start 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.428+0000 7f315131f800 1 -- start start 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.428+0000 7f315131f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b33f30 0x55f5f3b34350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.428+0000 7f315131f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f5f390bcf0 con 0x55f5f3b33f30 2024-05-07T13:57:57.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.428+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b33f30 0x55f5f3b34350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.428+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b33f30 0x55f5f3b34350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59020/0 (socket says 172.21.15.50:59020) 2024-05-07T13:57:57.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.428+0000 7f314cfe7640 1 -- 172.21.15.50:0/1790296782 learned_addr learned my addr 172.21.15.50:0/1790296782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.428+0000 7f314cfe7640 1 -- 172.21.15.50:0/1790296782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f3b34890 con 0x55f5f3b33f30 2024-05-07T13:57:57.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.428+0000 7f314cfe7640 1 --2- 172.21.15.50:0/1790296782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b33f30 0x55f5f3b34350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f313c04c010 tx=0x7f313c04abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.429+0000 7f30327fc640 1 -- 172.21.15.50:0/1790296782 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c04c1e0 con 0x55f5f3b33f30 2024-05-07T13:57:57.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.429+0000 7f30327fc640 1 -- 172.21.15.50:0/1790296782 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313c04c380 con 0x55f5f3b33f30 2024-05-07T13:57:57.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.429+0000 7f315131f800 1 -- 172.21.15.50:0/1790296782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5f3b35300 con 0x55f5f3b33f30 2024-05-07T13:57:57.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.429+0000 7f30327fc640 1 -- 172.21.15.50:0/1790296782 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c0490e0 con 0x55f5f3b33f30 2024-05-07T13:57:57.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.429+0000 7f315131f800 1 -- 172.21.15.50:0/1790296782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f3b35300 con 0x55f5f3b33f30 2024-05-07T13:57:57.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.429+0000 7f30327fc640 1 -- 172.21.15.50:0/1790296782 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f313c049280 con 0x55f5f3b33f30 2024-05-07T13:57:57.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f30327fc640 1 --2- 172.21.15.50:0/1790296782 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3024036900 0x7f3024038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f30327fc640 1 -- 172.21.15.50:0/1790296782 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f313c039d90 con 0x55f5f3b33f30 2024-05-07T13:57:57.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f31447e6640 1 --2- 172.21.15.50:0/1790296782 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3024036900 0x7f3024038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f315131f800 1 Processor -- start 2024-05-07T13:57:57.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f315131f800 1 -- start start 2024-05-07T13:57:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f31447e6640 1 --2- 172.21.15.50:0/1790296782 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3024036900 0x7f3024038dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55f5f3b1d540 tx=0x7f3134005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f315131f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b41260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f315131f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f5f3a18de0 con 0x55f5f3b40e40 2024-05-07T13:57:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b41260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b41260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59030/0 (socket says 172.21.15.50:59030) 2024-05-07T13:57:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.430+0000 7f314cfe7640 1 -- 172.21.15.50:0/2168560247 learned_addr learned my addr 172.21.15.50:0/2168560247 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f314cfe7640 1 -- 172.21.15.50:0/2168560247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f3b41830 con 0x55f5f3b40e40 2024-05-07T13:57:57.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f314cfe7640 1 --2- 172.21.15.50:0/2168560247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b41260 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f313c021000 tx=0x7f313c047790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d65030c2fc2a6eb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f3023fff640 1 -- 172.21.15.50:0/2168560247 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c05b070 con 0x55f5f3b40e40 2024-05-07T13:57:57.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f3023fff640 1 -- 172.21.15.50:0/2168560247 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313c044520 con 0x55f5f3b40e40 2024-05-07T13:57:57.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f3023fff640 1 -- 172.21.15.50:0/2168560247 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c03d030 con 0x55f5f3b40e40 2024-05-07T13:57:57.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f315131f800 1 -- 172.21.15.50:0/2168560247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 msgr2=0x55f5f3b41260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f315131f800 1 --2- 172.21.15.50:0/2168560247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b41260 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f313c021000 tx=0x7f313c047790 comp rx=0 tx=0).stop 2024-05-07T13:57:57.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f315131f800 1 -- 172.21.15.50:0/2168560247 shutdown_connections 2024-05-07T13:57:57.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f315131f800 1 --2- 172.21.15.50:0/2168560247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b41260 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.431+0000 7f315131f800 1 -- 172.21.15.50:0/2168560247 >> 172.21.15.50:0/2168560247 conn(0x55f5f3b3d1a0 msgr2=0x55f5f3b3b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f315131f800 1 -- 172.21.15.50:0/2168560247 shutdown_connections 2024-05-07T13:57:57.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f315131f800 1 -- 172.21.15.50:0/2168560247 wait complete. 2024-05-07T13:57:57.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f315131f800 1 Processor -- start 2024-05-07T13:57:57.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f315131f800 1 -- start start 2024-05-07T13:57:57.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f315131f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b48280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f315131f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f5f3b41ee0 con 0x55f5f3b40e40 2024-05-07T13:57:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b48280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f314cfe7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b48280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59044/0 (socket says 172.21.15.50:59044) 2024-05-07T13:57:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 learned_addr learned my addr 172.21.15.50:0/2335732241 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.432+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f3b487c0 con 0x55f5f3b40e40 2024-05-07T13:57:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.433+0000 7f314cfe7640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b48280 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f313c047a20 tx=0x7f313c03f060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.433+0000 7f30227fc640 1 -- 172.21.15.50:0/2335732241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c066020 con 0x55f5f3b40e40 2024-05-07T13:57:57.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.433+0000 7f30227fc640 1 -- 172.21.15.50:0/2335732241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313c049570 con 0x55f5f3b40e40 2024-05-07T13:57:57.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.433+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5f3b487c0 con 0x55f5f3b40e40 2024-05-07T13:57:57.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.433+0000 7f30227fc640 1 -- 172.21.15.50:0/2335732241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f313c05b030 con 0x55f5f3b40e40 2024-05-07T13:57:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.433+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f3b487c0 con 0x55f5f3b40e40 2024-05-07T13:57:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.434+0000 7f30227fc640 1 -- 172.21.15.50:0/2335732241 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f313c069020 con 0x55f5f3b40e40 2024-05-07T13:57:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.434+0000 7f30227fc640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3018036950 0x7f3018038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.434+0000 7f30227fc640 1 -- 172.21.15.50:0/2335732241 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f313c05c070 con 0x55f5f3b40e40 2024-05-07T13:57:57.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.434+0000 7f31447e6640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3018036950 0x7f3018038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.435+0000 7f31447e6640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3018036950 0x7f3018038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55f5f3b25ed0 tx=0x7f313404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.435+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.435+0000 7f315131f800 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3b539d0 0x55f5f3b55e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.435+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b565e0 con 0x55f5f3b539d0 2024-05-07T13:57:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.435+0000 7f314d7e8640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3b539d0 0x55f5f3b55e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.435+0000 7f314d7e8640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3b539d0 0x55f5f3b55e90 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 20 realm 2024-05-07T13:57:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b569f0 con 0x55f5f3b539d0 2024-05-07T13:57:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b572c0 con 0x55f5f3b539d0 2024-05-07T13:57:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b57660 con 0x55f5f3b539d0 2024-05-07T13:57:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b583c0 0x55f5f3b5a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5adc0 con 0x55f5f3b583c0 2024-05-07T13:57:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.436+0000 7f314cfe7640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b583c0 0x55f5f3b5a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.437+0000 7f314cfe7640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b583c0 0x55f5f3b5a7b0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.437+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.437+0000 7f315131f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.437+0000 7f315131f800 20 searching for the correct realm 2024-05-07T13:57:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.437+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5c6f0 con 0x55f5f3b583c0 2024-05-07T13:57:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.437+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.438+0000 7f314cfe7640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f313c076040 0x7f313c02e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.438+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5c6f0 con 0x7f313c076040 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.438+0000 7f31447e6640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f313c076040 0x7f313c02e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.438+0000 7f31447e6640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f313c076040 0x7f313c02e450 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.438+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.438+0000 7f31447e6640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3134074040 0x7f3134081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.438+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5c6f0 con 0x7f3134074040 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.438+0000 7f314d7e8640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3134074040 0x7f3134081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.439+0000 7f314d7e8640 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3134074040 0x7f3134081410 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.439+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.439+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b57660 con 0x55f5f3b539d0 2024-05-07T13:57:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.439+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.439+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b57660 con 0x55f5f3b539d0 2024-05-07T13:57:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.440+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.440+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b57660 con 0x55f5f3b539d0 2024-05-07T13:57:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.440+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.440+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b57660 con 0x7f3134074040 2024-05-07T13:57:57.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.440+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.440+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b57660 con 0x7f313c076040 2024-05-07T13:57:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.440+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.440+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b57660 con 0x7f313c076040 2024-05-07T13:57:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.441+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.441+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b539d0 2024-05-07T13:57:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.441+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.441+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f3134074040 2024-05-07T13:57:57.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.441+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.441+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b539d0 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.441+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.441+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f313c076040 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.442+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.442+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b583c0 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.442+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.442+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b583c0 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.442+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.442+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f3134074040 2024-05-07T13:57:57.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b583c0 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b583c0 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b539d0 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b539d0 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.443+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f3134074040 2024-05-07T13:57:57.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.444+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.444+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b583c0 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.444+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.444+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f313c076040 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.444+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.444+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b539d0 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.445+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.445+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f3134074040 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.445+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.445+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b583c0 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.445+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.445+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f3134074040 2024-05-07T13:57:57.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.446+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.446+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f313c076040 2024-05-07T13:57:57.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.446+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.446+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b583c0 2024-05-07T13:57:57.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.446+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.446+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f313c076040 2024-05-07T13:57:57.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.446+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.446+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x55f5f3b539d0 2024-05-07T13:57:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f313408e040 con 0x7f313c076040 2024-05-07T13:57:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:57.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:57.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:57.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:57.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5b680 con 0x55f5f3b539d0 2024-05-07T13:57:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5ba70 con 0x55f5f3b539d0 2024-05-07T13:57:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.447+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5ba70 con 0x7f3134074040 2024-05-07T13:57:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 20 zone default found 2024-05-07T13:57:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 4 Realm: () 2024-05-07T13:57:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:57.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 20 zonegroup default 2024-05-07T13:57:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5cb70 con 0x7f3134074040 2024-05-07T13:57:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5e550 con 0x55f5f3b583c0 2024-05-07T13:57:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.448+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5e8f0 con 0x55f5f3b583c0 2024-05-07T13:57:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.449+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.449+0000 7f315131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.449+0000 7f315131f800 20 started sync module instance, tier type = 2024-05-07T13:57:57.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.449+0000 7f315131f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.449+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5d9f0 con 0x7f313c076040 2024-05-07T13:57:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.450+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.450+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94514844128576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5ec90 con 0x7f313c076040 2024-05-07T13:57:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.450+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5f4e0 con 0x55f5f3b539d0 2024-05-07T13:57:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.451+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94514844128576] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.451+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.451+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94514844135472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5f450 con 0x55f5f3b539d0 2024-05-07T13:57:57.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.451+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b603a0 con 0x55f5f3b583c0 2024-05-07T13:57:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.452+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.453+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94514844139248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b60bf0 con 0x55f5f3b583c0 2024-05-07T13:57:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.453+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b616c0 con 0x7f313c076040 2024-05-07T13:57:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.453+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94514844135472] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.454+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.454+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94514844139248] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.454+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94514844141376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b61ab0 con 0x7f313c076040 2024-05-07T13:57:57.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.454+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b62340 con 0x55f5f3b539d0 2024-05-07T13:57:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.455+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94514844141376] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.455+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.455+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94514844137600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b62250 con 0x55f5f3b539d0 2024-05-07T13:57:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.455+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b62d70 con 0x7f3134074040 2024-05-07T13:57:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.456+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.456+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94514844149824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b62d30 con 0x7f3134074040 2024-05-07T13:57:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.456+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b63ce0 con 0x7f3134074040 2024-05-07T13:57:57.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.456+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94514844137600] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.468+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94514844149824] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.468+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.468+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94514844153872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b62f90 con 0x7f3134074040 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.468+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b64190 con 0x7f3134074040 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94514844153872] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94514844146912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b64190 con 0x7f3134074040 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f315131f800 20 add_watcher() i=0 2024-05-07T13:57:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f315131f800 20 add_watcher() i=1 2024-05-07T13:57:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f315131f800 20 add_watcher() i=2 2024-05-07T13:57:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f315131f800 20 add_watcher() i=3 2024-05-07T13:57:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f315131f800 20 add_watcher() i=4 2024-05-07T13:57:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f315131f800 20 add_watcher() i=5 2024-05-07T13:57:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.469+0000 7f315131f800 20 add_watcher() i=6 2024-05-07T13:57:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.470+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94514844146912] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.470+0000 7f315131f800 20 add_watcher() i=7 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.470+0000 7f315131f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.470+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b674d0 con 0x55f5f3b539d0 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.470+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.470+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94514844155472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b64720 con 0x55f5f3b539d0 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.471+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94514844155472] v29'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.471+0000 7f3002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.471+0000 7f315131f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.471+0000 7f315131f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.472+0000 7f315131f800 5 note: GC not initialized 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.472+0000 7f3001fe3640 20 reqs_thread_entry: start 2024-05-07T13:57:57.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.472+0000 7f315131f800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.472+0000 7f315131f800 20 Filter name: none 2024-05-07T13:57:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.472+0000 7f2f737fe640 20 reqs_thread_entry: start 2024-05-07T13:57:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.472+0000 7f315131f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.472+0000 7f315131f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.472+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b9aaa0 con 0x7f3134074040 2024-05-07T13:57:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.473+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.473+0000 7f315131f800 20 rados_obj.operate() r=0 bl.length=490 2024-05-07T13:57:57.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.473+0000 7f315131f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-07T13:57:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.473+0000 7f315131f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.473+0000 7f315131f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.473+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3ba0f10 con 0x7f3134074040 2024-05-07T13:57:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.474+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.474+0000 7f315131f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.474+0000 7f315131f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.474+0000 7f315131f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.474+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94514844404096 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b9fa60 con 0x55f5f3b539d0 2024-05-07T13:57:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.474+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 94514844137600 notify 124554051609 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f314803d040 con 0x55f5f3b539d0 2024-05-07T13:57:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.475+0000 7f3023fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 94514844137600 notifier 4873 bl.length()=666 2024-05-07T13:57:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.475+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 notify.4 [notify cookie 94514844404096 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.475+0000 7f3023fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.475+0000 7f3023fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.475+0000 7f3023fff640 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f3010003ea0 con 0x55f5f3b539d0 2024-05-07T13:57:57.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.475+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.475+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94514844404096 notify 124554051609 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f314802f040 con 0x55f5f3b539d0 2024-05-07T13:57:57.500 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:57.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.476+0000 7f3002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.476+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94514844155472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b666a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.477+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94514844155472] v29'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.477+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94514844128576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b63e50 con 0x7f313c076040 2024-05-07T13:57:57.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.478+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94514844128576] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.478+0000 7f315131f800 20 remove_watcher() i=0 2024-05-07T13:57:57.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.478+0000 7f315131f800 2 removed watcher, disabling cache 2024-05-07T13:57:57.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.478+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94514844135472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b63e50 con 0x55f5f3b539d0 2024-05-07T13:57:57.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.479+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94514844135472] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.480+0000 7f315131f800 20 remove_watcher() i=1 2024-05-07T13:57:57.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.480+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94514844139248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5f030 con 0x55f5f3b583c0 2024-05-07T13:57:57.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.481+0000 7f314cfe7640 1 -- 172.21.15.50:0/2335732241 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94514844139248] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f313c02b070 con 0x55f5f3b583c0 2024-05-07T13:57:57.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.481+0000 7f315131f800 20 remove_watcher() i=2 2024-05-07T13:57:57.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.481+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94514844141376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b63e50 con 0x7f313c076040 2024-05-07T13:57:57.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.482+0000 7f31447e6640 1 -- 172.21.15.50:0/2335732241 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94514844141376] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f313407f070 con 0x7f313c076040 2024-05-07T13:57:57.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.482+0000 7f315131f800 20 remove_watcher() i=3 2024-05-07T13:57:57.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.482+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94514844137600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5f030 con 0x55f5f3b539d0 2024-05-07T13:57:57.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.483+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94514844137600] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x55f5f3b539d0 2024-05-07T13:57:57.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.483+0000 7f315131f800 20 remove_watcher() i=4 2024-05-07T13:57:57.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.483+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94514844149824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b63e50 con 0x7f3134074040 2024-05-07T13:57:57.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.484+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94514844149824] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.484+0000 7f315131f800 20 remove_watcher() i=5 2024-05-07T13:57:57.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.484+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94514844153872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5f880 con 0x7f3134074040 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.485+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94514844153872] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.485+0000 7f315131f800 20 remove_watcher() i=6 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.485+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94514844146912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f5f3b5f030 con 0x7f3134074040 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.486+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94514844146912] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f314800a4a0 con 0x7f3134074040 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.486+0000 7f315131f800 20 remove_watcher() i=7 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3134074040 msgr2=0x7f3134081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3134074040 0x7f3134081410 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3b539d0 msgr2=0x55f5f3b55e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3b539d0 0x55f5f3b55e90 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f313c076040 msgr2=0x7f313c02e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f313c076040 0x7f313c02e450 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b583c0 msgr2=0x55f5f3b5a7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b583c0 0x55f5f3b5a7b0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3018036950 msgr2=0x7f3018038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3018036950 0x7f3018038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55f5f3b25ed0 tx=0x7f313404f000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 msgr2=0x55f5f3b48280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b48280 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f313c047a20 tx=0x7f313c03f060 comp rx=0 tx=0).stop 2024-05-07T13:57:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f314d7e8640 1 -- 172.21.15.50:0/2335732241 reap_dead start 2024-05-07T13:57:57.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 shutdown_connections 2024-05-07T13:57:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/2335732241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b40e40 0x55f5f3b48280 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 >> 172.21.15.50:0/2335732241 conn(0x55f5f3b3d1a0 msgr2=0x55f5f3b3a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 shutdown_connections 2024-05-07T13:57:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/2335732241 wait complete. 2024-05-07T13:57:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/1790296782 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3024036900 msgr2=0x7f3024038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/1790296782 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3024036900 0x7f3024038dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55f5f3b1d540 tx=0x7f3134005a00 comp rx=0 tx=0).stop 2024-05-07T13:57:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/1790296782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b33f30 msgr2=0x55f5f3b34350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/1790296782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b33f30 0x55f5f3b34350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f313c04c010 tx=0x7f313c04abf0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/1790296782 shutdown_connections 2024-05-07T13:57:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/1790296782 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3024036900 0x7f3024038dc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 --2- 172.21.15.50:0/1790296782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3b33f30 0x55f5f3b34350 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/1790296782 >> 172.21.15.50:0/1790296782 conn(0x55f5f3b27fd0 msgr2=0x55f5f3b283d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/1790296782 shutdown_connections 2024-05-07T13:57:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.487+0000 7f315131f800 1 -- 172.21.15.50:0/1790296782 wait complete. 2024-05-07T13:57:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f5f3b22f20 msgr2=0x55f5f3b25370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55f5f3b22f20 0x55f5f3b25370 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3a1e670 msgr2=0x55f5f3b1c700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55f5f3a1e670 0x55f5f3b1c700 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b1ef90 msgr2=0x55f5f3b21380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55f5f3b1ef90 0x55f5f3b21380 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3034036950 msgr2=0x7f3034038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f3034036950 0x7f3034038e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3134054000 tx=0x7f313404e000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 msgr2=0x55f5f3b154c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 --2- 172.21.15.50:0/2176881083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5f3a1ab60 0x55f5f3b154c0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f313c00c010 tx=0x7f313c000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f314d7e8640 1 -- 172.21.15.50:0/2176881083 reap_dead start 2024-05-07T13:57:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 shutdown_connections 2024-05-07T13:57:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 >> 172.21.15.50:0/2176881083 conn(0x55f5f3a14570 msgr2=0x55f5f3a19340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 shutdown_connections 2024-05-07T13:57:57.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.488+0000 7f315131f800 1 -- 172.21.15.50:0/2176881083 wait complete. 2024-05-07T13:57:57.517 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.517 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.518 ERROR:root:0 2024-05-07T13:57:57.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:57.530 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:57.530 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-07T13:57:57.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-07T13:57:57.531 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-07T13:57:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.592+0000 7f8102c12800 1 Processor -- start 2024-05-07T13:57:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.592+0000 7f8102c12800 1 -- start start 2024-05-07T13:57:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.593+0000 7f8102c12800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5616a2628680 0x5616a262aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.593+0000 7f8102c12800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616a262afb0 con 0x5616a2624b70 2024-05-07T13:57:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.593+0000 7f8102c12800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x5616a24b5050 con 0x5616a2628680 2024-05-07T13:57:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.593+0000 7f80fd9ed640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5616a2628680 0x5616a262aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.593+0000 7f80fd9ed640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5616a2628680 0x5616a262aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59060/0 (socket says 172.21.15.50:59060) 2024-05-07T13:57:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.593+0000 7f80fd9ed640 1 -- 172.21.15.50:0/2707056725 learned_addr learned my addr 172.21.15.50:0/2707056725 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.593+0000 7f80fe1ee640 1 --1- 172.21.15.50:0/2707056725 >> v1:172.21.15.22:6789/0 conn(0x5616a2624b70 0x5616a2626f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56888/0 (socket says 172.21.15.50:56888) 2024-05-07T13:57:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.593+0000 7f80fd9ed640 1 -- 172.21.15.50:0/2707056725 >> v1:172.21.15.22:6789/0 conn(0x5616a2624b70 legacy=0x5616a2626f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.593+0000 7f80fd9ed640 1 -- 172.21.15.50:0/2707056725 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a262c190 con 0x5616a2628680 2024-05-07T13:57:57.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.595+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/2707056725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2628680 0x5616a262aa70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f80f400a520 tx=0x7f80f401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba7db2be3ad3cbd server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.595+0000 7f80fd1ec640 1 -- 172.21.15.50:0/2707056725 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f4057070 con 0x5616a2628680 2024-05-07T13:57:57.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.595+0000 7f80fd1ec640 1 -- 172.21.15.50:0/2707056725 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f4052570 con 0x5616a2628680 2024-05-07T13:57:57.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.595+0000 7f80fd1ec640 1 -- 172.21.15.50:0/2707056725 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f404ae60 con 0x5616a2628680 2024-05-07T13:57:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.596+0000 7f8102c12800 1 -- 172.21.15.50:0/2707056725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2628680 msgr2=0x5616a262aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.596+0000 7f8102c12800 1 --2- 172.21.15.50:0/2707056725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2628680 0x5616a262aa70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f80f400a520 tx=0x7f80f401d010 comp rx=0 tx=0).stop 2024-05-07T13:57:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.596+0000 7f8102c12800 1 -- 172.21.15.50:0/2707056725 shutdown_connections 2024-05-07T13:57:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.596+0000 7f8102c12800 1 --2- 172.21.15.50:0/2707056725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2628680 0x5616a262aa70 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.596+0000 7f8102c12800 1 -- 172.21.15.50:0/2707056725 >> 172.21.15.50:0/2707056725 conn(0x5616a261e5c0 msgr2=0x5616a26209e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.596+0000 7f8102c12800 1 -- 172.21.15.50:0/2707056725 shutdown_connections 2024-05-07T13:57:57.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.596+0000 7f8102c12800 1 -- 172.21.15.50:0/2707056725 wait complete. 2024-05-07T13:57:57.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.611+0000 7f8102c12800 1 Processor -- start 2024-05-07T13:57:57.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.611+0000 7f8102c12800 1 -- start start 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.611+0000 7f8102c12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a26244b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.611+0000 7f8102c12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5616a256f1c0 con 0x5616a2624b70 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.612+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a26244b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.612+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a26244b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59064/0 (socket says 172.21.15.50:59064) 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.612+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1346559207 learned_addr learned my addr 172.21.15.50:0/1346559207 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.612+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1346559207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a2622a70 con 0x5616a2624b70 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.612+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/1346559207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a26244b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f80f0001e90 tx=0x7f80f000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694fe21851cb5734 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.612+0000 7f7fec608640 1 -- 172.21.15.50:0/1346559207 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f000e5c0 con 0x5616a2624b70 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.612+0000 7f7fec608640 1 -- 172.21.15.50:0/1346559207 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f0006070 con 0x5616a2624b70 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.612+0000 7f7fec608640 1 -- 172.21.15.50:0/1346559207 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f000e890 con 0x5616a2624b70 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.613+0000 7f8102c12800 1 -- 172.21.15.50:0/1346559207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 msgr2=0x5616a26244b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.613+0000 7f8102c12800 1 --2- 172.21.15.50:0/1346559207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a26244b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f80f0001e90 tx=0x7f80f000b6c0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.613+0000 7f8102c12800 1 -- 172.21.15.50:0/1346559207 shutdown_connections 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.613+0000 7f8102c12800 1 --2- 172.21.15.50:0/1346559207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a26244b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.613+0000 7f8102c12800 1 -- 172.21.15.50:0/1346559207 >> 172.21.15.50:0/1346559207 conn(0x5616a261e5c0 msgr2=0x5616a27110a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.613+0000 7f8102c12800 1 -- 172.21.15.50:0/1346559207 shutdown_connections 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.613+0000 7f8102c12800 1 -- 172.21.15.50:0/1346559207 wait complete. 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.613+0000 7f8102c12800 1 Processor -- start 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.613+0000 7f8102c12800 1 -- start start 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f8102c12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a271f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f8102c12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5616a262b480 con 0x5616a2624b70 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a271f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a271f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59076/0 (socket says 172.21.15.50:59076) 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f80fe1ee640 1 -- 172.21.15.50:0/414695159 learned_addr learned my addr 172.21.15.50:0/414695159 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f80fe1ee640 1 -- 172.21.15.50:0/414695159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a271fa40 con 0x5616a2624b70 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a271f500 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f80f0001ed0 tx=0x7f80f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f7feae05640 1 -- 172.21.15.50:0/414695159 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f001a880 con 0x5616a2624b70 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f7feae05640 1 -- 172.21.15.50:0/414695159 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f001aa20 con 0x5616a2624b70 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.614+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616a271fcd0 con 0x5616a2624b70 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.615+0000 7f7feae05640 1 -- 172.21.15.50:0/414695159 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f001ad40 con 0x5616a2624b70 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.615+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a2722980 con 0x5616a2624b70 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.615+0000 7f7feae05640 1 -- 172.21.15.50:0/414695159 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f80f0017070 con 0x5616a2624b70 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.616+0000 7f7feae05640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fe4036900 0x7f7fe4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.616+0000 7f7feae05640 1 -- 172.21.15.50:0/414695159 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f80f0015020 con 0x5616a2624b70 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.616+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fe4036900 0x7f7fe4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.616+0000 7f8102c12800 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a2628680 0x5616a2726740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.616+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2726c80 con 0x5616a2628680 2024-05-07T13:57:57.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.616+0000 7f80fe9ef640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a2628680 0x5616a2726740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.616+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fe4036900 0x7f7fe4038dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f80f4054000 tx=0x7f80f404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.616+0000 7f80fe9ef640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a2628680 0x5616a2726740 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.617+0000 7f80fe9ef640 1 -- 172.21.15.50:0/414695159 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a2628680 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.617+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2723d10 con 0x5616a2628680 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.617+0000 7f80fe9ef640 1 -- 172.21.15.50:0/414695159 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a2628680 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.617+0000 7f8102c12800 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2728fb0 0x5616a272b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.617+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a272ba90 con 0x5616a2728fb0 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.617+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2728fb0 0x5616a272b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.617+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2728fb0 0x5616a272b3a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.618+0000 7f80fe1ee640 1 -- 172.21.15.50:0/414695159 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f80f002e070 con 0x5616a2728fb0 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.618+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2727f60 con 0x5616a2628680 2024-05-07T13:57:57.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.618+0000 7f80fe9ef640 1 -- 172.21.15.50:0/414695159 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a2628680 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.618+0000 7f8102c12800 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5616a272cf40 0x5616a272f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.618+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a272faf0 con 0x5616a272cf40 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.618+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5616a272cf40 0x5616a272f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.619+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5616a272cf40 0x5616a272f390 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.619+0000 7f80fd9ed640 1 -- 172.21.15.50:0/414695159 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f80f405a040 con 0x5616a272cf40 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.619+0000 7f8102c12800 1 Processor -- start 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.619+0000 7f8102c12800 1 -- start start 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f8102c12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a273df50 0x5616a273e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f8102c12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5616a2515cf0 con 0x5616a273df50 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a273df50 0x5616a273e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a273df50 0x5616a273e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59080/0 (socket says 172.21.15.50:59080) 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f80fe1ee640 1 -- 172.21.15.50:0/3544295113 learned_addr learned my addr 172.21.15.50:0/3544295113 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f80fe1ee640 1 -- 172.21.15.50:0/3544295113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a273e8b0 con 0x5616a273df50 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/3544295113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a273df50 0x5616a273e370 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f80f00178f0 tx=0x7f80f0017d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f7fe3fff640 1 -- 172.21.15.50:0/3544295113 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00174a0 con 0x5616a273df50 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f7fe3fff640 1 -- 172.21.15.50:0/3544295113 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00408e0 con 0x5616a273df50 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.620+0000 7f8102c12800 1 -- 172.21.15.50:0/3544295113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616a273f320 con 0x5616a273df50 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.621+0000 7f7fe3fff640 1 -- 172.21.15.50:0/3544295113 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f0040bc0 con 0x5616a273df50 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.621+0000 7f8102c12800 1 -- 172.21.15.50:0/3544295113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a273f820 con 0x5616a273df50 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.621+0000 7f7fe3fff640 1 -- 172.21.15.50:0/3544295113 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f80f003f200 con 0x5616a273df50 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.621+0000 7f7fe3fff640 1 --2- 172.21.15.50:0/3544295113 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fd8036950 0x7f7fd8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.621+0000 7f7fe3fff640 1 -- 172.21.15.50:0/3544295113 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f80f003bd50 con 0x5616a273df50 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/3544295113 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fd8036950 0x7f7fd8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f8102c12800 1 Processor -- start 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f8102c12800 1 -- start start 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/3544295113 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fd8036950 0x7f7fd8038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5616a2727560 tx=0x7f80f4005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f8102c12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a274b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f8102c12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5616a2622df0 con 0x5616a274b050 2024-05-07T13:57:57.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a274b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a274b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59090/0 (socket says 172.21.15.50:59090) 2024-05-07T13:57:57.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1124013237 learned_addr learned my addr 172.21.15.50:0/1124013237 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.622+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1124013237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a274ba40 con 0x5616a274b050 2024-05-07T13:57:57.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/1124013237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a274b470 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f80f00449f0 tx=0x7f80f003de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553c8e9c207c6b1f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f7fe1ffb640 1 -- 172.21.15.50:0/1124013237 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f0058040 con 0x5616a274b050 2024-05-07T13:57:57.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f7fe1ffb640 1 -- 172.21.15.50:0/1124013237 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f0040d60 con 0x5616a274b050 2024-05-07T13:57:57.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f7fe1ffb640 1 -- 172.21.15.50:0/1124013237 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f0044ab0 con 0x5616a274b050 2024-05-07T13:57:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f8102c12800 1 -- 172.21.15.50:0/1124013237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 msgr2=0x5616a274b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f8102c12800 1 --2- 172.21.15.50:0/1124013237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a274b470 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f80f00449f0 tx=0x7f80f003de20 comp rx=0 tx=0).stop 2024-05-07T13:57:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f8102c12800 1 -- 172.21.15.50:0/1124013237 shutdown_connections 2024-05-07T13:57:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f8102c12800 1 --2- 172.21.15.50:0/1124013237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a274b470 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f8102c12800 1 -- 172.21.15.50:0/1124013237 >> 172.21.15.50:0/1124013237 conn(0x5616a2747370 msgr2=0x5616a27453d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f8102c12800 1 -- 172.21.15.50:0/1124013237 shutdown_connections 2024-05-07T13:57:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.623+0000 7f8102c12800 1 -- 172.21.15.50:0/1124013237 wait complete. 2024-05-07T13:57:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.624+0000 7f8102c12800 1 Processor -- start 2024-05-07T13:57:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.624+0000 7f8102c12800 1 -- start start 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.624+0000 7f8102c12800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a27523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.624+0000 7f8102c12800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5616a274c160 con 0x5616a274b050 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.624+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a27523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.624+0000 7f80fe1ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a27523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59098/0 (socket says 172.21.15.50:59098) 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.624+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 learned_addr learned my addr 172.21.15.50:0/1108944950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.624+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a2752910 con 0x5616a274b050 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.625+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a27523d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f80f00449f0 tx=0x7f80f0042f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.625+0000 7f7fcffff640 1 -- 172.21.15.50:0/1108944950 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f006a020 con 0x5616a274b050 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.625+0000 7f7fcffff640 1 -- 172.21.15.50:0/1108944950 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00317c0 con 0x5616a274b050 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.625+0000 7f7fcffff640 1 -- 172.21.15.50:0/1108944950 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f0031aa0 con 0x5616a274b050 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.625+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616a2752910 con 0x5616a274b050 2024-05-07T13:57:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.625+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a2752910 con 0x5616a274b050 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.625+0000 7f7fcffff640 1 -- 172.21.15.50:0/1108944950 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f80f006d020 con 0x5616a274b050 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.626+0000 7f7fcffff640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fc8036900 0x7f7fc8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.626+0000 7f7fcffff640 1 -- 172.21.15.50:0/1108944950 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f80f0062040 con 0x5616a274b050 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.626+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fc8036900 0x7f7fc8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.626+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fc8036900 0x7f7fc8038dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f80f4052fd0 tx=0x7f80f404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f8102c12800 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a275db80 0x5616a2760040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2760790 con 0x5616a275db80 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f80fe9ef640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a275db80 0x5616a2760040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f80fe9ef640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a275db80 0x5616a2760040 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f8102c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f8102c12800 20 realm 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.627+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2760ba0 con 0x5616a275db80 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2761470 con 0x5616a275db80 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2761810 con 0x5616a275db80 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2762570 0x5616a2764960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2764f70 con 0x5616a2762570 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.628+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2762570 0x5616a2764960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.629+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2762570 0x5616a2764960 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.629+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.629+0000 7f8102c12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.629+0000 7f8102c12800 20 searching for the correct realm 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.629+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5616a27668a0 con 0x5616a2762570 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.629+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.629+0000 7f80fe1ee640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f80f006f020 0x7f80f0044310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.629+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5616a27668a0 con 0x7f80f006f020 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.629+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f80f006f020 0x7f80f0044310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.630+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f80f006f020 0x7f80f0044310 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.630+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.630+0000 7f80fd9ed640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f80f4074040 0x7f80f4081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.630+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5616a27668a0 con 0x7f80f4074040 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.630+0000 7f80fe9ef640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f80f4074040 0x7f80f4081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.631+0000 7f80fe9ef640 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f80f4074040 0x7f80f4081410 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.631+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.631+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5616a2761810 con 0x5616a275db80 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.631+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.631+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5616a2761810 con 0x5616a275db80 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.632+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.632+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5616a2761810 con 0x5616a275db80 2024-05-07T13:57:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.632+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.632+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5616a2761810 con 0x7f80f4074040 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.632+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.632+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5616a2761810 con 0x7f80f006f020 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.632+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.632+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5616a2761810 con 0x7f80f006f020 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.633+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.633+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a275db80 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.633+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.633+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f4074040 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.633+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.633+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a275db80 2024-05-07T13:57:57.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.633+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.633+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f006f020 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.634+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.634+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a2762570 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.634+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.634+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a2762570 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.634+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.634+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f4074040 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a2762570 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a2762570 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a275db80 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a275db80 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.635+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f4074040 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.636+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.636+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a2762570 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.636+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.636+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f006f020 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.636+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.636+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a275db80 2024-05-07T13:57:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.636+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.636+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f4074040 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.637+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.637+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a2762570 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.637+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.637+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f4074040 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.637+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.637+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f006f020 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.638+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.638+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a2762570 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.638+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.638+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f006f020 2024-05-07T13:57:57.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.638+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.638+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x5616a275db80 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.638+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.638+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f80f408e040 con 0x7f80f006f020 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2765830 con 0x5616a275db80 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2765c20 con 0x5616a275db80 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.639+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2765c20 con 0x7f80f4074040 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 20 zone default found 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 4 Realm: () 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:57.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 20 zonegroup default 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2765490 con 0x7f80f4074040 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2765490 con 0x5616a2762570 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.640+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.641+0000 7f8102c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.641+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.641+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2768820 con 0x5616a2762570 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.641+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.641+0000 7f8102c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.641+0000 7f8102c12800 20 started sync module instance, tier type = 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.641+0000 7f8102c12800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.641+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a2767ba0 con 0x7f80f006f020 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.642+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.642+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94655214944144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a2767800 con 0x7f80f006f020 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.642+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a2769660 con 0x5616a275db80 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.643+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94655214944144] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.643+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.643+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94655214947456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a2769a50 con 0x5616a275db80 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.643+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276a4b0 con 0x5616a2762570 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.644+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94655214947456] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.645+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.645+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94655214952288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276a8a0 con 0x5616a2762570 2024-05-07T13:57:57.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.645+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276b2e0 con 0x7f80f006f020 2024-05-07T13:57:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.646+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94655214952288] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.646+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.646+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94655214948512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276bb80 con 0x7f80f006f020 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.646+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276c540 con 0x5616a275db80 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.647+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.647+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94655214960784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276c960 con 0x5616a275db80 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.647+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276d460 con 0x7f80f4074040 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.647+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94655214948512] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.648+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.648+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94655214960784] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.648+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94655214964560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276c4b0 con 0x7f80f4074040 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.648+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276dd00 con 0x7f80f4074040 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.649+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94655214964560] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.649+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.649+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94655214958288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276c4b0 con 0x7f80f4074040 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.649+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276e2d0 con 0x7f80f4074040 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(58 notify.7 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94655214958288] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94655214966720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276e290 con 0x7f80f4074040 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f8102c12800 20 add_watcher() i=0 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f8102c12800 20 add_watcher() i=1 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f8102c12800 20 add_watcher() i=2 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f8102c12800 20 add_watcher() i=3 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f8102c12800 20 add_watcher() i=4 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f8102c12800 20 add_watcher() i=5 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.650+0000 7f8102c12800 20 add_watcher() i=6 2024-05-07T13:57:57.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.651+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94655214966720] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.651+0000 7f8102c12800 20 add_watcher() i=7 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.651+0000 7f8102c12800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.651+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a2771720 con 0x5616a275db80 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.652+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.652+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94655214968752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276ec20 con 0x5616a275db80 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.653+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94655214968752] v29'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.653+0000 7f7fb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.653+0000 7f8102c12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.653+0000 7f8102c12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.653+0000 7f8102c12800 5 note: GC not initialized 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.653+0000 7f7f2f7fe640 20 reqs_thread_entry: start 2024-05-07T13:57:57.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.653+0000 7f8102c12800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.653+0000 7f8102c12800 20 Filter name: none 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f7f2d7fa640 20 reqs_thread_entry: start 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f8102c12800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f8102c12800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a27a4cb0 con 0x7f80f4074040 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f8102c12800 20 rados_obj.operate() r=0 bl.length=490 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f8102c12800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f8102c12800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f8102c12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.654+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a27ab0b0 con 0x7f80f4074040 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v29'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f8102c12800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f8102c12800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f8102c12800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94655215217440 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5616a27a9c00 con 0x5616a275db80 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 94655214960784 notify 124554051610 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f80f803d040 con 0x5616a275db80 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f7fe1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 94655214960784 notifier 4880 bl.length()=679 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f7fe1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f7fe1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 notify.4 [notify cookie 94655215217440 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f7fe1ffb640 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7fc4003ea0 con 0x5616a275db80 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.656+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.657+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94655215217440 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f80f802f040 con 0x5616a275db80 2024-05-07T13:57:57.657 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.657+0000 7f7fb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.658+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94655214968752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a27a5250 con 0x5616a275db80 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.659+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94655214968752] v29'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.659+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94655214944144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276df80 con 0x7f80f006f020 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.660+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94655214944144] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.660+0000 7f8102c12800 20 remove_watcher() i=0 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.660+0000 7f8102c12800 2 removed watcher, disabling cache 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.660+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94655214947456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a2767f90 con 0x5616a275db80 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.661+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94655214947456] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.661+0000 7f8102c12800 20 remove_watcher() i=1 2024-05-07T13:57:57.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.661+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94655214952288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a2768c80 con 0x5616a2762570 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.662+0000 7f80fe1ee640 1 -- 172.21.15.50:0/1108944950 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94655214952288] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f004e020 con 0x5616a2762570 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.662+0000 7f8102c12800 20 remove_watcher() i=2 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.662+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94655214948512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a2769f60 con 0x7f80f006f020 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.663+0000 7f80fd9ed640 1 -- 172.21.15.50:0/1108944950 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94655214948512] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f407f070 con 0x7f80f006f020 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.663+0000 7f8102c12800 20 remove_watcher() i=3 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.663+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94655214960784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a2769f60 con 0x5616a275db80 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.664+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94655214960784] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x5616a275db80 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.664+0000 7f8102c12800 20 remove_watcher() i=4 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.664+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94655214964560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276c090 con 0x7f80f4074040 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.665+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94655214964560] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.665+0000 7f8102c12800 20 remove_watcher() i=5 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.665+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94655214958288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276c090 con 0x7f80f4074040 2024-05-07T13:57:57.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.666+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94655214958288] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.666+0000 7f8102c12800 20 remove_watcher() i=6 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.666+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94655214966720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5616a276b6d0 con 0x7f80f4074040 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.667+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94655214966720] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f800a4a0 con 0x7f80f4074040 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.667+0000 7f8102c12800 20 remove_watcher() i=7 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f80f4074040 msgr2=0x7f80f4081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f80f4074040 0x7f80f4081410 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a275db80 msgr2=0x5616a2760040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a275db80 0x5616a2760040 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f80f006f020 msgr2=0x7f80f0044310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f80f006f020 0x7f80f0044310 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2762570 msgr2=0x5616a2764960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2762570 0x5616a2764960 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fc8036900 msgr2=0x7f7fc8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fc8036900 0x7f7fc8038dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f80f4052fd0 tx=0x7f80f404f000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 msgr2=0x5616a27523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/1108944950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a274b050 0x5616a27523d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f80f00449f0 tx=0x7f80f0042f90 comp rx=0 tx=0).stop 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 reap_dead start 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f80fe9ef640 1 -- 172.21.15.50:0/1108944950 reap_dead start 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 shutdown_connections 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 >> 172.21.15.50:0/1108944950 conn(0x5616a2747370 msgr2=0x5616a27449d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 shutdown_connections 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/1108944950 wait complete. 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/3544295113 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fd8036950 msgr2=0x7f7fd8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/3544295113 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fd8036950 0x7f7fd8038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5616a2727560 tx=0x7f80f4005ac0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/3544295113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a273df50 msgr2=0x5616a273e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/3544295113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a273df50 0x5616a273e370 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f80f00178f0 tx=0x7f80f0017d30 comp rx=0 tx=0).stop 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/3544295113 shutdown_connections 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/3544295113 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fd8036950 0x7f7fd8038e10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 --2- 172.21.15.50:0/3544295113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a273df50 0x5616a273e370 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/3544295113 >> 172.21.15.50:0/3544295113 conn(0x5616a2731ff0 msgr2=0x5616a27323f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/3544295113 shutdown_connections 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.668+0000 7f8102c12800 1 -- 172.21.15.50:0/3544295113 wait complete. 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5616a272cf40 msgr2=0x5616a272f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5616a272cf40 0x5616a272f390 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a2628680 msgr2=0x5616a2726740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5616a2628680 0x5616a2726740 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2728fb0 msgr2=0x5616a272b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5616a2728fb0 0x5616a272b3a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fe4036900 msgr2=0x7f7fe4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7fe4036900 0x7f7fe4038dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f80f4054000 tx=0x7f80f404e000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 msgr2=0x5616a271f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 --2- 172.21.15.50:0/414695159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5616a2624b70 0x5616a271f500 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f80f0001ed0 tx=0x7f80f0000ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f80fe9ef640 1 -- 172.21.15.50:0/414695159 reap_dead start 2024-05-07T13:57:57.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 shutdown_connections 2024-05-07T13:57:57.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 >> 172.21.15.50:0/414695159 conn(0x5616a261e5c0 msgr2=0x5616a2623350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 shutdown_connections 2024-05-07T13:57:57.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.669+0000 7f8102c12800 1 -- 172.21.15.50:0/414695159 wait complete. 2024-05-07T13:57:57.668 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.668 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.668 ERROR:root:0 2024-05-07T13:57:57.668 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:57.676 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:57.676 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-07T13:57:57.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-07T13:57:57.677 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-05-07T13:57:57.725 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:57.726 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:57.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.739+0000 7f3b0323f800 1 Processor -- start 2024-05-07T13:57:57.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.739+0000 7f3b0323f800 1 -- start start 2024-05-07T13:57:57.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.739+0000 7f3b0323f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5580782db650 0x5580782dba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.739+0000 7f3b0323f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580782e4120 con 0x5580782dbfb0 2024-05-07T13:57:57.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.739+0000 7f3b0323f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55807816c050 con 0x5580782db650 2024-05-07T13:57:57.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.739+0000 7f3b00d3e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5580782db650 0x5580782dba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.739+0000 7f3afbfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x5580782dbfb0 0x5580782e28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56898/0 (socket says 172.21.15.50:56898) 2024-05-07T13:57:57.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.739+0000 7f3b00d3e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x5580782db650 0x5580782dba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59112/0 (socket says 172.21.15.50:59112) 2024-05-07T13:57:57.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.739+0000 7f3afbfff640 1 -- 172.21.15.50:0/112118123 learned_addr learned my addr 172.21.15.50:0/112118123 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.740+0000 7f3b00d3e640 1 -- 172.21.15.50:0/112118123 >> v1:172.21.15.22:6789/0 conn(0x5580782dbfb0 legacy=0x5580782e28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.740+0000 7f3b00d3e640 1 -- 172.21.15.50:0/112118123 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580782e5350 con 0x5580782db650 2024-05-07T13:57:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/112118123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580782dba70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3af400a470 tx=0x7f3af401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd656e09a6a4c2f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3afb7fe640 1 -- 172.21.15.50:0/112118123 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af4057070 con 0x5580782db650 2024-05-07T13:57:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3afb7fe640 1 -- 172.21.15.50:0/112118123 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4052570 con 0x5580782db650 2024-05-07T13:57:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3afb7fe640 1 -- 172.21.15.50:0/112118123 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af4052870 con 0x5580782db650 2024-05-07T13:57:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3b0323f800 1 -- 172.21.15.50:0/112118123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 msgr2=0x5580782dba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3b0323f800 1 --2- 172.21.15.50:0/112118123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580782dba70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3af400a470 tx=0x7f3af401ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3b0323f800 1 -- 172.21.15.50:0/112118123 shutdown_connections 2024-05-07T13:57:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3b0323f800 1 --2- 172.21.15.50:0/112118123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580782dba70 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3b0323f800 1 -- 172.21.15.50:0/112118123 >> 172.21.15.50:0/112118123 conn(0x5580782d4d40 msgr2=0x5580782d7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3b0323f800 1 -- 172.21.15.50:0/112118123 shutdown_connections 2024-05-07T13:57:57.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.742+0000 7f3b0323f800 1 -- 172.21.15.50:0/112118123 wait complete. 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.757+0000 7f3b0323f800 1 Processor -- start 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.757+0000 7f3b0323f800 1 -- start start 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.757+0000 7f3b0323f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.757+0000 7f3b0323f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5580782261c0 con 0x5580782db650 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.758+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.758+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59114/0 (socket says 172.21.15.50:59114) 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.758+0000 7f3b00d3e640 1 -- 172.21.15.50:0/1878710738 learned_addr learned my addr 172.21.15.50:0/1878710738 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.758+0000 7f3b00d3e640 1 -- 172.21.15.50:0/1878710738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580783cef50 con 0x5580782db650 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.758+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/1878710738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783ce980 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3af4055040 tx=0x7f3af404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cff108ec75abca server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.758+0000 7f39eee05640 1 -- 172.21.15.50:0/1878710738 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af4057040 con 0x5580782db650 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.758+0000 7f39eee05640 1 -- 172.21.15.50:0/1878710738 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4052990 con 0x5580782db650 2024-05-07T13:57:57.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.758+0000 7f39eee05640 1 -- 172.21.15.50:0/1878710738 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af4052c70 con 0x5580782db650 2024-05-07T13:57:57.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.759+0000 7f3b0323f800 1 -- 172.21.15.50:0/1878710738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 msgr2=0x5580783ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.759+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1878710738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783ce980 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3af4055040 tx=0x7f3af404c000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.759+0000 7f3b0323f800 1 -- 172.21.15.50:0/1878710738 shutdown_connections 2024-05-07T13:57:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.759+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1878710738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783ce980 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.759+0000 7f3b0323f800 1 -- 172.21.15.50:0/1878710738 >> 172.21.15.50:0/1878710738 conn(0x5580782d4d40 msgr2=0x5580783ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.759+0000 7f3b0323f800 1 -- 172.21.15.50:0/1878710738 shutdown_connections 2024-05-07T13:57:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.759+0000 7f3b0323f800 1 -- 172.21.15.50:0/1878710738 wait complete. 2024-05-07T13:57:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.759+0000 7f3b0323f800 1 Processor -- start 2024-05-07T13:57:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.760+0000 7f3b0323f800 1 -- start start 2024-05-07T13:57:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.760+0000 7f3b0323f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783d6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.760+0000 7f3b0323f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5580782e4590 con 0x5580782db650 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.760+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783d6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.760+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783d6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59128/0 (socket says 172.21.15.50:59128) 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.760+0000 7f3b00d3e640 1 -- 172.21.15.50:0/1974147679 learned_addr learned my addr 172.21.15.50:0/1974147679 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.760+0000 7f3b00d3e640 1 -- 172.21.15.50:0/1974147679 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580783d6940 con 0x5580782db650 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.761+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783d6400 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3af400a470 tx=0x7f3af4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.761+0000 7f39ed602640 1 -- 172.21.15.50:0/1974147679 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af4073070 con 0x5580782db650 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.761+0000 7f39ed602640 1 -- 172.21.15.50:0/1974147679 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af405d650 con 0x5580782db650 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.761+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580783d6bd0 con 0x5580782db650 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.761+0000 7f39ed602640 1 -- 172.21.15.50:0/1974147679 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af4057070 con 0x5580782db650 2024-05-07T13:57:57.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.761+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580783d9880 con 0x5580782db650 2024-05-07T13:57:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.762+0000 7f39ed602640 1 -- 172.21.15.50:0/1974147679 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3af4076070 con 0x5580782db650 2024-05-07T13:57:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.762+0000 7f39ed602640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39e8036900 0x7f39e8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.762+0000 7f39ed602640 1 -- 172.21.15.50:0/1974147679 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3af408e0b0 con 0x5580782db650 2024-05-07T13:57:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.762+0000 7f3afbfff640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39e8036900 0x7f39e8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.762+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580782dbfb0 0x5580783dd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.762+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580783ddbc0 con 0x5580782dbfb0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.763+0000 7f3b0153f640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580782dbfb0 0x5580783dd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.763+0000 7f3afbfff640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39e8036900 0x7f39e8038dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3aec000f60 tx=0x7f3aec0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.763+0000 7f3b0153f640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580782dbfb0 0x5580783dd640 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.763+0000 7f3b0153f640 1 -- 172.21.15.50:0/1974147679 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x5580782dbfb0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.763+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580783dac10 con 0x5580782dbfb0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.763+0000 7f3b0153f640 1 -- 172.21.15.50:0/1974147679 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3afc00a4a0 con 0x5580782dbfb0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.763+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580783dff10 0x5580783e2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.763+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580783e29d0 con 0x5580783dff10 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.764+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580783dff10 0x5580783e2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.764+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580783dff10 0x5580783e2300 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.764+0000 7f3b00d3e640 1 -- 172.21.15.50:0/1974147679 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3af4075030 con 0x5580783dff10 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.764+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580783deec0 con 0x5580782dbfb0 2024-05-07T13:57:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.764+0000 7f3b0153f640 1 -- 172.21.15.50:0/1974147679 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3afc00a4a0 con 0x5580782dbfb0 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.764+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580783e3e10 0x5580783e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.764+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580783e6a60 con 0x5580783e3e10 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.765+0000 7f3afbfff640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580783e3e10 0x5580783e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.765+0000 7f3afbfff640 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580783e3e10 0x5580783e62d0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.765+0000 7f3afbfff640 1 -- 172.21.15.50:0/1974147679 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3aec009050 con 0x5580783e3e10 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.766+0000 7f3b0323f800 1 Processor -- start 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.766+0000 7f3b0323f800 1 -- start start 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.766+0000 7f3b0323f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580783f4f10 0x5580783f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.766+0000 7f3b0323f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5580781cccf0 con 0x5580783f4f10 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.766+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580783f4f10 0x5580783f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.766+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580783f4f10 0x5580783f5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59132/0 (socket says 172.21.15.50:59132) 2024-05-07T13:57:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.766+0000 7f3b00d3e640 1 -- 172.21.15.50:0/1558503002 learned_addr learned my addr 172.21.15.50:0/1558503002 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.766+0000 7f3b00d3e640 1 -- 172.21.15.50:0/1558503002 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580783f5870 con 0x5580783f4f10 2024-05-07T13:57:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.767+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/1558503002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580783f4f10 0x5580783f5330 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3af408c420 tx=0x7f3af405cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.767+0000 7f39e67fc640 1 -- 172.21.15.50:0/1558503002 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af405ea70 con 0x5580783f4f10 2024-05-07T13:57:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.767+0000 7f39e67fc640 1 -- 172.21.15.50:0/1558503002 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af405ec10 con 0x5580783f4f10 2024-05-07T13:57:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.767+0000 7f3b0323f800 1 -- 172.21.15.50:0/1558503002 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580783f62e0 con 0x5580783f4f10 2024-05-07T13:57:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.767+0000 7f39e67fc640 1 -- 172.21.15.50:0/1558503002 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af40773b0 con 0x5580783f4f10 2024-05-07T13:57:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.767+0000 7f3b0323f800 1 -- 172.21.15.50:0/1558503002 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580783f67e0 con 0x5580783f4f10 2024-05-07T13:57:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.767+0000 7f39e67fc640 1 -- 172.21.15.50:0/1558503002 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3af4077550 con 0x5580783f4f10 2024-05-07T13:57:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.768+0000 7f39e67fc640 1 --2- 172.21.15.50:0/1558503002 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39d8036950 0x7f39d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.768+0000 7f39e67fc640 1 -- 172.21.15.50:0/1558503002 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3af4088030 con 0x5580783f4f10 2024-05-07T13:57:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.768+0000 7f3afbfff640 1 --2- 172.21.15.50:0/1558503002 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39d8036950 0x7f39d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.768+0000 7f3b0323f800 1 Processor -- start 2024-05-07T13:57:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.768+0000 7f3b0323f800 1 -- start start 2024-05-07T13:57:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.768+0000 7f3afbfff640 1 --2- 172.21.15.50:0/1558503002 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39d8036950 0x7f39d8038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00bf50 tx=0x7f3aec00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.768+0000 7f3b0323f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078402540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.768+0000 7f3b0323f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5580783cf210 con 0x558078402120 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.769+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078402540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.769+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078402540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59144/0 (socket says 172.21.15.50:59144) 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.769+0000 7f3b00d3e640 1 -- 172.21.15.50:0/29362188 learned_addr learned my addr 172.21.15.50:0/29362188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.769+0000 7f3b00d3e640 1 -- 172.21.15.50:0/29362188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558078402b10 con 0x558078402120 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.769+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/29362188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078402540 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3af4098fd0 tx=0x7f3af406e6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb77701aef262d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.769+0000 7f39d7fff640 1 -- 172.21.15.50:0/29362188 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af4068e10 con 0x558078402120 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.769+0000 7f39d7fff640 1 -- 172.21.15.50:0/29362188 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af405e6a0 con 0x558078402120 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.769+0000 7f39d7fff640 1 -- 172.21.15.50:0/29362188 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af4080c00 con 0x558078402120 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 -- 172.21.15.50:0/29362188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 msgr2=0x558078402540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 --2- 172.21.15.50:0/29362188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078402540 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3af4098fd0 tx=0x7f3af406e6f0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 -- 172.21.15.50:0/29362188 shutdown_connections 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 --2- 172.21.15.50:0/29362188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078402540 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 -- 172.21.15.50:0/29362188 >> 172.21.15.50:0/29362188 conn(0x5580783fe3f0 msgr2=0x5580783fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 -- 172.21.15.50:0/29362188 shutdown_connections 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 -- 172.21.15.50:0/29362188 wait complete. 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 Processor -- start 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 -- start start 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078409400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b0323f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558078403170 con 0x558078402120 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078409400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b00d3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078409400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59158/0 (socket says 172.21.15.50:59158) 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.770+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 learned_addr learned my addr 172.21.15.50:0/3701495675 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.771+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558078409940 con 0x558078402120 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.771+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078409400 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3af406e730 tx=0x7f3af407bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.771+0000 7f39d67fc640 1 -- 172.21.15.50:0/3701495675 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af405e030 con 0x558078402120 2024-05-07T13:57:57.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.771+0000 7f39d67fc640 1 -- 172.21.15.50:0/3701495675 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af40b2070 con 0x558078402120 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.771+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558078409940 con 0x558078402120 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.771+0000 7f39d67fc640 1 -- 172.21.15.50:0/3701495675 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af405e300 con 0x558078402120 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.771+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558078409940 con 0x558078402120 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.772+0000 7f39d67fc640 1 -- 172.21.15.50:0/3701495675 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3af40a9040 con 0x558078402120 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.772+0000 7f39d67fc640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39cc036900 0x7f39cc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.772+0000 7f39d67fc640 1 -- 172.21.15.50:0/3701495675 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3af40a7020 con 0x558078402120 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.772+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39cc036900 0x7f39cc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.773+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39cc036900 0x7f39cc038dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3aec001b60 tx=0x7f3aec010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.773+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.773+0000 7f3b0323f800 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558078414c00 0x5580784170c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.773+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558078417810 con 0x558078414c00 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.773+0000 7f3b0153f640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558078414c00 0x5580784170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.773+0000 7f3b0153f640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558078414c00 0x5580784170c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 20 realm 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558078417c20 con 0x558078414c00 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580784184f0 con 0x558078414c00 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580784195f0 0x55807841b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55807841bfa0 con 0x5580784195f0 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.774+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580784195f0 0x55807841b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.775+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580784195f0 0x55807841b9e0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.775+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.775+0000 7f3b0323f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.775+0000 7f3b0323f800 20 searching for the correct realm 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.775+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55807841d8b0 con 0x5580784195f0 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.775+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.776+0000 7f3b00d3e640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3af4078060 0x7f3af40892d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.776+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55807841d8b0 con 0x7f3af4078060 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.776+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3af4078060 0x7f3af40892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.776+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3af4078060 0x7f3af40892d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.776+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.776+0000 7f3afbfff640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3aec037040 0x7f3aec036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.776+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55807841d8b0 con 0x7f3aec037040 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.776+0000 7f3b0153f640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3aec037040 0x7f3aec036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.777+0000 7f3b0153f640 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3aec037040 0x7f3aec036410 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.777+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.777+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.777+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.777+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.778+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.778+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.778+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.778+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3aec037040 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.778+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.778+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3af4078060 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.778+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.778+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3af4078060 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.779+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.779+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.779+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.779+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3aec037040 2024-05-07T13:57:57.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.779+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.779+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.780+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.780+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3af4078060 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.780+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.780+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x5580784195f0 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.780+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.780+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x5580784195f0 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.781+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.781+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3aec037040 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.781+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.781+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x5580784195f0 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.781+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.781+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x5580784195f0 2024-05-07T13:57:57.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.781+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.781+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.782+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.782+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.782+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.782+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3aec037040 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.783+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.783+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x5580784195f0 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.783+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.783+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3af4078060 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.783+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.783+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.783+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.783+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3aec037040 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.784+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.784+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x5580784195f0 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.784+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.784+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3aec037040 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.785+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.785+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3af4078060 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.785+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.785+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x5580784195f0 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.785+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.785+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3af4078060 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.785+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.785+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x558078414c00 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558078418890 con 0x7f3af4078060 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55807841c860 con 0x558078414c00 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55807841cc50 con 0x558078414c00 2024-05-07T13:57:57.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.786+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55807841cc50 con 0x7f3aec037040 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 20 zone default found 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 4 Realm: () 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 20 zonegroup default 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55807841c4c0 con 0x7f3aec037040 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55807841c4c0 con 0x5580784195f0 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.787+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.788+0000 7f3b0323f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.788+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.788+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55807841f820 con 0x5580784195f0 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.788+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.788+0000 7f3b0323f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.788+0000 7f3b0323f800 20 started sync module instance, tier type = 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.788+0000 7f3b0323f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.788+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55807841ebb0 con 0x7f3af4078060 2024-05-07T13:57:57.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.789+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.789+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94010261761952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55807841e810 con 0x7f3af4078060 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.789+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078420750 con 0x558078414c00 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.790+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94010261761952] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.790+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.791+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94010261766816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078420b70 con 0x558078414c00 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.791+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078421530 con 0x5580784195f0 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.791+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94010261766816] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.792+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.792+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94010261770368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580784218d0 con 0x5580784195f0 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.792+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078422350 con 0x7f3af4078060 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.793+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94010261770368] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.793+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.793+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94010261767872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078422c20 con 0x7f3af4078060 2024-05-07T13:57:57.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.793+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580784235e0 con 0x558078414c00 2024-05-07T13:57:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.794+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.794+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94010261779248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078423e80 con 0x558078414c00 2024-05-07T13:57:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.794+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078424970 con 0x7f3aec037040 2024-05-07T13:57:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.794+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94010261767872] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.795+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94010261779248] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.795+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.795+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94010261783616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078423980 con 0x7f3aec037040 2024-05-07T13:57:57.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.795+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078425210 con 0x7f3aec037040 2024-05-07T13:57:57.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.796+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94010261783616] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.796+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.796+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94010261776240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078423980 con 0x7f3aec037040 2024-05-07T13:57:57.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.796+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580784257a0 con 0x7f3aec037040 2024-05-07T13:57:57.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94010261776240] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94010261785808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580784257a0 con 0x7f3aec037040 2024-05-07T13:57:57.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 20 add_watcher() i=0 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 20 add_watcher() i=1 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 20 add_watcher() i=2 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 20 add_watcher() i=3 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 20 add_watcher() i=4 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 20 add_watcher() i=5 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 20 add_watcher() i=6 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94010261785808] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 20 add_watcher() i=7 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.798+0000 7f3b0323f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.799+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558078428c00 con 0x558078414c00 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.799+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.799+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94010261787840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078426150 con 0x558078414c00 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.800+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94010261787840] v29'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.800+0000 7f39b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.800+0000 7f3b0323f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.800+0000 7f3b0323f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.800+0000 7f3b0323f800 5 note: GC not initialized 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.801+0000 7f39b5fe3640 20 reqs_thread_entry: start 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.801+0000 7f3b0323f800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.801+0000 7f3b0323f800 20 Filter name: none 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.801+0000 7f39277fe640 20 reqs_thread_entry: start 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.801+0000 7f3b0323f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.801+0000 7f3b0323f800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.801+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55807845c140 con 0x7f3aec037040 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.802+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.802+0000 7f3b0323f800 20 rados_obj.operate() r=0 bl.length=503 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.802+0000 7f3b0323f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-07T13:57:57.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.802+0000 7f3b0323f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.802+0000 7f3b0323f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.802+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078462850 con 0x7f3aec037040 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f3b0323f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f3b0323f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f3b0323f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94010262037184 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580784613a0 con 0x558078414c00 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 94010261779248 notify 124554051611 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f3afc03d040 con 0x558078414c00 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f39d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051611 cookie 94010261779248 notifier 4887 bl.length()=636 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f39d7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f39d7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 notify.4 [notify cookie 94010262037184 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.803+0000 7f39d7fff640 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f39c4003ea0 con 0x558078414c00 2024-05-07T13:57:57.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.804+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.804+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94010262037184 notify 124554051611 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3afc02f040 con 0x558078414c00 2024-05-07T13:57:57.798 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:57.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.805+0000 7f39b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.805+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94010261787840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078461300 con 0x558078414c00 2024-05-07T13:57:57.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.806+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94010261787840] v29'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.806+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94010261761952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078425490 con 0x7f3af4078060 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.807+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94010261761952] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.807+0000 7f3b0323f800 20 remove_watcher() i=0 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.807+0000 7f3b0323f800 2 removed watcher, disabling cache 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.807+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94010261766816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55807841efa0 con 0x558078414c00 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.808+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94010261766816] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.808+0000 7f3b0323f800 20 remove_watcher() i=1 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.808+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94010261770368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55807841efa0 con 0x5580784195f0 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.809+0000 7f3b00d3e640 1 -- 172.21.15.50:0/3701495675 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94010261770368] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af4095020 con 0x5580784195f0 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.809+0000 7f3b0323f800 20 remove_watcher() i=2 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.809+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94010261767872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078421080 con 0x7f3af4078060 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.811+0000 7f3afbfff640 1 -- 172.21.15.50:0/3701495675 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94010261767872] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec009050 con 0x7f3af4078060 2024-05-07T13:57:57.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.811+0000 7f3b0323f800 20 remove_watcher() i=3 2024-05-07T13:57:57.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.811+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94010261779248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078421080 con 0x558078414c00 2024-05-07T13:57:57.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.812+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94010261779248] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x558078414c00 2024-05-07T13:57:57.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.812+0000 7f3b0323f800 20 remove_watcher() i=4 2024-05-07T13:57:57.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.812+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94010261783616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078423330 con 0x7f3aec037040 2024-05-07T13:57:57.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.813+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94010261783616] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.813+0000 7f3b0323f800 20 remove_watcher() i=5 2024-05-07T13:57:57.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.813+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94010261776240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078421080 con 0x7f3aec037040 2024-05-07T13:57:57.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.814+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94010261776240] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.814+0000 7f3b0323f800 20 remove_watcher() i=6 2024-05-07T13:57:57.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.814+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94010261785808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558078424440 con 0x7f3aec037040 2024-05-07T13:57:57.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94010261785808] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3afc00a4a0 con 0x7f3aec037040 2024-05-07T13:57:57.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0323f800 20 remove_watcher() i=7 2024-05-07T13:57:57.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3aec037040 msgr2=0x7f3aec036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0323f800 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f3aec037040 0x7f3aec036410 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558078414c00 msgr2=0x5580784170c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0323f800 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x558078414c00 0x5580784170c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3af4078060 msgr2=0x7f3af40892d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0323f800 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f3af4078060 0x7f3af40892d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580784195f0 msgr2=0x55807841b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.815+0000 7f3b0323f800 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580784195f0 0x55807841b9e0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39cc036900 msgr2=0x7f39cc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39cc036900 0x7f39cc038dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3aec001b60 tx=0x7f3aec010000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 msgr2=0x558078409400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0153f640 1 -- 172.21.15.50:0/3701495675 reap_dead start 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078409400 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3af406e730 tx=0x7f3af407bf60 comp rx=0 tx=0).stop 2024-05-07T13:57:57.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 shutdown_connections 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/3701495675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558078402120 0x558078409400 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 >> 172.21.15.50:0/3701495675 conn(0x5580783fe3f0 msgr2=0x5580783fba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 shutdown_connections 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/3701495675 wait complete. 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/1558503002 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39d8036950 msgr2=0x7f39d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1558503002 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39d8036950 0x7f39d8038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00bf50 tx=0x7f3aec00f000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/1558503002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580783f4f10 msgr2=0x5580783f5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1558503002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580783f4f10 0x5580783f5330 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3af408c420 tx=0x7f3af405cc00 comp rx=0 tx=0).stop 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/1558503002 shutdown_connections 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1558503002 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39d8036950 0x7f39d8038e10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1558503002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580783f4f10 0x5580783f5330 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/1558503002 >> 172.21.15.50:0/1558503002 conn(0x5580783e8fb0 msgr2=0x5580783e93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/1558503002 shutdown_connections 2024-05-07T13:57:57.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/1558503002 wait complete. 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580783e3e10 msgr2=0x5580783e62d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x5580783e3e10 0x5580783e62d0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580782dbfb0 msgr2=0x5580783dd640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x5580782dbfb0 0x5580783dd640 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580783dff10 msgr2=0x5580783e2300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.816+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x5580783dff10 0x5580783e2300 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.817+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39e8036900 msgr2=0x7f39e8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.817+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f39e8036900 0x7f39e8038dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3aec000f60 tx=0x7f3aec0012b0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.817+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 msgr2=0x5580783d6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.817+0000 7f3b0323f800 1 --2- 172.21.15.50:0/1974147679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5580782db650 0x5580783d6400 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3af400a470 tx=0x7f3af4003020 comp rx=0 tx=0).stop 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.817+0000 7f3b0153f640 1 -- 172.21.15.50:0/1974147679 reap_dead start 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.817+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 shutdown_connections 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.817+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 >> 172.21.15.50:0/1974147679 conn(0x5580782d4d40 msgr2=0x5580783c8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.817+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 shutdown_connections 2024-05-07T13:57:57.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.817+0000 7f3b0323f800 1 -- 172.21.15.50:0/1974147679 wait complete. 2024-05-07T13:57:57.813 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.814 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.814 ERROR:root:0 2024-05-07T13:57:57.814 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-07T13:57:57.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-07T13:57:57.814 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-05-07T13:57:57.862 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:57.862 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:57.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.875+0000 7f2e2e7a2800 1 Processor -- start 2024-05-07T13:57:57.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.875+0000 7f2e2e7a2800 1 -- start start 2024-05-07T13:57:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.876+0000 7f2e2e7a2800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x563f3a87f3d0 0x563f3a87f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.876+0000 7f2e2e7a2800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563f3a87fe20 con 0x563f3a8823c0 2024-05-07T13:57:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.876+0000 7f2e2e7a2800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x563f3a712050 con 0x563f3a87f3d0 2024-05-07T13:57:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.876+0000 7f2e2c2a8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x563f3a87f3d0 0x563f3a87f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.876+0000 7f2e2c2a8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x563f3a87f3d0 0x563f3a87f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59162/0 (socket says 172.21.15.50:59162) 2024-05-07T13:57:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.876+0000 7f2e2baa7640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x563f3a8823c0 0x563f3a882870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56902/0 (socket says 172.21.15.50:56902) 2024-05-07T13:57:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.876+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3949252486 learned_addr learned my addr 172.21.15.50:0/3949252486 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.876+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3949252486 >> v1:172.21.15.22:6789/0 conn(0x563f3a8823c0 legacy=0x563f3a882870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.876+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3949252486 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f3a882f80 con 0x563f3a87f3d0 2024-05-07T13:57:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.878+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/3949252486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a87f7f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00a520 tx=0x7f2e1c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14e6945808c555d server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.878+0000 7f2e2b2a6640 1 -- 172.21.15.50:0/3949252486 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c057070 con 0x563f3a87f3d0 2024-05-07T13:57:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.879+0000 7f2e2b2a6640 1 -- 172.21.15.50:0/3949252486 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c052570 con 0x563f3a87f3d0 2024-05-07T13:57:57.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.879+0000 7f2e2b2a6640 1 -- 172.21.15.50:0/3949252486 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c052870 con 0x563f3a87f3d0 2024-05-07T13:57:57.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.879+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3949252486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 msgr2=0x563f3a87f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.879+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3949252486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a87f7f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00a520 tx=0x7f2e1c01d010 comp rx=0 tx=0).stop 2024-05-07T13:57:57.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.879+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3949252486 shutdown_connections 2024-05-07T13:57:57.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.879+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3949252486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a87f7f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.879+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3949252486 >> 172.21.15.50:0/3949252486 conn(0x563f3a87ad40 msgr2=0x563f3a87d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.879+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3949252486 shutdown_connections 2024-05-07T13:57:57.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.879+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3949252486 wait complete. 2024-05-07T13:57:57.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.894+0000 7f2e2e7a2800 1 Processor -- start 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.894+0000 7f2e2e7a2800 1 -- start start 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.894+0000 7f2e2e7a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a972860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.894+0000 7f2e2e7a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563f3a7cc1c0 con 0x563f3a87f3d0 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.895+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a972860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.895+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a972860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59178/0 (socket says 172.21.15.50:59178) 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.895+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3965865404 learned_addr learned my addr 172.21.15.50:0/3965865404 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.895+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3965865404 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f3a972e30 con 0x563f3a87f3d0 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.895+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/3965865404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a972860 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c055040 tx=0x7f2e1c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fe344e9240a5eb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.895+0000 7f2d1a60c640 1 -- 172.21.15.50:0/3965865404 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c057040 con 0x563f3a87f3d0 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.895+0000 7f2d1a60c640 1 -- 172.21.15.50:0/3965865404 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c052850 con 0x563f3a87f3d0 2024-05-07T13:57:57.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.895+0000 7f2d1a60c640 1 -- 172.21.15.50:0/3965865404 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c052b50 con 0x563f3a87f3d0 2024-05-07T13:57:57.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.896+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3965865404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 msgr2=0x563f3a972860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.896+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3965865404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a972860 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c055040 tx=0x7f2e1c04c000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.896+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3965865404 shutdown_connections 2024-05-07T13:57:57.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.896+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3965865404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a972860 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.896+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3965865404 >> 172.21.15.50:0/3965865404 conn(0x563f3a87ad40 msgr2=0x563f3a96e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.896+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3965865404 shutdown_connections 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.896+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3965865404 wait complete. 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.896+0000 7f2e2e7a2800 1 Processor -- start 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.896+0000 7f2e2e7a2800 1 -- start start 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.897+0000 7f2e2e7a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a97a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.897+0000 7f2e2e7a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563f3a88a890 con 0x563f3a87f3d0 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.897+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a97a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.897+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a97a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59182/0 (socket says 172.21.15.50:59182) 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.897+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/2752795856 learned_addr learned my addr 172.21.15.50:0/2752795856 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.897+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/2752795856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f3a97a910 con 0x563f3a87f3d0 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.897+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a97a3d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00a520 tx=0x7f2e1c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.898+0000 7f2d18e09640 1 -- 172.21.15.50:0/2752795856 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c073070 con 0x563f3a87f3d0 2024-05-07T13:57:57.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.898+0000 7f2d18e09640 1 -- 172.21.15.50:0/2752795856 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c05d570 con 0x563f3a87f3d0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.898+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f3a97aba0 con 0x563f3a87f3d0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.898+0000 7f2d18e09640 1 -- 172.21.15.50:0/2752795856 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c057070 con 0x563f3a87f3d0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.898+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f3a97d850 con 0x563f3a87f3d0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.898+0000 7f2d18e09640 1 -- 172.21.15.50:0/2752795856 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2e1c076070 con 0x563f3a87f3d0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.899+0000 7f2d18e09640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d14036900 0x7f2d14038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.899+0000 7f2d18e09640 1 -- 172.21.15.50:0/2752795856 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2e1c08deb0 con 0x563f3a87f3d0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.899+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d14036900 0x7f2d14038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.899+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a8823c0 0x563f3a981610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.899+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a981b50 con 0x563f3a8823c0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.899+0000 7f2e2caa9640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a8823c0 0x563f3a981610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.899+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d14036900 0x7f2d14038dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2e20000f60 tx=0x7f2e20001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.899+0000 7f2e2caa9640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a8823c0 0x563f3a981610 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.900+0000 7f2e2caa9640 1 -- 172.21.15.50:0/2752795856 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a8823c0 2024-05-07T13:57:57.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.900+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a97ebe0 con 0x563f3a8823c0 2024-05-07T13:57:57.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.900+0000 7f2e2caa9640 1 -- 172.21.15.50:0/2752795856 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a8823c0 2024-05-07T13:57:57.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.900+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a983ea0 0x563f3a986290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.900+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a986980 con 0x563f3a983ea0 2024-05-07T13:57:57.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.900+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a983ea0 0x563f3a986290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.900+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a983ea0 0x563f3a986290 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.901+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/2752795856 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e1c075030 con 0x563f3a983ea0 2024-05-07T13:57:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.901+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a982e50 con 0x563f3a8823c0 2024-05-07T13:57:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.901+0000 7f2e2caa9640 1 -- 172.21.15.50:0/2752795856 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a8823c0 2024-05-07T13:57:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.901+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563f3a987e30 0x563f3a98a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.901+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a98a9e0 con 0x563f3a987e30 2024-05-07T13:57:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.901+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563f3a987e30 0x563f3a98a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.902+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563f3a987e30 0x563f3a98a280 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.902+0000 7f2e2baa7640 1 -- 172.21.15.50:0/2752795856 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e2000f690 con 0x563f3a987e30 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.902+0000 7f2e2e7a2800 1 Processor -- start 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.902+0000 7f2e2e7a2800 1 -- start start 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2e2e7a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a998d60 0x563f3a999180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2e2e7a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563f3a772cf0 con 0x563f3a998d60 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a998d60 0x563f3a999180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a998d60 0x563f3a999180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59190/0 (socket says 172.21.15.50:59190) 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3099283464 learned_addr learned my addr 172.21.15.50:0/3099283464 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3099283464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f3a9996c0 con 0x563f3a998d60 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/3099283464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a998d60 0x563f3a999180 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0774c0 tx=0x7f2e1c076650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2d11ffb640 1 -- 172.21.15.50:0/3099283464 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c076820 con 0x563f3a998d60 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2d11ffb640 1 -- 172.21.15.50:0/3099283464 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c0769c0 con 0x563f3a998d60 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2d11ffb640 1 -- 172.21.15.50:0/3099283464 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c007f60 con 0x563f3a998d60 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3099283464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f3a99a130 con 0x563f3a998d60 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.903+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3099283464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f3a99a630 con 0x563f3a998d60 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.904+0000 7f2d11ffb640 1 -- 172.21.15.50:0/3099283464 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2e1c077a90 con 0x563f3a998d60 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.904+0000 7f2d11ffb640 1 --2- 172.21.15.50:0/3099283464 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d04036950 0x7f2d04038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.904+0000 7f2d11ffb640 1 -- 172.21.15.50:0/3099283464 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2e1c083040 con 0x563f3a998d60 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.904+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/3099283464 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d04036950 0x7f2d04038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.905+0000 7f2e2e7a2800 1 Processor -- start 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.905+0000 7f2e2e7a2800 1 -- start start 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.905+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/3099283464 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d04036950 0x7f2d04038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x563f3a982450 tx=0x7f2e2000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.905+0000 7f2e2e7a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a881e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.905+0000 7f2e2e7a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563f3a9730f0 con 0x563f3a881a30 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.905+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a881e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.905+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a881e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59194/0 (socket says 172.21.15.50:59194) 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.905+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/2884344473 learned_addr learned my addr 172.21.15.50:0/2884344473 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/2884344473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f3a880240 con 0x563f3a881a30 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/2884344473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a881e50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c05de90 tx=0x7f2e1c04ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ff933c7c3ae64a server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2d037fe640 1 -- 172.21.15.50:0/2884344473 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c0aa020 con 0x563f3a881a30 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2d037fe640 1 -- 172.21.15.50:0/2884344473 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c077d80 con 0x563f3a881a30 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2d037fe640 1 -- 172.21.15.50:0/2884344473 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c0a1040 con 0x563f3a881a30 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2884344473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 msgr2=0x563f3a881e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2884344473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a881e50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c05de90 tx=0x7f2e1c04ce40 comp rx=0 tx=0).stop 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2884344473 shutdown_connections 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2884344473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a881e50 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2884344473 >> 172.21.15.50:0/2884344473 conn(0x563f3a9a21c0 msgr2=0x563f3a9a0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2884344473 shutdown_connections 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.906+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2884344473 wait complete. 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.907+0000 7f2e2e7a2800 1 Processor -- start 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.907+0000 7f2e2e7a2800 1 -- start start 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.907+0000 7f2e2e7a2800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a9af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.907+0000 7f2e2e7a2800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563f3a880650 con 0x563f3a881a30 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.907+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a9af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.907+0000 7f2e2c2a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a9af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59204/0 (socket says 172.21.15.50:59204) 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.907+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 learned_addr learned my addr 172.21.15.50:0/3287732555 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.907+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f3a9afa60 con 0x563f3a881a30 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.908+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a9af520 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c076c10 tx=0x7f2e1c0680b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.908+0000 7f2d01ffb640 1 -- 172.21.15.50:0/3287732555 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c079420 con 0x563f3a881a30 2024-05-07T13:57:57.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.908+0000 7f2d01ffb640 1 -- 172.21.15.50:0/3287732555 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c06f410 con 0x563f3a881a30 2024-05-07T13:57:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.908+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f3a9afa60 con 0x563f3a881a30 2024-05-07T13:57:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.908+0000 7f2d01ffb640 1 -- 172.21.15.50:0/3287732555 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c06f850 con 0x563f3a881a30 2024-05-07T13:57:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.908+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f3a9afa60 con 0x563f3a881a30 2024-05-07T13:57:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.909+0000 7f2d01ffb640 1 -- 172.21.15.50:0/3287732555 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2e1c0ad020 con 0x563f3a881a30 2024-05-07T13:57:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.909+0000 7f2d01ffb640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2cf4036900 0x7f2cf4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.909+0000 7f2d01ffb640 1 -- 172.21.15.50:0/3287732555 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2e1c083420 con 0x563f3a881a30 2024-05-07T13:57:57.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.909+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2cf4036900 0x7f2cf4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.909+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2cf4036900 0x7f2cf4038dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x563f3a98ade0 tx=0x7f2e20010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a9baa00 0x563f3a9bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9bd610 con 0x563f3a9baa00 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2caa9640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a9baa00 0x563f3a9bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2caa9640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a9baa00 0x563f3a9bcec0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 20 realm 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9bda20 con 0x563f3a9baa00 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:57.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.910+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be2f0 con 0x563f3a9baa00 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2e7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2e7a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a9bf3f0 0x563f3a9c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c1df0 con 0x563f3a9bf3f0 2024-05-07T13:57:57.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a9bf3f0 0x563f3a9c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.911+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a9bf3f0 0x563f3a9c17e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.912+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.912+0000 7f2e2e7a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.912+0000 7f2e2e7a2800 20 searching for the correct realm 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.912+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c3720 con 0x563f3a9bf3f0 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.912+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.912+0000 7f2e2c2a8640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2e1c0af050 0x7f2e1c05e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.912+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c3720 con 0x7f2e1c0af050 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.912+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2e1c0af050 0x7f2e1c05e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.913+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2e1c0af050 0x7f2e1c05e8c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.913+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e20037040 con 0x7f2e1c0af050 2024-05-07T13:57:57.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.913+0000 7f2e2baa7640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2e2000f070 0x7f2e2002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.913+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c3720 con 0x7f2e2000f070 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.913+0000 7f2e2caa9640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2e2000f070 0x7f2e2002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.914+0000 7f2e2caa9640 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2e2000f070 0x7f2e2002e910 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.914+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.914+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.914+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.914+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.914+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.915+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.915+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.915+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e2000f070 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.915+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.915+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e1c0af050 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.915+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e20037040 con 0x7f2e1c0af050 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.915+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e1c0af050 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.916+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e20037040 con 0x7f2e1c0af050 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.916+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.916+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.916+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e2000f070 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.916+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.916+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.916+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.916+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e1c0af050 2024-05-07T13:57:57.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.917+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e20037040 con 0x7f2e1c0af050 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.917+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9bf3f0 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.917+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.917+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9bf3f0 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.917+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.917+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e2000f070 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.917+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.917+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9bf3f0 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.918+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.918+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9bf3f0 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.918+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.918+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.918+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.918+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.918+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.918+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e2000f070 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.919+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.919+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9bf3f0 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.919+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.919+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e1c0af050 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.919+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e20037040 con 0x7f2e1c0af050 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.919+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.919+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.919+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e2000f070 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.920+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.920+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9bf3f0 2024-05-07T13:57:57.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.920+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.920+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e2000f070 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.920+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.920+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e1c0af050 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.921+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e20037040 con 0x7f2e1c0af050 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.921+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9bf3f0 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.921+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.921+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e1c0af050 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.921+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e20037040 con 0x7f2e1c0af050 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.921+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x563f3a9baa00 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.921+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.921+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9be690 con 0x7f2e1c0af050 2024-05-07T13:57:57.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e20037040 con 0x7f2e1c0af050 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c26b0 con 0x563f3a9baa00 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c2aa0 con 0x563f3a9baa00 2024-05-07T13:57:57.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.922+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c2aa0 con 0x7f2e2000f070 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 20 zone default found 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 4 Realm: () 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 20 zonegroup default 2024-05-07T13:57:57.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c3ba0 con 0x7f2e2000f070 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.923+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c5580 con 0x563f3a9bf3f0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.924+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.924+0000 7f2e2e7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.924+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.924+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c5920 con 0x563f3a9bf3f0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.924+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.924+0000 7f2e2e7a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:57.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.924+0000 7f2e2e7a2800 20 started sync module instance, tier type = 2024-05-07T13:57:57.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.924+0000 7f2e2e7a2800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:57.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.924+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c4a20 con 0x7f2e1c0af050 2024-05-07T13:57:57.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.925+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2004a040 con 0x7f2e1c0af050 2024-05-07T13:57:57.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.925+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94829566248304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c5cc0 con 0x7f2e1c0af050 2024-05-07T13:57:57.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.925+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c6510 con 0x563f3a9baa00 2024-05-07T13:57:57.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.926+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94829566248304] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2004a040 con 0x7f2e1c0af050 2024-05-07T13:57:57.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.927+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.927+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94829566255200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c6480 con 0x563f3a9baa00 2024-05-07T13:57:57.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.927+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c73d0 con 0x563f3a9bf3f0 2024-05-07T13:57:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.928+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94829566255200] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.928+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.928+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94829566258976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c7770 con 0x563f3a9bf3f0 2024-05-07T13:57:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.928+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c8190 con 0x7f2e1c0af050 2024-05-07T13:57:57.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.929+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2004a040 con 0x7f2e1c0af050 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.929+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94829566264704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c8e50 con 0x7f2e1c0af050 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.929+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c98c0 con 0x563f3a9baa00 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.929+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94829566258976] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.930+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.930+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94829566268304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c9cb0 con 0x563f3a9baa00 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.930+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9ca6f0 con 0x7f2e2000f070 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.930+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94829566264704] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2004a040 con 0x7f2e1c0af050 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.931+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.931+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94829566271936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9ca6b0 con 0x7f2e2000f070 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.931+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9cb120 con 0x7f2e2000f070 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.931+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94829566268304] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.932+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94829566271936] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.932+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.932+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94829566265760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c68b0 con 0x7f2e2000f070 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.932+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9cb5d0 con 0x7f2e2000f070 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94829566265760] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94829566274640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9cb5d0 con 0x7f2e2000f070 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2e7a2800 20 add_watcher() i=0 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2e7a2800 20 add_watcher() i=1 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2e7a2800 20 add_watcher() i=2 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2e7a2800 20 add_watcher() i=3 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2e7a2800 20 add_watcher() i=4 2024-05-07T13:57:57.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2e7a2800 20 add_watcher() i=5 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.933+0000 7f2e2e7a2800 20 add_watcher() i=6 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.934+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94829566274640] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.934+0000 7f2e2e7a2800 20 add_watcher() i=7 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.934+0000 7f2e2e7a2800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.934+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9cea00 con 0x563f3a9baa00 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.935+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.935+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94829566276336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9cbf20 con 0x563f3a9baa00 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.936+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94829566276336] v29'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.936+0000 7f2ce27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.936+0000 7f2e2e7a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.936+0000 7f2e2e7a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:57.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.936+0000 7f2e2e7a2800 5 note: GC not initialized 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.936+0000 7f2ce17e2640 20 reqs_thread_entry: start 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.936+0000 7f2e2e7a2800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.936+0000 7f2e2e7a2800 20 Filter name: none 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.936+0000 7f2c52ffd640 20 reqs_thread_entry: start 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.937+0000 7f2e2e7a2800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.937+0000 7f2e2e7a2800 20 rados->read ofs=0 len=0 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.937+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3aa01ed0 con 0x7f2e2000f070 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.937+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.937+0000 7f2e2e7a2800 20 rados_obj.operate() r=0 bl.length=460 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.937+0000 7f2e2e7a2800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.937+0000 7f2e2e7a2800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.937+0000 7f2e2e7a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:57.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.937+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3aa08230 con 0x7f2e2000f070 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.938+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.938+0000 7f2e2e7a2800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.938+0000 7f2e2e7a2800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.938+0000 7f2e2e7a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.938+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94829566524576 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563f3aa03a40 con 0x563f3a9baa00 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.939+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 94829566268304 notify 124554051612 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f2e2403d040 con 0x563f3a9baa00 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.939+0000 7f2d037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051612 cookie 94829566268304 notifier 4894 bl.length()=666 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.939+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 notify.4 [notify cookie 94829566524576 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.939+0000 7f2d037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.939+0000 7f2d037fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.939+0000 7f2d037fe640 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2cf0003ea0 con 0x563f3a9baa00 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.939+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.939+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94829566524576 notify 124554051612 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2e2402f040 con 0x563f3a9baa00 2024-05-07T13:57:57.938 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.940+0000 7f2ce27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.940+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94829566276336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3aa023d0 con 0x563f3a9baa00 2024-05-07T13:57:57.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.941+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94829566276336] v29'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.941+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94829566248304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9cb2c0 con 0x7f2e1c0af050 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.942+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94829566248304] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2004a040 con 0x7f2e1c0af050 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.942+0000 7f2e2e7a2800 20 remove_watcher() i=0 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.942+0000 7f2e2e7a2800 2 removed watcher, disabling cache 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.942+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94829566255200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c4570 con 0x563f3a9baa00 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.943+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94829566255200] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.943+0000 7f2e2e7a2800 20 remove_watcher() i=1 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.943+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94829566258976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c4570 con 0x563f3a9bf3f0 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.944+0000 7f2e2c2a8640 1 -- 172.21.15.50:0/3287732555 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94829566258976] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1c0a4040 con 0x563f3a9bf3f0 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.944+0000 7f2e2e7a2800 20 remove_watcher() i=2 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.944+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94829566264704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c6f20 con 0x7f2e1c0af050 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.945+0000 7f2e2baa7640 1 -- 172.21.15.50:0/3287732555 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94829566264704] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2004a040 con 0x7f2e1c0af050 2024-05-07T13:57:57.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.945+0000 7f2e2e7a2800 20 remove_watcher() i=3 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.945+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94829566268304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c4570 con 0x563f3a9baa00 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.946+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94829566268304] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x563f3a9baa00 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.946+0000 7f2e2e7a2800 20 remove_watcher() i=4 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.946+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94829566271936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c8580 con 0x7f2e2000f070 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.947+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94829566271936] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.947+0000 7f2e2e7a2800 20 remove_watcher() i=5 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.947+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94829566265760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c6f20 con 0x7f2e2000f070 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.948+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94829566265760] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.948+0000 7f2e2e7a2800 20 remove_watcher() i=6 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.948+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94829566274640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563f3a9c4570 con 0x7f2e2000f070 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.949+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94829566274640] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e2400a4a0 con 0x7f2e2000f070 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.949+0000 7f2e2e7a2800 20 remove_watcher() i=7 2024-05-07T13:57:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2e2000f070 msgr2=0x7f2e2002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f2e2000f070 0x7f2e2002e910 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a9baa00 msgr2=0x563f3a9bcec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a9baa00 0x563f3a9bcec0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2e1c0af050 msgr2=0x7f2e1c05e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f2e1c0af050 0x7f2e1c05e8c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a9bf3f0 msgr2=0x563f3a9c17e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a9bf3f0 0x563f3a9c17e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2cf4036900 msgr2=0x7f2cf4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2cf4036900 0x7f2cf4038dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x563f3a98ade0 tx=0x7f2e20010000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 msgr2=0x563f3a9af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3287732555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a881a30 0x563f3a9af520 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c076c10 tx=0x7f2e1c0680b0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 reap_dead start 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2caa9640 1 -- 172.21.15.50:0/3287732555 reap_dead start 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 shutdown_connections 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 >> 172.21.15.50:0/3287732555 conn(0x563f3a9a21c0 msgr2=0x563f3a99f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 shutdown_connections 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3287732555 wait complete. 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3099283464 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d04036950 msgr2=0x7f2d04038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3099283464 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d04036950 0x7f2d04038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x563f3a982450 tx=0x7f2e2000f000 comp rx=0 tx=0).stop 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3099283464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a998d60 msgr2=0x563f3a999180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3099283464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a998d60 0x563f3a999180 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0774c0 tx=0x7f2e1c076650 comp rx=0 tx=0).stop 2024-05-07T13:57:57.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3099283464 shutdown_connections 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3099283464 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d04036950 0x7f2d04038e10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/3099283464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a998d60 0x563f3a999180 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3099283464 >> 172.21.15.50:0/3099283464 conn(0x563f3a98ce70 msgr2=0x563f3a98d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3099283464 shutdown_connections 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.950+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/3099283464 wait complete. 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563f3a987e30 msgr2=0x563f3a98a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x563f3a987e30 0x563f3a98a280 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a8823c0 msgr2=0x563f3a981610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x563f3a8823c0 0x563f3a981610 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a983ea0 msgr2=0x563f3a986290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x563f3a983ea0 0x563f3a986290 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d14036900 msgr2=0x7f2d14038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f2d14036900 0x7f2d14038dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2e20000f60 tx=0x7f2e20001370 comp rx=0 tx=0).stop 2024-05-07T13:57:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 msgr2=0x563f3a97a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 --2- 172.21.15.50:0/2752795856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563f3a87f3d0 0x563f3a97a3d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00a520 tx=0x7f2e1c003020 comp rx=0 tx=0).stop 2024-05-07T13:57:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2caa9640 1 -- 172.21.15.50:0/2752795856 reap_dead start 2024-05-07T13:57:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 shutdown_connections 2024-05-07T13:57:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 >> 172.21.15.50:0/2752795856 conn(0x563f3a87ad40 msgr2=0x563f3a96c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 shutdown_connections 2024-05-07T13:57:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:57.951+0000 7f2e2e7a2800 1 -- 172.21.15.50:0/2752795856 wait complete. 2024-05-07T13:57:57.950 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.950 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:57.951 ERROR:root:0 2024-05-07T13:57:57.951 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:57.955 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000fa4d17ff4d94813c-00663a3365-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:57:57.955 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-07T13:57:57.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-07T13:57:57.956 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-05-07T13:57:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.017+0000 7fd000d23800 1 Processor -- start 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.017+0000 7fd000d23800 1 -- start start 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.017+0000 7fd000d23800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55cbeedffb60 0x55cbeee01f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.017+0000 7fd000d23800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cbeee05fa0 con 0x55cbeee02490 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.017+0000 7fd000d23800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x55cbeec90050 con 0x55cbeedffb60 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.017+0000 7fcffcae4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x55cbeedffb60 0x55cbeee01f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.017+0000 7fcffc2e3640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x55cbeee02490 0x55cbeee04880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56910/0 (socket says 172.21.15.50:56910) 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.017+0000 7fcffc2e3640 1 -- 172.21.15.50:0/1706095610 learned_addr learned my addr 172.21.15.50:0/1706095610 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.018+0000 7fcffcae4640 1 -- 172.21.15.50:0/1706095610 >> v1:172.21.15.22:6789/0 conn(0x55cbeee02490 legacy=0x55cbeee04880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.018+0000 7fcffcae4640 1 -- 172.21.15.50:0/1706095610 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeee07180 con 0x55cbeedffb60 2024-05-07T13:57:58.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.018+0000 7fcffbae2640 1 -- 172.21.15.50:0/1706095610 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650934973 0 0) 0x55cbeee05fa0 con 0x55cbeee02490 2024-05-07T13:57:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.019+0000 7fcffcae4640 1 --2- 172.21.15.50:0/1706095610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeee01f50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00a470 tx=0x7fcfec01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47b4661a0a9f92f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fcffbae2640 1 -- 172.21.15.50:0/1706095610 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec057070 con 0x55cbeedffb60 2024-05-07T13:57:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fcffbae2640 1 -- 172.21.15.50:0/1706095610 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec052570 con 0x55cbeedffb60 2024-05-07T13:57:58.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fcffbae2640 1 -- 172.21.15.50:0/1706095610 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec052870 con 0x55cbeedffb60 2024-05-07T13:57:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fd000d23800 1 -- 172.21.15.50:0/1706095610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 msgr2=0x55cbeee01f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fd000d23800 1 --2- 172.21.15.50:0/1706095610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeee01f50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00a470 tx=0x7fcfec01ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fd000d23800 1 -- 172.21.15.50:0/1706095610 shutdown_connections 2024-05-07T13:57:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fd000d23800 1 --2- 172.21.15.50:0/1706095610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeee01f50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fd000d23800 1 -- 172.21.15.50:0/1706095610 >> 172.21.15.50:0/1706095610 conn(0x55cbeedf9570 msgr2=0x55cbeedfb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fd000d23800 1 -- 172.21.15.50:0/1706095610 shutdown_connections 2024-05-07T13:57:58.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.020+0000 7fd000d23800 1 -- 172.21.15.50:0/1706095610 wait complete. 2024-05-07T13:57:58.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.035+0000 7fd000d23800 1 Processor -- start 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.035+0000 7fd000d23800 1 -- start start 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.035+0000 7fd000d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.035+0000 7fd000d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbeed4a1c0 con 0x55cbeedffb60 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.036+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.036+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59226/0 (socket says 172.21.15.50:59226) 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.036+0000 7fcffcae4640 1 -- 172.21.15.50:0/3293227458 learned_addr learned my addr 172.21.15.50:0/3293227458 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.036+0000 7fcffcae4640 1 -- 172.21.15.50:0/3293227458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeeef0a70 con 0x55cbeedffb60 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.036+0000 7fcffcae4640 1 --2- 172.21.15.50:0/3293227458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef04a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcfec055040 tx=0x7fcfec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41686ea0d8cd6595 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.036+0000 7fceeae0d640 1 -- 172.21.15.50:0/3293227458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec062070 con 0x55cbeedffb60 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.036+0000 7fceeae0d640 1 -- 172.21.15.50:0/3293227458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec0528d0 con 0x55cbeedffb60 2024-05-07T13:57:58.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.036+0000 7fceeae0d640 1 -- 172.21.15.50:0/3293227458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec057040 con 0x55cbeedffb60 2024-05-07T13:57:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.037+0000 7fd000d23800 1 -- 172.21.15.50:0/3293227458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 msgr2=0x55cbeeef04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.037+0000 7fd000d23800 1 --2- 172.21.15.50:0/3293227458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef04a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcfec055040 tx=0x7fcfec04c000 comp rx=0 tx=0).stop 2024-05-07T13:57:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.037+0000 7fd000d23800 1 -- 172.21.15.50:0/3293227458 shutdown_connections 2024-05-07T13:57:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.037+0000 7fd000d23800 1 --2- 172.21.15.50:0/3293227458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef04a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.037+0000 7fd000d23800 1 -- 172.21.15.50:0/3293227458 >> 172.21.15.50:0/3293227458 conn(0x55cbeedf9570 msgr2=0x55cbeeeebdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.037+0000 7fd000d23800 1 -- 172.21.15.50:0/3293227458 shutdown_connections 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.037+0000 7fd000d23800 1 -- 172.21.15.50:0/3293227458 wait complete. 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.037+0000 7fd000d23800 1 Processor -- start 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.037+0000 7fd000d23800 1 -- start start 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.038+0000 7fd000d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.038+0000 7fd000d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbeee06470 con 0x55cbeedffb60 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.038+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.038+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59242/0 (socket says 172.21.15.50:59242) 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.038+0000 7fcffcae4640 1 -- 172.21.15.50:0/803019522 learned_addr learned my addr 172.21.15.50:0/803019522 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.038+0000 7fcffcae4640 1 -- 172.21.15.50:0/803019522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeeef8410 con 0x55cbeedffb60 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.038+0000 7fcffcae4640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef7ed0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcfec055040 tx=0x7fcfec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.039+0000 7fcee960a640 1 -- 172.21.15.50:0/803019522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec057050 con 0x55cbeedffb60 2024-05-07T13:57:58.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.039+0000 7fcee960a640 1 -- 172.21.15.50:0/803019522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec067790 con 0x55cbeedffb60 2024-05-07T13:57:58.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.039+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbeeef86a0 con 0x55cbeedffb60 2024-05-07T13:57:58.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.039+0000 7fcee960a640 1 -- 172.21.15.50:0/803019522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec062040 con 0x55cbeedffb60 2024-05-07T13:57:58.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.039+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbeeefb350 con 0x55cbeedffb60 2024-05-07T13:57:58.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.039+0000 7fcee960a640 1 -- 172.21.15.50:0/803019522 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfec067a70 con 0x55cbeedffb60 2024-05-07T13:57:58.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.040+0000 7fcee960a640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcee4036950 0x7fcee4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.040+0000 7fcee960a640 1 -- 172.21.15.50:0/803019522 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fcfec08e710 con 0x55cbeedffb60 2024-05-07T13:57:58.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.040+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcee4036950 0x7fcee4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.040+0000 7fd000d23800 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeee02490 0x55cbeeeff110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.040+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeeeff650 con 0x55cbeee02490 2024-05-07T13:57:58.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.040+0000 7fcffd2e5640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeee02490 0x55cbeeeff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.040+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcee4036950 0x7fcee4038e10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4000c00 tx=0x7fcfe40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.040+0000 7fcffd2e5640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeee02490 0x55cbeeeff110 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.041+0000 7fcffd2e5640 1 -- 172.21.15.50:0/803019522 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeee02490 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.041+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeeefc690 con 0x55cbeee02490 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.041+0000 7fcffd2e5640 1 -- 172.21.15.50:0/803019522 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeee02490 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.041+0000 7fd000d23800 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef01910 0x55cbeef03d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.041+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef043f0 con 0x55cbeef01910 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.041+0000 7fcffcae4640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef01910 0x55cbeef03d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.041+0000 7fcffcae4640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef01910 0x55cbeef03d00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.042+0000 7fcffcae4640 1 -- 172.21.15.50:0/803019522 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcfec064070 con 0x55cbeef01910 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.042+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef008f0 con 0x55cbeee02490 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.042+0000 7fcffd2e5640 1 -- 172.21.15.50:0/803019522 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeee02490 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.042+0000 7fd000d23800 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeef05850 0x55cbeef07cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.042+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef08420 con 0x55cbeef05850 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.042+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeef05850 0x55cbeef07cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.043+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeef05850 0x55cbeef07cc0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.043+0000 7fcffc2e3640 1 -- 172.21.15.50:0/803019522 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcfe400f670 con 0x55cbeef05850 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.043+0000 7fd000d23800 1 Processor -- start 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.043+0000 7fd000d23800 1 -- start start 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fd000d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef16820 0x55cbeef16c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fd000d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbeecf0cf0 con 0x55cbeef16820 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef16820 0x55cbeef16c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef16820 0x55cbeef16c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59244/0 (socket says 172.21.15.50:59244) 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fcffcae4640 1 -- 172.21.15.50:0/201129792 learned_addr learned my addr 172.21.15.50:0/201129792 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fcffcae4640 1 -- 172.21.15.50:0/201129792 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeef17180 con 0x55cbeef16820 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fcffcae4640 1 --2- 172.21.15.50:0/201129792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef16820 0x55cbeef16c40 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcfec007000 tx=0x7fcfec05b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fcee27fc640 1 -- 172.21.15.50:0/201129792 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec093070 con 0x55cbeef16820 2024-05-07T13:57:58.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fcee27fc640 1 -- 172.21.15.50:0/201129792 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec05dd70 con 0x55cbeef16820 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fd000d23800 1 -- 172.21.15.50:0/201129792 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbeef17bf0 con 0x55cbeef16820 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.044+0000 7fcee27fc640 1 -- 172.21.15.50:0/201129792 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec08b070 con 0x55cbeef16820 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.045+0000 7fd000d23800 1 -- 172.21.15.50:0/201129792 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbeef180f0 con 0x55cbeef16820 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.045+0000 7fcee27fc640 1 -- 172.21.15.50:0/201129792 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfec096070 con 0x55cbeef16820 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.045+0000 7fcee27fc640 1 --2- 172.21.15.50:0/201129792 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fced40368d0 0x7fced4038d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.045+0000 7fcee27fc640 1 -- 172.21.15.50:0/201129792 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fcfec099d60 con 0x55cbeef16820 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.046+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/201129792 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fced40368d0 0x7fced4038d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.046+0000 7fd000d23800 1 Processor -- start 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.046+0000 7fd000d23800 1 -- start start 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.046+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/201129792 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fced40368d0 0x7fced4038d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55cbeeefca50 tx=0x7fcfe4006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.046+0000 7fd000d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef23db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.046+0000 7fd000d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbeeef0d30 con 0x55cbeef23990 2024-05-07T13:57:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.046+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef23db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.046+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef23db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59260/0 (socket says 172.21.15.50:59260) 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.046+0000 7fcffcae4640 1 -- 172.21.15.50:0/4194250712 learned_addr learned my addr 172.21.15.50:0/4194250712 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fcffcae4640 1 -- 172.21.15.50:0/4194250712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeef24380 con 0x55cbeef23990 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fcffcae4640 1 --2- 172.21.15.50:0/4194250712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef23db0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcfec05bf20 tx=0x7fcfec07dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4a26fd5d6455b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fced3fff640 1 -- 172.21.15.50:0/4194250712 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec05d7c0 con 0x55cbeef23990 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fced3fff640 1 -- 172.21.15.50:0/4194250712 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec007800 con 0x55cbeef23990 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fced3fff640 1 -- 172.21.15.50:0/4194250712 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec08ecf0 con 0x55cbeef23990 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fd000d23800 1 -- 172.21.15.50:0/4194250712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 msgr2=0x55cbeef23db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fd000d23800 1 --2- 172.21.15.50:0/4194250712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef23db0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcfec05bf20 tx=0x7fcfec07dcd0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fd000d23800 1 -- 172.21.15.50:0/4194250712 shutdown_connections 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fd000d23800 1 --2- 172.21.15.50:0/4194250712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef23db0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fd000d23800 1 -- 172.21.15.50:0/4194250712 >> 172.21.15.50:0/4194250712 conn(0x55cbeef1fca0 msgr2=0x55cbeef1dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fd000d23800 1 -- 172.21.15.50:0/4194250712 shutdown_connections 2024-05-07T13:57:58.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.047+0000 7fd000d23800 1 -- 172.21.15.50:0/4194250712 wait complete. 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.048+0000 7fd000d23800 1 Processor -- start 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.048+0000 7fd000d23800 1 -- start start 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.048+0000 7fd000d23800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef2ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.048+0000 7fd000d23800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbeef24a10 con 0x55cbeef23990 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.048+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef2ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.048+0000 7fcffcae4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef2ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59274/0 (socket says 172.21.15.50:59274) 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.048+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 learned_addr learned my addr 172.21.15.50:0/2830963843 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.048+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeef2b2e0 con 0x55cbeef23990 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.049+0000 7fcffcae4640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef2ada0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcfec04c040 tx=0x7fcfec091ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.049+0000 7fced27fc640 1 -- 172.21.15.50:0/2830963843 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec066af0 con 0x55cbeef23990 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.049+0000 7fced27fc640 1 -- 172.21.15.50:0/2830963843 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec07d580 con 0x55cbeef23990 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.049+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbeef2b2e0 con 0x55cbeef23990 2024-05-07T13:57:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.049+0000 7fced27fc640 1 -- 172.21.15.50:0/2830963843 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfec0657d0 con 0x55cbeef23990 2024-05-07T13:57:58.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.049+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbeef2b2e0 con 0x55cbeef23990 2024-05-07T13:57:58.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.050+0000 7fced27fc640 1 -- 172.21.15.50:0/2830963843 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfec0ac040 con 0x55cbeef23990 2024-05-07T13:57:58.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.050+0000 7fced27fc640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcec8036900 0x7fcec8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.050+0000 7fced27fc640 1 -- 172.21.15.50:0/2830963843 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fcfec0aa020 con 0x55cbeef23990 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.050+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcec8036900 0x7fcec8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.050+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcec8036900 0x7fcec8038dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55cbeef04790 tx=0x7fcfe4023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.050+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.050+0000 7fd000d23800 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeef364a0 0x55cbeef38960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.050+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef390b0 con 0x55cbeef364a0 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fcffd2e5640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeef364a0 0x55cbeef38960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fcffd2e5640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeef364a0 0x55cbeef38960 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fd000d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fd000d23800 20 realm 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef394c0 con 0x55cbeef364a0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fd000d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fd000d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.051+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef39d90 con 0x55cbeef364a0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fd000d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fd000d23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fd000d23800 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef3ae90 0x55cbeef3d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3d890 con 0x55cbeef3ae90 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fcffcae4640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef3ae90 0x55cbeef3d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.052+0000 7fcffcae4640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef3ae90 0x55cbeef3d280 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.053+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.053+0000 7fd000d23800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.053+0000 7fd000d23800 20 searching for the correct realm 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.053+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3f1a0 con 0x55cbeef3ae90 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.053+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.053+0000 7fcffcae4640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcfec0af040 0x7fcfec001630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.053+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3f1a0 con 0x7fcfec0af040 2024-05-07T13:57:58.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.053+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcfec0af040 0x7fcfec001630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.054+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcfec0af040 0x7fcfec001630 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.054+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x7fcfec0af040 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.054+0000 7fcffc2e3640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcfe403a3c0 0x7fcfe403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.054+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3f1a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.054+0000 7fcffd2e5640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcfe403a3c0 0x7fcfe403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.055+0000 7fcffd2e5640 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcfe403a3c0 0x7fcfe403a810 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.055+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.055+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.055+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.055+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.055+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.055+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.055+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.055+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfe403a3c0 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.056+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.056+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfec0af040 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.056+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x7fcfec0af040 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.056+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfec0af040 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.056+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x7fcfec0af040 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.056+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.056+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.056+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfe403a3c0 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.057+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.057+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.057+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.057+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfec0af040 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.057+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcfe4037040 con 0x7fcfec0af040 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.057+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef3ae90 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.057+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.057+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef3ae90 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.058+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.058+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfe403a3c0 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.058+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.058+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef3ae90 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.059+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.059+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef3ae90 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.059+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.059+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.059+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.059+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.059+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.059+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfe403a3c0 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.060+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.060+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef3ae90 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.060+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.060+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfec0af040 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.060+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x7fcfec0af040 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.060+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.060+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.060+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfe403a3c0 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.061+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.061+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef3ae90 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.061+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.061+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfe403a3c0 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.061+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.061+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfec0af040 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.062+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x7fcfec0af040 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.062+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef3ae90 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.062+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.062+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfec0af040 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.062+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x7fcfec0af040 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.062+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x55cbeef364a0 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.062+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.062+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3a130 con 0x7fcfec0af040 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe4037040 con 0x7fcfec0af040 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3e150 con 0x55cbeef364a0 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3e540 con 0x55cbeef364a0 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.063+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3e540 con 0x7fcfe403a3c0 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 20 zone default found 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 4 Realm: () 2024-05-07T13:57:58.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 20 zonegroup default 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3dcd0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef3dd00 con 0x55cbeef3ae90 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.064+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef41150 con 0x55cbeef3ae90 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.065+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.065+0000 7fd000d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.065+0000 7fd000d23800 20 started sync module instance, tier type = 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.065+0000 7fd000d23800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.065+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef404a0 con 0x7fcfec0af040 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.066+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe404a040 con 0x7fcfec0af040 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.066+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94334375692432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef40100 con 0x7fcfec0af040 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.066+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef42080 con 0x55cbeef364a0 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.067+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94334375692432] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe404a040 con 0x7fcfec0af040 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.067+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.067+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94334375697360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef41ff0 con 0x55cbeef364a0 2024-05-07T13:57:58.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.067+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef42f40 con 0x55cbeef3ae90 2024-05-07T13:57:58.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.068+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94334375697360] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.068+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.068+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94334375701136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef43330 con 0x55cbeef3ae90 2024-05-07T13:57:58.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.068+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef43d70 con 0x7fcfec0af040 2024-05-07T13:57:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.069+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94334375701136] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.069+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe404a040 con 0x7fcfec0af040 2024-05-07T13:57:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.069+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94334375699568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef44610 con 0x7fcfec0af040 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.069+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef44fd0 con 0x55cbeef364a0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.070+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.070+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94334375709984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef45870 con 0x55cbeef364a0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.070+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94334375699568] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe404a040 con 0x7fcfec0af040 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.070+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef44160 con 0x7fcfe403a3c0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.071+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94334375709984] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.072+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.072+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94334375711568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef45770 con 0x7fcfe403a3c0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.072+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef46790 con 0x7fcfe403a3c0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.073+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94334375711568] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.073+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.073+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94334375714352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef46700 con 0x7fcfe403a3c0 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.073+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef47120 con 0x7fcfe403a3c0 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94334375714352] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94334375715408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef46670 con 0x7fcfe403a3c0 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fd000d23800 20 add_watcher() i=0 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fd000d23800 20 add_watcher() i=1 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fd000d23800 20 add_watcher() i=2 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fd000d23800 20 add_watcher() i=3 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fd000d23800 20 add_watcher() i=4 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fd000d23800 20 add_watcher() i=5 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.074+0000 7fd000d23800 20 add_watcher() i=6 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.075+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94334375715408] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.075+0000 7fd000d23800 20 add_watcher() i=7 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.075+0000 7fd000d23800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.075+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef4a5c0 con 0x55cbeef364a0 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.075+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.075+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94334375719136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef47a80 con 0x55cbeef364a0 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.076+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94334375719136] v29'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.076+0000 7fceb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.076+0000 7fd000d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.076+0000 7fd000d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.076+0000 7fd000d23800 5 note: GC not initialized 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.077+0000 7fceb1fe3640 20 reqs_thread_entry: start 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.077+0000 7fd000d23800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.077+0000 7fd000d23800 20 Filter name: none 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.077+0000 7fce237fe640 20 reqs_thread_entry: start 2024-05-07T13:57:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.077+0000 7fd000d23800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.077+0000 7fd000d23800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.077+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef7da90 con 0x7fcfe403a3c0 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.078+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.078+0000 7fd000d23800 20 rados_obj.operate() r=0 bl.length=490 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.078+0000 7fd000d23800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.078+0000 7fd000d23800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.078+0000 7fd000d23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.078+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef83f00 con 0x7fcfe403a3c0 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.079+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.079+0000 7fd000d23800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.079+0000 7fd000d23800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fd000d23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94334375967088 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef82a50 con 0x55cbeef364a0 2024-05-07T13:57:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 94334375709984 notify 124554051613 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fcff403d040 con 0x55cbeef364a0 2024-05-07T13:57:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fced3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 94334375709984 notifier 4901 bl.length()=636 2024-05-07T13:57:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fced3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fced3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 notify.4 [notify cookie 94334375967088 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fced3fff640 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fcec0003ea0 con 0x55cbeef364a0 2024-05-07T13:57:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.080+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94334375967088 notify 124554051613 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcff402f040 con 0x55cbeef364a0 2024-05-07T13:57:58.078 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.081+0000 7fceb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.081+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94334375719136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef33610 con 0x55cbeef364a0 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.082+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94334375719136] v29'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.082+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94334375692432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef470e0 con 0x7fcfec0af040 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.083+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94334375692432] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe404a040 con 0x7fcfec0af040 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.083+0000 7fd000d23800 20 remove_watcher() i=0 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.083+0000 7fd000d23800 2 removed watcher, disabling cache 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.083+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94334375697360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef40890 con 0x55cbeef364a0 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.084+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94334375697360] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.084+0000 7fd000d23800 20 remove_watcher() i=1 2024-05-07T13:57:58.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.084+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94334375701136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef41bd0 con 0x55cbeef3ae90 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.085+0000 7fcffcae4640 1 -- 172.21.15.50:0/2830963843 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94334375701136] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec0a3030 con 0x55cbeef3ae90 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.085+0000 7fd000d23800 20 remove_watcher() i=2 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.085+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94334375699568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef41bd0 con 0x7fcfec0af040 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.086+0000 7fcffc2e3640 1 -- 172.21.15.50:0/2830963843 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94334375699568] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe404a040 con 0x7fcfec0af040 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.086+0000 7fd000d23800 20 remove_watcher() i=3 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.086+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94334375709984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef41bd0 con 0x55cbeef364a0 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.088+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94334375709984] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x55cbeef364a0 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.088+0000 7fd000d23800 20 remove_watcher() i=4 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.088+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94334375711568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef44d20 con 0x7fcfe403a3c0 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.089+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94334375711568] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.089+0000 7fd000d23800 20 remove_watcher() i=5 2024-05-07T13:57:58.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.089+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94334375714352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef41bd0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.090+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94334375714352] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.090+0000 7fd000d23800 20 remove_watcher() i=6 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.090+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94334375715408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cbeef45350 con 0x7fcfe403a3c0 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94334375715408] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff400a4a0 con 0x7fcfe403a3c0 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 20 remove_watcher() i=7 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcfe403a3c0 msgr2=0x7fcfe403a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fcfe403a3c0 0x7fcfe403a810 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeef364a0 msgr2=0x55cbeef38960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeef364a0 0x55cbeef38960 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcfec0af040 msgr2=0x7fcfec001630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fcfec0af040 0x7fcfec001630 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef3ae90 msgr2=0x55cbeef3d280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef3ae90 0x55cbeef3d280 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcec8036900 msgr2=0x7fcec8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcec8036900 0x7fcec8038dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55cbeef04790 tx=0x7fcfe4023040 comp rx=0 tx=0).stop 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 msgr2=0x55cbeef2ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fcffd2e5640 1 -- 172.21.15.50:0/2830963843 reap_dead start 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef2ada0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcfec04c040 tx=0x7fcfec091ed0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 shutdown_connections 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 --2- 172.21.15.50:0/2830963843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef23990 0x55cbeef2ada0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.091+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 >> 172.21.15.50:0/2830963843 conn(0x55cbeef1fca0 msgr2=0x55cbeef1d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 shutdown_connections 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/2830963843 wait complete. 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/201129792 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fced40368d0 msgr2=0x7fced4038d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 --2- 172.21.15.50:0/201129792 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fced40368d0 0x7fced4038d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55cbeeefca50 tx=0x7fcfe4006000 comp rx=0 tx=0).stop 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/201129792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef16820 msgr2=0x55cbeef16c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 --2- 172.21.15.50:0/201129792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef16820 0x55cbeef16c40 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcfec007000 tx=0x7fcfec05b470 comp rx=0 tx=0).stop 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/201129792 shutdown_connections 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 --2- 172.21.15.50:0/201129792 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fced40368d0 0x7fced4038d90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 --2- 172.21.15.50:0/201129792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeef16820 0x55cbeef16c40 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/201129792 >> 172.21.15.50:0/201129792 conn(0x55cbeef0a8f0 msgr2=0x55cbeef0acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/201129792 shutdown_connections 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/201129792 wait complete. 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeef05850 msgr2=0x55cbeef07cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x55cbeef05850 0x55cbeef07cc0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeee02490 msgr2=0x55cbeeeff110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x55cbeee02490 0x55cbeeeff110 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef01910 msgr2=0x55cbeef03d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x55cbeef01910 0x55cbeef03d00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcee4036950 msgr2=0x7fcee4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fcee4036950 0x7fcee4038e10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4000c00 tx=0x7fcfe40013b0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 msgr2=0x55cbeeef7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fd000d23800 1 --2- 172.21.15.50:0/803019522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbeedffb60 0x55cbeeef7ed0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcfec055040 tx=0x7fcfec002fb0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.092+0000 7fcffd2e5640 1 -- 172.21.15.50:0/803019522 reap_dead start 2024-05-07T13:57:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.093+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 shutdown_connections 2024-05-07T13:57:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.093+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 >> 172.21.15.50:0/803019522 conn(0x55cbeedf9570 msgr2=0x55cbeeeea5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.093+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 shutdown_connections 2024-05-07T13:57:58.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.093+0000 7fd000d23800 1 -- 172.21.15.50:0/803019522 wait complete. 2024-05-07T13:57:58.090 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:58.090 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:58.090 ERROR:root:0 2024-05-07T13:57:58.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-07T13:57:58.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-07T13:57:58.091 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-07T13:57:58.138 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:58.139 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:58.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.152+0000 7fc7d300e800 1 Processor -- start 2024-05-07T13:57:58.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.152+0000 7fc7d300e800 1 -- start start 2024-05-07T13:57:58.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.152+0000 7fc7d300e800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556a3cfbc630 0x556a3cfbea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.152+0000 7fc7d300e800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a3cfbef60 con 0x556a3cfb63c0 2024-05-07T13:57:58.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.152+0000 7fc7d300e800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x556a3ce49050 con 0x556a3cfbc630 2024-05-07T13:57:58.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.153+0000 7fc7d030c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556a3cfbc630 0x556a3cfbea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.153+0000 7fc7d030c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x556a3cfbc630 0x556a3cfbea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59284/0 (socket says 172.21.15.50:59284) 2024-05-07T13:57:58.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.153+0000 7fc7d030c640 1 -- 172.21.15.50:0/2018835030 learned_addr learned my addr 172.21.15.50:0/2018835030 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.153+0000 7fc7d0b0d640 1 --1- 172.21.15.50:0/2018835030 >> v1:172.21.15.22:6789/0 conn(0x556a3cfb63c0 0x556a3cfb67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56916/0 (socket says 172.21.15.50:56916) 2024-05-07T13:57:58.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.153+0000 7fc7d030c640 1 -- 172.21.15.50:0/2018835030 >> v1:172.21.15.22:6789/0 conn(0x556a3cfb63c0 legacy=0x556a3cfb67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.153+0000 7fc7d030c640 1 -- 172.21.15.50:0/2018835030 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3cfc0170 con 0x556a3cfbc630 2024-05-07T13:57:58.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.155+0000 7fc7d030c640 1 --2- 172.21.15.50:0/2018835030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfbc630 0x556a3cfbea20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400a520 tx=0x7fc7c401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41da6fbb50524733 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.155+0000 7fc7cfb0b640 1 -- 172.21.15.50:0/2018835030 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c4057070 con 0x556a3cfbc630 2024-05-07T13:57:58.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.155+0000 7fc7cfb0b640 1 -- 172.21.15.50:0/2018835030 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c4052570 con 0x556a3cfbc630 2024-05-07T13:57:58.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.155+0000 7fc7cfb0b640 1 -- 172.21.15.50:0/2018835030 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c404ae60 con 0x556a3cfbc630 2024-05-07T13:57:58.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.156+0000 7fc7d300e800 1 -- 172.21.15.50:0/2018835030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfbc630 msgr2=0x556a3cfbea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.156+0000 7fc7d300e800 1 --2- 172.21.15.50:0/2018835030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfbc630 0x556a3cfbea20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400a520 tx=0x7fc7c401d010 comp rx=0 tx=0).stop 2024-05-07T13:57:58.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.156+0000 7fc7d300e800 1 -- 172.21.15.50:0/2018835030 shutdown_connections 2024-05-07T13:57:58.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.156+0000 7fc7d300e800 1 --2- 172.21.15.50:0/2018835030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfbc630 0x556a3cfbea20 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.156+0000 7fc7d300e800 1 -- 172.21.15.50:0/2018835030 >> 172.21.15.50:0/2018835030 conn(0x556a3cfb1d40 msgr2=0x556a3cfb4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.156+0000 7fc7d300e800 1 -- 172.21.15.50:0/2018835030 shutdown_connections 2024-05-07T13:57:58.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.156+0000 7fc7d300e800 1 -- 172.21.15.50:0/2018835030 wait complete. 2024-05-07T13:57:58.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.171+0000 7fc7d300e800 1 Processor -- start 2024-05-07T13:57:58.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.171+0000 7fc7d300e800 1 -- start start 2024-05-07T13:57:58.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.171+0000 7fc7d300e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3cfb8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.171+0000 7fc7d300e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556a3cf031c0 con 0x556a3cfb63c0 2024-05-07T13:57:58.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.171+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3cfb8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.171+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3cfb8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59296/0 (socket says 172.21.15.50:59296) 2024-05-07T13:57:58.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.171+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/75062308 learned_addr learned my addr 172.21.15.50:0/75062308 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.171+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/75062308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3cfb7300 con 0x556a3cfb63c0 2024-05-07T13:57:58.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.172+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/75062308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3cfb8d40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0001e40 tx=0x7fc7c0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37bf46627e4f7c74 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.172+0000 7fc6bee0d640 1 -- 172.21.15.50:0/75062308 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c000e5c0 con 0x556a3cfb63c0 2024-05-07T13:57:58.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.172+0000 7fc6bee0d640 1 -- 172.21.15.50:0/75062308 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c0006070 con 0x556a3cfb63c0 2024-05-07T13:57:58.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.172+0000 7fc6bee0d640 1 -- 172.21.15.50:0/75062308 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c000e910 con 0x556a3cfb63c0 2024-05-07T13:57:58.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 -- 172.21.15.50:0/75062308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 msgr2=0x556a3cfb8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 --2- 172.21.15.50:0/75062308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3cfb8d40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0001e40 tx=0x7fc7c0001e70 comp rx=0 tx=0).stop 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 -- 172.21.15.50:0/75062308 shutdown_connections 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 --2- 172.21.15.50:0/75062308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3cfb8d40 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 -- 172.21.15.50:0/75062308 >> 172.21.15.50:0/75062308 conn(0x556a3cfb1d40 msgr2=0x556a3d0a4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 -- 172.21.15.50:0/75062308 shutdown_connections 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 -- 172.21.15.50:0/75062308 wait complete. 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 Processor -- start 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 -- start start 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3d0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d300e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556a3cfbf430 con 0x556a3cfb63c0 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3d0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3d0b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59312/0 (socket says 172.21.15.50:59312) 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.173+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/1746782375 learned_addr learned my addr 172.21.15.50:0/1746782375 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.174+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/1746782375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3d0b3a10 con 0x556a3cfb63c0 2024-05-07T13:57:58.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.174+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3d0b34d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0000f60 tx=0x7fc7c0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.174+0000 7fc6bd60a640 1 -- 172.21.15.50:0/1746782375 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c000f8d0 con 0x556a3cfb63c0 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.174+0000 7fc6bd60a640 1 -- 172.21.15.50:0/1746782375 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c000fa70 con 0x556a3cfb63c0 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.174+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a3d0b3ca0 con 0x556a3cfb63c0 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.174+0000 7fc6bd60a640 1 -- 172.21.15.50:0/1746782375 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c000fd90 con 0x556a3cfb63c0 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.174+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3d0b6950 con 0x556a3cfb63c0 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.175+0000 7fc6bd60a640 1 -- 172.21.15.50:0/1746782375 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7c0017070 con 0x556a3cfb63c0 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.175+0000 7fc6bd60a640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6b80368b0 0x7fc6b8038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.175+0000 7fc6bd60a640 1 -- 172.21.15.50:0/1746782375 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc7c0015020 con 0x556a3cfb63c0 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.175+0000 7fc7d030c640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6b80368b0 0x7fc6b8038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.175+0000 7fc7d300e800 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3cfbc630 0x556a3d0ba710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.175+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0bace0 con 0x556a3cfbc630 2024-05-07T13:57:58.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.175+0000 7fc7d130e640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3cfbc630 0x556a3d0ba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.176+0000 7fc7d030c640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6b80368b0 0x7fc6b8038d70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4054000 tx=0x7fc7c404e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.176+0000 7fc7d130e640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3cfbc630 0x556a3d0ba710 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.176+0000 7fc7d130e640 1 -- 172.21.15.50:0/1746782375 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3cfbc630 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.176+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0b7ce0 con 0x556a3cfbc630 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.176+0000 7fc7d130e640 1 -- 172.21.15.50:0/1746782375 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3cfbc630 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.176+0000 7fc7d300e800 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0bcff0 0x556a3d0bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.176+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0bfa80 con 0x556a3d0bcff0 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.176+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0bcff0 0x556a3d0bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.177+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0bcff0 0x556a3d0bf3e0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.177+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/1746782375 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7c002e070 con 0x556a3d0bcff0 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.177+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0bbfa0 con 0x556a3cfbc630 2024-05-07T13:57:58.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.177+0000 7fc7d130e640 1 -- 172.21.15.50:0/1746782375 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3cfbc630 2024-05-07T13:57:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.177+0000 7fc7d300e800 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556a3d0c0f30 0x556a3d0c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.177+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0c3ae0 con 0x556a3d0c0f30 2024-05-07T13:57:58.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.177+0000 7fc7d030c640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556a3d0c0f30 0x556a3d0c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.178+0000 7fc7d030c640 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556a3d0c0f30 0x556a3d0c3380 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.178+0000 7fc7d030c640 1 -- 172.21.15.50:0/1746782375 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7c405a040 con 0x556a3d0c0f30 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.178+0000 7fc7d300e800 1 Processor -- start 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.178+0000 7fc7d300e800 1 -- start start 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.179+0000 7fc7d300e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0d1ed0 0x556a3d0d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.179+0000 7fc7d300e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556a3cea9cf0 con 0x556a3d0d1ed0 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.179+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0d1ed0 0x556a3d0d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.179+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0d1ed0 0x556a3d0d22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59328/0 (socket says 172.21.15.50:59328) 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.179+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/4197947880 learned_addr learned my addr 172.21.15.50:0/4197947880 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.179+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/4197947880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3d0d2830 con 0x556a3d0d1ed0 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.179+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/4197947880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0d1ed0 0x556a3d0d22f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc7c001cfd0 tx=0x7fc7c0044950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.180+0000 7fc6b67fc640 1 -- 172.21.15.50:0/4197947880 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c003fe90 con 0x556a3d0d1ed0 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.180+0000 7fc6b67fc640 1 -- 172.21.15.50:0/4197947880 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c0017960 con 0x556a3d0d1ed0 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.180+0000 7fc7d300e800 1 -- 172.21.15.50:0/4197947880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a3d0d32a0 con 0x556a3d0d1ed0 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.180+0000 7fc6b67fc640 1 -- 172.21.15.50:0/4197947880 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c0017c60 con 0x556a3d0d1ed0 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.180+0000 7fc7d300e800 1 -- 172.21.15.50:0/4197947880 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3d0d37a0 con 0x556a3d0d1ed0 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.180+0000 7fc6b67fc640 1 -- 172.21.15.50:0/4197947880 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7c001a480 con 0x556a3d0d1ed0 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.180+0000 7fc6b67fc640 1 --2- 172.21.15.50:0/4197947880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6a8036af0 0x7fc6a8038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.180+0000 7fc6b67fc640 1 -- 172.21.15.50:0/4197947880 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc7c0038020 con 0x556a3d0d1ed0 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.181+0000 7fc7d030c640 1 --2- 172.21.15.50:0/4197947880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6a8036af0 0x7fc6a8038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.181+0000 7fc7d300e800 1 Processor -- start 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.181+0000 7fc7d300e800 1 -- start start 2024-05-07T13:57:58.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.181+0000 7fc7d030c640 1 --2- 172.21.15.50:0/4197947880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6a8036af0 0x7fc6a8038fb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x556a3d0b7c00 tx=0x7fc7c4005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.181+0000 7fc7d300e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0df410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.181+0000 7fc7d300e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556a3cfb7680 con 0x556a3d0deff0 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.181+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.181+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0df410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59334/0 (socket says 172.21.15.50:59334) 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.181+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/244164895 learned_addr learned my addr 172.21.15.50:0/244164895 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/244164895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3d0df9e0 con 0x556a3d0deff0 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/244164895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0df410 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0011fd0 tx=0x7fc7c0026450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73286ce4796a25eb server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc6a7fff640 1 -- 172.21.15.50:0/244164895 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c0060070 con 0x556a3d0deff0 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc6a7fff640 1 -- 172.21.15.50:0/244164895 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c0044b70 con 0x556a3d0deff0 2024-05-07T13:57:58.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc6a7fff640 1 -- 172.21.15.50:0/244164895 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c0026b60 con 0x556a3d0deff0 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc7d300e800 1 -- 172.21.15.50:0/244164895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 msgr2=0x556a3d0df410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc7d300e800 1 --2- 172.21.15.50:0/244164895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0df410 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0011fd0 tx=0x7fc7c0026450 comp rx=0 tx=0).stop 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc7d300e800 1 -- 172.21.15.50:0/244164895 shutdown_connections 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc7d300e800 1 --2- 172.21.15.50:0/244164895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0df410 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc7d300e800 1 -- 172.21.15.50:0/244164895 >> 172.21.15.50:0/244164895 conn(0x556a3d0db350 msgr2=0x556a3d0d93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.182+0000 7fc7d300e800 1 -- 172.21.15.50:0/244164895 shutdown_connections 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.183+0000 7fc7d300e800 1 -- 172.21.15.50:0/244164895 wait complete. 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.183+0000 7fc7d300e800 1 Processor -- start 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.183+0000 7fc7d300e800 1 -- start start 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.183+0000 7fc7d300e800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0e64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.183+0000 7fc7d300e800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556a3d0e0090 con 0x556a3d0deff0 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.183+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0e64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.183+0000 7fc7d0b0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0e64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59348/0 (socket says 172.21.15.50:59348) 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.183+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 learned_addr learned my addr 172.21.15.50:0/3530421915 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.184+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3d0e69f0 con 0x556a3d0deff0 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.184+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0e64b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0019fd0 tx=0x7fc7c0046f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.184+0000 7fc6a67fc640 1 -- 172.21.15.50:0/3530421915 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c0060070 con 0x556a3d0deff0 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.184+0000 7fc6a67fc640 1 -- 172.21.15.50:0/3530421915 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c002a330 con 0x556a3d0deff0 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.184+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a3d0e69f0 con 0x556a3d0deff0 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.184+0000 7fc6a67fc640 1 -- 172.21.15.50:0/3530421915 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c002a650 con 0x556a3d0deff0 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.184+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3d0e6e90 con 0x556a3d0deff0 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.185+0000 7fc6a67fc640 1 -- 172.21.15.50:0/3530421915 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7c006f020 con 0x556a3d0deff0 2024-05-07T13:57:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.185+0000 7fc6a67fc640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc69c036950 0x7fc69c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.185+0000 7fc6a67fc640 1 -- 172.21.15.50:0/3530421915 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc7c006d020 con 0x556a3d0deff0 2024-05-07T13:57:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.185+0000 7fc7d030c640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc69c036950 0x7fc69c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.186+0000 7fc7d030c640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc69c036950 0x7fc69c038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4052fd0 tx=0x7fc7c404f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.186+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.186+0000 7fc7d300e800 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3d0f1c60 0x556a3d0f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.186+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f4870 con 0x556a3d0f1c60 2024-05-07T13:57:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.186+0000 7fc7d130e640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3d0f1c60 0x556a3d0f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d130e640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3d0f1c60 0x556a3d0f4120 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 20 realm 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f4c80 con 0x556a3d0f1c60 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f5550 con 0x556a3d0f1c60 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f58f0 con 0x556a3d0f1c60 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.187+0000 7fc7d300e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.188+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.188+0000 7fc7d300e800 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0f6650 0x556a3d0f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.188+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f9050 con 0x556a3d0f6650 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.188+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0f6650 0x556a3d0f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.188+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0f6650 0x556a3d0f8a40 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.188+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7c002e070 con 0x556a3d0f6650 2024-05-07T13:57:58.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.188+0000 7fc7d300e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.188+0000 7fc7d300e800 20 searching for the correct realm 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.188+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fa980 con 0x556a3d0f6650 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.189+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c002e070 con 0x556a3d0f6650 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.189+0000 7fc7d0b0d640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc7c001d5f0 0x7fc7c0069a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.189+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fa980 con 0x7fc7c001d5f0 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.189+0000 7fc7d030c640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc7c001d5f0 0x7fc7c0069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.189+0000 7fc7d030c640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc7c001d5f0 0x7fc7c0069a30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.189+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.189+0000 7fc7d030c640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc7c4074040 0x7fc7c4081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.189+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fa980 con 0x7fc7c4074040 2024-05-07T13:57:58.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.190+0000 7fc7d130e640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc7c4074040 0x7fc7c4081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.190+0000 7fc7d130e640 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc7c4074040 0x7fc7c4081410 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.190+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.190+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f58f0 con 0x556a3d0f1c60 2024-05-07T13:57:58.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.191+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.191+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f58f0 con 0x556a3d0f1c60 2024-05-07T13:57:58.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.191+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.191+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f58f0 con 0x556a3d0f1c60 2024-05-07T13:57:58.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.191+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.191+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f58f0 con 0x7fc7c4074040 2024-05-07T13:57:58.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.191+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.191+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f58f0 con 0x7fc7c001d5f0 2024-05-07T13:57:58.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.192+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.192+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f58f0 con 0x7fc7c001d5f0 2024-05-07T13:57:58.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.192+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.192+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f1c60 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.192+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.192+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c4074040 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.192+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.192+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f1c60 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.193+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.193+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c001d5f0 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.193+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.193+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f6650 2024-05-07T13:57:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.193+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c002e070 con 0x556a3d0f6650 2024-05-07T13:57:58.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.193+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f6650 2024-05-07T13:57:58.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.193+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7c002e070 con 0x556a3d0f6650 2024-05-07T13:57:58.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.193+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c4074040 2024-05-07T13:57:58.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.194+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.194+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f6650 2024-05-07T13:57:58.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.194+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c002e070 con 0x556a3d0f6650 2024-05-07T13:57:58.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.194+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f6650 2024-05-07T13:57:58.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.194+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c002e070 con 0x556a3d0f6650 2024-05-07T13:57:58.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.194+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f1c60 2024-05-07T13:57:58.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.194+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.194+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f1c60 2024-05-07T13:57:58.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.195+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.195+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c4074040 2024-05-07T13:57:58.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.195+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.195+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f6650 2024-05-07T13:57:58.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.195+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c008a040 con 0x556a3d0f6650 2024-05-07T13:57:58.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.195+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c001d5f0 2024-05-07T13:57:58.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.195+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.196+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f1c60 2024-05-07T13:57:58.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.196+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.196+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c4074040 2024-05-07T13:57:58.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.196+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.196+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f6650 2024-05-07T13:57:58.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.196+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c008a040 con 0x556a3d0f6650 2024-05-07T13:57:58.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.196+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c4074040 2024-05-07T13:57:58.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.197+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.197+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c001d5f0 2024-05-07T13:57:58.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.197+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.197+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f6650 2024-05-07T13:57:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.197+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c008a040 con 0x556a3d0f6650 2024-05-07T13:57:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.197+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c001d5f0 2024-05-07T13:57:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.197+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.197+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x556a3d0f1c60 2024-05-07T13:57:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc7c408e040 con 0x7fc7c001d5f0 2024-05-07T13:57:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:58.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:58.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f9910 con 0x556a3d0f1c60 2024-05-07T13:57:58.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f9d00 con 0x556a3d0f1c60 2024-05-07T13:57:58.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:58.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.198+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f9d00 con 0x7fc7c4074040 2024-05-07T13:57:58.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:58.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 20 zone default found 2024-05-07T13:57:58.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 4 Realm: () 2024-05-07T13:57:58.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:58.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:58.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:58.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 20 zonegroup default 2024-05-07T13:57:58.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f9570 con 0x7fc7c4074040 2024-05-07T13:57:58.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0f9570 con 0x556a3d0f6650 2024-05-07T13:57:58.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.199+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7c008a040 con 0x556a3d0f6650 2024-05-07T13:57:58.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.200+0000 7fc7d300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.200+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.200+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fc880 con 0x556a3d0f6650 2024-05-07T13:57:58.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.200+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7c008a040 con 0x556a3d0f6650 2024-05-07T13:57:58.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.200+0000 7fc7d300e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.200+0000 7fc7d300e800 20 started sync module instance, tier type = 2024-05-07T13:57:58.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.200+0000 7fc7d300e800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:58.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.200+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fbc80 con 0x7fc7c001d5f0 2024-05-07T13:57:58.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.201+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.201+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93914779336816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fb8e0 con 0x7fc7c001d5f0 2024-05-07T13:57:58.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.201+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fd7b0 con 0x556a3d0f1c60 2024-05-07T13:57:58.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.202+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.202+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93914779336816] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.202+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93914779342048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fdfd0 con 0x556a3d0f1c60 2024-05-07T13:57:58.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.202+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fcd20 con 0x556a3d0f6650 2024-05-07T13:57:58.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.203+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93914779342048] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.203+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c008a040 con 0x556a3d0f6650 2024-05-07T13:57:58.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.203+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93914779343392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fdf90 con 0x556a3d0f6650 2024-05-07T13:57:58.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.203+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0ff090 con 0x7fc7c001d5f0 2024-05-07T13:57:58.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.204+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93914779343392] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c008a040 con 0x556a3d0f6650 2024-05-07T13:57:58.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.205+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.205+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93914779347936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0ff430 con 0x7fc7c001d5f0 2024-05-07T13:57:58.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.205+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0ffe50 con 0x556a3d0f1c60 2024-05-07T13:57:58.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.206+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93914779347936] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.206+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.206+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93914779351360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0ffe10 con 0x556a3d0f1c60 2024-05-07T13:57:58.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.206+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d100880 con 0x7fc7c4074040 2024-05-07T13:57:58.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.207+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93914779351360] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.207+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.207+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93914779353936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d100840 con 0x7fc7c4074040 2024-05-07T13:57:58.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.207+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d101290 con 0x7fc7c4074040 2024-05-07T13:57:58.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.208+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93914779353936] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.208+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.208+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93914779346368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d101290 con 0x7fc7c4074040 2024-05-07T13:57:58.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.208+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d101cd0 con 0x7fc7c4074040 2024-05-07T13:57:58.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93914779346368] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93914779357120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d101cd0 con 0x7fc7c4074040 2024-05-07T13:57:58.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d300e800 20 add_watcher() i=0 2024-05-07T13:57:58.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d300e800 20 add_watcher() i=1 2024-05-07T13:57:58.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d300e800 20 add_watcher() i=2 2024-05-07T13:57:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d300e800 20 add_watcher() i=3 2024-05-07T13:57:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d300e800 20 add_watcher() i=4 2024-05-07T13:57:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d300e800 20 add_watcher() i=5 2024-05-07T13:57:58.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.209+0000 7fc7d300e800 20 add_watcher() i=6 2024-05-07T13:57:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.210+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93914779357120] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.210+0000 7fc7d300e800 20 add_watcher() i=7 2024-05-07T13:57:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.210+0000 7fc7d300e800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.210+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d105000 con 0x556a3d0f1c60 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.211+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.211+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93914779359632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d102260 con 0x556a3d0f1c60 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93914779359632] v29'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc686fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc7d300e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc7d300e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc7d300e800 5 note: GC not initialized 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc685fe3640 20 reqs_thread_entry: start 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc7d300e800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc7d300e800 20 Filter name: none 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc5f77fe640 20 reqs_thread_entry: start 2024-05-07T13:57:58.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc7d300e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc7d300e800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.212+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d1385a0 con 0x7fc7c4074040 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.213+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.213+0000 7fc7d300e800 20 rados_obj.operate() r=0 bl.length=460 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.213+0000 7fc7d300e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.213+0000 7fc7d300e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.213+0000 7fc7d300e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.213+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d13e8c0 con 0x7fc7c4074040 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.214+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v29'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc7d300e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc7d300e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc7d300e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:58.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93914779607856 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a3d13a110 con 0x556a3d0f1c60 2024-05-07T13:57:58.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 93914779351360 notify 124554051614 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fc7c803d040 con 0x556a3d0f1c60 2024-05-07T13:57:58.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc6a7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 93914779351360 notifier 4908 bl.length()=649 2024-05-07T13:57:58.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 notify.4 [notify cookie 93914779607856 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc6a7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:58.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc6a7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:58.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc6a7fff640 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc694003ea0 con 0x556a3d0f1c60 2024-05-07T13:57:58.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.215+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 93914779607856 notify 124554051614 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc7c802f040 con 0x556a3d0f1c60 2024-05-07T13:57:58.238 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:58.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.216+0000 7fc686fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:58.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.216+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93914779359632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d13d760 con 0x556a3d0f1c60 2024-05-07T13:57:58.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.217+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93914779359632] v29'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.217+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93914779336816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d101990 con 0x7fc7c001d5f0 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.218+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93914779336816] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.218+0000 7fc7d300e800 20 remove_watcher() i=0 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.218+0000 7fc7d300e800 2 removed watcher, disabling cache 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.218+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93914779342048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d101990 con 0x556a3d0f1c60 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.219+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93914779342048] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.219+0000 7fc7d300e800 20 remove_watcher() i=1 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.219+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93914779343392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fd4e0 con 0x556a3d0f6650 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.220+0000 7fc7d0b0d640 1 -- 172.21.15.50:0/3530421915 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93914779343392] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c008a040 con 0x556a3d0f6650 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.220+0000 7fc7d300e800 20 remove_watcher() i=2 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.220+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93914779347936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d101990 con 0x7fc7c001d5f0 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.221+0000 7fc7d030c640 1 -- 172.21.15.50:0/3530421915 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93914779347936] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c407f070 con 0x7fc7c001d5f0 2024-05-07T13:57:58.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.222+0000 7fc7d300e800 20 remove_watcher() i=3 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.222+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93914779351360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fd4e0 con 0x556a3d0f1c60 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.223+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93914779351360] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x556a3d0f1c60 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.223+0000 7fc7d300e800 20 remove_watcher() i=4 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.223+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93914779353936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0febe0 con 0x7fc7c4074040 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.224+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93914779353936] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.224+0000 7fc7d300e800 20 remove_watcher() i=5 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.224+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93914779346368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d101990 con 0x7fc7c4074040 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.225+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93914779346368] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.225+0000 7fc7d300e800 20 remove_watcher() i=6 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.225+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93914779357120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a3d0fd4e0 con 0x7fc7c4074040 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93914779357120] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7c800a4a0 con 0x7fc7c4074040 2024-05-07T13:57:58.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 20 remove_watcher() i=7 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc7c4074040 msgr2=0x7fc7c4081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fc7c4074040 0x7fc7c4081410 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3d0f1c60 msgr2=0x556a3d0f4120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3d0f1c60 0x556a3d0f4120 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc7c001d5f0 msgr2=0x7fc7c0069a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7fc7c001d5f0 0x7fc7c0069a30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0f6650 msgr2=0x556a3d0f8a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0f6650 0x556a3d0f8a40 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc69c036950 msgr2=0x7fc69c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc69c036950 0x7fc69c038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4052fd0 tx=0x7fc7c404f000 comp rx=0 tx=0).stop 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 msgr2=0x556a3d0e64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 --2- 172.21.15.50:0/3530421915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0deff0 0x556a3d0e64b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0019fd0 tx=0x7fc7c0046f50 comp rx=0 tx=0).stop 2024-05-07T13:57:58.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 reap_dead start 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d130e640 1 -- 172.21.15.50:0/3530421915 reap_dead start 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 shutdown_connections 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 >> 172.21.15.50:0/3530421915 conn(0x556a3d0db350 msgr2=0x556a3d0d89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 shutdown_connections 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.226+0000 7fc7d300e800 1 -- 172.21.15.50:0/3530421915 wait complete. 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/4197947880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6a8036af0 msgr2=0x7fc6a8038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 --2- 172.21.15.50:0/4197947880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6a8036af0 0x7fc6a8038fb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x556a3d0b7c00 tx=0x7fc7c4005ac0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/4197947880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0d1ed0 msgr2=0x556a3d0d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 --2- 172.21.15.50:0/4197947880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0d1ed0 0x556a3d0d22f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc7c001cfd0 tx=0x7fc7c0044950 comp rx=0 tx=0).stop 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/4197947880 shutdown_connections 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 --2- 172.21.15.50:0/4197947880 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6a8036af0 0x7fc6a8038fb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 --2- 172.21.15.50:0/4197947880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3d0d1ed0 0x556a3d0d22f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/4197947880 >> 172.21.15.50:0/4197947880 conn(0x556a3d0c5f70 msgr2=0x556a3d0c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/4197947880 shutdown_connections 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/4197947880 wait complete. 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556a3d0c0f30 msgr2=0x556a3d0c3380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x556a3d0c0f30 0x556a3d0c3380 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3cfbc630 msgr2=0x556a3d0ba710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x556a3cfbc630 0x556a3d0ba710 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0bcff0 msgr2=0x556a3d0bf3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x556a3d0bcff0 0x556a3d0bf3e0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6b80368b0 msgr2=0x7fc6b8038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc6b80368b0 0x7fc6b8038d70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4054000 tx=0x7fc7c404e000 comp rx=0 tx=0).stop 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 msgr2=0x556a3d0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 --2- 172.21.15.50:0/1746782375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556a3cfb63c0 0x556a3d0b34d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0000f60 tx=0x7fc7c0000bc0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d130e640 1 -- 172.21.15.50:0/1746782375 reap_dead start 2024-05-07T13:57:58.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 shutdown_connections 2024-05-07T13:57:58.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 >> 172.21.15.50:0/1746782375 conn(0x556a3cfb1d40 msgr2=0x556a3cfb7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 shutdown_connections 2024-05-07T13:57:58.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.227+0000 7fc7d300e800 1 -- 172.21.15.50:0/1746782375 wait complete. 2024-05-07T13:57:58.250 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:58.250 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:58.250 ERROR:root:0 2024-05-07T13:57:58.250 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-07T13:57:58.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-07T13:57:58.251 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-07T13:57:58.298 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:57:58.299 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:57:58.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.312+0000 7f1e30887800 1 Processor -- start 2024-05-07T13:57:58.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.312+0000 7f1e30887800 1 -- start start 2024-05-07T13:57:58.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.312+0000 7f1e30887800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562b20313be0 0x562b20315fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.312+0000 7f1e30887800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b2031a020 con 0x562b20316510 2024-05-07T13:57:58.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.312+0000 7f1e30887800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x562b201a4050 con 0x562b20313be0 2024-05-07T13:57:58.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.312+0000 7f1e2e386640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x562b20313be0 0x562b20315fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.312+0000 7f1e2db85640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x562b20316510 0x562b20318900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:56932/0 (socket says 172.21.15.50:56932) 2024-05-07T13:57:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.312+0000 7f1e2db85640 1 -- 172.21.15.50:0/3389607817 learned_addr learned my addr 172.21.15.50:0/3389607817 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:57:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.313+0000 7f1e2e386640 1 -- 172.21.15.50:0/3389607817 >> v1:172.21.15.22:6789/0 conn(0x562b20316510 legacy=0x562b20318900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.313+0000 7f1e2e386640 1 -- 172.21.15.50:0/3389607817 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2031b200 con 0x562b20313be0 2024-05-07T13:57:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.313+0000 7f1e2d384640 1 -- 172.21.15.50:0/3389607817 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847542229 0 0) 0x562b2031a020 con 0x562b20316510 2024-05-07T13:57:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.314+0000 7f1e2e386640 1 --2- 172.21.15.50:0/3389607817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b20315fd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000a470 tx=0x7f1e2001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70511ab4f81e12c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e2d384640 1 -- 172.21.15.50:0/3389607817 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e20057070 con 0x562b20313be0 2024-05-07T13:57:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e2d384640 1 -- 172.21.15.50:0/3389607817 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e20052570 con 0x562b20313be0 2024-05-07T13:57:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e2d384640 1 -- 172.21.15.50:0/3389607817 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e20052870 con 0x562b20313be0 2024-05-07T13:57:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e30887800 1 -- 172.21.15.50:0/3389607817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 msgr2=0x562b20315fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e30887800 1 --2- 172.21.15.50:0/3389607817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b20315fd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000a470 tx=0x7f1e2001ce90 comp rx=0 tx=0).stop 2024-05-07T13:57:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e30887800 1 -- 172.21.15.50:0/3389607817 shutdown_connections 2024-05-07T13:57:58.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e30887800 1 --2- 172.21.15.50:0/3389607817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b20315fd0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e30887800 1 -- 172.21.15.50:0/3389607817 >> 172.21.15.50:0/3389607817 conn(0x562b2030d5b0 msgr2=0x562b2030f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e30887800 1 -- 172.21.15.50:0/3389607817 shutdown_connections 2024-05-07T13:57:58.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.315+0000 7f1e30887800 1 -- 172.21.15.50:0/3389607817 wait complete. 2024-05-07T13:57:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.333+0000 7f1e30887800 1 Processor -- start 2024-05-07T13:57:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.333+0000 7f1e30887800 1 -- start start 2024-05-07T13:57:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.333+0000 7f1e30887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b204044a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.333+0000 7f1e30887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b2025e1c0 con 0x562b20313be0 2024-05-07T13:57:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.334+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b204044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.334+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b204044a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59354/0 (socket says 172.21.15.50:59354) 2024-05-07T13:57:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.334+0000 7f1e2e386640 1 -- 172.21.15.50:0/789049242 learned_addr learned my addr 172.21.15.50:0/789049242 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.334+0000 7f1e2e386640 1 -- 172.21.15.50:0/789049242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b20404a70 con 0x562b20313be0 2024-05-07T13:57:58.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.334+0000 7f1e2e386640 1 --2- 172.21.15.50:0/789049242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b204044a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1e20055040 tx=0x7f1e2004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cded6026006a51 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.334+0000 7f1d1c608640 1 -- 172.21.15.50:0/789049242 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e20062070 con 0x562b20313be0 2024-05-07T13:57:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.334+0000 7f1d1c608640 1 -- 172.21.15.50:0/789049242 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e200528d0 con 0x562b20313be0 2024-05-07T13:57:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.334+0000 7f1d1c608640 1 -- 172.21.15.50:0/789049242 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e20057040 con 0x562b20313be0 2024-05-07T13:57:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.335+0000 7f1e30887800 1 -- 172.21.15.50:0/789049242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 msgr2=0x562b204044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.335+0000 7f1e30887800 1 --2- 172.21.15.50:0/789049242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b204044a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1e20055040 tx=0x7f1e2004c000 comp rx=0 tx=0).stop 2024-05-07T13:57:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.335+0000 7f1e30887800 1 -- 172.21.15.50:0/789049242 shutdown_connections 2024-05-07T13:57:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.335+0000 7f1e30887800 1 --2- 172.21.15.50:0/789049242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b204044a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.335+0000 7f1e30887800 1 -- 172.21.15.50:0/789049242 >> 172.21.15.50:0/789049242 conn(0x562b2030d5b0 msgr2=0x562b203ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.335+0000 7f1e30887800 1 -- 172.21.15.50:0/789049242 shutdown_connections 2024-05-07T13:57:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.335+0000 7f1e30887800 1 -- 172.21.15.50:0/789049242 wait complete. 2024-05-07T13:57:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.336+0000 7f1e30887800 1 Processor -- start 2024-05-07T13:57:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.336+0000 7f1e30887800 1 -- start start 2024-05-07T13:57:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.336+0000 7f1e30887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b2040be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.336+0000 7f1e30887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b2031a4f0 con 0x562b20313be0 2024-05-07T13:57:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.336+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b2040be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.336+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b2040be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59366/0 (socket says 172.21.15.50:59366) 2024-05-07T13:57:58.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.336+0000 7f1e2e386640 1 -- 172.21.15.50:0/1105597149 learned_addr learned my addr 172.21.15.50:0/1105597149 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.336+0000 7f1e2e386640 1 -- 172.21.15.50:0/1105597149 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2040c3c0 con 0x562b20313be0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.337+0000 7f1e2e386640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b2040be80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1e20000c00 tx=0x7f1e20002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.337+0000 7f1d1ae05640 1 -- 172.21.15.50:0/1105597149 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e20057050 con 0x562b20313be0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.337+0000 7f1d1ae05640 1 -- 172.21.15.50:0/1105597149 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e20067660 con 0x562b20313be0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.337+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b2040c650 con 0x562b20313be0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.337+0000 7f1d1ae05640 1 -- 172.21.15.50:0/1105597149 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e20062040 con 0x562b20313be0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.337+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2040f300 con 0x562b20313be0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.338+0000 7f1d1ae05640 1 -- 172.21.15.50:0/1105597149 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e20067940 con 0x562b20313be0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.338+0000 7f1d1ae05640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d14036900 0x7f1d14038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.338+0000 7f1d1ae05640 1 -- 172.21.15.50:0/1105597149 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1e2008e600 con 0x562b20313be0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.338+0000 7f1e2db85640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d14036900 0x7f1d14038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.338+0000 7f1e30887800 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b20316510 0x562b204130c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.338+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20413640 con 0x562b20316510 2024-05-07T13:57:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.338+0000 7f1e2eb87640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b20316510 0x562b204130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.338+0000 7f1e2db85640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d14036900 0x7f1d14038dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1e24000c00 tx=0x7f1e240013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.339+0000 7f1e2eb87640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b20316510 0x562b204130c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.339+0000 7f1e2eb87640 1 -- 172.21.15.50:0/1105597149 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b20316510 2024-05-07T13:57:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.339+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20410670 con 0x562b20316510 2024-05-07T13:57:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.339+0000 7f1e2eb87640 1 -- 172.21.15.50:0/1105597149 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b20316510 2024-05-07T13:57:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.339+0000 7f1e30887800 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b20415950 0x562b20417d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.339+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20418430 con 0x562b20415950 2024-05-07T13:57:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.339+0000 7f1e2e386640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b20415950 0x562b20417d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.340+0000 7f1e2e386640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b20415950 0x562b20417d40 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.340+0000 7f1e2e386640 1 -- 172.21.15.50:0/1105597149 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e20064070 con 0x562b20415950 2024-05-07T13:57:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.340+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b204148d0 con 0x562b20316510 2024-05-07T13:57:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.340+0000 7f1e2eb87640 1 -- 172.21.15.50:0/1105597149 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b20316510 2024-05-07T13:57:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.340+0000 7f1e30887800 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562b20419890 0x562b2041bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.340+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b2041c460 con 0x562b20419890 2024-05-07T13:57:58.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.340+0000 7f1e2db85640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562b20419890 0x562b2041bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.341+0000 7f1e2db85640 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562b20419890 0x562b2041bd00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.341+0000 7f1e2db85640 1 -- 172.21.15.50:0/1105597149 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e2400f670 con 0x562b20419890 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.341+0000 7f1e30887800 1 Processor -- start 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.341+0000 7f1e30887800 1 -- start start 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.341+0000 7f1e30887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2042a8c0 0x562b2042ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.341+0000 7f1e30887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b20204cf0 con 0x562b2042a8c0 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2042a8c0 0x562b2042ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2042a8c0 0x562b2042ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59372/0 (socket says 172.21.15.50:59372) 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1e2e386640 1 -- 172.21.15.50:0/1024015804 learned_addr learned my addr 172.21.15.50:0/1024015804 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1e2e386640 1 -- 172.21.15.50:0/1024015804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2042b220 con 0x562b2042a8c0 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1e2e386640 1 --2- 172.21.15.50:0/1024015804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2042a8c0 0x562b2042ace0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1e2005b500 tx=0x7f1e20066bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1d13fff640 1 -- 172.21.15.50:0/1024015804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e20006380 con 0x562b2042a8c0 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1d13fff640 1 -- 172.21.15.50:0/1024015804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2008b170 con 0x562b2042a8c0 2024-05-07T13:57:58.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1e30887800 1 -- 172.21.15.50:0/1024015804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b2042b220 con 0x562b2042a8c0 2024-05-07T13:57:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1d13fff640 1 -- 172.21.15.50:0/1024015804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e20006520 con 0x562b2042a8c0 2024-05-07T13:57:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.342+0000 7f1e30887800 1 -- 172.21.15.50:0/1024015804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2042b220 con 0x562b2042a8c0 2024-05-07T13:57:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.343+0000 7f1d13fff640 1 -- 172.21.15.50:0/1024015804 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e2008e0b0 con 0x562b2042a8c0 2024-05-07T13:57:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.343+0000 7f1d13fff640 1 --2- 172.21.15.50:0/1024015804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d08036950 0x7f1d08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.343+0000 7f1d13fff640 1 -- 172.21.15.50:0/1024015804 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1e20084050 con 0x562b2042a8c0 2024-05-07T13:57:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.343+0000 7f1e2db85640 1 --2- 172.21.15.50:0/1024015804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d08036950 0x7f1d08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.344+0000 7f1e30887800 1 Processor -- start 2024-05-07T13:57:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.344+0000 7f1e2db85640 1 --2- 172.21.15.50:0/1024015804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d08036950 0x7f1d08038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x562b20413f00 tx=0x7f1e24006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.344+0000 7f1e30887800 1 -- start start 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.344+0000 7f1e30887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b203135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.344+0000 7f1e30887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b20404d30 con 0x562b203131d0 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.344+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b203135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.344+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b203135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59382/0 (socket says 172.21.15.50:59382) 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.344+0000 7f1e2e386640 1 -- 172.21.15.50:0/1532826790 learned_addr learned my addr 172.21.15.50:0/1532826790 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.344+0000 7f1e2e386640 1 -- 172.21.15.50:0/1532826790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b203119d0 con 0x562b203131d0 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1e2e386640 1 --2- 172.21.15.50:0/1532826790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b203135f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1e2007a080 tx=0x7f1e20081ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ce719fe7d3784f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1d11ffb640 1 -- 172.21.15.50:0/1532826790 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e200a6070 con 0x562b203131d0 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1d11ffb640 1 -- 172.21.15.50:0/1532826790 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e20087430 con 0x562b203131d0 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1d11ffb640 1 -- 172.21.15.50:0/1532826790 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e200973a0 con 0x562b203131d0 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1e30887800 1 -- 172.21.15.50:0/1532826790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 msgr2=0x562b203135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1e30887800 1 --2- 172.21.15.50:0/1532826790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b203135f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1e2007a080 tx=0x7f1e20081ef0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1e30887800 1 -- 172.21.15.50:0/1532826790 shutdown_connections 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1e30887800 1 --2- 172.21.15.50:0/1532826790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b203135f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1e30887800 1 -- 172.21.15.50:0/1532826790 >> 172.21.15.50:0/1532826790 conn(0x562b20433960 msgr2=0x562b204319c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1e30887800 1 -- 172.21.15.50:0/1532826790 shutdown_connections 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.345+0000 7f1e30887800 1 -- 172.21.15.50:0/1532826790 wait complete. 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.346+0000 7f1e30887800 1 Processor -- start 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.346+0000 7f1e30887800 1 -- start start 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.346+0000 7f1e30887800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b20440b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.346+0000 7f1e30887800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b20311de0 con 0x562b203131d0 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.346+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b20440b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.346+0000 7f1e2e386640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b20440b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59394/0 (socket says 172.21.15.50:59394) 2024-05-07T13:57:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.346+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 learned_addr learned my addr 172.21.15.50:0/559016994 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:57:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.346+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b204410b0 con 0x562b203131d0 2024-05-07T13:57:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.347+0000 7f1e2e386640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b20440b70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1e2005cfd0 tx=0x7f1e20080210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.347+0000 7f1cfffff640 1 -- 172.21.15.50:0/559016994 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e200b0070 con 0x562b203131d0 2024-05-07T13:57:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.347+0000 7f1cfffff640 1 -- 172.21.15.50:0/559016994 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2008b450 con 0x562b203131d0 2024-05-07T13:57:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.347+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b204410b0 con 0x562b203131d0 2024-05-07T13:57:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.347+0000 7f1cfffff640 1 -- 172.21.15.50:0/559016994 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e200a6040 con 0x562b203131d0 2024-05-07T13:57:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.347+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b204410b0 con 0x562b203131d0 2024-05-07T13:57:58.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.348+0000 7f1cfffff640 1 -- 172.21.15.50:0/559016994 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e200b3070 con 0x562b203131d0 2024-05-07T13:57:58.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.348+0000 7f1cfffff640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1cf8036950 0x7f1cf8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.348+0000 7f1cfffff640 1 -- 172.21.15.50:0/559016994 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f1e200b6d70 con 0x562b203131d0 2024-05-07T13:57:58.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.349+0000 7f1e2db85640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1cf8036950 0x7f1cf8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.349+0000 7f1e2db85640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1cf8036950 0x7f1cf8038e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400ffd0 tx=0x7f1e24023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.350+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.350+0000 7f1e30887800 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b2044c2b0 0x562b2044e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.350+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b2044eec0 con 0x562b2044c2b0 2024-05-07T13:57:58.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.350+0000 7f1e2eb87640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b2044c2b0 0x562b2044e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.350+0000 7f1e2eb87640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b2044c2b0 0x562b2044e770 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 20 realm 2024-05-07T13:57:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b2044f2d0 con 0x562b2044c2b0 2024-05-07T13:57:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:57:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b2044f6f0 con 0x562b2044c2b0 2024-05-07T13:57:58.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:58.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.351+0000 7f1e30887800 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b204509b0 0x562b20452da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.352+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20453490 con 0x562b204509b0 2024-05-07T13:57:58.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.352+0000 7f1e2e386640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b204509b0 0x562b20452da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.352+0000 7f1e2e386640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b204509b0 0x562b20452da0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.352+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.352+0000 7f1e30887800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:57:58.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.352+0000 7f1e30887800 20 searching for the correct realm 2024-05-07T13:57:58.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.352+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b20454de0 con 0x562b204509b0 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.353+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.353+0000 7f1e2e386640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e200b5070 0x7f1e20087650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.353+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b20454de0 con 0x7f1e200b5070 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.353+0000 7f1e2db85640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e200b5070 0x7f1e20087650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.353+0000 7f1e2db85640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e200b5070 0x7f1e20087650 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.353+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.354+0000 7f1e2db85640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e2402e910 0x7f1e2403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.354+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b20454de0 con 0x7f1e2402e910 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.354+0000 7f1e2eb87640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e2402e910 0x7f1e2403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.354+0000 7f1e2eb87640 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e2402e910 0x7f1e2403a3c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.355+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.355+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.355+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.355+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.355+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.355+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.355+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.355+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e2402e910 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.356+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.356+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e200b5070 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.356+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.356+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e200b5070 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.356+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.356+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.356+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.356+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e2402e910 2024-05-07T13:57:58.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.357+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.357+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.357+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.357+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e200b5070 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.357+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.357+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b204509b0 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.357+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.357+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b204509b0 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.357+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.358+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e2402e910 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.358+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.358+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b204509b0 2024-05-07T13:57:58.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.358+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.358+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b204509b0 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.358+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.358+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.359+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.359+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.359+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.359+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e2402e910 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.359+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.359+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b204509b0 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.359+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.359+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e200b5070 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.360+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.360+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.360+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.360+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e2402e910 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.360+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.360+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b204509b0 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.360+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.360+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e2402e910 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.361+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.361+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e200b5070 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.361+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.361+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b204509b0 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e200b5070 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x562b2044c2b0 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562b2044ff90 con 0x7f1e200b5070 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e30887800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e30887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e30887800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e30887800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e30887800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:57:58.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e30887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.362+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20453d50 con 0x562b2044c2b0 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20454140 con 0x562b2044c2b0 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20454140 con 0x7f1e2402e910 2024-05-07T13:57:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 20 zone default found 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 4 Realm: () 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 20 zonegroup default 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.363+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20454660 con 0x7f1e2402e910 2024-05-07T13:57:58.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20454660 con 0x562b204509b0 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20456dc0 con 0x562b204509b0 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:57:58.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 20 started sync module instance, tier type = 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.364+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b204560e0 con 0x7f1e200b5070 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.365+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.365+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94743225001168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20455d40 con 0x7f1e200b5070 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.365+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20457bc0 con 0x562b2044c2b0 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.366+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94743225001168] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.367+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.367+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94743225004576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20457fb0 con 0x562b2044c2b0 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.367+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20458630 con 0x562b204509b0 2024-05-07T13:57:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.368+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94743225004576] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.368+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.368+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94743225005632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20458f00 con 0x562b204509b0 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.368+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b204598c0 con 0x7f1e200b5070 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.369+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94743225005632] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.369+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.369+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94743225010768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20458e70 con 0x7f1e200b5070 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.369+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045a730 con 0x562b2044c2b0 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.370+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94743225010768] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.371+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.371+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94743225016960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045a6a0 con 0x562b2044c2b0 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.371+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045b5f0 con 0x7f1e2402e910 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.372+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94743225016960] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.372+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.372+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94743225019088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045b5f0 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.372+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045c000 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.373+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94743225019088] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.373+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(56 notify.6 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.373+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94743225021216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045c000 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.373+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045c9c0 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.374+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94743225021216] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.374+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.374+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94743225023312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045cba0 con 0x7f1e2402e910 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.375+0000 7f1e30887800 20 add_watcher() i=0 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.375+0000 7f1e30887800 20 add_watcher() i=1 2024-05-07T13:57:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.375+0000 7f1e30887800 20 add_watcher() i=2 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.375+0000 7f1e30887800 20 add_watcher() i=3 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.375+0000 7f1e30887800 20 add_watcher() i=4 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.375+0000 7f1e30887800 20 add_watcher() i=5 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.375+0000 7f1e30887800 20 add_watcher() i=6 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.375+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94743225023312] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.376+0000 7f1e30887800 20 add_watcher() i=7 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.376+0000 7f1e30887800 2 all 8 watchers are set, enabling cache 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.376+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b2045fd30 con 0x562b2044c2b0 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.376+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.376+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94743225038560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045caf0 con 0x562b2044c2b0 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.377+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94743225038560] v29'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.377+0000 7f1ce4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.377+0000 7f1e30887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.377+0000 7f1e30887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.377+0000 7f1e30887800 5 note: GC not initialized 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.377+0000 7f1c5f7fe640 20 reqs_thread_entry: start 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.377+0000 7f1e30887800 20 init_complete bucket index max shards: 11 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.377+0000 7f1e30887800 20 Filter name: none 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1c5d7fa640 20 reqs_thread_entry: start 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1e30887800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1e30887800 20 rados->read ofs=0 len=0 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20493340 con 0x7f1e2402e910 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1e30887800 20 rados_obj.operate() r=0 bl.length=473 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1e30887800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1e30887800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1e30887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-07T13:57:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.378+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20499910 con 0x7f1e2402e910 2024-05-07T13:57:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.379+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v29'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.379+0000 7f1e30887800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.379+0000 7f1e30887800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.379+0000 7f1e30887800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-07T13:57:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.379+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94743225275264 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562b20498460 con 0x562b2044c2b0 2024-05-07T13:57:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.380+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== watch-notify(notify (1) cookie 94743225016960 notify 124554051615 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f1e2803d040 con 0x562b2044c2b0 2024-05-07T13:57:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.380+0000 7f1d11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051615 cookie 94743225016960 notifier 4915 bl.length()=649 2024-05-07T13:57:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.380+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(64 notify.4 [notify cookie 94743225275264 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.380+0000 7f1d11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-07T13:57:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.380+0000 7f1d11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-07T13:57:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.380+0000 7f1d11ffb640 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1cf4003ea0 con 0x562b2044c2b0 2024-05-07T13:57:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.380+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.380+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== watch-notify(notify_complete (2) cookie 94743225275264 notify 124554051615 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1e2802f040 con 0x562b2044c2b0 2024-05-07T13:57:58.383 INFO:teuthology.orchestra.run.smithi050.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-07T13:57:56.308734Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-07T13:57:56.308716Z","tags":[],"group_ids":[]} 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.381+0000 7f1ce4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.381+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94743225038560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20498c20 con 0x562b2044c2b0 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.382+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94743225038560] v29'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.382+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94743225001168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20498c20 con 0x7f1e200b5070 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.383+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94743225001168] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.383+0000 7f1e30887800 20 remove_watcher() i=0 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.383+0000 7f1e30887800 2 removed watcher, disabling cache 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.383+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94743225004576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b204564d0 con 0x562b2044c2b0 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.384+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94743225004576] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.384+0000 7f1e30887800 20 remove_watcher() i=1 2024-05-07T13:57:58.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.384+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94743225005632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20457220 con 0x562b204509b0 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.385+0000 7f1e2e386640 1 -- 172.21.15.50:0/559016994 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94743225005632] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e200bc070 con 0x562b204509b0 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.385+0000 7f1e30887800 20 remove_watcher() i=2 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.385+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94743225010768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b204564d0 con 0x7f1e200b5070 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.387+0000 7f1e2db85640 1 -- 172.21.15.50:0/559016994 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94743225010768] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e24037040 con 0x7f1e200b5070 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.387+0000 7f1e30887800 20 remove_watcher() i=3 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.387+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94743225016960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20458a50 con 0x562b2044c2b0 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.388+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94743225016960] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x562b2044c2b0 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.388+0000 7f1e30887800 20 remove_watcher() i=4 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.388+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94743225019088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045a280 con 0x7f1e2402e910 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.389+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94743225019088] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.389+0000 7f1e30887800 20 remove_watcher() i=5 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.389+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94743225021216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b20458a50 con 0x7f1e2402e910 2024-05-07T13:57:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.390+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94743225021216] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.390+0000 7f1e30887800 20 remove_watcher() i=6 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.390+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94743225023312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562b2045a280 con 0x7f1e2402e910 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94743225023312] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2800a4a0 con 0x7f1e2402e910 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 20 remove_watcher() i=7 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e2402e910 msgr2=0x7f1e2403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f1e2402e910 0x7f1e2403a3c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b2044c2b0 msgr2=0x562b2044e770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b2044c2b0 0x562b2044e770 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e200b5070 msgr2=0x7f1e20087650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f1e200b5070 0x7f1e20087650 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b204509b0 msgr2=0x562b20452da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b204509b0 0x562b20452da0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1cf8036950 msgr2=0x7f1cf8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.391+0000 7f1e30887800 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1cf8036950 0x7f1cf8038e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400ffd0 tx=0x7f1e24023040 comp rx=0 tx=0).stop 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e2eb87640 1 -- 172.21.15.50:0/559016994 reap_dead start 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 msgr2=0x562b20440b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b20440b70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1e2005cfd0 tx=0x7f1e20080210 comp rx=0 tx=0).stop 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 shutdown_connections 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 --2- 172.21.15.50:0/559016994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b203131d0 0x562b20440b70 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 >> 172.21.15.50:0/559016994 conn(0x562b20433960 msgr2=0x562b20430fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 shutdown_connections 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/559016994 wait complete. 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/1024015804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d08036950 msgr2=0x7f1d08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 --2- 172.21.15.50:0/1024015804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d08036950 0x7f1d08038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x562b20413f00 tx=0x7f1e24006000 comp rx=0 tx=0).stop 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/1024015804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2042a8c0 msgr2=0x562b2042ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 --2- 172.21.15.50:0/1024015804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2042a8c0 0x562b2042ace0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1e2005b500 tx=0x7f1e20066bb0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/1024015804 shutdown_connections 2024-05-07T13:57:58.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 --2- 172.21.15.50:0/1024015804 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d08036950 0x7f1d08038e10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 --2- 172.21.15.50:0/1024015804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b2042a8c0 0x562b2042ace0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/1024015804 >> 172.21.15.50:0/1024015804 conn(0x562b2041e960 msgr2=0x562b2041ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/1024015804 shutdown_connections 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/1024015804 wait complete. 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562b20419890 msgr2=0x562b2041bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x562b20419890 0x562b2041bd00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b20316510 msgr2=0x562b204130c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x562b20316510 0x562b204130c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b20415950 msgr2=0x562b20417d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.392+0000 7f1e30887800 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x562b20415950 0x562b20417d40 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.393+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d14036900 msgr2=0x7f1d14038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.393+0000 7f1e30887800 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f1d14036900 0x7f1d14038dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1e24000c00 tx=0x7f1e240013b0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.393+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 msgr2=0x562b2040be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:57:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.393+0000 7f1e30887800 1 --2- 172.21.15.50:0/1105597149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b20313be0 0x562b2040be80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1e20000c00 tx=0x7f1e20002fb0 comp rx=0 tx=0).stop 2024-05-07T13:57:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.393+0000 7f1e2eb87640 1 -- 172.21.15.50:0/1105597149 reap_dead start 2024-05-07T13:57:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.393+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 shutdown_connections 2024-05-07T13:57:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.393+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 >> 172.21.15.50:0/1105597149 conn(0x562b2030d5b0 msgr2=0x562b203fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:57:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.393+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 shutdown_connections 2024-05-07T13:57:58.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:57:58.393+0000 7f1e30887800 1 -- 172.21.15.50:0/1105597149 wait complete. 2024-05-07T13:57:58.395 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:58.395 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-07T13:57:56.308734Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-07T13:57:56.308716Z', 'tags': [], 'group_ids': []} 2024-05-07T13:57:58.396 ERROR:root:0 2024-05-07T13:57:58.396 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-07T13:57:58.404 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.404 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.408 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.409 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-07T13:57:58.414 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.415 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.418 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.418 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-05-07T13:57:58.426 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-05-07T13:57:58.426 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.430 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.430 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-05-07T13:57:58.437 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:57:58.438 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.443 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.443 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-05-07T13:57:58.450 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-05-07T13:57:58.450 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.454 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.454 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-05-07T13:57:58.462 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-05-07T13:57:58.462 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.466 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.466 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-05-07T13:57:58.475 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:57:58.475 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.479 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.479 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-05-07T13:57:58.484 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:57:58.484 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.488 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.488 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-05-07T13:57:58.494 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:57:58.495 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.498 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.499 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.503 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-07T13:57:58.504 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-07T13:57:58.507 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-07T13:57:58.519 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-07T13:57:58.523 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-05-07T13:57:58.523 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-07T13:57:58.528 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '02b45de7-8fca-4685-ae50-761ba20a02e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-07T13:57:58.527808Z', 'creation_time': '2024-05-07T13:57:58.525200Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-07T13:57:58.528 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-07T13:57:58.533 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '02b45de7-8fca-4685-ae50-761ba20a02e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-07T13:57:58.527808Z', 'creation_time': '2024-05-07T13:57:58.525200Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-07T13:57:58.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-07T13:57:58.544 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '02b45de7-8fca-4685-ae50-761ba20a02e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-07T13:57:58.527808Z', 'creation_time': '2024-05-07T13:57:58.525200Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-07T13:57:58.544 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-05-07T13:57:58.548 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000720e3343bc585ae4-00663a3366-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:57:58.554 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-05-07T13:57:58.560 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:57:58.561 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-05-07T13:57:58.569 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:57:58.619 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11'} 2024-05-07T13:57:58.628 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:57:58.631 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11'} 2024-05-07T13:57:58.640 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:57:58.640 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-05-07T13:57:58.651 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:57:58.657 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-05-07T13:57:58.664 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:57:58.664 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-07T13:57:58.668 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '02b45de7-8fca-4685-ae50-761ba20a02e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11', 'marker': '2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-07T13:57:58.649155Z', 'creation_time': '2024-05-07T13:57:58.525200Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-07T13:58:58.714 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-05-07T13:58:58.734 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-05-07T13:58:58.735 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-05-07T13:58:58.751 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-05-07T13:58:58.751 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-07T13:58:58.756 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-05-07T13:58:58.757 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-05-07T13:58:58.761 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-05-07T13:58:58.762 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-05-07T13:58:58.766 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-05-07T13:58:58.767 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-05-07T13:58:58.771 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-05-07T13:58:58.771 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-05-07T13:58:58.775 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-05-07T13:00:00.000000Z', 'epoch': 1715086800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-05-07T13:58:58.776 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-05-07T13:58:58.783 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:58:58.783 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-07T13:58:58.787 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-05-07T13:58:58.788 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-07T13:58:58.798 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:58:58.802 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-07T13:58:58.811 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:58:59.094 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-07T13:58:59.099 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000c591f0d34a6ef122-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.199 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-07T13:58:59.205 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-07T13:58:59.219 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-07T13:58:59.227 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-07T13:58:59.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-05-07T13:58:59.405 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:58:59.405 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-07T13:58:59.418 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-05-07T13:58:59.418 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-07T13:58:59.434 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-07T13:58:59.444 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-07T13:58:59.453 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000f5eb7ee818073572-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.475 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-05-07T13:58:59.507 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:58:59.507 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-07T13:58:59.512 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000a72e81a59fcbe303-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.513 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-05-07T13:58:59.519 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '454556b8-fea2-4140-96b4-1e350fef55bd'}]}} 2024-05-07T13:58:59.520 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-05-07T13:58:59.534 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-07T13:58:59.534 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-07T13:58:59.553 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-07T13:58:59.553 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-05-07T13:58:59.563 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000007ee1847293f8eca2-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.563 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-05-07T13:58:59.572 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000007670f4020985504f-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.584 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-07T13:58:59.590 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-07T13:58:59.590 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-05-07T13:58:59.596 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000eb6d2b3beab1f6f7-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.596 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-05-07T13:58:59.605 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000007c446993edcf087d-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.605 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-05-07T13:58:59.612 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-07T13:58:59.612 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-05-07T13:58:59.616 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b9bcf423e18fca1d-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.617 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-05-07T13:58:59.621 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000bfe03d18b618463b-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.621 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-05-07T13:58:59.625 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000a583a97d37ccac18-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-05-07T13:58:59.629 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000006c8ff5d10c68b903-00663a33a3-4222-default', 'HostId': '4222-default-default'} 2024-05-07T13:58:59.629 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-05-07T13:58:59.639 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:58:59.639 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-07T13:58:59.645 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-05-07T13:58:59.646 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-05-07T13:58:59.652 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:58:59.652 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-07T13:58:59.656 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-05-07T13:58:59.657 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-05-07T13:58:59.663 INFO:tasks.radosgw_admin_rest: empty result 2024-05-07T13:58:59.668 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-07T13:58:59.680 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-07T13:58:59.680 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T13:58:59.681 INFO:tasks.rgw.client.0.smithi050.stdout:2024-05-07T13:58:59.693+0000 7f9e4706e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 34271) UID: 0 2024-05-07T13:58:59.681 INFO:tasks.rgw.client.0.smithi050.stdout:2024-05-07T13:58:59.693+0000 7f9e4a8c7880 -1 shutting down 2024-05-07T13:59:00.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-07T13:59:05.782 INFO:tasks.rgw.client.0:Stopped 2024-05-07T13:59:05.782 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-07T13:59:05.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/vault-root-token 2024-05-07T13:59:05.871 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~6s 2024-05-07T13:59:05.876 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-07T13:59:05.947 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-07T13:59:05.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-07T13:59:05.948 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-07T13:59:06.039 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setuser ceph since I am not root 2024-05-07T13:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:ignoring --setgroup ceph since I am not root 2024-05-07T13:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.053+0000 7f4c75f2f800 1 Processor -- start 2024-05-07T13:59:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.053+0000 7f4c75f2f800 1 -- start start 2024-05-07T13:59:06.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.054+0000 7f4c75f2f800 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561cf68f2750 0x561cf68f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.054+0000 7f4c75f2f800 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561cf68f5080 con 0x561cf68eec40 2024-05-07T13:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.054+0000 7f4c75f2f800 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x561cf677f050 con 0x561cf68f2750 2024-05-07T13:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.054+0000 7f4c713b4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x561cf68f2750 0x561cf68f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.054+0000 7f4c71bb5640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x561cf68eec40 0x561cf68f1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.50:60132/0 (socket says 172.21.15.50:60132) 2024-05-07T13:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.054+0000 7f4c71bb5640 1 -- 172.21.15.50:0/2893830291 learned_addr learned my addr 172.21.15.50:0/2893830291 (peer_addr_for_me v1:172.21.15.50:0/0) 2024-05-07T13:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.054+0000 7f4c70bb3640 1 -- 172.21.15.50:0/2893830291 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740782496 0 0) 0x561cf68f5080 con 0x561cf68eec40 2024-05-07T13:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.054+0000 7f4c70bb3640 1 -- 172.21.15.50:0/2893830291 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c60001e10 con 0x561cf68eec40 2024-05-07T13:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.055+0000 7f4c713b4640 1 -- 172.21.15.50:0/2893830291 >> v1:172.21.15.22:6789/0 conn(0x561cf68eec40 legacy=0x561cf68f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.055+0000 7f4c713b4640 1 -- 172.21.15.50:0/2893830291 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf68f6260 con 0x561cf68f2750 2024-05-07T13:59:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c713b4640 1 --2- 172.21.15.50:0/2893830291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68f2750 0x561cf68f4b40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00a470 tx=0x7f4c5c01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96cdf95efe5c276 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c70bb3640 1 -- 172.21.15.50:0/2893830291 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c5c057070 con 0x561cf68f2750 2024-05-07T13:59:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c70bb3640 1 -- 172.21.15.50:0/2893830291 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5c052570 con 0x561cf68f2750 2024-05-07T13:59:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c70bb3640 1 -- 172.21.15.50:0/2893830291 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c5c052870 con 0x561cf68f2750 2024-05-07T13:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2893830291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68f2750 msgr2=0x561cf68f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2893830291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68f2750 0x561cf68f4b40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00a470 tx=0x7f4c5c01cdb0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2893830291 shutdown_connections 2024-05-07T13:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2893830291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68f2750 0x561cf68f4b40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2893830291 >> 172.21.15.50:0/2893830291 conn(0x561cf68e85b0 msgr2=0x561cf68ea9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.057+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2893830291 shutdown_connections 2024-05-07T13:59:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.058+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2893830291 wait complete. 2024-05-07T13:59:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.075+0000 7f4c75f2f800 1 Processor -- start 2024-05-07T13:59:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.075+0000 7f4c75f2f800 1 -- start start 2024-05-07T13:59:06.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.075+0000 7f4c75f2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69df4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.075+0000 7f4c75f2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561cf68391d0 con 0x561cf68eec40 2024-05-07T13:59:06.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.075+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69df4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.075+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69df4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59758/0 (socket says 172.21.15.50:59758) 2024-05-07T13:59:06.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.075+0000 7f4c71bb5640 1 -- 172.21.15.50:0/1469340915 learned_addr learned my addr 172.21.15.50:0/1469340915 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:59:06.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.076+0000 7f4c71bb5640 1 -- 172.21.15.50:0/1469340915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf69dfaa0 con 0x561cf68eec40 2024-05-07T13:59:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.076+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/1469340915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69df4d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4c64001de0 tx=0x7f4c6400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b264852381326af0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.076+0000 7f4b5fe07640 1 -- 172.21.15.50:0/1469340915 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64012020 con 0x561cf68eec40 2024-05-07T13:59:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.076+0000 7f4b5fe07640 1 -- 172.21.15.50:0/1469340915 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6400e5a0 con 0x561cf68eec40 2024-05-07T13:59:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.076+0000 7f4b5fe07640 1 -- 172.21.15.50:0/1469340915 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6400e900 con 0x561cf68eec40 2024-05-07T13:59:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1469340915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 msgr2=0x561cf69df4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/1469340915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69df4d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4c64001de0 tx=0x7f4c6400b6c0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1469340915 shutdown_connections 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/1469340915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69df4d0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1469340915 >> 172.21.15.50:0/1469340915 conn(0x561cf68e85b0 msgr2=0x561cf69dadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1469340915 shutdown_connections 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1469340915 wait complete. 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 Processor -- start 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 -- start start 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69e7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.077+0000 7f4c75f2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561cf68f54f0 con 0x561cf68eec40 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.078+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.078+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69e7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59770/0 (socket says 172.21.15.50:59770) 2024-05-07T13:59:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.078+0000 7f4c71bb5640 1 -- 172.21.15.50:0/2108204652 learned_addr learned my addr 172.21.15.50:0/2108204652 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:59:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.078+0000 7f4c71bb5640 1 -- 172.21.15.50:0/2108204652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf69e7650 con 0x561cf68eec40 2024-05-07T13:59:06.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.078+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69e7110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400c010 tx=0x7f4c64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.079+0000 7f4b5e604640 1 -- 172.21.15.50:0/2108204652 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64012030 con 0x561cf68eec40 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.079+0000 7f4b5e604640 1 -- 172.21.15.50:0/2108204652 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6401a7a0 con 0x561cf68eec40 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.079+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cf69e78e0 con 0x561cf68eec40 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.079+0000 7f4b5e604640 1 -- 172.21.15.50:0/2108204652 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6401a950 con 0x561cf68eec40 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.079+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf69ea540 con 0x561cf68eec40 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.080+0000 7f4b5e604640 1 -- 172.21.15.50:0/2108204652 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4c64015020 con 0x561cf68eec40 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.080+0000 7f4b5e604640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b58036950 0x7f4b58038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.080+0000 7f4b5e604640 1 -- 172.21.15.50:0/2108204652 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4c64020030 con 0x561cf68eec40 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.080+0000 7f4c713b4640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b58036950 0x7f4b58038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.080+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf68f2750 0x561cf69ee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.080+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf69ee840 con 0x561cf68f2750 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.080+0000 7f4c723b6640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf68f2750 0x561cf69ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.080+0000 7f4c713b4640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b58036950 0x7f4b58038e10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c054000 tx=0x7f4c5c04e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.081+0000 7f4c723b6640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf68f2750 0x561cf69ee300 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.081+0000 7f4c723b6640 1 -- 172.21.15.50:0/2108204652 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf68f2750 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.081+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf69eb8d0 con 0x561cf68f2750 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.081+0000 7f4c723b6640 1 -- 172.21.15.50:0/2108204652 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf68f2750 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.081+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf69f0b90 0x561cf69f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.081+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:3 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf69f3670 con 0x561cf69f0b90 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.081+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf69f0b90 0x561cf69f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.082+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf69f0b90 0x561cf69f2f80 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.082+0000 7f4c71bb5640 1 -- 172.21.15.50:0/2108204652 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(3 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c6400dcd0 con 0x561cf69f0b90 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.082+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf69efb40 con 0x561cf68f2750 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.083+0000 7f4c723b6640 1 -- 172.21.15.50:0/2108204652 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf68f2750 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.083+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561cf69f4b20 0x561cf69f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.083+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:5 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf69f76d0 con 0x561cf69f4b20 2024-05-07T13:59:06.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.083+0000 7f4c713b4640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561cf69f4b20 0x561cf69f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.084+0000 7f4c713b4640 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561cf69f4b20 0x561cf69f6f70 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.084+0000 7f4c713b4640 1 -- 172.21.15.50:0/2108204652 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(5 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c5c05a040 con 0x561cf69f4b20 2024-05-07T13:59:06.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.084+0000 7f4c75f2f800 1 Processor -- start 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.084+0000 7f4c75f2f800 1 -- start start 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4c75f2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf6a05a50 0x561cf6a05e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4c75f2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561cf67dfcf0 con 0x561cf6a05a50 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf6a05a50 0x561cf6a05e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf6a05a50 0x561cf6a05e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59776/0 (socket says 172.21.15.50:59776) 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4c71bb5640 1 -- 172.21.15.50:0/1608579920 learned_addr learned my addr 172.21.15.50:0/1608579920 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4c71bb5640 1 -- 172.21.15.50:0/1608579920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf6a063b0 con 0x561cf6a05a50 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/1608579920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf6a05a50 0x561cf6a05e70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400b700 tx=0x7f4c64016650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4b577fe640 1 -- 172.21.15.50:0/1608579920 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64040040 con 0x561cf6a05a50 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4b577fe640 1 -- 172.21.15.50:0/1608579920 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64044430 con 0x561cf6a05a50 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1608579920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cf6a06e20 con 0x561cf6a05a50 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.085+0000 7f4b577fe640 1 -- 172.21.15.50:0/1608579920 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64044730 con 0x561cf6a05a50 2024-05-07T13:59:06.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.086+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1608579920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf6a07320 con 0x561cf6a05a50 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.086+0000 7f4b577fe640 1 -- 172.21.15.50:0/1608579920 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4c6400c540 con 0x561cf6a05a50 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4b577fe640 1 --2- 172.21.15.50:0/1608579920 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b4c036900 0x7f4b4c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4b577fe640 1 -- 172.21.15.50:0/1608579920 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4c64037d40 con 0x561cf6a05a50 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4c713b4640 1 --2- 172.21.15.50:0/1608579920 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b4c036900 0x7f4b4c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4c75f2f800 1 Processor -- start 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4c75f2f800 1 -- start start 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4c713b4640 1 --2- 172.21.15.50:0/1608579920 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b4c036900 0x7f4b4c038dc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x561cf69ef140 tx=0x7f4c5c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4c75f2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf68eca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4c75f2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561cf69dfe20 con 0x561cf68ee300 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf68eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf68eca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59788/0 (socket says 172.21.15.50:59788) 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.087+0000 7f4c71bb5640 1 -- 172.21.15.50:0/2468717713 learned_addr learned my addr 172.21.15.50:0/2468717713 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:59:06.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.088+0000 7f4c71bb5640 1 -- 172.21.15.50:0/2468717713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf68ee7b0 con 0x561cf68ee300 2024-05-07T13:59:06.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.088+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/2468717713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf68eca30 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4c64021040 tx=0x7f4c64035c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9560723888565299 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.088+0000 7f4b557fa640 1 -- 172.21.15.50:0/2468717713 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6405d070 con 0x561cf68ee300 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.088+0000 7f4b557fa640 1 -- 172.21.15.50:0/2468717713 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64034df0 con 0x561cf68ee300 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.088+0000 7f4b557fa640 1 -- 172.21.15.50:0/2468717713 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64052040 con 0x561cf68ee300 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2468717713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 msgr2=0x561cf68eca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2468717713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf68eca30 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4c64021040 tx=0x7f4c64035c50 comp rx=0 tx=0).stop 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2468717713 shutdown_connections 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2468717713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf68eca30 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2468717713 >> 172.21.15.50:0/2468717713 conn(0x561cf6a0eed0 msgr2=0x561cf6a0cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2468717713 shutdown_connections 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2468717713 wait complete. 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 Processor -- start 2024-05-07T13:59:06.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 -- start start 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf6a1c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c75f2f800 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561cf68ecf70 con 0x561cf68ee300 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf6a1c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c71bb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf6a1c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.50:59802/0 (socket says 172.21.15.50:59802) 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.089+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 learned_addr learned my addr 172.21.15.50:0/959403596 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.090+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf6a1c6f0 con 0x561cf68ee300 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.090+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf6a1c1b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4c6402dd60 tx=0x7f4c64043a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.090+0000 7f4b437fe640 1 -- 172.21.15.50:0/959403596 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64068020 con 0x561cf68ee300 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.090+0000 7f4b437fe640 1 -- 172.21.15.50:0/959403596 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c640354f0 con 0x561cf68ee300 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.090+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cf6a1c6f0 con 0x561cf68ee300 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.090+0000 7f4b437fe640 1 -- 172.21.15.50:0/959403596 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6405d030 con 0x561cf68ee300 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.090+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf6a1c6f0 con 0x561cf68ee300 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.091+0000 7f4b437fe640 1 -- 172.21.15.50:0/959403596 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4c6406b020 con 0x561cf68ee300 2024-05-07T13:59:06.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.091+0000 7f4b437fe640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b3c036950 0x7f4b3c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.091+0000 7f4b437fe640 1 -- 172.21.15.50:0/959403596 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4c6405e070 con 0x561cf68ee300 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.092+0000 7f4c713b4640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b3c036950 0x7f4b3c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.092+0000 7f4c713b4640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b3c036950 0x7f4b3c038e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x561cf69f7ad0 tx=0x7f4c5c04f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.092+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.092+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf6a278f0 0x561cf6a29db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.092+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2a500 con 0x561cf6a278f0 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c723b6640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf6a278f0 0x561cf6a29db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c723b6640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf6a278f0 0x561cf6a29db0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c75f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c75f2f800 20 realm 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2a910 con 0x561cf6a278f0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c75f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c75f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.093+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2b1e0 con 0x561cf6a278f0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c75f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2b580 con 0x561cf6a278f0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c75f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf6a2c2e0 0x561cf6a2e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:5 5.e 5:72c18bf1:::zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2ece0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf6a2c2e0 0x561cf6a2e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.094+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf6a2c2e0 0x561cf6a2e6d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.095+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== osd_op_reply(5 zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.095+0000 7f4c75f2f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.095+0000 7f4c75f2f800 20 searching for the correct realm 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.095+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a30610 con 0x561cf6a2c2e0 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.095+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.095+0000 7f4c71bb5640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4c64078040 0x7f4c64020990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.095+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a30610 con 0x7f4c64078040 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.095+0000 7f4c713b4640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4c64078040 0x7f4c64020990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.096+0000 7f4c713b4640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4c64078040 0x7f4c64020990 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.096+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.096+0000 7f4c713b4640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4c5c074040 0x7f4c5c081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.096+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a30610 con 0x7f4c5c074040 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.096+0000 7f4c723b6640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4c5c074040 0x7f4c5c081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.097+0000 7f4c723b6640 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4c5c074040 0x7f4c5c081410 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.097+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.097+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2b580 con 0x561cf6a278f0 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.098+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.098+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2b580 con 0x561cf6a278f0 2024-05-07T13:59:06.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.098+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.098+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2b580 con 0x561cf6a278f0 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.098+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 7 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.098+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2b580 con 0x7f4c5c074040 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.098+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.098+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2b580 con 0x7f4c64078040 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.099+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.099+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2b580 con 0x7f4c64078040 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.099+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.099+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a278f0 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.099+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 8 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.099+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c5c074040 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.100+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 3 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.100+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a278f0 2024-05-07T13:59:06.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.100+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 9 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.100+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c64078040 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.100+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.100+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.100+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.100+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.101+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.101+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c5c074040 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.101+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 4 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.101+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.101+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.101+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.102+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.102+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a278f0 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.102+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 10 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.102+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a278f0 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.102+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 11 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.102+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c5c074040 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.103+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 5 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.103+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.103+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.103+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c64078040 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.103+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.103+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a278f0 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.104+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 12 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.104+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c5c074040 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.104+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 6 ==== osd_op_reply(30 [pgnls start_epoch 29 out=82b] v29'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.104+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.104+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.104+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c5c074040 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.105+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 7 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.105+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c64078040 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.105+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.105+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.105+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.105+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c64078040 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 7 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x561cf6a278f0 2024-05-07T13:59:06.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 13 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4c5c08e040 con 0x7f4c64078040 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 8 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c75f2f800 20 RGWRados::pool_iterate: got zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c75f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c75f2f800 20 RGWRados::pool_iterate: got zone_info.2bb55b15-c5ac-4d27-90e2-375e6d1786e5 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c75f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c75f2f800 20 RGWRados::pool_iterate: got period_config.default 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c75f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c75f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.106+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2f5a0 con 0x561cf6a278f0 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.107+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.107+0000 7f4c75f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.107+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.107+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2f990 con 0x561cf6a278f0 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.107+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.107+0000 7f4c75f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.107+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.107+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:40 5.c 5:334bfff9:::zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a2f990 con 0x7f4c5c074040 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 8 ==== osd_op_reply(40 zonegroup_info.02b45de7-8fca-4685-ae50-761ba20a02e2 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 20 zone default found 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 4 Realm: () 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 4 ZoneGroup: default (02b45de7-8fca-4685-ae50-761ba20a02e2) 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 4 Zone: default (2bb55b15-c5ac-4d27-90e2-375e6d1786e5) 2024-05-07T13:59:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 20 zonegroup default 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a30a90 con 0x7f4c5c074040 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 20 rados_obj.operate() r=0 bl.length=187 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a32470 con 0x561cf6a2c2e0 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 20 rados->read ofs=0 len=0 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.108+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a32810 con 0x561cf6a2c2e0 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.109+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.109+0000 7f4c75f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-07T13:59:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.109+0000 7f4c75f2f800 20 started sync module instance, tier type = 2024-05-07T13:59:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.109+0000 7f4c75f2f800 20 started zone id=2bb55b15-c5ac-4d27-90e2-375e6d1786e5 (name=default) with tier type = 2024-05-07T13:59:06.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.109+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a31910 con 0x7f4c64078040 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.110+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 9 ==== osd_op_reply(44 notify.0 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.110+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94682396958000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a31570 con 0x7f4c64078040 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.110+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a33510 con 0x561cf6a278f0 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.111+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94682396958000] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.111+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 16 ==== osd_op_reply(46 notify.1 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.111+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94682396962016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a33900 con 0x561cf6a278f0 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.112+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a342c0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.113+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94682396962016] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.113+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 12 ==== osd_op_reply(48 notify.2 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.113+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94682396966416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a34660 con 0x561cf6a2c2e0 2024-05-07T13:59:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.113+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a35080 con 0x7f4c64078040 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.114+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94682396966416] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.114+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 11 ==== osd_op_reply(50 notify.3 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.114+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94682396969840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a35470 con 0x7f4c64078040 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.114+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a35eb0 con 0x561cf6a278f0 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.115+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94682396969840] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.115+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 18 ==== osd_op_reply(52 notify.4 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.115+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94682396973440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a35e70 con 0x561cf6a278f0 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.115+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a36960 con 0x7f4c5c074040 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.117+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94682396973440] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.117+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 10 ==== osd_op_reply(54 notify.5 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.117+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94682396976240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a36960 con 0x7f4c5c074040 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.117+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a37370 con 0x7f4c5c074040 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.118+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 11 ==== osd_op_reply(56 notify.6 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.118+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94682396978880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a37790 con 0x7f4c5c074040 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.118+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a38290 con 0x7f4c5c074040 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.118+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94682396976240] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94682396978880] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 14 ==== osd_op_reply(58 notify.7 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94682396979936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a33140 con 0x7f4c5c074040 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c75f2f800 20 add_watcher() i=0 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c75f2f800 20 add_watcher() i=1 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c75f2f800 20 add_watcher() i=2 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c75f2f800 20 add_watcher() i=3 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c75f2f800 20 add_watcher() i=4 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c75f2f800 20 add_watcher() i=5 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.119+0000 7f4c75f2f800 20 add_watcher() i=6 2024-05-07T13:59:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.120+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94682396979936] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.120+0000 7f4c75f2f800 20 add_watcher() i=7 2024-05-07T13:59:06.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.120+0000 7f4c75f2f800 2 all 8 watchers are set, enabling cache 2024-05-07T13:59:06.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.120+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a3b280 con 0x561cf6a278f0 2024-05-07T13:59:06.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.121+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.121+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94682396982656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a38700 con 0x561cf6a278f0 2024-05-07T13:59:06.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.122+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94682396982656] v29'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.122+0000 7f4b237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:59:06.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.122+0000 7f4c75f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-07T13:59:06.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.122+0000 7f4c75f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-07T13:59:06.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.122+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a439f0 con 0x561cf6a278f0 2024-05-07T13:59:06.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.123+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.123+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a44040 con 0x7f4c5c074040 2024-05-07T13:59:06.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.124+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.124+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a444a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.125+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.125+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a443c0 con 0x561cf6a278f0 2024-05-07T13:59:06.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.126+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.126+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a443e0 con 0x7f4c64078040 2024-05-07T13:59:06.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.127+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.127+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a44ad0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.128+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.128+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a44b60 con 0x561cf6a278f0 2024-05-07T13:59:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.130+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.130+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a44bf0 con 0x7f4c5c074040 2024-05-07T13:59:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.131+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.131+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a44c80 con 0x7f4c64078040 2024-05-07T13:59:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.133+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.133+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a451f0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.134+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.134+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a451f0 con 0x7f4c64078040 2024-05-07T13:59:06.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.135+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.135+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x7f4c5c074040 2024-05-07T13:59:06.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.136+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.136+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x7f4c64078040 2024-05-07T13:59:06.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.137+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.137+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x7f4c5c074040 2024-05-07T13:59:06.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.138+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.138+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a278f0 2024-05-07T13:59:06.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.139+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.139+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.141+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'77 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.141+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x7f4c64078040 2024-05-07T13:59:06.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.142+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.142+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.143+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.143+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a278f0 2024-05-07T13:59:06.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.144+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'40 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.144+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a278f0 2024-05-07T13:59:06.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.145+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.145+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.146+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'78 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.146+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x7f4c64078040 2024-05-07T13:59:06.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.148+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.148+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.149+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.149+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.150+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.150+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.151+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.151+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.151+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.152+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x7f4c5c074040 2024-05-07T13:59:06.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.153+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.153+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.154+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.154+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x7f4c5c074040 2024-05-07T13:59:06.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.155+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.155+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.156+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'79 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.156+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x7f4c5c074040 2024-05-07T13:59:06.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.157+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'64 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.157+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a456a0 con 0x7f4c64078040 2024-05-07T13:59:06.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.159+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.159+0000 7f4b227fc640 20 reqs_thread_entry: start 2024-05-07T13:59:06.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.159+0000 7f4c75f2f800 20 init_complete bucket index max shards: 11 2024-05-07T13:59:06.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.159+0000 7f4c75f2f800 20 Filter name: none 2024-05-07T13:59:06.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.159+0000 7f4a93fff640 20 reqs_thread_entry: start 2024-05-07T13:59:06.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.159+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-05-07T13:59:06.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.159+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:94 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.160+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 26 ==== osd_op_reply(94 gc.25 [call] v29'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.160+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:95 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 27 ==== osd_op_reply(95 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:96 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 28 ==== osd_op_reply(96 gc.25 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:97 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 29 ==== osd_op_reply(97 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:98 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 30 ==== osd_op_reply(98 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.161+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:99 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.162+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 31 ==== osd_op_reply(99 gc.25 [call] v29'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.162+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-05-07T13:59:06.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.162+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:100 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.163+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 23 ==== osd_op_reply(100 gc.26 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.163+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:101 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.164+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 24 ==== osd_op_reply(101 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.164+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.164+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:102 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x7f4c5c074040 2024-05-07T13:59:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.164+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 25 ==== osd_op_reply(102 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.164+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:103 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.165+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 26 ==== osd_op_reply(103 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.165+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.165+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:104 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.165+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 27 ==== osd_op_reply(104 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.165+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.165+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:105 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.167+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 28 ==== osd_op_reply(105 gc.26 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.167+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-05-07T13:59:06.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.167+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:106 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.168+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 32 ==== osd_op_reply(106 gc.27 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.168+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:107 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.168+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 33 ==== osd_op_reply(107 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.168+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.168+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:108 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.168+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 34 ==== osd_op_reply(108 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.168+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:109 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.169+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 35 ==== osd_op_reply(109 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.169+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.169+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:110 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.169+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 36 ==== osd_op_reply(110 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.169+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.169+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:111 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.170+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 37 ==== osd_op_reply(111 gc.27 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.170+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-05-07T13:59:06.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.170+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:112 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.171+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 29 ==== osd_op_reply(112 gc.28 [call] v29'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.171+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:113 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.172+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 30 ==== osd_op_reply(113 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.172+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.172+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:114 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x7f4c5c074040 2024-05-07T13:59:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.172+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 31 ==== osd_op_reply(114 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.172+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:115 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.172+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 32 ==== osd_op_reply(115 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.172+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.172+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:116 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.173+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 33 ==== osd_op_reply(116 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.173+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.173+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.174+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 34 ==== osd_op_reply(117 gc.28 [call] v29'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.174+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-05-07T13:59:06.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.174+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:118 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.175+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 38 ==== osd_op_reply(118 gc.29 [call] v29'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.175+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:119 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 39 ==== osd_op_reply(119 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 40 ==== osd_op_reply(120 gc.29 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 41 ==== osd_op_reply(121 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 42 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.176+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:123 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.178+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 43 ==== osd_op_reply(123 gc.29 [call] v29'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.178+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-05-07T13:59:06.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.178+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.179+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 35 ==== osd_op_reply(124 gc.30 [call] v29'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.179+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.179+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 36 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.179+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.179+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:126 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x7f4c5c074040 2024-05-07T13:59:06.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.179+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 37 ==== osd_op_reply(126 gc.30 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.179+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:127 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.180+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 38 ==== osd_op_reply(127 gc.30 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.180+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.180+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:128 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.180+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 39 ==== osd_op_reply(128 gc.30 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.180+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.180+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:129 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.181+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 40 ==== osd_op_reply(129 gc.30 [call] v29'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.181+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-05-07T13:59:06.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.181+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:130 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 20 ==== osd_op_reply(130 gc.31 [call] v29'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:131 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 21 ==== osd_op_reply(131 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:132 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x7f4c64078040 2024-05-07T13:59:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 22 ==== osd_op_reply(132 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:133 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 23 ==== osd_op_reply(133 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.183+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:134 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.184+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 24 ==== osd_op_reply(134 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.184+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.184+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:135 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.185+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 25 ==== osd_op_reply(135 gc.31 [call] v29'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.185+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-05-07T13:59:06.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.185+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:136 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.186+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 28 ==== osd_op_reply(136 gc.0 [call] v29'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.186+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:137 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.186+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 29 ==== osd_op_reply(137 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.186+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.186+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:138 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x561cf6a278f0 2024-05-07T13:59:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.187+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 30 ==== osd_op_reply(138 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.187+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:139 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.187+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 31 ==== osd_op_reply(139 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.187+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.187+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:140 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.187+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 32 ==== osd_op_reply(140 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.187+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.187+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:141 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.188+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 33 ==== osd_op_reply(141 gc.0 [call] v29'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.188+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-05-07T13:59:06.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.188+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:142 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.189+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 41 ==== osd_op_reply(142 gc.1 [call] v29'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.189+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:143 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.189+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 42 ==== osd_op_reply(143 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:144 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x7f4c5c074040 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 43 ==== osd_op_reply(144 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:145 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 44 ==== osd_op_reply(145 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:146 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 45 ==== osd_op_reply(146 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.190+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:147 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c5c074040 2024-05-07T13:59:06.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.191+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 46 ==== osd_op_reply(147 gc.1 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.191+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-05-07T13:59:06.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.191+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:148 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 44 ==== osd_op_reply(148 gc.2 [call] v29'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:149 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 45 ==== osd_op_reply(149 gc.2 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:150 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 46 ==== osd_op_reply(150 gc.2 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:151 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 47 ==== osd_op_reply(151 gc.2 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.193+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:152 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.194+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 48 ==== osd_op_reply(152 gc.2 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.194+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.194+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:153 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.194+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 49 ==== osd_op_reply(153 gc.2 [call] v29'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.194+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-05-07T13:59:06.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.194+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:154 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.195+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 34 ==== osd_op_reply(154 gc.3 [call] v29'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.195+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:155 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 35 ==== osd_op_reply(155 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:156 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x561cf6a278f0 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 36 ==== osd_op_reply(156 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:157 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 37 ==== osd_op_reply(157 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:158 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 38 ==== osd_op_reply(158 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.196+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:159 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.197+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 39 ==== osd_op_reply(159 gc.3 [call] v29'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.197+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.197+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:160 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.198+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 26 ==== osd_op_reply(160 gc.4 [call] v29'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.198+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:161 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 27 ==== osd_op_reply(161 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:162 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 28 ==== osd_op_reply(162 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:163 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 29 ==== osd_op_reply(163 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:164 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 30 ==== osd_op_reply(164 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.199+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:165 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x7f4c64078040 2024-05-07T13:59:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.200+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 31 ==== osd_op_reply(165 gc.4 [call] v29'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.200+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-05-07T13:59:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.200+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:166 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.201+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 50 ==== osd_op_reply(166 gc.5 [call] v29'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.201+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:167 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.201+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 51 ==== osd_op_reply(167 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.201+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.202+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:168 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.202+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 52 ==== osd_op_reply(168 gc.5 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.202+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:169 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.202+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 53 ==== osd_op_reply(169 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.202+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.202+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:170 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.202+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 54 ==== osd_op_reply(170 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.202+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.202+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:171 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.203+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 55 ==== osd_op_reply(171 gc.5 [call] v29'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.203+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-05-07T13:59:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.203+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:172 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.204+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 40 ==== osd_op_reply(172 gc.6 [call] v29'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.204+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:173 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 41 ==== osd_op_reply(173 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:174 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a70b90 con 0x561cf6a278f0 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 42 ==== osd_op_reply(174 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:175 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 43 ==== osd_op_reply(175 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:176 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a71ba0 con 0x561cf6a278f0 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 44 ==== osd_op_reply(176 gc.6 [call out=1715b] v0'0 uv35 ondisk = 0) ==== 148+0+1715 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c75f2f800 20 garbage collection: RGWGC::process iterating over entry tag='2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.9035386263919114903', time=2024-05-07T13:59:14.106611+0000, chain.objs.size()=7 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c75f2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_1 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.205+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:177 3.26s0 3:66b680c7:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a6fe60 con 0x7f4c64078040 2024-05-07T13:59:06.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_2 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:178 3.bs0 3:d2238c6f:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a74e10 con 0x7f4c5c074040 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_3 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:179 3.23s0 3:c5322566:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77770 con 0x7f4c5c074040 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_4 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:180 3.1as0 3:5aa8188c:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a74e10 con 0x561cf6a278f0 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_5 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:181 3.1as0 3:5870be1d:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77770 con 0x561cf6a278f0 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_6 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:182 3.24s0 3:251724e3:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a7edb0 con 0x7f4c5c074040 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_7 2024-05-07T13:59:06.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.206+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:183 3.2as0 3:54e23b51:::2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a81620 con 0x561cf6a278f0 2024-05-07T13:59:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.208+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 32 ==== osd_op_reply(177 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_1 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.208+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 47 ==== osd_op_reply(178 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_2 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.208+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 48 ==== osd_op_reply(182 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_6 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.208+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 49 ==== osd_op_reply(179 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_3 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.209+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 45 ==== osd_op_reply(180 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_4 [call] v29'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.209+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 46 ==== osd_op_reply(183 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_7 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.210+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 47 ==== osd_op_reply(181 2bb55b15-c5ac-4d27-90e2-375e6d1786e5.4222.11__shadow_.W8Bs8-FFS_CrEMPrX1W7qUFmP8bYpzP_5 [call] v29'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.210+0000 7f4c75f2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-07T13:59:06.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.210+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:184 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a7c120 con 0x561cf6a278f0 2024-05-07T13:59:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.212+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 48 ==== osd_op_reply(184 gc.6 [call] v29'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.212+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:185 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77220 con 0x561cf6a278f0 2024-05-07T13:59:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.213+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 49 ==== osd_op_reply(185 gc.6 [call] v29'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.213+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-05-07T13:59:06.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.213+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:186 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77220 con 0x7f4c5c074040 2024-05-07T13:59:06.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.214+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 50 ==== osd_op_reply(186 gc.7 [call] v29'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.214+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:187 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77220 con 0x7f4c5c074040 2024-05-07T13:59:06.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.215+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 51 ==== osd_op_reply(187 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.215+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.215+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:188 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76210 con 0x7f4c5c074040 2024-05-07T13:59:06.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.215+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 52 ==== osd_op_reply(188 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.215+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:189 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77220 con 0x7f4c5c074040 2024-05-07T13:59:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.216+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 53 ==== osd_op_reply(189 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.216+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.216+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:190 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77220 con 0x7f4c5c074040 2024-05-07T13:59:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.216+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 54 ==== osd_op_reply(190 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.216+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.216+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:191 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77220 con 0x7f4c5c074040 2024-05-07T13:59:06.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.217+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 55 ==== osd_op_reply(191 gc.7 [call] v29'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.217+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-05-07T13:59:06.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.217+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:192 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 33 ==== osd_op_reply(192 gc.8 [call] v29'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:193 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 34 ==== osd_op_reply(193 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:194 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77370 con 0x7f4c64078040 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 35 ==== osd_op_reply(194 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:195 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 36 ==== osd_op_reply(195 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.219+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:196 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.220+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 37 ==== osd_op_reply(196 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.220+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.220+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:197 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.221+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 38 ==== osd_op_reply(197 gc.8 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.221+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.221+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:198 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 56 ==== osd_op_reply(198 gc.9 [call] v29'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:199 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 57 ==== osd_op_reply(199 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:200 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77390 con 0x561cf6a2c2e0 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 58 ==== osd_op_reply(200 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:201 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77390 con 0x561cf6a2c2e0 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 59 ==== osd_op_reply(201 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.222+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:202 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.223+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 60 ==== osd_op_reply(202 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.223+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.223+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:203 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.224+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 61 ==== osd_op_reply(203 gc.9 [call] v29'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.224+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.224+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:204 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.224+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 39 ==== osd_op_reply(204 gc.10 [call] v29'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.225+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:205 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.225+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 40 ==== osd_op_reply(205 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.225+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.225+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:206 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77390 con 0x7f4c64078040 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.225+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 41 ==== osd_op_reply(206 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.225+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:207 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77390 con 0x7f4c64078040 2024-05-07T13:59:06.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.225+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 42 ==== osd_op_reply(207 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.225+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.225+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:208 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.226+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 43 ==== osd_op_reply(208 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.226+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.226+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:209 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.226+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 44 ==== osd_op_reply(209 gc.10 [call] v29'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.226+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-05-07T13:59:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.226+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:210 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c5c074040 2024-05-07T13:59:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 56 ==== osd_op_reply(210 gc.11 [call] v29'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:211 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c5c074040 2024-05-07T13:59:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 57 ==== osd_op_reply(211 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:212 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c5c074040 2024-05-07T13:59:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 58 ==== osd_op_reply(212 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:213 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c5c074040 2024-05-07T13:59:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 59 ==== osd_op_reply(213 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.228+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:214 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c5c074040 2024-05-07T13:59:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.229+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 60 ==== osd_op_reply(214 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.229+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.229+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:215 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c5c074040 2024-05-07T13:59:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.230+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 61 ==== osd_op_reply(215 gc.11 [call] v29'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.230+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-05-07T13:59:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.230+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:216 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c64078040 2024-05-07T13:59:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 45 ==== osd_op_reply(216 gc.12 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:217 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c64078040 2024-05-07T13:59:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 46 ==== osd_op_reply(217 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:218 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c64078040 2024-05-07T13:59:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 47 ==== osd_op_reply(218 gc.12 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:219 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c64078040 2024-05-07T13:59:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 48 ==== osd_op_reply(219 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.231+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:220 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c64078040 2024-05-07T13:59:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.232+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 49 ==== osd_op_reply(220 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.232+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.232+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:221 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c64078040 2024-05-07T13:59:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.233+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 50 ==== osd_op_reply(221 gc.12 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.233+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-05-07T13:59:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.233+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:222 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x7f4c5c074040 2024-05-07T13:59:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.234+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 62 ==== osd_op_reply(222 gc.13 [call] v29'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.234+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:223 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c5c074040 2024-05-07T13:59:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.234+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 63 ==== osd_op_reply(223 gc.13 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.234+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.234+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:224 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773a0 con 0x7f4c5c074040 2024-05-07T13:59:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.234+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 64 ==== osd_op_reply(224 gc.13 [call out=24b] v0'0 uv67 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.234+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:225 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c5c074040 2024-05-07T13:59:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.235+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 65 ==== osd_op_reply(225 gc.13 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.235+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.235+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:226 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c5c074040 2024-05-07T13:59:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.235+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 66 ==== osd_op_reply(226 gc.13 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.235+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.235+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:227 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c5c074040 2024-05-07T13:59:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.236+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 67 ==== osd_op_reply(227 gc.13 [call] v29'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.236+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-05-07T13:59:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.236+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:228 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.237+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 50 ==== osd_op_reply(228 gc.14 [call] v29'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.237+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:229 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.237+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 51 ==== osd_op_reply(229 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.237+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.237+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:230 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773a0 con 0x561cf6a278f0 2024-05-07T13:59:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.237+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 52 ==== osd_op_reply(230 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.237+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:231 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.238+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 53 ==== osd_op_reply(231 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.238+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.238+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:232 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.238+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 54 ==== osd_op_reply(232 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.238+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.238+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:233 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.239+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 55 ==== osd_op_reply(233 gc.14 [call] v29'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.239+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-05-07T13:59:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.239+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:234 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.240+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 62 ==== osd_op_reply(234 gc.15 [call] v29'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.240+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:235 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.240+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 63 ==== osd_op_reply(235 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.240+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.240+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:236 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77380 con 0x561cf6a2c2e0 2024-05-07T13:59:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.241+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 64 ==== osd_op_reply(236 gc.15 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.241+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:237 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.241+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 65 ==== osd_op_reply(237 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.241+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.241+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:238 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.241+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 66 ==== osd_op_reply(238 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.241+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.241+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:239 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.242+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 67 ==== osd_op_reply(239 gc.15 [call] v29'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.242+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-05-07T13:59:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.242+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:240 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.243+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 51 ==== osd_op_reply(240 gc.16 [call] v29'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.243+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:241 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 52 ==== osd_op_reply(241 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:242 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77380 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 53 ==== osd_op_reply(242 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:243 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77380 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 54 ==== osd_op_reply(243 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:244 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 55 ==== osd_op_reply(244 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.244+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:245 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x7f4c64078040 2024-05-07T13:59:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.245+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 56 ==== osd_op_reply(245 gc.16 [call] v29'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.245+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.245+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:246 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.246+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 68 ==== osd_op_reply(246 gc.17 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.246+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:247 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 69 ==== osd_op_reply(247 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:248 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77380 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 70 ==== osd_op_reply(248 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:249 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77380 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 71 ==== osd_op_reply(249 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:250 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 72 ==== osd_op_reply(250 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.247+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:251 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a77380 con 0x561cf6a2c2e0 2024-05-07T13:59:06.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.248+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 73 ==== osd_op_reply(251 gc.17 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.248+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-05-07T13:59:06.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.248+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:252 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 56 ==== osd_op_reply(252 gc.18 [call] v29'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:253 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 57 ==== osd_op_reply(253 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:254 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x561cf6a278f0 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 58 ==== osd_op_reply(254 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:255 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 59 ==== osd_op_reply(255 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.250+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:256 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.251+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 60 ==== osd_op_reply(256 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.251+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.251+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:257 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a278f0 2024-05-07T13:59:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.252+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 61 ==== osd_op_reply(257 gc.18 [call] v29'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.252+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-05-07T13:59:06.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.252+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:258 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a278f0 2024-05-07T13:59:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.253+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 62 ==== osd_op_reply(258 gc.19 [call] v29'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.253+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:259 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.253+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 63 ==== osd_op_reply(259 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.253+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.253+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:260 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a75f80 con 0x561cf6a278f0 2024-05-07T13:59:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.253+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 64 ==== osd_op_reply(260 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.253+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:261 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.254+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 65 ==== osd_op_reply(261 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.254+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.254+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:262 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a76f90 con 0x561cf6a278f0 2024-05-07T13:59:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.254+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 66 ==== osd_op_reply(262 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.254+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.254+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:263 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a278f0 2024-05-07T13:59:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.255+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 67 ==== osd_op_reply(263 gc.19 [call] v29'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.255+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-05-07T13:59:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.255+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:264 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.256+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 74 ==== osd_op_reply(264 gc.20 [call] v29'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.256+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:265 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.256+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 75 ==== osd_op_reply(265 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.256+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.256+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:266 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.256+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 76 ==== osd_op_reply(266 gc.20 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.256+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:267 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.257+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 77 ==== osd_op_reply(267 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.257+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.257+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:268 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.257+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 78 ==== osd_op_reply(268 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.257+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.257+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:269 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.258+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 79 ==== osd_op_reply(269 gc.20 [call] v29'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.258+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-05-07T13:59:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.258+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:270 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x7f4c64078040 2024-05-07T13:59:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.259+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 57 ==== osd_op_reply(270 gc.21 [call] v29'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.259+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:271 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x7f4c64078040 2024-05-07T13:59:06.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.259+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 58 ==== osd_op_reply(271 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.259+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.259+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:272 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x7f4c64078040 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.259+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 59 ==== osd_op_reply(272 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.259+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:273 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x7f4c64078040 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.260+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 60 ==== osd_op_reply(273 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.260+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.260+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:274 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x7f4c64078040 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.260+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 61 ==== osd_op_reply(274 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.260+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.260+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:275 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x7f4c64078040 2024-05-07T13:59:06.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.261+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 62 ==== osd_op_reply(275 gc.21 [call] v29'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.261+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-05-07T13:59:06.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.261+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:276 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.262+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 80 ==== osd_op_reply(276 gc.22 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.262+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:277 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.262+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 81 ==== osd_op_reply(277 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.262+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.262+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:278 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.262+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 82 ==== osd_op_reply(278 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.262+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:279 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.263+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 83 ==== osd_op_reply(279 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.263+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.263+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:280 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.263+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 84 ==== osd_op_reply(280 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.263+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.263+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:281 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.264+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 85 ==== osd_op_reply(281 gc.22 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.264+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-05-07T13:59:06.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.264+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:282 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.265+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 86 ==== osd_op_reply(282 gc.23 [call] v29'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.265+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:283 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.265+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 87 ==== osd_op_reply(283 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.265+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.265+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:284 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.265+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 88 ==== osd_op_reply(284 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.265+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:285 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.266+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 89 ==== osd_op_reply(285 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.266+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.266+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:286 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.266+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 90 ==== osd_op_reply(286 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.266+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.266+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:287 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.267+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 91 ==== osd_op_reply(287 gc.23 [call] v29'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.267+0000 7f4c75f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.267+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:288 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.268+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 92 ==== osd_op_reply(288 gc.24 [call] v29'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.268+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:289 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.268+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 93 ==== osd_op_reply(289 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.268+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.268+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:290 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.269+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 94 ==== osd_op_reply(290 gc.24 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.269+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:291 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.269+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 95 ==== osd_op_reply(291 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.269+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.269+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:292 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.269+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 96 ==== osd_op_reply(292 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.269+0000 7f4c75f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-07T13:59:06.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.269+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:293 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.270+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 97 ==== osd_op_reply(293 gc.24 [call] v29'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.271+0000 7f4b237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-07T13:59:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.271+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94682396982656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a773b0 con 0x561cf6a278f0 2024-05-07T13:59:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.272+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94682396982656] v29'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.272+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94682396958000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a37d80 con 0x7f4c64078040 2024-05-07T13:59:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.273+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94682396958000] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.273+0000 7f4c75f2f800 20 remove_watcher() i=0 2024-05-07T13:59:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.273+0000 7f4c75f2f800 2 removed watcher, disabling cache 2024-05-07T13:59:06.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.273+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94682396962016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a37d80 con 0x561cf6a278f0 2024-05-07T13:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.274+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94682396962016] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.274+0000 7f4c75f2f800 20 remove_watcher() i=1 2024-05-07T13:59:06.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.274+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94682396966416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a32ce0 con 0x561cf6a2c2e0 2024-05-07T13:59:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.276+0000 7f4c71bb5640 1 -- 172.21.15.50:0/959403596 <== osd.3 v2:172.21.15.50:6814/3553060046 98 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94682396966416] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c64055040 con 0x561cf6a2c2e0 2024-05-07T13:59:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.276+0000 7f4c75f2f800 20 remove_watcher() i=2 2024-05-07T13:59:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.276+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94682396969840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a37d80 con 0x7f4c64078040 2024-05-07T13:59:06.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.277+0000 7f4c713b4640 1 -- 172.21.15.50:0/959403596 <== osd.2 v2:172.21.15.50:6808/2034796854 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94682396969840] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c07f070 con 0x7f4c64078040 2024-05-07T13:59:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.277+0000 7f4c75f2f800 20 remove_watcher() i=3 2024-05-07T13:59:06.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.277+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94682396973440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a33e10 con 0x561cf6a278f0 2024-05-07T13:59:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.278+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.1 v2:172.21.15.50:6800/3441257969 70 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94682396973440] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x561cf6a278f0 2024-05-07T13:59:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.278+0000 7f4c75f2f800 20 remove_watcher() i=4 2024-05-07T13:59:06.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.278+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94682396976240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a37d80 con 0x7f4c5c074040 2024-05-07T13:59:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.279+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94682396976240] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.279+0000 7f4c75f2f800 20 remove_watcher() i=5 2024-05-07T13:59:06.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.279+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94682396978880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a35980 con 0x7f4c5c074040 2024-05-07T13:59:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.280+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94682396978880] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.280+0000 7f4c75f2f800 20 remove_watcher() i=6 2024-05-07T13:59:06.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.280+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94682396979936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561cf6a33e10 con 0x7f4c5c074040 2024-05-07T13:59:06.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 <== osd.0 v2:172.21.15.22:6800/2215278347 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94682396979936] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c00a4a0 con 0x7f4c5c074040 2024-05-07T13:59:06.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c75f2f800 20 remove_watcher() i=7 2024-05-07T13:59:06.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4c5c074040 msgr2=0x7f4c5c081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7f4c5c074040 0x7f4c5c081410 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf6a278f0 msgr2=0x561cf6a29db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf6a278f0 0x561cf6a29db0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4c64078040 msgr2=0x7f4c64020990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f4c64078040 0x7f4c64020990 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf6a2c2e0 msgr2=0x561cf6a2e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.281+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf6a2c2e0 0x561cf6a2e6d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b3c036950 msgr2=0x7f4b3c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b3c036950 0x7f4b3c038e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x561cf69f7ad0 tx=0x7f4c5c04f000 comp rx=0 tx=0).stop 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 msgr2=0x561cf6a1c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c723b6640 1 -- 172.21.15.50:0/959403596 reap_dead start 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf6a1c1b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4c6402dd60 tx=0x7f4c64043a70 comp rx=0 tx=0).stop 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 shutdown_connections 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/959403596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68ee300 0x561cf6a1c1b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 >> 172.21.15.50:0/959403596 conn(0x561cf6a0eed0 msgr2=0x561cf6a0c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 shutdown_connections 2024-05-07T13:59:06.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/959403596 wait complete. 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1608579920 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b4c036900 msgr2=0x7f4b4c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/1608579920 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b4c036900 0x7f4b4c038dc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x561cf69ef140 tx=0x7f4c5c005a00 comp rx=0 tx=0).stop 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1608579920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf6a05a50 msgr2=0x561cf6a05e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/1608579920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf6a05a50 0x561cf6a05e70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400b700 tx=0x7f4c64016650 comp rx=0 tx=0).stop 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1608579920 shutdown_connections 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/1608579920 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b4c036900 0x7f4b4c038dc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/1608579920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf6a05a50 0x561cf6a05e70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1608579920 >> 172.21.15.50:0/1608579920 conn(0x561cf69f9b60 msgr2=0x561cf69f9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1608579920 shutdown_connections 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.282+0000 7f4c75f2f800 1 -- 172.21.15.50:0/1608579920 wait complete. 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561cf69f4b20 msgr2=0x561cf69f6f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x561cf69f4b20 0x561cf69f6f70 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf68f2750 msgr2=0x561cf69ee300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x561cf68f2750 0x561cf69ee300 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf69f0b90 msgr2=0x561cf69f2f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x561cf69f0b90 0x561cf69f2f80 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b58036950 msgr2=0x7f4b58038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4b58036950 0x7f4b58038e10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c054000 tx=0x7f4c5c04e000 comp rx=0 tx=0).stop 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 msgr2=0x561cf69e7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 --2- 172.21.15.50:0/2108204652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561cf68eec40 0x561cf69e7110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400c010 tx=0x7f4c64000ed0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c723b6640 1 -- 172.21.15.50:0/2108204652 reap_dead start 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 shutdown_connections 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 >> 172.21.15.50:0/2108204652 conn(0x561cf68e85b0 msgr2=0x561cf69d95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 shutdown_connections 2024-05-07T13:59:06.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-05-07T13:59:06.283+0000 7f4c75f2f800 1 -- 172.21.15.50:0/2108204652 wait complete. 2024-05-07T13:59:06.279 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-07T13:59:06.291 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-07T13:59:06.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T13:59:06.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.411+0000 7f0c7ce1a640 1 Processor -- start 2024-05-07T13:59:06.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.411+0000 7f0c7ce1a640 1 -- start start 2024-05-07T13:59:06.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.412+0000 7f0c7ce1a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0c7812ea60 0x7f0c7812ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.412+0000 7f0c7ce1a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c78072830 con 0x7f0c7806de40 2024-05-07T13:59:06.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.412+0000 7f0c7ce1a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0c780701c0 con 0x7f0c7812ea60 2024-05-07T13:59:06.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.412+0000 7f0c7659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0c7812ea60 0x7f0c7812ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.412+0000 7f0c75d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0c7806de40 0x7f0c7806e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38144/0 (socket says 172.21.15.22:38144) 2024-05-07T13:59:06.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.412+0000 7f0c75d9b640 1 -- 172.21.15.22:0/2160281916 learned_addr learned my addr 172.21.15.22:0/2160281916 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:06.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.412+0000 7f0c7659c640 1 -- 172.21.15.22:0/2160281916 >> v1:172.21.15.22:6789/0 conn(0x7f0c7806de40 legacy=0x7f0c7806e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.412+0000 7f0c7659c640 1 -- 172.21.15.22:0/2160281916 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7812f380 con 0x7f0c7812ea60 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.413+0000 7f0c7659c640 1 --2- 172.21.15.22:0/2160281916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7812ea60 0x7f0c7812ee40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009720 tx=0x7f0c6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142d63390ee8855 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.413+0000 7f0c7559a640 1 -- 172.21.15.22:0/2160281916 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c680316d0 con 0x7f0c7812ea60 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.413+0000 7f0c7559a640 1 -- 172.21.15.22:0/2160281916 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c68037070 con 0x7f0c7812ea60 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.413+0000 7f0c7559a640 1 -- 172.21.15.22:0/2160281916 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c680319c0 con 0x7f0c7812ea60 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.414+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/2160281916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7812ea60 msgr2=0x7f0c7812ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.414+0000 7f0c7ce1a640 1 --2- 172.21.15.22:0/2160281916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7812ea60 0x7f0c7812ee40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009720 tx=0x7f0c6802b840 comp rx=0 tx=0).stop 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.414+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/2160281916 shutdown_connections 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.414+0000 7f0c7ce1a640 1 --2- 172.21.15.22:0/2160281916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7812ea60 0x7f0c7812ee40 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.414+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/2160281916 >> 172.21.15.22:0/2160281916 conn(0x7f0c7809cc80 msgr2=0x7f0c7809d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.414+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/2160281916 shutdown_connections 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.414+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/2160281916 wait complete. 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.415+0000 7f0c7ce1a640 1 Processor -- start 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.415+0000 7f0c7ce1a640 1 -- start start 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.415+0000 7f0c7ce1a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7806de40 0x7f0c781c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.415+0000 7f0c7ce1a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7806fa70 con 0x7f0c7806de40 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.415+0000 7f0c7659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7806de40 0x7f0c781c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.415+0000 7f0c7659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7806de40 0x7f0c781c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35402/0 (socket says 172.21.15.22:35402) 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.415+0000 7f0c7659c640 1 -- 172.21.15.22:0/3993514628 learned_addr learned my addr 172.21.15.22:0/3993514628 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.416+0000 7f0c7659c640 1 -- 172.21.15.22:0/3993514628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7812b940 con 0x7f0c7806de40 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.416+0000 7f0c7659c640 1 --2- 172.21.15.22:0/3993514628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7806de40 0x7f0c781c3600 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009720 tx=0x7f0c680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.416+0000 7f0c66ffd640 1 -- 172.21.15.22:0/3993514628 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c68032770 con 0x7f0c7806de40 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.416+0000 7f0c66ffd640 1 -- 172.21.15.22:0/3993514628 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c68032910 con 0x7f0c7806de40 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.416+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7811fde0 con 0x7f0c7806de40 2024-05-07T13:59:06.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.416+0000 7f0c66ffd640 1 -- 172.21.15.22:0/3993514628 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c68032bf0 con 0x7f0c7806de40 2024-05-07T13:59:06.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.416+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c78120a70 con 0x7f0c7806de40 2024-05-07T13:59:06.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.417+0000 7f0c66ffd640 1 -- 172.21.15.22:0/3993514628 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c6804c060 con 0x7f0c7806de40 2024-05-07T13:59:06.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.417+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7811f940 con 0x7f0c7806de40 2024-05-07T13:59:06.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.417+0000 7f0c66ffd640 1 --2- 172.21.15.22:0/3993514628 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0c58038060 0x7f0c5803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.417+0000 7f0c66ffd640 1 -- 172.21.15.22:0/3993514628 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0c6802f050 con 0x7f0c7806de40 2024-05-07T13:59:06.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.418+0000 7f0c75d9b640 1 --2- 172.21.15.22:0/3993514628 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0c58038060 0x7f0c5803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.418+0000 7f0c75d9b640 1 --2- 172.21.15.22:0/3993514628 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0c58038060 0x7f0c5803a520 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c002080 tx=0x7f0c6c001670 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.422+0000 7f0c66ffd640 1 -- 172.21.15.22:0/3993514628 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0c7812b940 con 0x7f0c7806de40 2024-05-07T13:59:06.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.603+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0c78062e90 con 0x7f0c58038060 2024-05-07T13:59:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.621+0000 7f0c66ffd640 1 -- 172.21.15.22:0/3993514628 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665926 (secure 0 0 0) 0x7f0c78062e90 con 0x7f0c58038060 2024-05-07T13:59:06.617 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:59:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T13:59:06.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.625+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0c58038060 msgr2=0x7f0c5803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.625+0000 7f0c7ce1a640 1 --2- 172.21.15.22:0/3993514628 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0c58038060 0x7f0c5803a520 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c002080 tx=0x7f0c6c001670 comp rx=0 tx=0).stop 2024-05-07T13:59:06.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.625+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7806de40 msgr2=0x7f0c781c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.625+0000 7f0c7ce1a640 1 --2- 172.21.15.22:0/3993514628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7806de40 0x7f0c781c3600 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009720 tx=0x7f0c680046c0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.625+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 shutdown_connections 2024-05-07T13:59:06.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.626+0000 7f0c7ce1a640 1 --2- 172.21.15.22:0/3993514628 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0c58038060 0x7f0c5803a520 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.626+0000 7f0c7ce1a640 1 --2- 172.21.15.22:0/3993514628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c7806de40 0x7f0c781c3600 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.626+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 >> 172.21.15.22:0/3993514628 conn(0x7f0c7809cc80 msgr2=0x7f0c7812ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.626+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 shutdown_connections 2024-05-07T13:59:06.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.626+0000 7f0c7ce1a640 1 -- 172.21.15.22:0/3993514628 wait complete. 2024-05-07T13:59:06.628 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-05-07T13:59:06.164628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416885,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4903,"num_read_kb":4480,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4478,"ondisk_log_size":4478,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177712,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309648,"statfs":{"total":386547056640,"available":386365079552,"internally_reserved":0,"allocated":37240832,"data_stored":36146218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":511,"num_read_kb":466,"num_write":388,"num_write_kb":29374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003777"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369379+0000","last_change":"2024-05-07T13:55:48.336201+0000","last_active":"2024-05-07T13:56:35.369379+0000","last_peered":"2024-05-07T13:56:35.369379+0000","last_clean":"2024-05-07T13:56:35.369379+0000","last_became_active":"2024-05-07T13:55:48.335740+0000","last_became_peered":"2024-05-07T13:55:48.335740+0000","last_unstale":"2024-05-07T13:56:35.369379+0000","last_undegraded":"2024-05-07T13:56:35.369379+0000","last_fullsized":"2024-05-07T13:56:35.369379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'13","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.510112+0000","last_change":"2024-05-07T13:55:50.316599+0000","last_active":"2024-05-07T13:58:59.510112+0000","last_peered":"2024-05-07T13:58:59.510112+0000","last_clean":"2024-05-07T13:58:59.510112+0000","last_became_active":"2024-05-07T13:55:50.316253+0000","last_became_peered":"2024-05-07T13:55:50.316253+0000","last_unstale":"2024-05-07T13:58:59.510112+0000","last_undegraded":"2024-05-07T13:58:59.510112+0000","last_fullsized":"2024-05-07T13:58:59.510112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:27.304492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.390309+0000","last_change":"2024-05-07T13:55:48.324242+0000","last_active":"2024-05-07T13:58:59.390309+0000","last_peered":"2024-05-07T13:58:59.390309+0000","last_clean":"2024-05-07T13:58:59.390309+0000","last_became_active":"2024-05-07T13:55:48.323151+0000","last_became_peered":"2024-05-07T13:55:48.323151+0000","last_unstale":"2024-05-07T13:58:59.390309+0000","last_undegraded":"2024-05-07T13:58:59.390309+0000","last_fullsized":"2024-05-07T13:58:59.390309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:18:09.959294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358436+0000","last_change":"2024-05-07T13:55:50.322812+0000","last_active":"2024-05-07T13:56:35.358436+0000","last_peered":"2024-05-07T13:56:35.358436+0000","last_clean":"2024-05-07T13:56:35.358436+0000","last_became_active":"2024-05-07T13:55:50.322066+0000","last_became_peered":"2024-05-07T13:55:50.322066+0000","last_unstale":"2024-05-07T13:56:35.358436+0000","last_undegraded":"2024-05-07T13:56:35.358436+0000","last_fullsized":"2024-05-07T13:56:35.358436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:40.527236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360959+0000","last_change":"2024-05-07T13:55:48.350450+0000","last_active":"2024-05-07T13:56:35.360959+0000","last_peered":"2024-05-07T13:56:35.360959+0000","last_clean":"2024-05-07T13:56:35.360959+0000","last_became_active":"2024-05-07T13:55:48.347661+0000","last_became_peered":"2024-05-07T13:55:48.347661+0000","last_unstale":"2024-05-07T13:56:35.360959+0000","last_undegraded":"2024-05-07T13:56:35.360959+0000","last_fullsized":"2024-05-07T13:56:35.360959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:43.418566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358314+0000","last_change":"2024-05-07T13:55:50.322032+0000","last_active":"2024-05-07T13:56:35.358314+0000","last_peered":"2024-05-07T13:56:35.358314+0000","last_clean":"2024-05-07T13:56:35.358314+0000","last_became_active":"2024-05-07T13:55:50.321598+0000","last_became_peered":"2024-05-07T13:55:50.321598+0000","last_unstale":"2024-05-07T13:56:35.358314+0000","last_undegraded":"2024-05-07T13:56:35.358314+0000","last_fullsized":"2024-05-07T13:56:35.358314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:59.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.697458+0000","last_change":"2024-05-07T13:55:48.337861+0000","last_active":"2024-05-07T13:57:58.697458+0000","last_peered":"2024-05-07T13:57:58.697458+0000","last_clean":"2024-05-07T13:57:58.697458+0000","last_became_active":"2024-05-07T13:55:48.337418+0000","last_became_peered":"2024-05-07T13:55:48.337418+0000","last_unstale":"2024-05-07T13:57:58.697458+0000","last_undegraded":"2024-05-07T13:57:58.697458+0000","last_fullsized":"2024-05-07T13:57:58.697458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.245251+0000","last_change":"2024-05-07T13:56:35.367287+0000","last_active":"2024-05-07T13:58:59.245251+0000","last_peered":"2024-05-07T13:58:59.245251+0000","last_clean":"2024-05-07T13:58:59.245251+0000","last_became_active":"2024-05-07T13:56:35.366947+0000","last_became_peered":"2024-05-07T13:56:35.366947+0000","last_unstale":"2024-05-07T13:58:59.245251+0000","last_undegraded":"2024-05-07T13:58:59.245251+0000","last_fullsized":"2024-05-07T13:58:59.245251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:38.628455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358752+0000","last_change":"2024-05-07T13:55:48.349880+0000","last_active":"2024-05-07T13:56:35.358752+0000","last_peered":"2024-05-07T13:56:35.358752+0000","last_clean":"2024-05-07T13:56:35.358752+0000","last_became_active":"2024-05-07T13:55:48.347714+0000","last_became_peered":"2024-05-07T13:55:48.347714+0000","last_unstale":"2024-05-07T13:56:35.358752+0000","last_undegraded":"2024-05-07T13:56:35.358752+0000","last_fullsized":"2024-05-07T13:56:35.358752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:35.715822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'8","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364637+0000","last_change":"2024-05-07T13:55:50.314953+0000","last_active":"2024-05-07T13:56:35.364637+0000","last_peered":"2024-05-07T13:56:35.364637+0000","last_clean":"2024-05-07T13:56:35.364637+0000","last_became_active":"2024-05-07T13:55:50.314660+0000","last_became_peered":"2024-05-07T13:55:50.314660+0000","last_unstale":"2024-05-07T13:56:35.364637+0000","last_undegraded":"2024-05-07T13:56:35.364637+0000","last_fullsized":"2024-05-07T13:56:35.364637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:05.386488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359638+0000","last_change":"2024-05-07T13:55:48.338607+0000","last_active":"2024-05-07T13:56:35.359638+0000","last_peered":"2024-05-07T13:56:35.359638+0000","last_clean":"2024-05-07T13:56:35.359638+0000","last_became_active":"2024-05-07T13:55:48.337256+0000","last_became_peered":"2024-05-07T13:55:48.337256+0000","last_unstale":"2024-05-07T13:56:35.359638+0000","last_undegraded":"2024-05-07T13:56:35.359638+0000","last_fullsized":"2024-05-07T13:56:35.359638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:43.039363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502905+0000","last_change":"2024-05-07T13:55:50.322605+0000","last_active":"2024-05-07T13:58:59.502905+0000","last_peered":"2024-05-07T13:58:59.502905+0000","last_clean":"2024-05-07T13:58:59.502905+0000","last_became_active":"2024-05-07T13:55:50.322204+0000","last_became_peered":"2024-05-07T13:55:50.322204+0000","last_unstale":"2024-05-07T13:58:59.502905+0000","last_undegraded":"2024-05-07T13:58:59.502905+0000","last_fullsized":"2024-05-07T13:58:59.502905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:49.695086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357314+0000","last_change":"2024-05-07T13:55:48.348111+0000","last_active":"2024-05-07T13:56:35.357314+0000","last_peered":"2024-05-07T13:56:35.357314+0000","last_clean":"2024-05-07T13:56:35.357314+0000","last_became_active":"2024-05-07T13:55:48.347006+0000","last_became_peered":"2024-05-07T13:55:48.347006+0000","last_unstale":"2024-05-07T13:56:35.357314+0000","last_undegraded":"2024-05-07T13:56:35.357314+0000","last_fullsized":"2024-05-07T13:56:35.357314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:03:02.570573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.739053+0000","last_change":"2024-05-07T13:55:50.313130+0000","last_active":"2024-05-07T13:57:14.739053+0000","last_peered":"2024-05-07T13:57:14.739053+0000","last_clean":"2024-05-07T13:57:14.739053+0000","last_became_active":"2024-05-07T13:55:50.312835+0000","last_became_peered":"2024-05-07T13:55:50.312835+0000","last_unstale":"2024-05-07T13:57:14.739053+0000","last_undegraded":"2024-05-07T13:57:14.739053+0000","last_fullsized":"2024-05-07T13:57:14.739053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358691+0000","last_change":"2024-05-07T13:55:48.325646+0000","last_active":"2024-05-07T13:56:35.358691+0000","last_peered":"2024-05-07T13:56:35.358691+0000","last_clean":"2024-05-07T13:56:35.358691+0000","last_became_active":"2024-05-07T13:55:48.323612+0000","last_became_peered":"2024-05-07T13:55:48.323612+0000","last_unstale":"2024-05-07T13:56:35.358691+0000","last_undegraded":"2024-05-07T13:56:35.358691+0000","last_fullsized":"2024-05-07T13:56:35.358691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.140533+0000","last_change":"2024-05-07T13:55:50.325361+0000","last_active":"2024-05-07T13:58:59.140533+0000","last_peered":"2024-05-07T13:58:59.140533+0000","last_clean":"2024-05-07T13:58:59.140533+0000","last_became_active":"2024-05-07T13:55:50.325055+0000","last_became_peered":"2024-05-07T13:55:50.325055+0000","last_unstale":"2024-05-07T13:58:59.140533+0000","last_undegraded":"2024-05-07T13:58:59.140533+0000","last_fullsized":"2024-05-07T13:58:59.140533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'22","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502985+0000","last_change":"2024-05-07T13:55:50.321695+0000","last_active":"2024-05-07T13:58:59.502985+0000","last_peered":"2024-05-07T13:58:59.502985+0000","last_clean":"2024-05-07T13:58:59.502985+0000","last_became_active":"2024-05-07T13:55:50.321385+0000","last_became_peered":"2024-05-07T13:55:50.321385+0000","last_unstale":"2024-05-07T13:58:59.502985+0000","last_undegraded":"2024-05-07T13:58:59.502985+0000","last_fullsized":"2024-05-07T13:58:59.502985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:35.440672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366609+0000","last_change":"2024-05-07T13:55:48.335649+0000","last_active":"2024-05-07T13:56:35.366609+0000","last_peered":"2024-05-07T13:56:35.366609+0000","last_clean":"2024-05-07T13:56:35.366609+0000","last_became_active":"2024-05-07T13:55:48.335213+0000","last_became_peered":"2024-05-07T13:55:48.335213+0000","last_unstale":"2024-05-07T13:56:35.366609+0000","last_undegraded":"2024-05-07T13:56:35.366609+0000","last_fullsized":"2024-05-07T13:56:35.366609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'15","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415641+0000","last_change":"2024-05-07T13:55:50.313758+0000","last_active":"2024-05-07T13:58:59.415641+0000","last_peered":"2024-05-07T13:58:59.415641+0000","last_clean":"2024-05-07T13:58:59.415641+0000","last_became_active":"2024-05-07T13:55:50.313457+0000","last_became_peered":"2024-05-07T13:55:50.313457+0000","last_unstale":"2024-05-07T13:58:59.415641+0000","last_undegraded":"2024-05-07T13:58:59.415641+0000","last_fullsized":"2024-05-07T13:58:59.415641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370399+0000","last_change":"2024-05-07T13:55:48.341129+0000","last_active":"2024-05-07T13:56:35.370399+0000","last_peered":"2024-05-07T13:56:35.370399+0000","last_clean":"2024-05-07T13:56:35.370399+0000","last_became_active":"2024-05-07T13:55:48.340516+0000","last_became_peered":"2024-05-07T13:55:48.340516+0000","last_unstale":"2024-05-07T13:56:35.370399+0000","last_undegraded":"2024-05-07T13:56:35.370399+0000","last_fullsized":"2024-05-07T13:56:35.370399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.503272+0000","last_change":"2024-05-07T13:55:50.313924+0000","last_active":"2024-05-07T13:58:59.503272+0000","last_peered":"2024-05-07T13:58:59.503272+0000","last_clean":"2024-05-07T13:58:59.503272+0000","last_became_active":"2024-05-07T13:55:50.313442+0000","last_became_peered":"2024-05-07T13:55:50.313442+0000","last_unstale":"2024-05-07T13:58:59.503272+0000","last_undegraded":"2024-05-07T13:58:59.503272+0000","last_fullsized":"2024-05-07T13:58:59.503272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:52.088546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.632765+0000","last_change":"2024-05-07T13:55:48.339008+0000","last_active":"2024-05-07T13:57:58.632765+0000","last_peered":"2024-05-07T13:57:58.632765+0000","last_clean":"2024-05-07T13:57:58.632765+0000","last_became_active":"2024-05-07T13:55:48.338589+0000","last_became_peered":"2024-05-07T13:55:48.338589+0000","last_unstale":"2024-05-07T13:57:58.632765+0000","last_undegraded":"2024-05-07T13:57:58.632765+0000","last_fullsized":"2024-05-07T13:57:58.632765+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'7","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149687+0000","last_change":"2024-05-07T13:55:50.328784+0000","last_active":"2024-05-07T13:58:59.149687+0000","last_peered":"2024-05-07T13:58:59.149687+0000","last_clean":"2024-05-07T13:58:59.149687+0000","last_became_active":"2024-05-07T13:55:50.328471+0000","last_became_peered":"2024-05-07T13:55:50.328471+0000","last_unstale":"2024-05-07T13:58:59.149687+0000","last_undegraded":"2024-05-07T13:58:59.149687+0000","last_fullsized":"2024-05-07T13:58:59.149687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363639+0000","last_change":"2024-05-07T13:55:48.340701+0000","last_active":"2024-05-07T13:56:35.363639+0000","last_peered":"2024-05-07T13:56:35.363639+0000","last_clean":"2024-05-07T13:56:35.363639+0000","last_became_active":"2024-05-07T13:55:48.340284+0000","last_became_peered":"2024-05-07T13:55:48.340284+0000","last_unstale":"2024-05-07T13:56:35.363639+0000","last_undegraded":"2024-05-07T13:56:35.363639+0000","last_fullsized":"2024-05-07T13:56:35.363639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:03:37.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509996+0000","last_change":"2024-05-07T13:55:50.322836+0000","last_active":"2024-05-07T13:58:59.509996+0000","last_peered":"2024-05-07T13:58:59.509996+0000","last_clean":"2024-05-07T13:58:59.509996+0000","last_became_active":"2024-05-07T13:55:50.322513+0000","last_became_peered":"2024-05-07T13:55:50.322513+0000","last_unstale":"2024-05-07T13:58:59.509996+0000","last_undegraded":"2024-05-07T13:58:59.509996+0000","last_fullsized":"2024-05-07T13:58:59.509996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:05.386488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359883+0000","last_change":"2024-05-07T13:55:48.326455+0000","last_active":"2024-05-07T13:56:35.359883+0000","last_peered":"2024-05-07T13:56:35.359883+0000","last_clean":"2024-05-07T13:56:35.359883+0000","last_became_active":"2024-05-07T13:55:48.325321+0000","last_became_peered":"2024-05-07T13:55:48.325321+0000","last_unstale":"2024-05-07T13:56:35.359883+0000","last_undegraded":"2024-05-07T13:56:35.359883+0000","last_fullsized":"2024-05-07T13:56:35.359883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471610+0000","last_change":"2024-05-07T13:55:50.322751+0000","last_active":"2024-05-07T13:58:59.471610+0000","last_peered":"2024-05-07T13:58:59.471610+0000","last_clean":"2024-05-07T13:58:59.471610+0000","last_became_active":"2024-05-07T13:55:50.322476+0000","last_became_peered":"2024-05-07T13:55:50.322476+0000","last_unstale":"2024-05-07T13:58:59.471610+0000","last_undegraded":"2024-05-07T13:58:59.471610+0000","last_fullsized":"2024-05-07T13:58:59.471610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:06.112406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357654+0000","last_change":"2024-05-07T13:55:48.351155+0000","last_active":"2024-05-07T13:56:35.357654+0000","last_peered":"2024-05-07T13:56:35.357654+0000","last_clean":"2024-05-07T13:56:35.357654+0000","last_became_active":"2024-05-07T13:55:48.348714+0000","last_became_peered":"2024-05-07T13:55:48.348714+0000","last_unstale":"2024-05-07T13:56:35.357654+0000","last_undegraded":"2024-05-07T13:56:35.357654+0000","last_fullsized":"2024-05-07T13:56:35.357654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:56.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'37","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.441141+0000","last_change":"2024-05-07T13:55:58.348302+0000","last_active":"2024-05-07T13:58:59.441141+0000","last_peered":"2024-05-07T13:58:59.441141+0000","last_clean":"2024-05-07T13:58:59.441141+0000","last_became_active":"2024-05-07T13:55:58.347993+0000","last_became_peered":"2024-05-07T13:55:58.347993+0000","last_unstale":"2024-05-07T13:58:59.441141+0000","last_undegraded":"2024-05-07T13:58:59.441141+0000","last_fullsized":"2024-05-07T13:58:59.441141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:48:53.516894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358863+0000","last_change":"2024-05-07T13:55:50.323646+0000","last_active":"2024-05-07T13:56:35.358863+0000","last_peered":"2024-05-07T13:56:35.358863+0000","last_clean":"2024-05-07T13:56:35.358863+0000","last_became_active":"2024-05-07T13:55:50.323355+0000","last_became_peered":"2024-05-07T13:55:50.323355+0000","last_unstale":"2024-05-07T13:56:35.358863+0000","last_undegraded":"2024-05-07T13:56:35.358863+0000","last_fullsized":"2024-05-07T13:56:35.358863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:08.563941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.403334+0000","last_change":"2024-05-07T13:55:48.352275+0000","last_active":"2024-05-07T13:58:59.403334+0000","last_peered":"2024-05-07T13:58:59.403334+0000","last_clean":"2024-05-07T13:58:59.403334+0000","last_became_active":"2024-05-07T13:55:48.350161+0000","last_became_peered":"2024-05-07T13:55:48.350161+0000","last_unstale":"2024-05-07T13:58:59.403334+0000","last_undegraded":"2024-05-07T13:58:59.403334+0000","last_fullsized":"2024-05-07T13:58:59.403334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:28.942263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359868+0000","last_change":"2024-05-07T13:55:52.319295+0000","last_active":"2024-05-07T13:56:35.359868+0000","last_peered":"2024-05-07T13:56:35.359868+0000","last_clean":"2024-05-07T13:56:35.359868+0000","last_became_active":"2024-05-07T13:55:52.318966+0000","last_became_peered":"2024-05-07T13:55:52.318966+0000","last_unstale":"2024-05-07T13:56:35.359868+0000","last_undegraded":"2024-05-07T13:56:35.359868+0000","last_fullsized":"2024-05-07T13:56:35.359868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:08:48.912920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.155499+0000","last_change":"2024-05-07T13:55:54.332167+0000","last_active":"2024-05-07T13:57:57.155499+0000","last_peered":"2024-05-07T13:57:57.155499+0000","last_clean":"2024-05-07T13:57:57.155499+0000","last_became_active":"2024-05-07T13:55:54.331835+0000","last_became_peered":"2024-05-07T13:55:54.331835+0000","last_unstale":"2024-05-07T13:57:57.155499+0000","last_undegraded":"2024-05-07T13:57:57.155499+0000","last_fullsized":"2024-05-07T13:57:57.155499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:49:52.843419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366444+0000","last_change":"2024-05-07T13:55:56.338931+0000","last_active":"2024-05-07T13:56:35.366444+0000","last_peered":"2024-05-07T13:56:35.366444+0000","last_clean":"2024-05-07T13:56:35.366444+0000","last_became_active":"2024-05-07T13:55:56.338638+0000","last_became_peered":"2024-05-07T13:55:56.338638+0000","last_unstale":"2024-05-07T13:56:35.366444+0000","last_undegraded":"2024-05-07T13:56:35.366444+0000","last_fullsized":"2024-05-07T13:56:35.366444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:50.175136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'13","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.744345+0000","last_change":"2024-05-07T13:55:58.348663+0000","last_active":"2024-05-07T13:57:14.744345+0000","last_peered":"2024-05-07T13:57:14.744345+0000","last_clean":"2024-05-07T13:57:14.744345+0000","last_became_active":"2024-05-07T13:55:58.348341+0000","last_became_peered":"2024-05-07T13:55:58.348341+0000","last_unstale":"2024-05-07T13:57:14.744345+0000","last_undegraded":"2024-05-07T13:57:14.744345+0000","last_fullsized":"2024-05-07T13:57:14.744345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:46.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360493+0000","last_change":"2024-05-07T13:55:50.325607+0000","last_active":"2024-05-07T13:56:35.360493+0000","last_peered":"2024-05-07T13:56:35.360493+0000","last_clean":"2024-05-07T13:56:35.360493+0000","last_became_active":"2024-05-07T13:55:50.325201+0000","last_became_peered":"2024-05-07T13:55:50.325201+0000","last_unstale":"2024-05-07T13:56:35.360493+0000","last_undegraded":"2024-05-07T13:56:35.360493+0000","last_fullsized":"2024-05-07T13:56:35.360493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:39.839247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359294+0000","last_change":"2024-05-07T13:55:48.339081+0000","last_active":"2024-05-07T13:56:35.359294+0000","last_peered":"2024-05-07T13:56:35.359294+0000","last_clean":"2024-05-07T13:56:35.359294+0000","last_became_active":"2024-05-07T13:55:48.338704+0000","last_became_peered":"2024-05-07T13:55:48.338704+0000","last_unstale":"2024-05-07T13:56:35.359294+0000","last_undegraded":"2024-05-07T13:56:35.359294+0000","last_fullsized":"2024-05-07T13:56:35.359294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:02:32.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.167968+0000","last_change":"2024-05-07T13:56:35.362029+0000","last_active":"2024-05-07T13:56:38.167968+0000","last_peered":"2024-05-07T13:56:38.167968+0000","last_clean":"2024-05-07T13:56:38.167968+0000","last_became_active":"2024-05-07T13:56:35.361623+0000","last_became_peered":"2024-05-07T13:56:35.361623+0000","last_unstale":"2024-05-07T13:56:38.167968+0000","last_undegraded":"2024-05-07T13:56:38.167968+0000","last_fullsized":"2024-05-07T13:56:38.167968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:19.312383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"27'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.365053+0000","last_change":"2024-05-07T13:55:54.333882+0000","last_active":"2024-05-07T13:56:35.365053+0000","last_peered":"2024-05-07T13:56:35.365053+0000","last_clean":"2024-05-07T13:56:35.365053+0000","last_became_active":"2024-05-07T13:55:54.333402+0000","last_became_peered":"2024-05-07T13:55:54.333402+0000","last_unstale":"2024-05-07T13:56:35.365053+0000","last_undegraded":"2024-05-07T13:56:35.365053+0000","last_fullsized":"2024-05-07T13:56:35.365053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:39.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364824+0000","last_change":"2024-05-07T13:55:56.335951+0000","last_active":"2024-05-07T13:56:35.364824+0000","last_peered":"2024-05-07T13:56:35.364824+0000","last_clean":"2024-05-07T13:56:35.364824+0000","last_became_active":"2024-05-07T13:55:56.335463+0000","last_became_peered":"2024-05-07T13:55:56.335463+0000","last_unstale":"2024-05-07T13:56:35.364824+0000","last_undegraded":"2024-05-07T13:56:35.364824+0000","last_fullsized":"2024-05-07T13:56:35.364824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:46.396698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358195+0000","last_change":"2024-05-07T13:55:58.341190+0000","last_active":"2024-05-07T13:56:35.358195+0000","last_peered":"2024-05-07T13:56:35.358195+0000","last_clean":"2024-05-07T13:56:35.358195+0000","last_became_active":"2024-05-07T13:55:58.340688+0000","last_became_peered":"2024-05-07T13:55:58.340688+0000","last_unstale":"2024-05-07T13:56:35.358195+0000","last_undegraded":"2024-05-07T13:56:35.358195+0000","last_fullsized":"2024-05-07T13:56:35.358195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:49:27.158233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509454+0000","last_change":"2024-05-07T13:55:50.324646+0000","last_active":"2024-05-07T13:58:59.509454+0000","last_peered":"2024-05-07T13:58:59.509454+0000","last_clean":"2024-05-07T13:58:59.509454+0000","last_became_active":"2024-05-07T13:55:50.323775+0000","last_became_peered":"2024-05-07T13:55:50.323775+0000","last_unstale":"2024-05-07T13:58:59.509454+0000","last_undegraded":"2024-05-07T13:58:59.509454+0000","last_fullsized":"2024-05-07T13:58:59.509454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:07:56.445202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.393425+0000","last_change":"2024-05-07T13:55:48.350102+0000","last_active":"2024-05-07T13:58:59.393425+0000","last_peered":"2024-05-07T13:58:59.393425+0000","last_clean":"2024-05-07T13:58:59.393425+0000","last_became_active":"2024-05-07T13:55:48.349636+0000","last_became_peered":"2024-05-07T13:55:48.349636+0000","last_unstale":"2024-05-07T13:58:59.393425+0000","last_undegraded":"2024-05-07T13:58:59.393425+0000","last_fullsized":"2024-05-07T13:58:59.393425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:58.430354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.171913+0000","last_change":"2024-05-07T13:56:35.370451+0000","last_active":"2024-05-07T13:56:38.171913+0000","last_peered":"2024-05-07T13:56:38.171913+0000","last_clean":"2024-05-07T13:56:38.171913+0000","last_became_active":"2024-05-07T13:56:35.370109+0000","last_became_peered":"2024-05-07T13:56:35.370109+0000","last_unstale":"2024-05-07T13:56:38.171913+0000","last_undegraded":"2024-05-07T13:56:38.171913+0000","last_fullsized":"2024-05-07T13:56:38.171913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:20.523325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366990+0000","last_change":"2024-05-07T13:55:54.327564+0000","last_active":"2024-05-07T13:56:35.366990+0000","last_peered":"2024-05-07T13:56:35.366990+0000","last_clean":"2024-05-07T13:56:35.366990+0000","last_became_active":"2024-05-07T13:55:54.327178+0000","last_became_peered":"2024-05-07T13:55:54.327178+0000","last_unstale":"2024-05-07T13:56:35.366990+0000","last_undegraded":"2024-05-07T13:56:35.366990+0000","last_fullsized":"2024-05-07T13:56:35.366990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:53.709163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":390,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405101+0000","last_change":"2024-05-07T13:55:56.347848+0000","last_active":"2024-05-07T13:58:57.405101+0000","last_peered":"2024-05-07T13:58:57.405101+0000","last_clean":"2024-05-07T13:58:57.405101+0000","last_became_active":"2024-05-07T13:55:56.345712+0000","last_became_peered":"2024-05-07T13:55:56.345712+0000","last_unstale":"2024-05-07T13:58:57.405101+0000","last_undegraded":"2024-05-07T13:58:57.405101+0000","last_fullsized":"2024-05-07T13:58:57.405101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:18:51.323865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358426+0000","last_change":"2024-05-07T13:55:58.340114+0000","last_active":"2024-05-07T13:56:35.358426+0000","last_peered":"2024-05-07T13:56:35.358426+0000","last_clean":"2024-05-07T13:56:35.358426+0000","last_became_active":"2024-05-07T13:55:58.339825+0000","last_became_peered":"2024-05-07T13:55:58.339825+0000","last_unstale":"2024-05-07T13:56:35.358426+0000","last_undegraded":"2024-05-07T13:56:35.358426+0000","last_fullsized":"2024-05-07T13:56:35.358426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.742507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361998+0000","last_change":"2024-05-07T13:55:50.319097+0000","last_active":"2024-05-07T13:56:35.361998+0000","last_peered":"2024-05-07T13:56:35.361998+0000","last_clean":"2024-05-07T13:56:35.361998+0000","last_became_active":"2024-05-07T13:55:50.318502+0000","last_became_peered":"2024-05-07T13:55:50.318502+0000","last_unstale":"2024-05-07T13:56:35.361998+0000","last_undegraded":"2024-05-07T13:56:35.361998+0000","last_fullsized":"2024-05-07T13:56:35.361998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:27.304492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360217+0000","last_change":"2024-05-07T13:55:48.345523+0000","last_active":"2024-05-07T13:56:35.360217+0000","last_peered":"2024-05-07T13:56:35.360217+0000","last_clean":"2024-05-07T13:56:35.360217+0000","last_became_active":"2024-05-07T13:55:48.345080+0000","last_became_peered":"2024-05-07T13:55:48.345080+0000","last_unstale":"2024-05-07T13:56:35.360217+0000","last_undegraded":"2024-05-07T13:56:35.360217+0000","last_fullsized":"2024-05-07T13:56:35.360217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:40:38.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360412+0000","last_change":"2024-05-07T13:55:52.318507+0000","last_active":"2024-05-07T13:56:35.360412+0000","last_peered":"2024-05-07T13:56:35.360412+0000","last_clean":"2024-05-07T13:56:35.360412+0000","last_became_active":"2024-05-07T13:55:52.318178+0000","last_became_peered":"2024-05-07T13:55:52.318178+0000","last_unstale":"2024-05-07T13:56:35.360412+0000","last_undegraded":"2024-05-07T13:56:35.360412+0000","last_fullsized":"2024-05-07T13:56:35.360412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:00.831525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.185340+0000","last_change":"2024-05-07T13:55:54.330944+0000","last_active":"2024-05-07T13:58:23.185340+0000","last_peered":"2024-05-07T13:58:23.185340+0000","last_clean":"2024-05-07T13:58:23.185340+0000","last_became_active":"2024-05-07T13:55:54.330662+0000","last_became_peered":"2024-05-07T13:55:54.330662+0000","last_unstale":"2024-05-07T13:58:23.185340+0000","last_undegraded":"2024-05-07T13:58:23.185340+0000","last_fullsized":"2024-05-07T13:58:23.185340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:12.578018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.506255+0000","last_change":"2024-05-07T13:55:56.334463+0000","last_active":"2024-05-07T13:58:59.506255+0000","last_peered":"2024-05-07T13:58:59.506255+0000","last_clean":"2024-05-07T13:58:59.506255+0000","last_became_active":"2024-05-07T13:55:56.334111+0000","last_became_peered":"2024-05-07T13:55:56.334111+0000","last_unstale":"2024-05-07T13:58:59.506255+0000","last_undegraded":"2024-05-07T13:58:59.506255+0000","last_fullsized":"2024-05-07T13:58:59.506255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:37:50.578504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'11","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477925+0000","last_change":"2024-05-07T13:55:50.325659+0000","last_active":"2024-05-07T13:58:59.477925+0000","last_peered":"2024-05-07T13:58:59.477925+0000","last_clean":"2024-05-07T13:58:59.477925+0000","last_became_active":"2024-05-07T13:55:50.324820+0000","last_became_peered":"2024-05-07T13:55:50.324820+0000","last_unstale":"2024-05-07T13:58:59.477925+0000","last_undegraded":"2024-05-07T13:58:59.477925+0000","last_fullsized":"2024-05-07T13:58:59.477925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:06.283557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369244+0000","last_change":"2024-05-07T13:55:48.335906+0000","last_active":"2024-05-07T13:56:35.369244+0000","last_peered":"2024-05-07T13:56:35.369244+0000","last_clean":"2024-05-07T13:56:35.369244+0000","last_became_active":"2024-05-07T13:55:48.335443+0000","last_became_peered":"2024-05-07T13:55:48.335443+0000","last_unstale":"2024-05-07T13:56:35.369244+0000","last_undegraded":"2024-05-07T13:56:35.369244+0000","last_fullsized":"2024-05-07T13:56:35.369244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361209+0000","last_change":"2024-05-07T13:55:52.322554+0000","last_active":"2024-05-07T13:56:35.361209+0000","last_peered":"2024-05-07T13:56:35.361209+0000","last_clean":"2024-05-07T13:56:35.361209+0000","last_became_active":"2024-05-07T13:55:52.322188+0000","last_became_peered":"2024-05-07T13:55:52.322188+0000","last_unstale":"2024-05-07T13:56:35.361209+0000","last_undegraded":"2024-05-07T13:56:35.361209+0000","last_fullsized":"2024-05-07T13:56:35.361209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:10.020335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.159540+0000","last_change":"2024-05-07T13:55:54.330742+0000","last_active":"2024-05-07T13:57:57.159540+0000","last_peered":"2024-05-07T13:57:57.159540+0000","last_clean":"2024-05-07T13:57:57.159540+0000","last_became_active":"2024-05-07T13:55:54.330401+0000","last_became_peered":"2024-05-07T13:55:54.330401+0000","last_unstale":"2024-05-07T13:57:57.159540+0000","last_undegraded":"2024-05-07T13:57:57.159540+0000","last_fullsized":"2024-05-07T13:57:57.159540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:16.443532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359580+0000","last_change":"2024-05-07T13:55:56.334861+0000","last_active":"2024-05-07T13:56:35.359580+0000","last_peered":"2024-05-07T13:56:35.359580+0000","last_clean":"2024-05-07T13:56:35.359580+0000","last_became_active":"2024-05-07T13:55:56.334368+0000","last_became_peered":"2024-05-07T13:55:56.334368+0000","last_unstale":"2024-05-07T13:56:35.359580+0000","last_undegraded":"2024-05-07T13:56:35.359580+0000","last_fullsized":"2024-05-07T13:56:35.359580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:57.692076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.746003+0000","last_change":"2024-05-07T13:55:58.346747+0000","last_active":"2024-05-07T13:57:14.746003+0000","last_peered":"2024-05-07T13:57:14.746003+0000","last_clean":"2024-05-07T13:57:14.746003+0000","last_became_active":"2024-05-07T13:55:58.346457+0000","last_became_peered":"2024-05-07T13:55:58.346457+0000","last_unstale":"2024-05-07T13:57:14.746003+0000","last_undegraded":"2024-05-07T13:57:14.746003+0000","last_fullsized":"2024-05-07T13:57:14.746003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:02:07.921627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723506+0000","last_change":"2024-05-07T13:55:50.312874+0000","last_active":"2024-05-07T13:57:58.723506+0000","last_peered":"2024-05-07T13:57:58.723506+0000","last_clean":"2024-05-07T13:57:58.723506+0000","last_became_active":"2024-05-07T13:55:50.312564+0000","last_became_peered":"2024-05-07T13:55:50.312564+0000","last_unstale":"2024-05-07T13:57:58.723506+0000","last_undegraded":"2024-05-07T13:57:58.723506+0000","last_fullsized":"2024-05-07T13:57:58.723506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369832+0000","last_change":"2024-05-07T13:55:48.336211+0000","last_active":"2024-05-07T13:56:35.369832+0000","last_peered":"2024-05-07T13:56:35.369832+0000","last_clean":"2024-05-07T13:56:35.369832+0000","last_became_active":"2024-05-07T13:55:48.335791+0000","last_became_peered":"2024-05-07T13:55:48.335791+0000","last_unstale":"2024-05-07T13:56:35.369832+0000","last_undegraded":"2024-05-07T13:56:35.369832+0000","last_fullsized":"2024-05-07T13:56:35.369832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358813+0000","last_change":"2024-05-07T13:55:52.326024+0000","last_active":"2024-05-07T13:56:35.358813+0000","last_peered":"2024-05-07T13:56:35.358813+0000","last_clean":"2024-05-07T13:56:35.358813+0000","last_became_active":"2024-05-07T13:55:52.325676+0000","last_became_peered":"2024-05-07T13:55:52.325676+0000","last_unstale":"2024-05-07T13:56:35.358813+0000","last_undegraded":"2024-05-07T13:56:35.358813+0000","last_fullsized":"2024-05-07T13:56:35.358813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:11.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'33","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.139118+0000","last_change":"2024-05-07T13:55:54.332289+0000","last_active":"2024-05-07T13:57:57.139118+0000","last_peered":"2024-05-07T13:57:57.139118+0000","last_clean":"2024-05-07T13:57:57.139118+0000","last_became_active":"2024-05-07T13:55:54.331979+0000","last_became_peered":"2024-05-07T13:55:54.331979+0000","last_unstale":"2024-05-07T13:57:57.139118+0000","last_undegraded":"2024-05-07T13:57:57.139118+0000","last_fullsized":"2024-05-07T13:57:57.139118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:00:56.934082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359423+0000","last_change":"2024-05-07T13:55:56.333704+0000","last_active":"2024-05-07T13:56:35.359423+0000","last_peered":"2024-05-07T13:56:35.359423+0000","last_clean":"2024-05-07T13:56:35.359423+0000","last_became_active":"2024-05-07T13:55:56.333357+0000","last_became_peered":"2024-05-07T13:55:56.333357+0000","last_unstale":"2024-05-07T13:56:35.359423+0000","last_undegraded":"2024-05-07T13:56:35.359423+0000","last_fullsized":"2024-05-07T13:56:35.359423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:08:52.926954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:09.129804+0000","last_change":"2024-05-07T13:55:58.345252+0000","last_active":"2024-05-07T13:57:09.129804+0000","last_peered":"2024-05-07T13:57:09.129804+0000","last_clean":"2024-05-07T13:57:09.129804+0000","last_became_active":"2024-05-07T13:55:58.344955+0000","last_became_peered":"2024-05-07T13:55:58.344955+0000","last_unstale":"2024-05-07T13:57:09.129804+0000","last_undegraded":"2024-05-07T13:57:09.129804+0000","last_fullsized":"2024-05-07T13:57:09.129804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:24.188610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.252302+0000","last_change":"2024-05-07T13:55:50.327717+0000","last_active":"2024-05-07T13:58:59.252302+0000","last_peered":"2024-05-07T13:58:59.252302+0000","last_clean":"2024-05-07T13:58:59.252302+0000","last_became_active":"2024-05-07T13:55:50.327059+0000","last_became_peered":"2024-05-07T13:55:50.327059+0000","last_unstale":"2024-05-07T13:58:59.252302+0000","last_undegraded":"2024-05-07T13:58:59.252302+0000","last_fullsized":"2024-05-07T13:58:59.252302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:49.671647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360718+0000","last_change":"2024-05-07T13:55:48.350939+0000","last_active":"2024-05-07T13:56:35.360718+0000","last_peered":"2024-05-07T13:56:35.360718+0000","last_clean":"2024-05-07T13:56:35.360718+0000","last_became_active":"2024-05-07T13:55:48.350442+0000","last_became_peered":"2024-05-07T13:55:48.350442+0000","last_unstale":"2024-05-07T13:56:35.360718+0000","last_undegraded":"2024-05-07T13:56:35.360718+0000","last_fullsized":"2024-05-07T13:56:35.360718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:13.461398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359027+0000","last_change":"2024-05-07T13:55:52.321998+0000","last_active":"2024-05-07T13:56:35.359027+0000","last_peered":"2024-05-07T13:56:35.359027+0000","last_clean":"2024-05-07T13:56:35.359027+0000","last_became_active":"2024-05-07T13:55:52.321674+0000","last_became_peered":"2024-05-07T13:55:52.321674+0000","last_unstale":"2024-05-07T13:56:35.359027+0000","last_undegraded":"2024-05-07T13:56:35.359027+0000","last_fullsized":"2024-05-07T13:56:35.359027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:09.668336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.161433+0000","last_change":"2024-05-07T13:55:54.325770+0000","last_active":"2024-05-07T13:57:57.161433+0000","last_peered":"2024-05-07T13:57:57.161433+0000","last_clean":"2024-05-07T13:57:57.161433+0000","last_became_active":"2024-05-07T13:55:54.325336+0000","last_became_peered":"2024-05-07T13:55:54.325336+0000","last_unstale":"2024-05-07T13:57:57.161433+0000","last_undegraded":"2024-05-07T13:57:57.161433+0000","last_fullsized":"2024-05-07T13:57:57.161433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:56:55.004347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.676575+0000","last_change":"2024-05-07T13:55:56.335209+0000","last_active":"2024-05-07T13:58:59.676575+0000","last_peered":"2024-05-07T13:58:59.676575+0000","last_clean":"2024-05-07T13:58:59.676575+0000","last_became_active":"2024-05-07T13:55:56.334895+0000","last_became_peered":"2024-05-07T13:55:56.334895+0000","last_unstale":"2024-05-07T13:58:59.676575+0000","last_undegraded":"2024-05-07T13:58:59.676575+0000","last_fullsized":"2024-05-07T13:58:59.676575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:42.722681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.928109+0000","last_change":"2024-05-07T13:55:58.341127+0000","last_active":"2024-05-07T13:57:14.928109+0000","last_peered":"2024-05-07T13:57:14.928109+0000","last_clean":"2024-05-07T13:57:14.928109+0000","last_became_active":"2024-05-07T13:55:58.340764+0000","last_became_peered":"2024-05-07T13:55:58.340764+0000","last_unstale":"2024-05-07T13:57:14.928109+0000","last_undegraded":"2024-05-07T13:57:14.928109+0000","last_fullsized":"2024-05-07T13:57:14.928109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:56:59.018427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.591694+0000","last_change":"2024-05-07T13:55:50.313309+0000","last_active":"2024-05-07T13:58:59.591694+0000","last_peered":"2024-05-07T13:58:59.591694+0000","last_clean":"2024-05-07T13:58:59.591694+0000","last_became_active":"2024-05-07T13:55:50.312649+0000","last_became_peered":"2024-05-07T13:55:50.312649+0000","last_unstale":"2024-05-07T13:58:59.591694+0000","last_undegraded":"2024-05-07T13:58:59.591694+0000","last_fullsized":"2024-05-07T13:58:59.591694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:05.135442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358043+0000","last_change":"2024-05-07T13:55:48.347430+0000","last_active":"2024-05-07T13:56:35.358043+0000","last_peered":"2024-05-07T13:56:35.358043+0000","last_clean":"2024-05-07T13:56:35.358043+0000","last_became_active":"2024-05-07T13:55:48.346027+0000","last_became_peered":"2024-05-07T13:55:48.346027+0000","last_unstale":"2024-05-07T13:56:35.358043+0000","last_undegraded":"2024-05-07T13:56:35.358043+0000","last_fullsized":"2024-05-07T13:56:35.358043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:17.757284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359224+0000","last_change":"2024-05-07T13:55:52.325971+0000","last_active":"2024-05-07T13:56:35.359224+0000","last_peered":"2024-05-07T13:56:35.359224+0000","last_clean":"2024-05-07T13:56:35.359224+0000","last_became_active":"2024-05-07T13:55:52.325427+0000","last_became_peered":"2024-05-07T13:55:52.325427+0000","last_unstale":"2024-05-07T13:56:35.359224+0000","last_undegraded":"2024-05-07T13:56:35.359224+0000","last_fullsized":"2024-05-07T13:56:35.359224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:46:31.400962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.163338+0000","last_change":"2024-05-07T13:55:54.334756+0000","last_active":"2024-05-07T13:57:57.163338+0000","last_peered":"2024-05-07T13:57:57.163338+0000","last_clean":"2024-05-07T13:57:57.163338+0000","last_became_active":"2024-05-07T13:55:54.334315+0000","last_became_peered":"2024-05-07T13:55:54.334315+0000","last_unstale":"2024-05-07T13:57:57.163338+0000","last_undegraded":"2024-05-07T13:57:57.163338+0000","last_fullsized":"2024-05-07T13:57:57.163338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:20.597897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358395+0000","last_change":"2024-05-07T13:55:56.330997+0000","last_active":"2024-05-07T13:56:35.358395+0000","last_peered":"2024-05-07T13:56:35.358395+0000","last_clean":"2024-05-07T13:56:35.358395+0000","last_became_active":"2024-05-07T13:55:56.330355+0000","last_became_peered":"2024-05-07T13:55:56.330355+0000","last_unstale":"2024-05-07T13:56:35.358395+0000","last_undegraded":"2024-05-07T13:56:35.358395+0000","last_fullsized":"2024-05-07T13:56:35.358395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:50.175136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.648614+0000","last_change":"2024-05-07T13:55:58.337164+0000","last_active":"2024-05-07T13:58:59.648614+0000","last_peered":"2024-05-07T13:58:59.648614+0000","last_clean":"2024-05-07T13:58:59.648614+0000","last_became_active":"2024-05-07T13:55:58.336692+0000","last_became_peered":"2024-05-07T13:55:58.336692+0000","last_unstale":"2024-05-07T13:58:59.648614+0000","last_undegraded":"2024-05-07T13:58:59.648614+0000","last_fullsized":"2024-05-07T13:58:59.648614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:54:59.700436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.143745+0000","last_change":"2024-05-07T13:55:50.323082+0000","last_active":"2024-05-07T13:58:59.143745+0000","last_peered":"2024-05-07T13:58:59.143745+0000","last_clean":"2024-05-07T13:58:59.143745+0000","last_became_active":"2024-05-07T13:55:50.322764+0000","last_became_peered":"2024-05-07T13:55:50.322764+0000","last_unstale":"2024-05-07T13:58:59.143745+0000","last_undegraded":"2024-05-07T13:58:59.143745+0000","last_fullsized":"2024-05-07T13:58:59.143745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.178785+0000","last_change":"2024-05-07T13:55:48.325995+0000","last_active":"2024-05-07T13:58:03.178785+0000","last_peered":"2024-05-07T13:58:03.178785+0000","last_clean":"2024-05-07T13:58:03.178785+0000","last_became_active":"2024-05-07T13:55:48.325075+0000","last_became_peered":"2024-05-07T13:55:48.325075+0000","last_unstale":"2024-05-07T13:58:03.178785+0000","last_undegraded":"2024-05-07T13:58:03.178785+0000","last_fullsized":"2024-05-07T13:58:03.178785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.368200+0000","last_change":"2024-05-07T13:55:52.322042+0000","last_active":"2024-05-07T13:56:35.368200+0000","last_peered":"2024-05-07T13:56:35.368200+0000","last_clean":"2024-05-07T13:56:35.368200+0000","last_became_active":"2024-05-07T13:55:52.321730+0000","last_became_peered":"2024-05-07T13:55:52.321730+0000","last_unstale":"2024-05-07T13:56:35.368200+0000","last_undegraded":"2024-05-07T13:56:35.368200+0000","last_fullsized":"2024-05-07T13:56:35.368200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:57:20.455708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181998+0000","last_change":"2024-05-07T13:55:54.327401+0000","last_active":"2024-05-07T13:58:13.181998+0000","last_peered":"2024-05-07T13:58:13.181998+0000","last_clean":"2024-05-07T13:58:13.181998+0000","last_became_active":"2024-05-07T13:55:54.324530+0000","last_became_peered":"2024-05-07T13:55:54.324530+0000","last_unstale":"2024-05-07T13:58:13.181998+0000","last_undegraded":"2024-05-07T13:58:13.181998+0000","last_fullsized":"2024-05-07T13:58:13.181998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:18.265571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361297+0000","last_change":"2024-05-07T13:55:56.344241+0000","last_active":"2024-05-07T13:56:35.361297+0000","last_peered":"2024-05-07T13:56:35.361297+0000","last_clean":"2024-05-07T13:56:35.361297+0000","last_became_active":"2024-05-07T13:55:56.343900+0000","last_became_peered":"2024-05-07T13:55:56.343900+0000","last_unstale":"2024-05-07T13:56:35.361297+0000","last_undegraded":"2024-05-07T13:56:35.361297+0000","last_fullsized":"2024-05-07T13:56:35.361297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:44.620800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.179998+0000","last_change":"2024-05-07T13:55:58.352050+0000","last_active":"2024-05-07T13:57:58.179998+0000","last_peered":"2024-05-07T13:57:58.179998+0000","last_clean":"2024-05-07T13:57:58.179998+0000","last_became_active":"2024-05-07T13:55:58.351724+0000","last_became_peered":"2024-05-07T13:55:58.351724+0000","last_unstale":"2024-05-07T13:57:58.179998+0000","last_undegraded":"2024-05-07T13:57:58.179998+0000","last_fullsized":"2024-05-07T13:57:58.179998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:24.287671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.724211+0000","last_change":"2024-05-07T13:55:50.330503+0000","last_active":"2024-05-07T13:57:58.724211+0000","last_peered":"2024-05-07T13:57:58.724211+0000","last_clean":"2024-05-07T13:57:58.724211+0000","last_became_active":"2024-05-07T13:55:50.326050+0000","last_became_peered":"2024-05-07T13:55:50.326050+0000","last_unstale":"2024-05-07T13:57:58.724211+0000","last_undegraded":"2024-05-07T13:57:58.724211+0000","last_fullsized":"2024-05-07T13:57:58.724211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:35.534512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358437+0000","last_change":"2024-05-07T13:55:48.352032+0000","last_active":"2024-05-07T13:56:35.358437+0000","last_peered":"2024-05-07T13:56:35.358437+0000","last_clean":"2024-05-07T13:56:35.358437+0000","last_became_active":"2024-05-07T13:55:48.350335+0000","last_became_peered":"2024-05-07T13:55:48.350335+0000","last_unstale":"2024-05-07T13:56:35.358437+0000","last_undegraded":"2024-05-07T13:56:35.358437+0000","last_fullsized":"2024-05-07T13:56:35.358437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:46.976702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.364086+0000","last_change":"2024-05-07T13:55:52.322369+0000","last_active":"2024-05-07T13:57:58.364086+0000","last_peered":"2024-05-07T13:57:58.364086+0000","last_clean":"2024-05-07T13:57:58.364086+0000","last_became_active":"2024-05-07T13:55:52.322006+0000","last_became_peered":"2024-05-07T13:55:52.322006+0000","last_unstale":"2024-05-07T13:57:58.364086+0000","last_undegraded":"2024-05-07T13:57:58.364086+0000","last_fullsized":"2024-05-07T13:57:58.364086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:14.436330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.170397+0000","last_change":"2024-05-07T13:55:54.320190+0000","last_active":"2024-05-07T13:57:57.170397+0000","last_peered":"2024-05-07T13:57:57.170397+0000","last_clean":"2024-05-07T13:57:57.170397+0000","last_became_active":"2024-05-07T13:55:54.319812+0000","last_became_peered":"2024-05-07T13:55:54.319812+0000","last_unstale":"2024-05-07T13:57:57.170397+0000","last_undegraded":"2024-05-07T13:57:57.170397+0000","last_fullsized":"2024-05-07T13:57:57.170397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:33.788094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.665948+0000","last_change":"2024-05-07T13:55:56.332248+0000","last_active":"2024-05-07T13:58:59.665948+0000","last_peered":"2024-05-07T13:58:59.665948+0000","last_clean":"2024-05-07T13:58:59.665948+0000","last_became_active":"2024-05-07T13:55:56.331966+0000","last_became_peered":"2024-05-07T13:55:56.331966+0000","last_unstale":"2024-05-07T13:58:59.665948+0000","last_undegraded":"2024-05-07T13:58:59.665948+0000","last_fullsized":"2024-05-07T13:58:59.665948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:41.555422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.507257+0000","last_change":"2024-05-07T13:55:58.340997+0000","last_active":"2024-05-07T13:58:59.507257+0000","last_peered":"2024-05-07T13:58:59.507257+0000","last_clean":"2024-05-07T13:58:59.507257+0000","last_became_active":"2024-05-07T13:55:58.340608+0000","last_became_peered":"2024-05-07T13:55:58.340608+0000","last_unstale":"2024-05-07T13:58:59.507257+0000","last_undegraded":"2024-05-07T13:58:59.507257+0000","last_fullsized":"2024-05-07T13:58:59.507257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:04.022939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.246015+0000","last_change":"2024-05-07T13:55:50.322925+0000","last_active":"2024-05-07T13:58:59.246015+0000","last_peered":"2024-05-07T13:58:59.246015+0000","last_clean":"2024-05-07T13:58:59.246015+0000","last_became_active":"2024-05-07T13:55:50.322650+0000","last_became_peered":"2024-05-07T13:55:50.322650+0000","last_unstale":"2024-05-07T13:58:59.246015+0000","last_undegraded":"2024-05-07T13:58:59.246015+0000","last_fullsized":"2024-05-07T13:58:59.246015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357841+0000","last_change":"2024-05-07T13:55:48.349364+0000","last_active":"2024-05-07T13:56:35.357841+0000","last_peered":"2024-05-07T13:56:35.357841+0000","last_clean":"2024-05-07T13:56:35.357841+0000","last_became_active":"2024-05-07T13:55:48.347434+0000","last_became_peered":"2024-05-07T13:55:48.347434+0000","last_unstale":"2024-05-07T13:56:35.357841+0000","last_undegraded":"2024-05-07T13:56:35.357841+0000","last_fullsized":"2024-05-07T13:56:35.357841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:21.121562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.363686+0000","last_change":"2024-05-07T13:55:52.321582+0000","last_active":"2024-05-07T13:57:58.363686+0000","last_peered":"2024-05-07T13:57:58.363686+0000","last_clean":"2024-05-07T13:57:58.363686+0000","last_became_active":"2024-05-07T13:55:52.321251+0000","last_became_peered":"2024-05-07T13:55:52.321251+0000","last_unstale":"2024-05-07T13:57:58.363686+0000","last_undegraded":"2024-05-07T13:57:58.363686+0000","last_fullsized":"2024-05-07T13:57:58.363686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:47.624596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359197+0000","last_change":"2024-05-07T13:55:54.332203+0000","last_active":"2024-05-07T13:56:35.359197+0000","last_peered":"2024-05-07T13:56:35.359197+0000","last_clean":"2024-05-07T13:56:35.359197+0000","last_became_active":"2024-05-07T13:55:54.331844+0000","last_became_peered":"2024-05-07T13:55:54.331844+0000","last_unstale":"2024-05-07T13:56:35.359197+0000","last_undegraded":"2024-05-07T13:56:35.359197+0000","last_fullsized":"2024-05-07T13:56:35.359197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:37:22.283720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.595950+0000","last_change":"2024-05-07T13:55:56.333205+0000","last_active":"2024-05-07T13:58:59.595950+0000","last_peered":"2024-05-07T13:58:59.595950+0000","last_clean":"2024-05-07T13:58:59.595950+0000","last_became_active":"2024-05-07T13:55:56.332858+0000","last_became_peered":"2024-05-07T13:55:56.332858+0000","last_unstale":"2024-05-07T13:58:59.595950+0000","last_undegraded":"2024-05-07T13:58:59.595950+0000","last_fullsized":"2024-05-07T13:58:59.595950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:19.698130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.507540+0000","last_change":"2024-05-07T13:55:58.335655+0000","last_active":"2024-05-07T13:57:58.507540+0000","last_peered":"2024-05-07T13:57:58.507540+0000","last_clean":"2024-05-07T13:57:58.507540+0000","last_became_active":"2024-05-07T13:55:58.335341+0000","last_became_peered":"2024-05-07T13:55:58.335341+0000","last_unstale":"2024-05-07T13:57:58.507540+0000","last_undegraded":"2024-05-07T13:57:58.507540+0000","last_fullsized":"2024-05-07T13:57:58.507540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:07.873806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477769+0000","last_change":"2024-05-07T13:55:50.331652+0000","last_active":"2024-05-07T13:58:59.477769+0000","last_peered":"2024-05-07T13:58:59.477769+0000","last_clean":"2024-05-07T13:58:59.477769+0000","last_became_active":"2024-05-07T13:55:50.331295+0000","last_became_peered":"2024-05-07T13:55:50.331295+0000","last_unstale":"2024-05-07T13:58:59.477769+0000","last_undegraded":"2024-05-07T13:58:59.477769+0000","last_fullsized":"2024-05-07T13:58:59.477769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:51:22.677704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357223+0000","last_change":"2024-05-07T13:55:48.352519+0000","last_active":"2024-05-07T13:56:35.357223+0000","last_peered":"2024-05-07T13:56:35.357223+0000","last_clean":"2024-05-07T13:56:35.357223+0000","last_became_active":"2024-05-07T13:55:48.351055+0000","last_became_peered":"2024-05-07T13:55:48.351055+0000","last_unstale":"2024-05-07T13:56:35.357223+0000","last_undegraded":"2024-05-07T13:56:35.357223+0000","last_fullsized":"2024-05-07T13:56:35.357223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:13:23.846967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"29'4","reported_seq":226,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.352994+0000","last_change":"2024-05-07T13:55:52.320405+0000","last_active":"2024-05-07T13:57:58.352994+0000","last_peered":"2024-05-07T13:57:58.352994+0000","last_clean":"2024-05-07T13:57:58.352994+0000","last_became_active":"2024-05-07T13:55:52.320027+0000","last_became_peered":"2024-05-07T13:55:52.320027+0000","last_unstale":"2024-05-07T13:57:58.352994+0000","last_undegraded":"2024-05-07T13:57:58.352994+0000","last_fullsized":"2024-05-07T13:57:58.352994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:36.196536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'39","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.156522+0000","last_change":"2024-05-07T13:55:54.334106+0000","last_active":"2024-05-07T13:57:57.156522+0000","last_peered":"2024-05-07T13:57:57.156522+0000","last_clean":"2024-05-07T13:57:57.156522+0000","last_became_active":"2024-05-07T13:55:54.333766+0000","last_became_peered":"2024-05-07T13:55:54.333766+0000","last_unstale":"2024-05-07T13:57:57.156522+0000","last_undegraded":"2024-05-07T13:57:57.156522+0000","last_fullsized":"2024-05-07T13:57:57.156522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:56.275417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366808+0000","last_change":"2024-05-07T13:55:56.338510+0000","last_active":"2024-05-07T13:56:35.366808+0000","last_peered":"2024-05-07T13:56:35.366808+0000","last_clean":"2024-05-07T13:56:35.366808+0000","last_became_active":"2024-05-07T13:55:56.338195+0000","last_became_peered":"2024-05-07T13:55:56.338195+0000","last_unstale":"2024-05-07T13:56:35.366808+0000","last_undegraded":"2024-05-07T13:56:35.366808+0000","last_fullsized":"2024-05-07T13:56:35.366808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:41.461582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.544535+0000","last_change":"2024-05-07T13:55:58.346374+0000","last_active":"2024-05-07T13:58:59.544535+0000","last_peered":"2024-05-07T13:58:59.544535+0000","last_clean":"2024-05-07T13:58:59.544535+0000","last_became_active":"2024-05-07T13:55:58.346040+0000","last_became_peered":"2024-05-07T13:55:58.346040+0000","last_unstale":"2024-05-07T13:58:59.544535+0000","last_undegraded":"2024-05-07T13:58:59.544535+0000","last_fullsized":"2024-05-07T13:58:59.544535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.039656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'16","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.143397+0000","last_change":"2024-05-07T13:56:35.374383+0000","last_active":"2024-05-07T13:58:59.143397+0000","last_peered":"2024-05-07T13:58:59.143397+0000","last_clean":"2024-05-07T13:58:59.143397+0000","last_became_active":"2024-05-07T13:56:35.369148+0000","last_became_peered":"2024-05-07T13:56:35.369148+0000","last_unstale":"2024-05-07T13:58:59.143397+0000","last_undegraded":"2024-05-07T13:58:59.143397+0000","last_fullsized":"2024-05-07T13:58:59.143397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:30.011499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359758+0000","last_change":"2024-05-07T13:55:40.043635+0000","last_active":"2024-05-07T13:56:35.359758+0000","last_peered":"2024-05-07T13:56:35.359758+0000","last_clean":"2024-05-07T13:56:35.359758+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:56:35.359758+0000","last_undegraded":"2024-05-07T13:56:35.359758+0000","last_fullsized":"2024-05-07T13:56:35.359758+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:01:05.355008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358964+0000","last_change":"2024-05-07T13:55:40.045474+0000","last_active":"2024-05-07T13:56:35.358964+0000","last_peered":"2024-05-07T13:56:35.358964+0000","last_clean":"2024-05-07T13:56:35.358964+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T13:56:35.358964+0000","last_undegraded":"2024-05-07T13:56:35.358964+0000","last_fullsized":"2024-05-07T13:56:35.358964+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:03.440717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.728528+0000","last_change":"2024-05-07T13:55:48.352406+0000","last_active":"2024-05-07T13:57:14.728528+0000","last_peered":"2024-05-07T13:57:14.728528+0000","last_clean":"2024-05-07T13:57:14.728528+0000","last_became_active":"2024-05-07T13:55:48.350998+0000","last_became_peered":"2024-05-07T13:55:48.350998+0000","last_unstale":"2024-05-07T13:57:14.728528+0000","last_undegraded":"2024-05-07T13:57:14.728528+0000","last_fullsized":"2024-05-07T13:57:14.728528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:52.052094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364056+0000","last_change":"2024-05-07T13:55:52.321728+0000","last_active":"2024-05-07T13:56:35.364056+0000","last_peered":"2024-05-07T13:56:35.364056+0000","last_clean":"2024-05-07T13:56:35.364056+0000","last_became_active":"2024-05-07T13:55:52.321406+0000","last_became_peered":"2024-05-07T13:55:52.321406+0000","last_unstale":"2024-05-07T13:56:35.364056+0000","last_undegraded":"2024-05-07T13:56:35.364056+0000","last_fullsized":"2024-05-07T13:56:35.364056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:35.607190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.167946+0000","last_change":"2024-05-07T13:55:54.329086+0000","last_active":"2024-05-07T13:57:57.167946+0000","last_peered":"2024-05-07T13:57:57.167946+0000","last_clean":"2024-05-07T13:57:57.167946+0000","last_became_active":"2024-05-07T13:55:54.328677+0000","last_became_peered":"2024-05-07T13:55:54.328677+0000","last_unstale":"2024-05-07T13:57:57.167946+0000","last_undegraded":"2024-05-07T13:57:57.167946+0000","last_fullsized":"2024-05-07T13:57:57.167946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:31:48.109295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359644+0000","last_change":"2024-05-07T13:55:56.335298+0000","last_active":"2024-05-07T13:56:35.359644+0000","last_peered":"2024-05-07T13:56:35.359644+0000","last_clean":"2024-05-07T13:56:35.359644+0000","last_became_active":"2024-05-07T13:55:56.335013+0000","last_became_peered":"2024-05-07T13:55:56.335013+0000","last_unstale":"2024-05-07T13:56:35.359644+0000","last_undegraded":"2024-05-07T13:56:35.359644+0000","last_fullsized":"2024-05-07T13:56:35.359644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:04.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'82","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.513260+0000","last_change":"2024-05-07T13:55:58.335516+0000","last_active":"2024-05-07T13:58:59.513260+0000","last_peered":"2024-05-07T13:58:59.513260+0000","last_clean":"2024-05-07T13:58:59.513260+0000","last_became_active":"2024-05-07T13:55:58.335220+0000","last_became_peered":"2024-05-07T13:55:58.335220+0000","last_unstale":"2024-05-07T13:58:59.513260+0000","last_undegraded":"2024-05-07T13:58:59.513260+0000","last_fullsized":"2024-05-07T13:58:59.513260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:01:58.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.476754+0000","last_change":"2024-05-07T13:55:50.324475+0000","last_active":"2024-05-07T13:58:59.476754+0000","last_peered":"2024-05-07T13:58:59.476754+0000","last_clean":"2024-05-07T13:58:59.476754+0000","last_became_active":"2024-05-07T13:55:50.323408+0000","last_became_peered":"2024-05-07T13:55:50.323408+0000","last_unstale":"2024-05-07T13:58:59.476754+0000","last_undegraded":"2024-05-07T13:58:59.476754+0000","last_fullsized":"2024-05-07T13:58:59.476754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:26:01.826472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356763+0000","last_change":"2024-05-07T13:55:40.043428+0000","last_active":"2024-05-07T13:56:35.356763+0000","last_peered":"2024-05-07T13:56:35.356763+0000","last_clean":"2024-05-07T13:56:35.356763+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T13:56:35.356763+0000","last_undegraded":"2024-05-07T13:56:35.356763+0000","last_fullsized":"2024-05-07T13:56:35.356763+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:34.894187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358426+0000","last_change":"2024-05-07T13:55:48.327071+0000","last_active":"2024-05-07T13:56:35.358426+0000","last_peered":"2024-05-07T13:56:35.358426+0000","last_clean":"2024-05-07T13:56:35.358426+0000","last_became_active":"2024-05-07T13:55:48.325905+0000","last_became_peered":"2024-05-07T13:55:48.325905+0000","last_unstale":"2024-05-07T13:56:35.358426+0000","last_undegraded":"2024-05-07T13:56:35.358426+0000","last_fullsized":"2024-05-07T13:56:35.358426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361487+0000","last_change":"2024-05-07T13:55:52.318581+0000","last_active":"2024-05-07T13:56:35.361487+0000","last_peered":"2024-05-07T13:56:35.361487+0000","last_clean":"2024-05-07T13:56:35.361487+0000","last_became_active":"2024-05-07T13:55:52.318221+0000","last_became_peered":"2024-05-07T13:55:52.318221+0000","last_unstale":"2024-05-07T13:56:35.361487+0000","last_undegraded":"2024-05-07T13:56:35.361487+0000","last_fullsized":"2024-05-07T13:56:35.361487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:37:46.564469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405111+0000","last_change":"2024-05-07T13:55:54.330092+0000","last_active":"2024-05-07T13:58:57.405111+0000","last_peered":"2024-05-07T13:58:57.405111+0000","last_clean":"2024-05-07T13:58:57.405111+0000","last_became_active":"2024-05-07T13:55:54.329774+0000","last_became_peered":"2024-05-07T13:55:54.329774+0000","last_unstale":"2024-05-07T13:58:57.405111+0000","last_undegraded":"2024-05-07T13:58:57.405111+0000","last_fullsized":"2024-05-07T13:58:57.405111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:39.454749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359063+0000","last_change":"2024-05-07T13:55:56.344460+0000","last_active":"2024-05-07T13:56:35.359063+0000","last_peered":"2024-05-07T13:56:35.359063+0000","last_clean":"2024-05-07T13:56:35.359063+0000","last_became_active":"2024-05-07T13:55:56.343224+0000","last_became_peered":"2024-05-07T13:55:56.343224+0000","last_unstale":"2024-05-07T13:56:35.359063+0000","last_undegraded":"2024-05-07T13:56:35.359063+0000","last_fullsized":"2024-05-07T13:56:35.359063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:31:00.903367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.721038+0000","last_change":"2024-05-07T13:55:58.345308+0000","last_active":"2024-05-07T13:57:58.721038+0000","last_peered":"2024-05-07T13:57:58.721038+0000","last_clean":"2024-05-07T13:57:58.721038+0000","last_became_active":"2024-05-07T13:55:58.344996+0000","last_became_peered":"2024-05-07T13:55:58.344996+0000","last_unstale":"2024-05-07T13:57:58.721038+0000","last_undegraded":"2024-05-07T13:57:58.721038+0000","last_fullsized":"2024-05-07T13:57:58.721038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:26.544607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502914+0000","last_change":"2024-05-07T13:55:50.318832+0000","last_active":"2024-05-07T13:58:59.502914+0000","last_peered":"2024-05-07T13:58:59.502914+0000","last_clean":"2024-05-07T13:58:59.502914+0000","last_became_active":"2024-05-07T13:55:50.318471+0000","last_became_peered":"2024-05-07T13:55:50.318471+0000","last_unstale":"2024-05-07T13:58:59.502914+0000","last_undegraded":"2024-05-07T13:58:59.502914+0000","last_fullsized":"2024-05-07T13:58:59.502914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:26.371060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362574+0000","last_change":"2024-05-07T13:55:40.043522+0000","last_active":"2024-05-07T13:56:35.362574+0000","last_peered":"2024-05-07T13:56:35.362574+0000","last_clean":"2024-05-07T13:56:35.362574+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:56:35.362574+0000","last_undegraded":"2024-05-07T13:56:35.362574+0000","last_fullsized":"2024-05-07T13:56:35.362574+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:01:05.355008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357954+0000","last_change":"2024-05-07T13:55:48.326648+0000","last_active":"2024-05-07T13:56:35.357954+0000","last_peered":"2024-05-07T13:56:35.357954+0000","last_clean":"2024-05-07T13:56:35.357954+0000","last_became_active":"2024-05-07T13:55:48.325013+0000","last_became_peered":"2024-05-07T13:55:48.325013+0000","last_unstale":"2024-05-07T13:56:35.357954+0000","last_undegraded":"2024-05-07T13:56:35.357954+0000","last_fullsized":"2024-05-07T13:56:35.357954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.377191+0000","last_change":"2024-05-07T13:56:35.376721+0000","last_active":"2024-05-07T13:56:35.377191+0000","last_peered":"2024-05-07T13:56:35.377191+0000","last_clean":"2024-05-07T13:56:35.377191+0000","last_became_active":"2024-05-07T13:56:35.368904+0000","last_became_peered":"2024-05-07T13:56:35.368904+0000","last_unstale":"2024-05-07T13:56:35.377191+0000","last_undegraded":"2024-05-07T13:56:35.377191+0000","last_fullsized":"2024-05-07T13:56:35.377191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:48:47.495613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405246+0000","last_change":"2024-05-07T13:55:54.330092+0000","last_active":"2024-05-07T13:58:57.405246+0000","last_peered":"2024-05-07T13:58:57.405246+0000","last_clean":"2024-05-07T13:58:57.405246+0000","last_became_active":"2024-05-07T13:55:54.329778+0000","last_became_peered":"2024-05-07T13:55:54.329778+0000","last_unstale":"2024-05-07T13:58:57.405246+0000","last_undegraded":"2024-05-07T13:58:57.405246+0000","last_fullsized":"2024-05-07T13:58:57.405246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:49.631798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360263+0000","last_change":"2024-05-07T13:55:56.336320+0000","last_active":"2024-05-07T13:56:35.360263+0000","last_peered":"2024-05-07T13:56:35.360263+0000","last_clean":"2024-05-07T13:56:35.360263+0000","last_became_active":"2024-05-07T13:55:56.336064+0000","last_became_peered":"2024-05-07T13:55:56.336064+0000","last_unstale":"2024-05-07T13:56:35.360263+0000","last_undegraded":"2024-05-07T13:56:35.360263+0000","last_fullsized":"2024-05-07T13:56:35.360263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:40.210571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.473318+0000","last_change":"2024-05-07T13:55:58.350552+0000","last_active":"2024-05-07T13:58:59.473318+0000","last_peered":"2024-05-07T13:58:59.473318+0000","last_clean":"2024-05-07T13:58:59.473318+0000","last_became_active":"2024-05-07T13:55:58.350208+0000","last_became_peered":"2024-05-07T13:55:58.350208+0000","last_unstale":"2024-05-07T13:58:59.473318+0000","last_undegraded":"2024-05-07T13:58:59.473318+0000","last_fullsized":"2024-05-07T13:58:59.473318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:40.675669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.931596+0000","last_change":"2024-05-07T13:55:50.313509+0000","last_active":"2024-05-07T13:57:14.931596+0000","last_peered":"2024-05-07T13:57:14.931596+0000","last_clean":"2024-05-07T13:57:14.931596+0000","last_became_active":"2024-05-07T13:55:50.313163+0000","last_became_peered":"2024-05-07T13:55:50.313163+0000","last_unstale":"2024-05-07T13:57:14.931596+0000","last_undegraded":"2024-05-07T13:57:14.931596+0000","last_fullsized":"2024-05-07T13:57:14.931596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:30.949901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356826+0000","last_change":"2024-05-07T13:55:40.044279+0000","last_active":"2024-05-07T13:56:35.356826+0000","last_peered":"2024-05-07T13:56:35.356826+0000","last_clean":"2024-05-07T13:56:35.356826+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T13:56:35.356826+0000","last_undegraded":"2024-05-07T13:56:35.356826+0000","last_fullsized":"2024-05-07T13:56:35.356826+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:05:53.554681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.365647+0000","last_change":"2024-05-07T13:55:48.338820+0000","last_active":"2024-05-07T13:56:35.365647+0000","last_peered":"2024-05-07T13:56:35.365647+0000","last_clean":"2024-05-07T13:56:35.365647+0000","last_became_active":"2024-05-07T13:55:48.338442+0000","last_became_peered":"2024-05-07T13:55:48.338442+0000","last_unstale":"2024-05-07T13:56:35.365647+0000","last_undegraded":"2024-05-07T13:56:35.365647+0000","last_fullsized":"2024-05-07T13:56:35.365647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:03:37.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360317+0000","last_change":"2024-05-07T13:55:52.321916+0000","last_active":"2024-05-07T13:56:35.360317+0000","last_peered":"2024-05-07T13:56:35.360317+0000","last_clean":"2024-05-07T13:56:35.360317+0000","last_became_active":"2024-05-07T13:55:52.321506+0000","last_became_peered":"2024-05-07T13:55:52.321506+0000","last_unstale":"2024-05-07T13:56:35.360317+0000","last_undegraded":"2024-05-07T13:56:35.360317+0000","last_fullsized":"2024-05-07T13:56:35.360317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:35.607190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'15","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.754593+0000","last_change":"2024-05-07T13:55:54.329113+0000","last_active":"2024-05-07T13:58:58.754593+0000","last_peered":"2024-05-07T13:58:58.754593+0000","last_clean":"2024-05-07T13:58:58.754593+0000","last_became_active":"2024-05-07T13:55:54.328763+0000","last_became_peered":"2024-05-07T13:55:54.328763+0000","last_unstale":"2024-05-07T13:58:58.754593+0000","last_undegraded":"2024-05-07T13:58:58.754593+0000","last_fullsized":"2024-05-07T13:58:58.754593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:29:04.977290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361744+0000","last_change":"2024-05-07T13:55:56.343480+0000","last_active":"2024-05-07T13:56:35.361744+0000","last_peered":"2024-05-07T13:56:35.361744+0000","last_clean":"2024-05-07T13:56:35.361744+0000","last_became_active":"2024-05-07T13:55:56.343131+0000","last_became_peered":"2024-05-07T13:55:56.343131+0000","last_unstale":"2024-05-07T13:56:35.361744+0000","last_undegraded":"2024-05-07T13:56:35.361744+0000","last_fullsized":"2024-05-07T13:56:35.361744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:50.212923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.487763+0000","last_change":"2024-05-07T13:55:58.348390+0000","last_active":"2024-05-07T13:57:58.487763+0000","last_peered":"2024-05-07T13:57:58.487763+0000","last_clean":"2024-05-07T13:57:58.487763+0000","last_became_active":"2024-05-07T13:55:58.348068+0000","last_became_peered":"2024-05-07T13:55:58.348068+0000","last_unstale":"2024-05-07T13:57:58.487763+0000","last_undegraded":"2024-05-07T13:57:58.487763+0000","last_fullsized":"2024-05-07T13:57:58.487763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:21.047817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'14","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408795+0000","last_change":"2024-05-07T13:55:50.324091+0000","last_active":"2024-05-07T13:58:59.408795+0000","last_peered":"2024-05-07T13:58:59.408795+0000","last_clean":"2024-05-07T13:58:59.408795+0000","last_became_active":"2024-05-07T13:55:50.323820+0000","last_became_peered":"2024-05-07T13:55:50.323820+0000","last_unstale":"2024-05-07T13:58:59.408795+0000","last_undegraded":"2024-05-07T13:58:59.408795+0000","last_fullsized":"2024-05-07T13:58:59.408795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367577+0000","last_change":"2024-05-07T13:55:48.338590+0000","last_active":"2024-05-07T13:56:35.367577+0000","last_peered":"2024-05-07T13:56:35.367577+0000","last_clean":"2024-05-07T13:56:35.367577+0000","last_became_active":"2024-05-07T13:55:48.338139+0000","last_became_peered":"2024-05-07T13:55:48.338139+0000","last_unstale":"2024-05-07T13:56:35.367577+0000","last_undegraded":"2024-05-07T13:56:35.367577+0000","last_fullsized":"2024-05-07T13:56:35.367577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:02.747875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359773+0000","last_change":"2024-05-07T13:55:40.043241+0000","last_active":"2024-05-07T13:56:35.359773+0000","last_peered":"2024-05-07T13:56:35.359773+0000","last_clean":"2024-05-07T13:56:35.359773+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:56:35.359773+0000","last_undegraded":"2024-05-07T13:56:35.359773+0000","last_fullsized":"2024-05-07T13:56:35.359773+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:09.446119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178121+0000","last_change":"2024-05-07T13:55:52.321594+0000","last_active":"2024-05-07T13:57:58.178121+0000","last_peered":"2024-05-07T13:57:58.178121+0000","last_clean":"2024-05-07T13:57:58.178121+0000","last_became_active":"2024-05-07T13:55:52.321249+0000","last_became_peered":"2024-05-07T13:55:52.321249+0000","last_unstale":"2024-05-07T13:57:58.178121+0000","last_undegraded":"2024-05-07T13:57:58.178121+0000","last_fullsized":"2024-05-07T13:57:58.178121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:09.429892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'62","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.416916+0000","last_change":"2024-05-07T13:55:54.327059+0000","last_active":"2024-05-07T13:58:59.416916+0000","last_peered":"2024-05-07T13:58:59.416916+0000","last_clean":"2024-05-07T13:58:59.416916+0000","last_became_active":"2024-05-07T13:55:54.326812+0000","last_became_peered":"2024-05-07T13:55:54.326812+0000","last_unstale":"2024-05-07T13:58:59.416916+0000","last_undegraded":"2024-05-07T13:58:59.416916+0000","last_fullsized":"2024-05-07T13:58:59.416916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:43.853324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358924+0000","last_change":"2024-05-07T13:55:56.331774+0000","last_active":"2024-05-07T13:56:35.358924+0000","last_peered":"2024-05-07T13:56:35.358924+0000","last_clean":"2024-05-07T13:56:35.358924+0000","last_became_active":"2024-05-07T13:55:56.331343+0000","last_became_peered":"2024-05-07T13:55:56.331343+0000","last_unstale":"2024-05-07T13:56:35.358924+0000","last_undegraded":"2024-05-07T13:56:35.358924+0000","last_fullsized":"2024-05-07T13:56:35.358924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:45.860157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'11","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.663624+0000","last_change":"2024-05-07T13:55:58.347841+0000","last_active":"2024-05-07T13:57:58.663624+0000","last_peered":"2024-05-07T13:57:58.663624+0000","last_clean":"2024-05-07T13:57:58.663624+0000","last_became_active":"2024-05-07T13:55:58.347566+0000","last_became_peered":"2024-05-07T13:55:58.347566+0000","last_unstale":"2024-05-07T13:57:58.663624+0000","last_undegraded":"2024-05-07T13:57:58.663624+0000","last_fullsized":"2024-05-07T13:57:58.663624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:13:51.441059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'8","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471883+0000","last_change":"2024-05-07T13:55:50.330859+0000","last_active":"2024-05-07T13:58:59.471883+0000","last_peered":"2024-05-07T13:58:59.471883+0000","last_clean":"2024-05-07T13:58:59.471883+0000","last_became_active":"2024-05-07T13:55:50.330547+0000","last_became_peered":"2024-05-07T13:55:50.330547+0000","last_unstale":"2024-05-07T13:58:59.471883+0000","last_undegraded":"2024-05-07T13:58:59.471883+0000","last_fullsized":"2024-05-07T13:58:59.471883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:30.949901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360448+0000","last_change":"2024-05-07T13:55:48.325207+0000","last_active":"2024-05-07T13:56:35.360448+0000","last_peered":"2024-05-07T13:56:35.360448+0000","last_clean":"2024-05-07T13:56:35.360448+0000","last_became_active":"2024-05-07T13:55:48.324378+0000","last_became_peered":"2024-05-07T13:55:48.324378+0000","last_unstale":"2024-05-07T13:56:35.360448+0000","last_undegraded":"2024-05-07T13:56:35.360448+0000","last_fullsized":"2024-05-07T13:56:35.360448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:02:32.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360246+0000","last_change":"2024-05-07T13:55:40.044124+0000","last_active":"2024-05-07T13:56:35.360246+0000","last_peered":"2024-05-07T13:56:35.360246+0000","last_clean":"2024-05-07T13:56:35.360246+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T13:56:35.360246+0000","last_undegraded":"2024-05-07T13:56:35.360246+0000","last_fullsized":"2024-05-07T13:56:35.360246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:38.642853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.171773+0000","last_change":"2024-05-07T13:56:35.366451+0000","last_active":"2024-05-07T13:56:38.171773+0000","last_peered":"2024-05-07T13:56:38.171773+0000","last_clean":"2024-05-07T13:56:38.171773+0000","last_became_active":"2024-05-07T13:56:35.366075+0000","last_became_peered":"2024-05-07T13:56:35.366075+0000","last_unstale":"2024-05-07T13:56:38.171773+0000","last_undegraded":"2024-05-07T13:56:38.171773+0000","last_fullsized":"2024-05-07T13:56:38.171773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:15.026535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"27'14","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361524+0000","last_change":"2024-05-07T13:55:54.331195+0000","last_active":"2024-05-07T13:56:35.361524+0000","last_peered":"2024-05-07T13:56:35.361524+0000","last_clean":"2024-05-07T13:56:35.361524+0000","last_became_active":"2024-05-07T13:55:54.330896+0000","last_became_peered":"2024-05-07T13:55:54.330896+0000","last_unstale":"2024-05-07T13:56:35.361524+0000","last_undegraded":"2024-05-07T13:56:35.361524+0000","last_fullsized":"2024-05-07T13:56:35.361524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:44.541313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.507824+0000","last_change":"2024-05-07T13:55:56.335191+0000","last_active":"2024-05-07T13:58:59.507824+0000","last_peered":"2024-05-07T13:58:59.507824+0000","last_clean":"2024-05-07T13:58:59.507824+0000","last_became_active":"2024-05-07T13:55:56.333242+0000","last_became_peered":"2024-05-07T13:55:56.333242+0000","last_unstale":"2024-05-07T13:58:59.507824+0000","last_undegraded":"2024-05-07T13:58:59.507824+0000","last_fullsized":"2024-05-07T13:58:59.507824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:38.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.438838+0000","last_change":"2024-05-07T13:55:58.346596+0000","last_active":"2024-05-07T13:57:55.438838+0000","last_peered":"2024-05-07T13:57:55.438838+0000","last_clean":"2024-05-07T13:57:55.438838+0000","last_became_active":"2024-05-07T13:55:58.346295+0000","last_became_peered":"2024-05-07T13:55:58.346295+0000","last_unstale":"2024-05-07T13:57:55.438838+0000","last_undegraded":"2024-05-07T13:57:55.438838+0000","last_fullsized":"2024-05-07T13:57:55.438838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:45.742064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.433453+0000","last_change":"2024-05-07T13:55:50.326085+0000","last_active":"2024-05-07T13:57:55.433453+0000","last_peered":"2024-05-07T13:57:55.433453+0000","last_clean":"2024-05-07T13:57:55.433453+0000","last_became_active":"2024-05-07T13:55:50.325665+0000","last_became_peered":"2024-05-07T13:55:50.325665+0000","last_unstale":"2024-05-07T13:57:55.433453+0000","last_undegraded":"2024-05-07T13:57:55.433453+0000","last_fullsized":"2024-05-07T13:57:55.433453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:03.486728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.396425+0000","last_change":"2024-05-07T13:55:48.347535+0000","last_active":"2024-05-07T13:58:59.396425+0000","last_peered":"2024-05-07T13:58:59.396425+0000","last_clean":"2024-05-07T13:58:59.396425+0000","last_became_active":"2024-05-07T13:55:48.346645+0000","last_became_peered":"2024-05-07T13:55:48.346645+0000","last_unstale":"2024-05-07T13:58:59.396425+0000","last_undegraded":"2024-05-07T13:58:59.396425+0000","last_fullsized":"2024-05-07T13:58:59.396425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:01.162350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359789+0000","last_change":"2024-05-07T13:55:40.045556+0000","last_active":"2024-05-07T13:56:35.359789+0000","last_peered":"2024-05-07T13:56:35.359789+0000","last_clean":"2024-05-07T13:56:35.359789+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:56:35.359789+0000","last_undegraded":"2024-05-07T13:56:35.359789+0000","last_fullsized":"2024-05-07T13:56:35.359789+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:10.678478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356709+0000","last_change":"2024-05-07T13:55:52.321677+0000","last_active":"2024-05-07T13:56:35.356709+0000","last_peered":"2024-05-07T13:56:35.356709+0000","last_clean":"2024-05-07T13:56:35.356709+0000","last_became_active":"2024-05-07T13:55:52.321160+0000","last_became_peered":"2024-05-07T13:55:52.321160+0000","last_unstale":"2024-05-07T13:56:35.356709+0000","last_undegraded":"2024-05-07T13:56:35.356709+0000","last_fullsized":"2024-05-07T13:56:35.356709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:38.708646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.725372+0000","last_change":"2024-05-07T13:55:54.330229+0000","last_active":"2024-05-07T13:57:58.725372+0000","last_peered":"2024-05-07T13:57:58.725372+0000","last_clean":"2024-05-07T13:57:58.725372+0000","last_became_active":"2024-05-07T13:55:54.329885+0000","last_became_peered":"2024-05-07T13:55:54.329885+0000","last_unstale":"2024-05-07T13:57:58.725372+0000","last_undegraded":"2024-05-07T13:57:58.725372+0000","last_fullsized":"2024-05-07T13:57:58.725372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:21.319585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.649285+0000","last_change":"2024-05-07T13:55:56.334411+0000","last_active":"2024-05-07T13:58:59.649285+0000","last_peered":"2024-05-07T13:58:59.649285+0000","last_clean":"2024-05-07T13:58:59.649285+0000","last_became_active":"2024-05-07T13:55:56.334023+0000","last_became_peered":"2024-05-07T13:55:56.334023+0000","last_unstale":"2024-05-07T13:58:59.649285+0000","last_undegraded":"2024-05-07T13:58:59.649285+0000","last_fullsized":"2024-05-07T13:58:59.649285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:38.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363496+0000","last_change":"2024-05-07T13:55:58.347319+0000","last_active":"2024-05-07T13:56:35.363496+0000","last_peered":"2024-05-07T13:56:35.363496+0000","last_clean":"2024-05-07T13:56:35.363496+0000","last_became_active":"2024-05-07T13:55:58.346984+0000","last_became_peered":"2024-05-07T13:55:58.346984+0000","last_unstale":"2024-05-07T13:56:35.363496+0000","last_undegraded":"2024-05-07T13:56:35.363496+0000","last_fullsized":"2024-05-07T13:56:35.363496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:09:17.780125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363167+0000","last_change":"2024-05-07T13:55:50.327606+0000","last_active":"2024-05-07T13:56:35.363167+0000","last_peered":"2024-05-07T13:56:35.363167+0000","last_clean":"2024-05-07T13:56:35.363167+0000","last_became_active":"2024-05-07T13:55:50.327283+0000","last_became_peered":"2024-05-07T13:55:50.327283+0000","last_unstale":"2024-05-07T13:56:35.363167+0000","last_undegraded":"2024-05-07T13:56:35.363167+0000","last_fullsized":"2024-05-07T13:56:35.363167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:54.059732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364948+0000","last_change":"2024-05-07T13:55:48.337939+0000","last_active":"2024-05-07T13:56:35.364948+0000","last_peered":"2024-05-07T13:56:35.364948+0000","last_clean":"2024-05-07T13:56:35.364948+0000","last_became_active":"2024-05-07T13:55:48.337553+0000","last_became_peered":"2024-05-07T13:55:48.337553+0000","last_unstale":"2024-05-07T13:56:35.364948+0000","last_undegraded":"2024-05-07T13:56:35.364948+0000","last_fullsized":"2024-05-07T13:56:35.364948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363756+0000","last_change":"2024-05-07T13:55:40.043788+0000","last_active":"2024-05-07T13:56:35.363756+0000","last_peered":"2024-05-07T13:56:35.363756+0000","last_clean":"2024-05-07T13:56:35.363756+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T13:56:35.363756+0000","last_undegraded":"2024-05-07T13:56:35.363756+0000","last_fullsized":"2024-05-07T13:56:35.363756+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:00.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356449+0000","last_change":"2024-05-07T13:55:52.315544+0000","last_active":"2024-05-07T13:56:35.356449+0000","last_peered":"2024-05-07T13:56:35.356449+0000","last_clean":"2024-05-07T13:56:35.356449+0000","last_became_active":"2024-05-07T13:55:52.314793+0000","last_became_peered":"2024-05-07T13:55:52.314793+0000","last_unstale":"2024-05-07T13:56:35.356449+0000","last_undegraded":"2024-05-07T13:56:35.356449+0000","last_fullsized":"2024-05-07T13:56:35.356449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:46.161101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.154539+0000","last_change":"2024-05-07T13:55:54.330188+0000","last_active":"2024-05-07T13:57:57.154539+0000","last_peered":"2024-05-07T13:57:57.154539+0000","last_clean":"2024-05-07T13:57:57.154539+0000","last_became_active":"2024-05-07T13:55:54.329879+0000","last_became_peered":"2024-05-07T13:55:54.329879+0000","last_unstale":"2024-05-07T13:57:57.154539+0000","last_undegraded":"2024-05-07T13:57:57.154539+0000","last_fullsized":"2024-05-07T13:57:57.154539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:37.614392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358335+0000","last_change":"2024-05-07T13:55:56.333232+0000","last_active":"2024-05-07T13:56:35.358335+0000","last_peered":"2024-05-07T13:56:35.358335+0000","last_clean":"2024-05-07T13:56:35.358335+0000","last_became_active":"2024-05-07T13:55:56.332931+0000","last_became_peered":"2024-05-07T13:55:56.332931+0000","last_unstale":"2024-05-07T13:56:35.358335+0000","last_undegraded":"2024-05-07T13:56:35.358335+0000","last_fullsized":"2024-05-07T13:56:35.358335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:05.866559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370012+0000","last_change":"2024-05-07T13:55:58.341180+0000","last_active":"2024-05-07T13:56:35.370012+0000","last_peered":"2024-05-07T13:56:35.370012+0000","last_clean":"2024-05-07T13:56:35.370012+0000","last_became_active":"2024-05-07T13:55:58.340759+0000","last_became_peered":"2024-05-07T13:55:58.340759+0000","last_unstale":"2024-05-07T13:56:35.370012+0000","last_undegraded":"2024-05-07T13:56:35.370012+0000","last_fullsized":"2024-05-07T13:56:35.370012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:48.403945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369103+0000","last_change":"2024-05-07T13:55:58.348875+0000","last_active":"2024-05-07T13:56:35.369103+0000","last_peered":"2024-05-07T13:56:35.369103+0000","last_clean":"2024-05-07T13:56:35.369103+0000","last_became_active":"2024-05-07T13:55:58.348566+0000","last_became_peered":"2024-05-07T13:55:58.348566+0000","last_unstale":"2024-05-07T13:56:35.369103+0000","last_undegraded":"2024-05-07T13:56:35.369103+0000","last_fullsized":"2024-05-07T13:56:35.369103+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:21.705378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723807+0000","last_change":"2024-05-07T13:55:50.329912+0000","last_active":"2024-05-07T13:57:58.723807+0000","last_peered":"2024-05-07T13:57:58.723807+0000","last_clean":"2024-05-07T13:57:58.723807+0000","last_became_active":"2024-05-07T13:55:50.329615+0000","last_became_peered":"2024-05-07T13:55:50.329615+0000","last_unstale":"2024-05-07T13:57:58.723807+0000","last_undegraded":"2024-05-07T13:57:58.723807+0000","last_fullsized":"2024-05-07T13:57:58.723807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358159+0000","last_change":"2024-05-07T13:55:48.348585+0000","last_active":"2024-05-07T13:56:35.358159+0000","last_peered":"2024-05-07T13:56:35.358159+0000","last_clean":"2024-05-07T13:56:35.358159+0000","last_became_active":"2024-05-07T13:55:48.346558+0000","last_became_peered":"2024-05-07T13:55:48.346558+0000","last_unstale":"2024-05-07T13:56:35.358159+0000","last_undegraded":"2024-05-07T13:56:35.358159+0000","last_fullsized":"2024-05-07T13:56:35.358159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:46.733619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362239+0000","last_change":"2024-05-07T13:55:52.324475+0000","last_active":"2024-05-07T13:56:35.362239+0000","last_peered":"2024-05-07T13:56:35.362239+0000","last_clean":"2024-05-07T13:56:35.362239+0000","last_became_active":"2024-05-07T13:55:52.324083+0000","last_became_peered":"2024-05-07T13:55:52.324083+0000","last_unstale":"2024-05-07T13:56:35.362239+0000","last_undegraded":"2024-05-07T13:56:35.362239+0000","last_fullsized":"2024-05-07T13:56:35.362239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:22.175165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.160493+0000","last_change":"2024-05-07T13:55:54.331198+0000","last_active":"2024-05-07T13:57:57.160493+0000","last_peered":"2024-05-07T13:57:57.160493+0000","last_clean":"2024-05-07T13:57:57.160493+0000","last_became_active":"2024-05-07T13:55:54.330906+0000","last_became_peered":"2024-05-07T13:55:54.330906+0000","last_unstale":"2024-05-07T13:57:57.160493+0000","last_undegraded":"2024-05-07T13:57:57.160493+0000","last_fullsized":"2024-05-07T13:57:57.160493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:54:55.686356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358029+0000","last_change":"2024-05-07T13:55:56.348303+0000","last_active":"2024-05-07T13:56:35.358029+0000","last_peered":"2024-05-07T13:56:35.358029+0000","last_clean":"2024-05-07T13:56:35.358029+0000","last_became_active":"2024-05-07T13:55:56.346371+0000","last_became_peered":"2024-05-07T13:55:56.346371+0000","last_unstale":"2024-05-07T13:56:35.358029+0000","last_undegraded":"2024-05-07T13:56:35.358029+0000","last_fullsized":"2024-05-07T13:56:35.358029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:32:39.746591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:56.842330+0000","last_change":"2024-05-07T13:55:58.341454+0000","last_active":"2024-05-07T13:57:56.842330+0000","last_peered":"2024-05-07T13:57:56.842330+0000","last_clean":"2024-05-07T13:57:56.842330+0000","last_became_active":"2024-05-07T13:55:58.341102+0000","last_became_peered":"2024-05-07T13:55:58.341102+0000","last_unstale":"2024-05-07T13:57:56.842330+0000","last_undegraded":"2024-05-07T13:57:56.842330+0000","last_fullsized":"2024-05-07T13:57:56.842330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:24.611977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.931037+0000","last_change":"2024-05-07T13:55:50.330176+0000","last_active":"2024-05-07T13:57:14.931037+0000","last_peered":"2024-05-07T13:57:14.931037+0000","last_clean":"2024-05-07T13:57:14.931037+0000","last_became_active":"2024-05-07T13:55:50.329869+0000","last_became_peered":"2024-05-07T13:55:50.329869+0000","last_unstale":"2024-05-07T13:57:14.931037+0000","last_undegraded":"2024-05-07T13:57:14.931037+0000","last_fullsized":"2024-05-07T13:57:14.931037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:56.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.399682+0000","last_change":"2024-05-07T13:55:48.338314+0000","last_active":"2024-05-07T13:58:59.399682+0000","last_peered":"2024-05-07T13:58:59.399682+0000","last_clean":"2024-05-07T13:58:59.399682+0000","last_became_active":"2024-05-07T13:55:48.336807+0000","last_became_peered":"2024-05-07T13:55:48.336807+0000","last_unstale":"2024-05-07T13:58:59.399682+0000","last_undegraded":"2024-05-07T13:58:59.399682+0000","last_fullsized":"2024-05-07T13:58:59.399682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:40:38.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358047+0000","last_change":"2024-05-07T13:55:52.319258+0000","last_active":"2024-05-07T13:56:35.358047+0000","last_peered":"2024-05-07T13:56:35.358047+0000","last_clean":"2024-05-07T13:56:35.358047+0000","last_became_active":"2024-05-07T13:55:52.318534+0000","last_became_peered":"2024-05-07T13:55:52.318534+0000","last_unstale":"2024-05-07T13:56:35.358047+0000","last_undegraded":"2024-05-07T13:56:35.358047+0000","last_fullsized":"2024-05-07T13:56:35.358047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:59:17.441061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.742005+0000","last_change":"2024-05-07T13:55:54.319908+0000","last_active":"2024-05-07T13:58:58.742005+0000","last_peered":"2024-05-07T13:58:58.742005+0000","last_clean":"2024-05-07T13:58:58.742005+0000","last_became_active":"2024-05-07T13:55:54.319714+0000","last_became_peered":"2024-05-07T13:55:54.319714+0000","last_unstale":"2024-05-07T13:58:58.742005+0000","last_undegraded":"2024-05-07T13:58:58.742005+0000","last_fullsized":"2024-05-07T13:58:58.742005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:06:57.744609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359119+0000","last_change":"2024-05-07T13:55:56.334660+0000","last_active":"2024-05-07T13:56:35.359119+0000","last_peered":"2024-05-07T13:56:35.359119+0000","last_clean":"2024-05-07T13:56:35.359119+0000","last_became_active":"2024-05-07T13:55:56.334342+0000","last_became_peered":"2024-05-07T13:55:56.334342+0000","last_unstale":"2024-05-07T13:56:35.359119+0000","last_undegraded":"2024-05-07T13:56:35.359119+0000","last_fullsized":"2024-05-07T13:56:35.359119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:12.304466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.158018+0000","last_change":"2024-05-07T13:55:58.342684+0000","last_active":"2024-05-07T13:58:59.158018+0000","last_peered":"2024-05-07T13:58:59.158018+0000","last_clean":"2024-05-07T13:58:59.158018+0000","last_became_active":"2024-05-07T13:55:58.342382+0000","last_became_peered":"2024-05-07T13:55:58.342382+0000","last_unstale":"2024-05-07T13:58:59.158018+0000","last_undegraded":"2024-05-07T13:58:59.158018+0000","last_fullsized":"2024-05-07T13:58:59.158018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:58:54.112594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415635+0000","last_change":"2024-05-07T13:56:35.366216+0000","last_active":"2024-05-07T13:58:59.415635+0000","last_peered":"2024-05-07T13:58:59.415635+0000","last_clean":"2024-05-07T13:58:59.415635+0000","last_became_active":"2024-05-07T13:56:35.365890+0000","last_became_peered":"2024-05-07T13:56:35.365890+0000","last_unstale":"2024-05-07T13:58:59.415635+0000","last_undegraded":"2024-05-07T13:58:59.415635+0000","last_fullsized":"2024-05-07T13:58:59.415635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:31:44.095217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.567474+0000","last_change":"2024-05-07T13:55:48.337211+0000","last_active":"2024-05-07T13:57:58.567474+0000","last_peered":"2024-05-07T13:57:58.567474+0000","last_clean":"2024-05-07T13:57:58.567474+0000","last_became_active":"2024-05-07T13:55:48.336730+0000","last_became_peered":"2024-05-07T13:55:48.336730+0000","last_unstale":"2024-05-07T13:57:58.567474+0000","last_undegraded":"2024-05-07T13:57:58.567474+0000","last_fullsized":"2024-05-07T13:57:58.567474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362051+0000","last_change":"2024-05-07T13:55:52.325126+0000","last_active":"2024-05-07T13:56:35.362051+0000","last_peered":"2024-05-07T13:56:35.362051+0000","last_clean":"2024-05-07T13:56:35.362051+0000","last_became_active":"2024-05-07T13:55:52.324639+0000","last_became_peered":"2024-05-07T13:55:52.324639+0000","last_unstale":"2024-05-07T13:56:35.362051+0000","last_undegraded":"2024-05-07T13:56:35.362051+0000","last_fullsized":"2024-05-07T13:56:35.362051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:43:51.986602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'41","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.420602+0000","last_change":"2024-05-07T13:55:54.331164+0000","last_active":"2024-05-07T13:58:59.420602+0000","last_peered":"2024-05-07T13:58:59.420602+0000","last_clean":"2024-05-07T13:58:59.420602+0000","last_became_active":"2024-05-07T13:55:54.330738+0000","last_became_peered":"2024-05-07T13:55:54.330738+0000","last_unstale":"2024-05-07T13:58:59.420602+0000","last_undegraded":"2024-05-07T13:58:59.420602+0000","last_fullsized":"2024-05-07T13:58:59.420602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:10.297634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":65,"num_write":48,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361731+0000","last_change":"2024-05-07T13:55:56.333196+0000","last_active":"2024-05-07T13:56:35.361731+0000","last_peered":"2024-05-07T13:56:35.361731+0000","last_clean":"2024-05-07T13:56:35.361731+0000","last_became_active":"2024-05-07T13:55:56.332844+0000","last_became_peered":"2024-05-07T13:55:56.332844+0000","last_unstale":"2024-05-07T13:56:35.361731+0000","last_undegraded":"2024-05-07T13:56:35.361731+0000","last_fullsized":"2024-05-07T13:56:35.361731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:02:05.914379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357546+0000","last_change":"2024-05-07T13:55:58.348258+0000","last_active":"2024-05-07T13:56:35.357546+0000","last_peered":"2024-05-07T13:56:35.357546+0000","last_clean":"2024-05-07T13:56:35.357546+0000","last_became_active":"2024-05-07T13:55:58.347598+0000","last_became_peered":"2024-05-07T13:55:58.347598+0000","last_unstale":"2024-05-07T13:56:35.357546+0000","last_undegraded":"2024-05-07T13:56:35.357546+0000","last_fullsized":"2024-05-07T13:56:35.357546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:42:16.894503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'14","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723917+0000","last_change":"2024-05-07T13:55:50.326698+0000","last_active":"2024-05-07T13:57:58.723917+0000","last_peered":"2024-05-07T13:57:58.723917+0000","last_clean":"2024-05-07T13:57:58.723917+0000","last_became_active":"2024-05-07T13:55:50.326430+0000","last_became_peered":"2024-05-07T13:55:50.326430+0000","last_unstale":"2024-05-07T13:57:58.723917+0000","last_undegraded":"2024-05-07T13:57:58.723917+0000","last_fullsized":"2024-05-07T13:57:58.723917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:45.617720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366242+0000","last_change":"2024-05-07T13:55:48.332048+0000","last_active":"2024-05-07T13:56:35.366242+0000","last_peered":"2024-05-07T13:56:35.366242+0000","last_clean":"2024-05-07T13:56:35.366242+0000","last_became_active":"2024-05-07T13:55:48.331660+0000","last_became_peered":"2024-05-07T13:55:48.331660+0000","last_unstale":"2024-05-07T13:56:35.366242+0000","last_undegraded":"2024-05-07T13:56:35.366242+0000","last_fullsized":"2024-05-07T13:56:35.366242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356670+0000","last_change":"2024-05-07T13:55:52.320839+0000","last_active":"2024-05-07T13:56:35.356670+0000","last_peered":"2024-05-07T13:56:35.356670+0000","last_clean":"2024-05-07T13:56:35.356670+0000","last_became_active":"2024-05-07T13:55:52.320520+0000","last_became_peered":"2024-05-07T13:55:52.320520+0000","last_unstale":"2024-05-07T13:56:35.356670+0000","last_undegraded":"2024-05-07T13:56:35.356670+0000","last_fullsized":"2024-05-07T13:56:35.356670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:34.956299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.146019+0000","last_change":"2024-05-07T13:55:54.320598+0000","last_active":"2024-05-07T13:57:57.146019+0000","last_peered":"2024-05-07T13:57:57.146019+0000","last_clean":"2024-05-07T13:57:57.146019+0000","last_became_active":"2024-05-07T13:55:54.320266+0000","last_became_peered":"2024-05-07T13:55:54.320266+0000","last_unstale":"2024-05-07T13:57:57.146019+0000","last_undegraded":"2024-05-07T13:57:57.146019+0000","last_fullsized":"2024-05-07T13:57:57.146019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:11.437094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364874+0000","last_change":"2024-05-07T13:55:56.330536+0000","last_active":"2024-05-07T13:56:35.364874+0000","last_peered":"2024-05-07T13:56:35.364874+0000","last_clean":"2024-05-07T13:56:35.364874+0000","last_became_active":"2024-05-07T13:55:56.330251+0000","last_became_peered":"2024-05-07T13:55:56.330251+0000","last_unstale":"2024-05-07T13:56:35.364874+0000","last_undegraded":"2024-05-07T13:56:35.364874+0000","last_fullsized":"2024-05-07T13:56:35.364874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:02.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.141147+0000","last_change":"2024-05-07T13:55:50.323450+0000","last_active":"2024-05-07T13:58:59.141147+0000","last_peered":"2024-05-07T13:58:59.141147+0000","last_clean":"2024-05-07T13:58:59.141147+0000","last_became_active":"2024-05-07T13:55:50.323159+0000","last_became_peered":"2024-05-07T13:55:50.323159+0000","last_unstale":"2024-05-07T13:58:59.141147+0000","last_undegraded":"2024-05-07T13:58:59.141147+0000","last_fullsized":"2024-05-07T13:58:59.141147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:20.168290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356619+0000","last_change":"2024-05-07T13:55:48.352309+0000","last_active":"2024-05-07T13:56:35.356619+0000","last_peered":"2024-05-07T13:56:35.356619+0000","last_clean":"2024-05-07T13:56:35.356619+0000","last_became_active":"2024-05-07T13:55:48.350462+0000","last_became_peered":"2024-05-07T13:55:48.350462+0000","last_unstale":"2024-05-07T13:56:35.356619+0000","last_undegraded":"2024-05-07T13:56:35.356619+0000","last_fullsized":"2024-05-07T13:56:35.356619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:59.353984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359809+0000","last_change":"2024-05-07T13:55:52.321486+0000","last_active":"2024-05-07T13:56:35.359809+0000","last_peered":"2024-05-07T13:56:35.359809+0000","last_clean":"2024-05-07T13:56:35.359809+0000","last_became_active":"2024-05-07T13:55:52.321171+0000","last_became_peered":"2024-05-07T13:55:52.321171+0000","last_unstale":"2024-05-07T13:56:35.359809+0000","last_undegraded":"2024-05-07T13:56:35.359809+0000","last_fullsized":"2024-05-07T13:56:35.359809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:10.570816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.166855+0000","last_change":"2024-05-07T13:55:54.320095+0000","last_active":"2024-05-07T13:57:57.166855+0000","last_peered":"2024-05-07T13:57:57.166855+0000","last_clean":"2024-05-07T13:57:57.166855+0000","last_became_active":"2024-05-07T13:55:54.319819+0000","last_became_peered":"2024-05-07T13:55:54.319819+0000","last_unstale":"2024-05-07T13:57:57.166855+0000","last_undegraded":"2024-05-07T13:57:57.166855+0000","last_fullsized":"2024-05-07T13:57:57.166855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:00.166078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366700+0000","last_change":"2024-05-07T13:55:56.330532+0000","last_active":"2024-05-07T13:56:35.366700+0000","last_peered":"2024-05-07T13:56:35.366700+0000","last_clean":"2024-05-07T13:56:35.366700+0000","last_became_active":"2024-05-07T13:55:56.330190+0000","last_became_peered":"2024-05-07T13:55:56.330190+0000","last_unstale":"2024-05-07T13:56:35.366700+0000","last_undegraded":"2024-05-07T13:56:35.366700+0000","last_fullsized":"2024-05-07T13:56:35.366700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:46.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.660351+0000","last_change":"2024-05-07T13:55:58.341039+0000","last_active":"2024-05-07T13:57:58.660351+0000","last_peered":"2024-05-07T13:57:58.660351+0000","last_clean":"2024-05-07T13:57:58.660351+0000","last_became_active":"2024-05-07T13:55:58.340674+0000","last_became_peered":"2024-05-07T13:55:58.340674+0000","last_unstale":"2024-05-07T13:57:58.660351+0000","last_undegraded":"2024-05-07T13:57:58.660351+0000","last_fullsized":"2024-05-07T13:57:58.660351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:55:16.822393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408545+0000","last_change":"2024-05-07T13:55:50.318936+0000","last_active":"2024-05-07T13:58:59.408545+0000","last_peered":"2024-05-07T13:58:59.408545+0000","last_clean":"2024-05-07T13:58:59.408545+0000","last_became_active":"2024-05-07T13:55:50.318546+0000","last_became_peered":"2024-05-07T13:55:50.318546+0000","last_unstale":"2024-05-07T13:58:59.408545+0000","last_undegraded":"2024-05-07T13:58:59.408545+0000","last_fullsized":"2024-05-07T13:58:59.408545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:51.713206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361299+0000","last_change":"2024-05-07T13:55:48.332704+0000","last_active":"2024-05-07T13:56:35.361299+0000","last_peered":"2024-05-07T13:56:35.361299+0000","last_clean":"2024-05-07T13:56:35.361299+0000","last_became_active":"2024-05-07T13:55:48.331278+0000","last_became_peered":"2024-05-07T13:55:48.331278+0000","last_unstale":"2024-05-07T13:56:35.361299+0000","last_undegraded":"2024-05-07T13:56:35.361299+0000","last_fullsized":"2024-05-07T13:56:35.361299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:34:15.892537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369459+0000","last_change":"2024-05-07T13:55:52.317997+0000","last_active":"2024-05-07T13:56:35.369459+0000","last_peered":"2024-05-07T13:56:35.369459+0000","last_clean":"2024-05-07T13:56:35.369459+0000","last_became_active":"2024-05-07T13:55:52.317564+0000","last_became_peered":"2024-05-07T13:55:52.317564+0000","last_unstale":"2024-05-07T13:56:35.369459+0000","last_undegraded":"2024-05-07T13:56:35.369459+0000","last_fullsized":"2024-05-07T13:56:35.369459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:08.119281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.147002+0000","last_change":"2024-05-07T13:55:54.330150+0000","last_active":"2024-05-07T13:57:57.147002+0000","last_peered":"2024-05-07T13:57:57.147002+0000","last_clean":"2024-05-07T13:57:57.147002+0000","last_became_active":"2024-05-07T13:55:54.329443+0000","last_became_peered":"2024-05-07T13:55:54.329443+0000","last_unstale":"2024-05-07T13:57:57.147002+0000","last_undegraded":"2024-05-07T13:57:57.147002+0000","last_fullsized":"2024-05-07T13:57:57.147002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:38:57.980890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364045+0000","last_change":"2024-05-07T13:55:56.344810+0000","last_active":"2024-05-07T13:56:35.364045+0000","last_peered":"2024-05-07T13:56:35.364045+0000","last_clean":"2024-05-07T13:56:35.364045+0000","last_became_active":"2024-05-07T13:55:56.344470+0000","last_became_peered":"2024-05-07T13:55:56.344470+0000","last_unstale":"2024-05-07T13:56:35.364045+0000","last_undegraded":"2024-05-07T13:56:35.364045+0000","last_fullsized":"2024-05-07T13:56:35.364045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:05.866559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.821748+0000","last_change":"2024-05-07T13:55:58.351086+0000","last_active":"2024-05-07T13:58:58.821748+0000","last_peered":"2024-05-07T13:58:58.821748+0000","last_clean":"2024-05-07T13:58:58.821748+0000","last_became_active":"2024-05-07T13:55:58.350796+0000","last_became_peered":"2024-05-07T13:55:58.350796+0000","last_unstale":"2024-05-07T13:58:58.821748+0000","last_undegraded":"2024-05-07T13:58:58.821748+0000","last_fullsized":"2024-05-07T13:58:58.821748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:13:08.107265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502779+0000","last_change":"2024-05-07T13:55:50.327981+0000","last_active":"2024-05-07T13:58:59.502779+0000","last_peered":"2024-05-07T13:58:59.502779+0000","last_clean":"2024-05-07T13:58:59.502779+0000","last_became_active":"2024-05-07T13:55:50.326424+0000","last_became_peered":"2024-05-07T13:55:50.326424+0000","last_unstale":"2024-05-07T13:58:59.502779+0000","last_undegraded":"2024-05-07T13:58:59.502779+0000","last_fullsized":"2024-05-07T13:58:59.502779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:52.261340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.055616+0000","last_change":"2024-05-07T13:55:48.342464+0000","last_active":"2024-05-07T13:58:59.055616+0000","last_peered":"2024-05-07T13:58:59.055616+0000","last_clean":"2024-05-07T13:58:59.055616+0000","last_became_active":"2024-05-07T13:55:48.342072+0000","last_became_peered":"2024-05-07T13:55:48.342072+0000","last_unstale":"2024-05-07T13:58:59.055616+0000","last_undegraded":"2024-05-07T13:58:59.055616+0000","last_fullsized":"2024-05-07T13:58:59.055616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367888+0000","last_change":"2024-05-07T13:55:52.318946+0000","last_active":"2024-05-07T13:56:35.367888+0000","last_peered":"2024-05-07T13:56:35.367888+0000","last_clean":"2024-05-07T13:56:35.367888+0000","last_became_active":"2024-05-07T13:55:52.318605+0000","last_became_peered":"2024-05-07T13:55:52.318605+0000","last_unstale":"2024-05-07T13:56:35.367888+0000","last_undegraded":"2024-05-07T13:56:35.367888+0000","last_fullsized":"2024-05-07T13:56:35.367888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:09.398107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.164378+0000","last_change":"2024-05-07T13:55:54.326840+0000","last_active":"2024-05-07T13:57:57.164378+0000","last_peered":"2024-05-07T13:57:57.164378+0000","last_clean":"2024-05-07T13:57:57.164378+0000","last_became_active":"2024-05-07T13:55:54.326599+0000","last_became_peered":"2024-05-07T13:55:54.326599+0000","last_unstale":"2024-05-07T13:57:57.164378+0000","last_undegraded":"2024-05-07T13:57:57.164378+0000","last_fullsized":"2024-05-07T13:57:57.164378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:44.541313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359346+0000","last_change":"2024-05-07T13:55:56.334669+0000","last_active":"2024-05-07T13:56:35.359346+0000","last_peered":"2024-05-07T13:56:35.359346+0000","last_clean":"2024-05-07T13:56:35.359346+0000","last_became_active":"2024-05-07T13:55:56.334226+0000","last_became_peered":"2024-05-07T13:55:56.334226+0000","last_unstale":"2024-05-07T13:56:35.359346+0000","last_undegraded":"2024-05-07T13:56:35.359346+0000","last_fullsized":"2024-05-07T13:56:35.359346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:59:21.455096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.719529+0000","last_change":"2024-05-07T13:55:58.352585+0000","last_active":"2024-05-07T13:57:58.719529+0000","last_peered":"2024-05-07T13:57:58.719529+0000","last_clean":"2024-05-07T13:57:58.719529+0000","last_became_active":"2024-05-07T13:55:58.352263+0000","last_became_peered":"2024-05-07T13:55:58.352263+0000","last_unstale":"2024-05-07T13:57:58.719529+0000","last_undegraded":"2024-05-07T13:57:58.719529+0000","last_fullsized":"2024-05-07T13:57:58.719529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:11:22.158209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361243+0000","last_change":"2024-05-07T13:55:50.313466+0000","last_active":"2024-05-07T13:56:35.361243+0000","last_peered":"2024-05-07T13:56:35.361243+0000","last_clean":"2024-05-07T13:56:35.361243+0000","last_became_active":"2024-05-07T13:55:50.312852+0000","last_became_peered":"2024-05-07T13:55:50.312852+0000","last_unstale":"2024-05-07T13:56:35.361243+0000","last_undegraded":"2024-05-07T13:56:35.361243+0000","last_fullsized":"2024-05-07T13:56:35.361243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358505+0000","last_change":"2024-05-07T13:55:48.351068+0000","last_active":"2024-05-07T13:56:35.358505+0000","last_peered":"2024-05-07T13:56:35.358505+0000","last_clean":"2024-05-07T13:56:35.358505+0000","last_became_active":"2024-05-07T13:55:48.348476+0000","last_became_peered":"2024-05-07T13:55:48.348476+0000","last_unstale":"2024-05-07T13:56:35.358505+0000","last_undegraded":"2024-05-07T13:56:35.358505+0000","last_fullsized":"2024-05-07T13:56:35.358505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:24.363423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364249+0000","last_change":"2024-05-07T13:55:52.323853+0000","last_active":"2024-05-07T13:56:35.364249+0000","last_peered":"2024-05-07T13:56:35.364249+0000","last_clean":"2024-05-07T13:56:35.364249+0000","last_became_active":"2024-05-07T13:55:52.322431+0000","last_became_peered":"2024-05-07T13:55:52.322431+0000","last_unstale":"2024-05-07T13:56:35.364249+0000","last_undegraded":"2024-05-07T13:56:35.364249+0000","last_fullsized":"2024-05-07T13:56:35.364249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:10.570816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361154+0000","last_change":"2024-05-07T13:55:54.329901+0000","last_active":"2024-05-07T13:56:35.361154+0000","last_peered":"2024-05-07T13:56:35.361154+0000","last_clean":"2024-05-07T13:56:35.361154+0000","last_became_active":"2024-05-07T13:55:54.329539+0000","last_became_peered":"2024-05-07T13:55:54.329539+0000","last_unstale":"2024-05-07T13:56:35.361154+0000","last_undegraded":"2024-05-07T13:56:35.361154+0000","last_fullsized":"2024-05-07T13:56:35.361154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:26:09.693773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405101+0000","last_change":"2024-05-07T13:55:56.338533+0000","last_active":"2024-05-07T13:58:57.405101+0000","last_peered":"2024-05-07T13:58:57.405101+0000","last_clean":"2024-05-07T13:58:57.405101+0000","last_became_active":"2024-05-07T13:55:56.338021+0000","last_became_peered":"2024-05-07T13:55:56.338021+0000","last_unstale":"2024-05-07T13:58:57.405101+0000","last_undegraded":"2024-05-07T13:58:57.405101+0000","last_fullsized":"2024-05-07T13:58:57.405101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:20.272404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356081+0000","last_change":"2024-05-07T13:55:58.351904+0000","last_active":"2024-05-07T13:56:35.356081+0000","last_peered":"2024-05-07T13:56:35.356081+0000","last_clean":"2024-05-07T13:56:35.356081+0000","last_became_active":"2024-05-07T13:55:58.351616+0000","last_became_peered":"2024-05-07T13:55:58.351616+0000","last_unstale":"2024-05-07T13:56:35.356081+0000","last_undegraded":"2024-05-07T13:56:35.356081+0000","last_fullsized":"2024-05-07T13:56:35.356081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:22.090983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.185290+0000","last_change":"2024-05-07T13:55:50.313284+0000","last_active":"2024-05-07T13:58:23.185290+0000","last_peered":"2024-05-07T13:58:23.185290+0000","last_clean":"2024-05-07T13:58:23.185290+0000","last_became_active":"2024-05-07T13:55:50.313016+0000","last_became_peered":"2024-05-07T13:55:50.313016+0000","last_unstale":"2024-05-07T13:58:23.185290+0000","last_undegraded":"2024-05-07T13:58:23.185290+0000","last_fullsized":"2024-05-07T13:58:23.185290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:15.469036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363748+0000","last_change":"2024-05-07T13:55:48.340087+0000","last_active":"2024-05-07T13:56:35.363748+0000","last_peered":"2024-05-07T13:56:35.363748+0000","last_clean":"2024-05-07T13:56:35.363748+0000","last_became_active":"2024-05-07T13:55:48.339639+0000","last_became_peered":"2024-05-07T13:55:48.339639+0000","last_unstale":"2024-05-07T13:56:35.363748+0000","last_undegraded":"2024-05-07T13:56:35.363748+0000","last_fullsized":"2024-05-07T13:56:35.363748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361140+0000","last_change":"2024-05-07T13:55:52.324874+0000","last_active":"2024-05-07T13:56:35.361140+0000","last_peered":"2024-05-07T13:56:35.361140+0000","last_clean":"2024-05-07T13:56:35.361140+0000","last_became_active":"2024-05-07T13:55:52.324567+0000","last_became_peered":"2024-05-07T13:55:52.324567+0000","last_unstale":"2024-05-07T13:56:35.361140+0000","last_undegraded":"2024-05-07T13:56:35.361140+0000","last_fullsized":"2024-05-07T13:56:35.361140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:01.502846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.136732+0000","last_change":"2024-05-07T13:55:54.329601+0000","last_active":"2024-05-07T13:57:57.136732+0000","last_peered":"2024-05-07T13:57:57.136732+0000","last_clean":"2024-05-07T13:57:57.136732+0000","last_became_active":"2024-05-07T13:55:54.329220+0000","last_became_peered":"2024-05-07T13:55:54.329220+0000","last_unstale":"2024-05-07T13:57:57.136732+0000","last_undegraded":"2024-05-07T13:57:57.136732+0000","last_fullsized":"2024-05-07T13:57:57.136732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:00.166078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358098+0000","last_change":"2024-05-07T13:55:56.333675+0000","last_active":"2024-05-07T13:56:35.358098+0000","last_peered":"2024-05-07T13:56:35.358098+0000","last_clean":"2024-05-07T13:56:35.358098+0000","last_became_active":"2024-05-07T13:55:56.333373+0000","last_became_peered":"2024-05-07T13:55:56.333373+0000","last_unstale":"2024-05-07T13:56:35.358098+0000","last_undegraded":"2024-05-07T13:56:35.358098+0000","last_fullsized":"2024-05-07T13:56:35.358098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:19.698130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366747+0000","last_change":"2024-05-07T13:55:58.347910+0000","last_active":"2024-05-07T13:56:35.366747+0000","last_peered":"2024-05-07T13:56:35.366747+0000","last_clean":"2024-05-07T13:56:35.366747+0000","last_became_active":"2024-05-07T13:55:58.347327+0000","last_became_peered":"2024-05-07T13:55:58.347327+0000","last_unstale":"2024-05-07T13:56:35.366747+0000","last_undegraded":"2024-05-07T13:56:35.366747+0000","last_fullsized":"2024-05-07T13:56:35.366747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:18.476650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359524+0000","last_change":"2024-05-07T13:55:50.311670+0000","last_active":"2024-05-07T13:56:35.359524+0000","last_peered":"2024-05-07T13:56:35.359524+0000","last_clean":"2024-05-07T13:56:35.359524+0000","last_became_active":"2024-05-07T13:55:50.311340+0000","last_became_peered":"2024-05-07T13:55:50.311340+0000","last_unstale":"2024-05-07T13:56:35.359524+0000","last_undegraded":"2024-05-07T13:56:35.359524+0000","last_fullsized":"2024-05-07T13:56:35.359524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:45.426204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360374+0000","last_change":"2024-05-07T13:55:48.351060+0000","last_active":"2024-05-07T13:56:35.360374+0000","last_peered":"2024-05-07T13:56:35.360374+0000","last_clean":"2024-05-07T13:56:35.360374+0000","last_became_active":"2024-05-07T13:55:48.349589+0000","last_became_peered":"2024-05-07T13:55:48.349589+0000","last_unstale":"2024-05-07T13:56:35.360374+0000","last_undegraded":"2024-05-07T13:56:35.360374+0000","last_fullsized":"2024-05-07T13:56:35.360374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:54:44.852941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366095+0000","last_change":"2024-05-07T13:55:52.323978+0000","last_active":"2024-05-07T13:56:35.366095+0000","last_peered":"2024-05-07T13:56:35.366095+0000","last_clean":"2024-05-07T13:56:35.366095+0000","last_became_active":"2024-05-07T13:55:52.323548+0000","last_became_peered":"2024-05-07T13:55:52.323548+0000","last_unstale":"2024-05-07T13:56:35.366095+0000","last_undegraded":"2024-05-07T13:56:35.366095+0000","last_fullsized":"2024-05-07T13:56:35.366095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:51:24.684579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.137962+0000","last_change":"2024-05-07T13:55:54.327074+0000","last_active":"2024-05-07T13:57:57.137962+0000","last_peered":"2024-05-07T13:57:57.137962+0000","last_clean":"2024-05-07T13:57:57.137962+0000","last_became_active":"2024-05-07T13:55:54.326844+0000","last_became_peered":"2024-05-07T13:55:54.326844+0000","last_unstale":"2024-05-07T13:57:57.137962+0000","last_undegraded":"2024-05-07T13:57:57.137962+0000","last_fullsized":"2024-05-07T13:57:57.137962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:07.500805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356419+0000","last_change":"2024-05-07T13:55:56.345203+0000","last_active":"2024-05-07T13:56:35.356419+0000","last_peered":"2024-05-07T13:56:35.356419+0000","last_clean":"2024-05-07T13:56:35.356419+0000","last_became_active":"2024-05-07T13:55:56.344885+0000","last_became_peered":"2024-05-07T13:55:56.344885+0000","last_unstale":"2024-05-07T13:56:35.356419+0000","last_undegraded":"2024-05-07T13:56:35.356419+0000","last_fullsized":"2024-05-07T13:56:35.356419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:23.344207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361365+0000","last_change":"2024-05-07T13:55:58.348158+0000","last_active":"2024-05-07T13:56:35.361365+0000","last_peered":"2024-05-07T13:56:35.361365+0000","last_clean":"2024-05-07T13:56:35.361365+0000","last_became_active":"2024-05-07T13:55:58.347850+0000","last_became_peered":"2024-05-07T13:55:58.347850+0000","last_unstale":"2024-05-07T13:56:35.361365+0000","last_undegraded":"2024-05-07T13:56:35.361365+0000","last_fullsized":"2024-05-07T13:56:35.361365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:53.578201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'20","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502897+0000","last_change":"2024-05-07T13:55:50.325227+0000","last_active":"2024-05-07T13:58:59.502897+0000","last_peered":"2024-05-07T13:58:59.502897+0000","last_clean":"2024-05-07T13:58:59.502897+0000","last_became_active":"2024-05-07T13:55:50.324745+0000","last_became_peered":"2024-05-07T13:55:50.324745+0000","last_unstale":"2024-05-07T13:58:59.502897+0000","last_undegraded":"2024-05-07T13:58:59.502897+0000","last_fullsized":"2024-05-07T13:58:59.502897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:33.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.920397+0000","last_change":"2024-05-07T13:55:48.324008+0000","last_active":"2024-05-07T13:57:14.920397+0000","last_peered":"2024-05-07T13:57:14.920397+0000","last_clean":"2024-05-07T13:57:14.920397+0000","last_became_active":"2024-05-07T13:55:48.323125+0000","last_became_peered":"2024-05-07T13:55:48.323125+0000","last_unstale":"2024-05-07T13:57:14.920397+0000","last_undegraded":"2024-05-07T13:57:14.920397+0000","last_fullsized":"2024-05-07T13:57:14.920397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:00:13.644367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359668+0000","last_change":"2024-05-07T13:55:52.322334+0000","last_active":"2024-05-07T13:56:35.359668+0000","last_peered":"2024-05-07T13:56:35.359668+0000","last_clean":"2024-05-07T13:56:35.359668+0000","last_became_active":"2024-05-07T13:55:52.322012+0000","last_became_peered":"2024-05-07T13:55:52.322012+0000","last_unstale":"2024-05-07T13:56:35.359668+0000","last_undegraded":"2024-05-07T13:56:35.359668+0000","last_fullsized":"2024-05-07T13:56:35.359668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:51.701961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'27","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.162341+0000","last_change":"2024-05-07T13:55:54.327483+0000","last_active":"2024-05-07T13:57:57.162341+0000","last_peered":"2024-05-07T13:57:57.162341+0000","last_clean":"2024-05-07T13:57:57.162341+0000","last_became_active":"2024-05-07T13:55:54.326758+0000","last_became_peered":"2024-05-07T13:55:54.326758+0000","last_unstale":"2024-05-07T13:57:57.162341+0000","last_undegraded":"2024-05-07T13:57:57.162341+0000","last_fullsized":"2024-05-07T13:57:57.162341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:13:47.426980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357488+0000","last_change":"2024-05-07T13:55:56.346233+0000","last_active":"2024-05-07T13:56:35.357488+0000","last_peered":"2024-05-07T13:56:35.357488+0000","last_clean":"2024-05-07T13:56:35.357488+0000","last_became_active":"2024-05-07T13:55:56.345933+0000","last_became_peered":"2024-05-07T13:55:56.345933+0000","last_unstale":"2024-05-07T13:56:35.357488+0000","last_undegraded":"2024-05-07T13:56:35.357488+0000","last_fullsized":"2024-05-07T13:56:35.357488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:38:24.160530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.172834+0000","last_change":"2024-05-07T13:55:58.349147+0000","last_active":"2024-05-07T13:57:57.172834+0000","last_peered":"2024-05-07T13:57:57.172834+0000","last_clean":"2024-05-07T13:57:57.172834+0000","last_became_active":"2024-05-07T13:55:58.348763+0000","last_became_peered":"2024-05-07T13:55:58.348763+0000","last_unstale":"2024-05-07T13:57:57.172834+0000","last_undegraded":"2024-05-07T13:57:57.172834+0000","last_fullsized":"2024-05-07T13:57:57.172834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:37.840451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408575+0000","last_change":"2024-05-07T13:55:50.313977+0000","last_active":"2024-05-07T13:58:59.408575+0000","last_peered":"2024-05-07T13:58:59.408575+0000","last_clean":"2024-05-07T13:58:59.408575+0000","last_became_active":"2024-05-07T13:55:50.312605+0000","last_became_peered":"2024-05-07T13:55:50.312605+0000","last_unstale":"2024-05-07T13:58:59.408575+0000","last_undegraded":"2024-05-07T13:58:59.408575+0000","last_fullsized":"2024-05-07T13:58:59.408575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:54:46.860579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366631+0000","last_change":"2024-05-07T13:55:48.333628+0000","last_active":"2024-05-07T13:56:35.366631+0000","last_peered":"2024-05-07T13:56:35.366631+0000","last_clean":"2024-05-07T13:56:35.366631+0000","last_became_active":"2024-05-07T13:55:48.333254+0000","last_became_peered":"2024-05-07T13:55:48.333254+0000","last_unstale":"2024-05-07T13:56:35.366631+0000","last_undegraded":"2024-05-07T13:56:35.366631+0000","last_fullsized":"2024-05-07T13:56:35.366631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.781719+0000","last_change":"2024-05-07T13:55:52.322300+0000","last_active":"2024-05-07T13:57:55.781719+0000","last_peered":"2024-05-07T13:57:55.781719+0000","last_clean":"2024-05-07T13:57:55.781719+0000","last_became_active":"2024-05-07T13:55:52.321982+0000","last_became_peered":"2024-05-07T13:55:52.321982+0000","last_unstale":"2024-05-07T13:57:55.781719+0000","last_undegraded":"2024-05-07T13:57:55.781719+0000","last_fullsized":"2024-05-07T13:57:55.781719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:07:58.452077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.742866+0000","last_change":"2024-05-07T13:55:54.327217+0000","last_active":"2024-05-07T13:58:58.742866+0000","last_peered":"2024-05-07T13:58:58.742866+0000","last_clean":"2024-05-07T13:58:58.742866+0000","last_became_active":"2024-05-07T13:55:54.326895+0000","last_became_peered":"2024-05-07T13:55:54.326895+0000","last_unstale":"2024-05-07T13:58:58.742866+0000","last_undegraded":"2024-05-07T13:58:58.742866+0000","last_fullsized":"2024-05-07T13:58:58.742866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:20:31.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359452+0000","last_change":"2024-05-07T13:55:56.343265+0000","last_active":"2024-05-07T13:56:35.359452+0000","last_peered":"2024-05-07T13:56:35.359452+0000","last_clean":"2024-05-07T13:56:35.359452+0000","last_became_active":"2024-05-07T13:55:56.343002+0000","last_became_peered":"2024-05-07T13:55:56.343002+0000","last_unstale":"2024-05-07T13:56:35.359452+0000","last_undegraded":"2024-05-07T13:56:35.359452+0000","last_fullsized":"2024-05-07T13:56:35.359452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:46.396698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.593707+0000","last_change":"2024-05-07T13:55:58.348783+0000","last_active":"2024-05-07T13:58:59.593707+0000","last_peered":"2024-05-07T13:58:59.593707+0000","last_clean":"2024-05-07T13:58:59.593707+0000","last_became_active":"2024-05-07T13:55:58.347820+0000","last_became_peered":"2024-05-07T13:55:58.347820+0000","last_unstale":"2024-05-07T13:58:59.593707+0000","last_undegraded":"2024-05-07T13:58:59.593707+0000","last_fullsized":"2024-05-07T13:58:59.593707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:54.677953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471805+0000","last_change":"2024-05-07T13:55:50.330476+0000","last_active":"2024-05-07T13:58:59.471805+0000","last_peered":"2024-05-07T13:58:59.471805+0000","last_clean":"2024-05-07T13:58:59.471805+0000","last_became_active":"2024-05-07T13:55:50.330166+0000","last_became_peered":"2024-05-07T13:55:50.330166+0000","last_unstale":"2024-05-07T13:58:59.471805+0000","last_undegraded":"2024-05-07T13:58:59.471805+0000","last_fullsized":"2024-05-07T13:58:59.471805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:17:53.138578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358590+0000","last_change":"2024-05-07T13:55:48.339261+0000","last_active":"2024-05-07T13:56:35.358590+0000","last_peered":"2024-05-07T13:56:35.358590+0000","last_clean":"2024-05-07T13:56:35.358590+0000","last_became_active":"2024-05-07T13:55:48.338874+0000","last_became_peered":"2024-05-07T13:55:48.338874+0000","last_unstale":"2024-05-07T13:56:35.358590+0000","last_undegraded":"2024-05-07T13:56:35.358590+0000","last_fullsized":"2024-05-07T13:56:35.358590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.142958+0000","last_change":"2024-05-07T13:55:50.311630+0000","last_active":"2024-05-07T13:58:59.142958+0000","last_peered":"2024-05-07T13:58:59.142958+0000","last_clean":"2024-05-07T13:58:59.142958+0000","last_became_active":"2024-05-07T13:55:50.311324+0000","last_became_peered":"2024-05-07T13:55:50.311324+0000","last_unstale":"2024-05-07T13:58:59.142958+0000","last_undegraded":"2024-05-07T13:58:59.142958+0000","last_fullsized":"2024-05-07T13:58:59.142958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:52.088546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358534+0000","last_change":"2024-05-07T13:55:48.327068+0000","last_active":"2024-05-07T13:56:35.358534+0000","last_peered":"2024-05-07T13:56:35.358534+0000","last_clean":"2024-05-07T13:56:35.358534+0000","last_became_active":"2024-05-07T13:55:48.325561+0000","last_became_peered":"2024-05-07T13:55:48.325561+0000","last_unstale":"2024-05-07T13:56:35.358534+0000","last_undegraded":"2024-05-07T13:56:35.358534+0000","last_fullsized":"2024-05-07T13:56:35.358534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180888+0000","last_change":"2024-05-07T13:55:50.326752+0000","last_active":"2024-05-07T13:58:03.180888+0000","last_peered":"2024-05-07T13:58:03.180888+0000","last_clean":"2024-05-07T13:58:03.180888+0000","last_became_active":"2024-05-07T13:55:50.326322+0000","last_became_peered":"2024-05-07T13:55:50.326322+0000","last_unstale":"2024-05-07T13:58:03.180888+0000","last_undegraded":"2024-05-07T13:58:03.180888+0000","last_fullsized":"2024-05-07T13:58:03.180888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:07:36.575334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357230+0000","last_change":"2024-05-07T13:55:48.352058+0000","last_active":"2024-05-07T13:56:35.357230+0000","last_peered":"2024-05-07T13:56:35.357230+0000","last_clean":"2024-05-07T13:56:35.357230+0000","last_became_active":"2024-05-07T13:55:48.350385+0000","last_became_peered":"2024-05-07T13:55:48.350385+0000","last_unstale":"2024-05-07T13:56:35.357230+0000","last_undegraded":"2024-05-07T13:56:35.357230+0000","last_fullsized":"2024-05-07T13:56:35.357230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:17:38.955925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.178821+0000","last_change":"2024-05-07T13:55:50.313167+0000","last_active":"2024-05-07T13:58:03.178821+0000","last_peered":"2024-05-07T13:58:03.178821+0000","last_clean":"2024-05-07T13:58:03.178821+0000","last_became_active":"2024-05-07T13:55:50.312703+0000","last_became_peered":"2024-05-07T13:55:50.312703+0000","last_unstale":"2024-05-07T13:58:03.178821+0000","last_undegraded":"2024-05-07T13:58:03.178821+0000","last_fullsized":"2024-05-07T13:58:03.178821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.177520+0000","last_change":"2024-05-07T13:55:48.325914+0000","last_active":"2024-05-07T13:57:53.177520+0000","last_peered":"2024-05-07T13:57:53.177520+0000","last_clean":"2024-05-07T13:57:53.177520+0000","last_became_active":"2024-05-07T13:55:48.323979+0000","last_became_peered":"2024-05-07T13:55:48.323979+0000","last_unstale":"2024-05-07T13:57:53.177520+0000","last_undegraded":"2024-05-07T13:57:53.177520+0000","last_fullsized":"2024-05-07T13:57:53.177520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.472146+0000","last_change":"2024-05-07T13:55:50.331631+0000","last_active":"2024-05-07T13:58:59.472146+0000","last_peered":"2024-05-07T13:58:59.472146+0000","last_clean":"2024-05-07T13:58:59.472146+0000","last_became_active":"2024-05-07T13:55:50.331311+0000","last_became_peered":"2024-05-07T13:55:50.331311+0000","last_unstale":"2024-05-07T13:58:59.472146+0000","last_undegraded":"2024-05-07T13:58:59.472146+0000","last_fullsized":"2024-05-07T13:58:59.472146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178153+0000","last_change":"2024-05-07T13:55:48.326606+0000","last_active":"2024-05-07T13:57:58.178153+0000","last_peered":"2024-05-07T13:57:58.178153+0000","last_clean":"2024-05-07T13:57:58.178153+0000","last_became_active":"2024-05-07T13:55:48.325858+0000","last_became_peered":"2024-05-07T13:55:48.325858+0000","last_unstale":"2024-05-07T13:57:58.178153+0000","last_undegraded":"2024-05-07T13:57:58.178153+0000","last_fullsized":"2024-05-07T13:57:58.178153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:43.039363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.717865+0000","last_change":"2024-05-07T13:55:50.324360+0000","last_active":"2024-05-07T13:57:58.717865+0000","last_peered":"2024-05-07T13:57:58.717865+0000","last_clean":"2024-05-07T13:57:58.717865+0000","last_became_active":"2024-05-07T13:55:50.323573+0000","last_became_peered":"2024-05-07T13:55:50.323573+0000","last_unstale":"2024-05-07T13:57:58.717865+0000","last_undegraded":"2024-05-07T13:57:58.717865+0000","last_fullsized":"2024-05-07T13:57:58.717865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:57:18.448833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364364+0000","last_change":"2024-05-07T13:55:48.334670+0000","last_active":"2024-05-07T13:56:35.364364+0000","last_peered":"2024-05-07T13:56:35.364364+0000","last_clean":"2024-05-07T13:56:35.364364+0000","last_became_active":"2024-05-07T13:55:48.334268+0000","last_became_peered":"2024-05-07T13:55:48.334268+0000","last_unstale":"2024-05-07T13:56:35.364364+0000","last_undegraded":"2024-05-07T13:56:35.364364+0000","last_fullsized":"2024-05-07T13:56:35.364364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471690+0000","last_change":"2024-05-07T13:55:50.320633+0000","last_active":"2024-05-07T13:58:59.471690+0000","last_peered":"2024-05-07T13:58:59.471690+0000","last_clean":"2024-05-07T13:58:59.471690+0000","last_became_active":"2024-05-07T13:55:50.320242+0000","last_became_peered":"2024-05-07T13:55:50.320242+0000","last_unstale":"2024-05-07T13:58:59.471690+0000","last_undegraded":"2024-05-07T13:58:59.471690+0000","last_fullsized":"2024-05-07T13:58:59.471690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:05.135442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.182163+0000","last_change":"2024-05-07T13:55:48.341172+0000","last_active":"2024-05-07T13:57:58.182163+0000","last_peered":"2024-05-07T13:57:58.182163+0000","last_clean":"2024-05-07T13:57:58.182163+0000","last_became_active":"2024-05-07T13:55:48.340718+0000","last_became_peered":"2024-05-07T13:55:48.340718+0000","last_unstale":"2024-05-07T13:57:58.182163+0000","last_undegraded":"2024-05-07T13:57:58.182163+0000","last_fullsized":"2024-05-07T13:57:58.182163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'11","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149433+0000","last_change":"2024-05-07T13:55:50.320724+0000","last_active":"2024-05-07T13:58:59.149433+0000","last_peered":"2024-05-07T13:58:59.149433+0000","last_clean":"2024-05-07T13:58:59.149433+0000","last_became_active":"2024-05-07T13:55:50.320430+0000","last_became_peered":"2024-05-07T13:55:50.320430+0000","last_unstale":"2024-05-07T13:58:59.149433+0000","last_undegraded":"2024-05-07T13:58:59.149433+0000","last_fullsized":"2024-05-07T13:58:59.149433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:25:44.298994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361383+0000","last_change":"2024-05-07T13:55:48.324349+0000","last_active":"2024-05-07T13:56:35.361383+0000","last_peered":"2024-05-07T13:56:35.361383+0000","last_clean":"2024-05-07T13:56:35.361383+0000","last_became_active":"2024-05-07T13:55:48.323524+0000","last_became_peered":"2024-05-07T13:55:48.323524+0000","last_unstale":"2024-05-07T13:56:35.361383+0000","last_undegraded":"2024-05-07T13:56:35.361383+0000","last_fullsized":"2024-05-07T13:56:35.361383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:02.962105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367054+0000","last_change":"2024-05-07T13:55:50.313308+0000","last_active":"2024-05-07T13:56:35.367054+0000","last_peered":"2024-05-07T13:56:35.367054+0000","last_clean":"2024-05-07T13:56:35.367054+0000","last_became_active":"2024-05-07T13:55:50.313012+0000","last_became_peered":"2024-05-07T13:55:50.313012+0000","last_unstale":"2024-05-07T13:56:35.367054+0000","last_undegraded":"2024-05-07T13:56:35.367054+0000","last_fullsized":"2024-05-07T13:56:35.367054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:18.182290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.430794+0000","last_change":"2024-05-07T13:55:48.353515+0000","last_active":"2024-05-07T13:57:55.430794+0000","last_peered":"2024-05-07T13:57:55.430794+0000","last_clean":"2024-05-07T13:57:55.430794+0000","last_became_active":"2024-05-07T13:55:48.351882+0000","last_became_peered":"2024-05-07T13:55:48.351882+0000","last_unstale":"2024-05-07T13:57:55.430794+0000","last_undegraded":"2024-05-07T13:57:55.430794+0000","last_fullsized":"2024-05-07T13:57:55.430794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:34.947652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408508+0000","last_change":"2024-05-07T13:55:50.326172+0000","last_active":"2024-05-07T13:58:59.408508+0000","last_peered":"2024-05-07T13:58:59.408508+0000","last_clean":"2024-05-07T13:58:59.408508+0000","last_became_active":"2024-05-07T13:55:50.325807+0000","last_became_peered":"2024-05-07T13:55:50.325807+0000","last_unstale":"2024-05-07T13:58:59.408508+0000","last_undegraded":"2024-05-07T13:58:59.408508+0000","last_fullsized":"2024-05-07T13:58:59.408508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:08.013460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358738+0000","last_change":"2024-05-07T13:55:48.326746+0000","last_active":"2024-05-07T13:56:35.358738+0000","last_peered":"2024-05-07T13:56:35.358738+0000","last_clean":"2024-05-07T13:56:35.358738+0000","last_became_active":"2024-05-07T13:55:48.324919+0000","last_became_peered":"2024-05-07T13:55:48.324919+0000","last_unstale":"2024-05-07T13:56:35.358738+0000","last_undegraded":"2024-05-07T13:56:35.358738+0000","last_fullsized":"2024-05-07T13:56:35.358738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723663+0000","last_change":"2024-05-07T13:55:50.326002+0000","last_active":"2024-05-07T13:57:58.723663+0000","last_peered":"2024-05-07T13:57:58.723663+0000","last_clean":"2024-05-07T13:57:58.723663+0000","last_became_active":"2024-05-07T13:55:50.325620+0000","last_became_peered":"2024-05-07T13:55:50.325620+0000","last_unstale":"2024-05-07T13:57:58.723663+0000","last_undegraded":"2024-05-07T13:57:58.723663+0000","last_fullsized":"2024-05-07T13:57:58.723663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:56.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180393+0000","last_change":"2024-05-07T13:55:48.342921+0000","last_active":"2024-05-07T13:58:03.180393+0000","last_peered":"2024-05-07T13:58:03.180393+0000","last_clean":"2024-05-07T13:58:03.180393+0000","last_became_active":"2024-05-07T13:55:48.342508+0000","last_became_peered":"2024-05-07T13:55:48.342508+0000","last_unstale":"2024-05-07T13:58:03.180393+0000","last_undegraded":"2024-05-07T13:58:03.180393+0000","last_fullsized":"2024-05-07T13:58:03.180393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:02.747875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.246679+0000","last_change":"2024-05-07T13:55:50.321908+0000","last_active":"2024-05-07T13:58:59.246679+0000","last_peered":"2024-05-07T13:58:59.246679+0000","last_clean":"2024-05-07T13:58:59.246679+0000","last_became_active":"2024-05-07T13:55:50.321606+0000","last_became_peered":"2024-05-07T13:55:50.321606+0000","last_unstale":"2024-05-07T13:58:59.246679+0000","last_undegraded":"2024-05-07T13:58:59.246679+0000","last_fullsized":"2024-05-07T13:58:59.246679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:26.371060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361244+0000","last_change":"2024-05-07T13:55:48.332694+0000","last_active":"2024-05-07T13:56:35.361244+0000","last_peered":"2024-05-07T13:56:35.361244+0000","last_clean":"2024-05-07T13:56:35.361244+0000","last_became_active":"2024-05-07T13:55:48.332247+0000","last_became_peered":"2024-05-07T13:55:48.332247+0000","last_unstale":"2024-05-07T13:56:35.361244+0000","last_undegraded":"2024-05-07T13:56:35.361244+0000","last_fullsized":"2024-05-07T13:56:35.361244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408527+0000","last_change":"2024-05-07T13:55:50.329959+0000","last_active":"2024-05-07T13:58:59.408527+0000","last_peered":"2024-05-07T13:58:59.408527+0000","last_clean":"2024-05-07T13:58:59.408527+0000","last_became_active":"2024-05-07T13:55:50.329434+0000","last_became_peered":"2024-05-07T13:55:50.329434+0000","last_unstale":"2024-05-07T13:58:59.408527+0000","last_undegraded":"2024-05-07T13:58:59.408527+0000","last_fullsized":"2024-05-07T13:58:59.408527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.498000+0000","last_change":"2024-05-07T13:55:48.348177+0000","last_active":"2024-05-07T13:58:59.498000+0000","last_peered":"2024-05-07T13:58:59.498000+0000","last_clean":"2024-05-07T13:58:59.498000+0000","last_became_active":"2024-05-07T13:55:48.345844+0000","last_became_peered":"2024-05-07T13:55:48.345844+0000","last_unstale":"2024-05-07T13:58:59.498000+0000","last_undegraded":"2024-05-07T13:58:59.498000+0000","last_fullsized":"2024-05-07T13:58:59.498000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:03.127804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363106+0000","last_change":"2024-05-07T13:55:50.313698+0000","last_active":"2024-05-07T13:56:35.363106+0000","last_peered":"2024-05-07T13:56:35.363106+0000","last_clean":"2024-05-07T13:56:35.363106+0000","last_became_active":"2024-05-07T13:55:50.313049+0000","last_became_peered":"2024-05-07T13:55:50.313049+0000","last_unstale":"2024-05-07T13:56:35.363106+0000","last_undegraded":"2024-05-07T13:56:35.363106+0000","last_fullsized":"2024-05-07T13:56:35.363106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:43:49.979727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.121947+0000","last_change":"2024-05-07T13:55:48.349780+0000","last_active":"2024-05-07T13:58:59.121947+0000","last_peered":"2024-05-07T13:58:59.121947+0000","last_clean":"2024-05-07T13:58:59.121947+0000","last_became_active":"2024-05-07T13:55:48.346691+0000","last_became_peered":"2024-05-07T13:55:48.346691+0000","last_unstale":"2024-05-07T13:58:59.121947+0000","last_undegraded":"2024-05-07T13:58:59.121947+0000","last_fullsized":"2024-05-07T13:58:59.121947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:47.664009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'10","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.739245+0000","last_change":"2024-05-07T13:55:50.323717+0000","last_active":"2024-05-07T13:57:14.739245+0000","last_peered":"2024-05-07T13:57:14.739245+0000","last_clean":"2024-05-07T13:57:14.739245+0000","last_became_active":"2024-05-07T13:55:50.322543+0000","last_became_peered":"2024-05-07T13:55:50.322543+0000","last_unstale":"2024-05-07T13:57:14.739245+0000","last_undegraded":"2024-05-07T13:57:14.739245+0000","last_fullsized":"2024-05-07T13:57:14.739245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:12:56.152000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370285+0000","last_change":"2024-05-07T13:55:48.340889+0000","last_active":"2024-05-07T13:56:35.370285+0000","last_peered":"2024-05-07T13:56:35.370285+0000","last_clean":"2024-05-07T13:56:35.370285+0000","last_became_active":"2024-05-07T13:55:48.339909+0000","last_became_peered":"2024-05-07T13:55:48.339909+0000","last_unstale":"2024-05-07T13:56:35.370285+0000","last_undegraded":"2024-05-07T13:56:35.370285+0000","last_fullsized":"2024-05-07T13:56:35.370285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408516+0000","last_change":"2024-05-07T13:55:50.323280+0000","last_active":"2024-05-07T13:58:59.408516+0000","last_peered":"2024-05-07T13:58:59.408516+0000","last_clean":"2024-05-07T13:58:59.408516+0000","last_became_active":"2024-05-07T13:55:50.322967+0000","last_became_peered":"2024-05-07T13:55:50.322967+0000","last_unstale":"2024-05-07T13:58:59.408516+0000","last_undegraded":"2024-05-07T13:58:59.408516+0000","last_fullsized":"2024-05-07T13:58:59.408516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:51.713206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.102826+0000","last_change":"2024-05-07T13:55:48.347208+0000","last_active":"2024-05-07T13:58:59.102826+0000","last_peered":"2024-05-07T13:58:59.102826+0000","last_clean":"2024-05-07T13:58:59.102826+0000","last_became_active":"2024-05-07T13:55:48.346724+0000","last_became_peered":"2024-05-07T13:55:48.346724+0000","last_unstale":"2024-05-07T13:58:59.102826+0000","last_undegraded":"2024-05-07T13:58:59.102826+0000","last_fullsized":"2024-05-07T13:58:59.102826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:03.378851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357777+0000","last_change":"2024-05-07T13:55:48.351645+0000","last_active":"2024-05-07T13:56:35.357777+0000","last_peered":"2024-05-07T13:56:35.357777+0000","last_clean":"2024-05-07T13:56:35.357777+0000","last_became_active":"2024-05-07T13:55:48.349852+0000","last_became_peered":"2024-05-07T13:55:48.349852+0000","last_unstale":"2024-05-07T13:56:35.357777+0000","last_undegraded":"2024-05-07T13:56:35.357777+0000","last_fullsized":"2024-05-07T13:56:35.357777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:37:41.603367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408432+0000","last_change":"2024-05-07T13:55:50.319944+0000","last_active":"2024-05-07T13:58:59.408432+0000","last_peered":"2024-05-07T13:58:59.408432+0000","last_clean":"2024-05-07T13:58:59.408432+0000","last_became_active":"2024-05-07T13:55:50.319033+0000","last_became_peered":"2024-05-07T13:55:50.319033+0000","last_unstale":"2024-05-07T13:58:59.408432+0000","last_undegraded":"2024-05-07T13:58:59.408432+0000","last_fullsized":"2024-05-07T13:58:59.408432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359001+0000","last_change":"2024-05-07T13:55:48.326709+0000","last_active":"2024-05-07T13:56:35.359001+0000","last_peered":"2024-05-07T13:56:35.359001+0000","last_clean":"2024-05-07T13:56:35.359001+0000","last_became_active":"2024-05-07T13:55:48.324081+0000","last_became_peered":"2024-05-07T13:55:48.324081+0000","last_unstale":"2024-05-07T13:56:35.359001+0000","last_undegraded":"2024-05-07T13:56:35.359001+0000","last_fullsized":"2024-05-07T13:56:35.359001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723822+0000","last_change":"2024-05-07T13:55:50.330143+0000","last_active":"2024-05-07T13:57:58.723822+0000","last_peered":"2024-05-07T13:57:58.723822+0000","last_clean":"2024-05-07T13:57:58.723822+0000","last_became_active":"2024-05-07T13:55:50.329848+0000","last_became_peered":"2024-05-07T13:55:50.329848+0000","last_unstale":"2024-05-07T13:57:58.723822+0000","last_undegraded":"2024-05-07T13:57:58.723822+0000","last_fullsized":"2024-05-07T13:57:58.723822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:07.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1403,"num_read_kb":1189,"num_write":533,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1276,"ondisk_log_size":1276,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52492,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319348,"statfs":{"total":96636764160,"available":96583012352,"internally_reserved":0,"allocated":9048064,"data_stored":8742301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":9352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":9576448,"data_stored":9330398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":157,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48876,"kb_used_data":9380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322964,"statfs":{"total":96636764160,"available":96586715136,"internally_reserved":0,"allocated":9605120,"data_stored":9331528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":8800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":9011200,"data_stored":8741991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T13:59:06.640 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T13:59:06.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.779+0000 7fc506532640 1 Processor -- start 2024-05-07T13:59:06.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.779+0000 7fc506532640 1 -- start start 2024-05-07T13:59:06.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.780+0000 7fc506532640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5001316f0 0x7fc500133ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.780+0000 7fc506532640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc500070f50 con 0x7fc50012b590 2024-05-07T13:59:06.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.780+0000 7fc506532640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fc5000706e0 con 0x7fc5001316f0 2024-05-07T13:59:06.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.780+0000 7fc4ff7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5001316f0 0x7fc500133ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.780+0000 7fc4fffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc50012b590 0x7fc50012b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38148/0 (socket says 172.21.15.22:38148) 2024-05-07T13:59:06.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.780+0000 7fc4fffff640 1 -- 172.21.15.22:0/1380696051 learned_addr learned my addr 172.21.15.22:0/1380696051 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:06.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.780+0000 7fc4ff7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc5001316f0 0x7fc500133ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35412/0 (socket says 172.21.15.22:35412) 2024-05-07T13:59:06.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.780+0000 7fc4ff7fe640 1 -- 172.21.15.22:0/1380696051 >> v1:172.21.15.22:6789/0 conn(0x7fc50012b590 legacy=0x7fc50012b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.780+0000 7fc4ff7fe640 1 -- 172.21.15.22:0/1380696051 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50009dd00 con 0x7fc5001316f0 2024-05-07T13:59:06.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.781+0000 7fc4ff7fe640 1 --2- 172.21.15.22:0/1380696051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5001316f0 0x7fc500133ae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009720 tx=0x7fc4f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f90d7cd9e73d62 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.781+0000 7fc4feffd640 1 -- 172.21.15.22:0/1380696051 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f40316d0 con 0x7fc5001316f0 2024-05-07T13:59:06.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.781+0000 7fc4feffd640 1 -- 172.21.15.22:0/1380696051 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f4037070 con 0x7fc5001316f0 2024-05-07T13:59:06.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.781+0000 7fc4feffd640 1 -- 172.21.15.22:0/1380696051 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f40319c0 con 0x7fc5001316f0 2024-05-07T13:59:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.781+0000 7fc506532640 1 -- 172.21.15.22:0/1380696051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5001316f0 msgr2=0x7fc500133ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.781+0000 7fc506532640 1 --2- 172.21.15.22:0/1380696051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5001316f0 0x7fc500133ae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009720 tx=0x7fc4f402b840 comp rx=0 tx=0).stop 2024-05-07T13:59:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.782+0000 7fc506532640 1 -- 172.21.15.22:0/1380696051 shutdown_connections 2024-05-07T13:59:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.782+0000 7fc506532640 1 --2- 172.21.15.22:0/1380696051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5001316f0 0x7fc500133ae0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.782+0000 7fc506532640 1 -- 172.21.15.22:0/1380696051 >> 172.21.15.22:0/1380696051 conn(0x7fc50009ed60 msgr2=0x7fc50009f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.782+0000 7fc506532640 1 -- 172.21.15.22:0/1380696051 shutdown_connections 2024-05-07T13:59:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.782+0000 7fc506532640 1 -- 172.21.15.22:0/1380696051 wait complete. 2024-05-07T13:59:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.782+0000 7fc506532640 1 Processor -- start 2024-05-07T13:59:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.783+0000 7fc506532640 1 -- start start 2024-05-07T13:59:06.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.783+0000 7fc506532640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc50012b590 0x7fc50006e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.783+0000 7fc506532640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc500134020 con 0x7fc50012b590 2024-05-07T13:59:06.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.783+0000 7fc4fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc50012b590 0x7fc50006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.783+0000 7fc4fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc50012b590 0x7fc50006e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35424/0 (socket says 172.21.15.22:35424) 2024-05-07T13:59:06.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.783+0000 7fc4fffff640 1 -- 172.21.15.22:0/2534090349 learned_addr learned my addr 172.21.15.22:0/2534090349 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:06.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.783+0000 7fc4fffff640 1 -- 172.21.15.22:0/2534090349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50012c260 con 0x7fc50012b590 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.784+0000 7fc4fffff640 1 --2- 172.21.15.22:0/2534090349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc50012b590 0x7fc50006e210 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c480 tx=0x7fc4f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.784+0000 7fc4fcff9640 1 -- 172.21.15.22:0/2534090349 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0017070 con 0x7fc50012b590 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.784+0000 7fc4fcff9640 1 -- 172.21.15.22:0/2534090349 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f0005c10 con 0x7fc50012b590 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.784+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc500070380 con 0x7fc50012b590 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.784+0000 7fc4fcff9640 1 -- 172.21.15.22:0/2534090349 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f00070d0 con 0x7fc50012b590 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.784+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50012c6f0 con 0x7fc50012b590 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.785+0000 7fc4fcff9640 1 -- 172.21.15.22:0/2534090349 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc4f001a070 con 0x7fc50012b590 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.785+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc500062e90 con 0x7fc50012b590 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.785+0000 7fc4fcff9640 1 --2- 172.21.15.22:0/2534090349 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4ec038060 0x7fc4ec03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.785+0000 7fc4fcff9640 1 -- 172.21.15.22:0/2534090349 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fc4f004aca0 con 0x7fc50012b590 2024-05-07T13:59:06.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.785+0000 7fc4ff7fe640 1 --2- 172.21.15.22:0/2534090349 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4ec038060 0x7fc4ec03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:06.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.786+0000 7fc4ff7fe640 1 --2- 172.21.15.22:0/2534090349 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4ec038060 0x7fc4ec03a520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4036000 tx=0x7fc4f4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:06.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.790+0000 7fc4fcff9640 1 -- 172.21.15.22:0/2534090349 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc4f00104c0 con 0x7fc50012b590 2024-05-07T13:59:06.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.968+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc500133490 con 0x7fc4ec038060 2024-05-07T13:59:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.984+0000 7fc4fcff9640 1 -- 172.21.15.22:0/2534090349 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665926 (secure 0 0 0) 0x7fc4f4037040 con 0x7fc4ec038060 2024-05-07T13:59:06.978 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:59:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T13:59:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4ec038060 msgr2=0x7fc4ec03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 --2- 172.21.15.22:0/2534090349 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4ec038060 0x7fc4ec03a520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4036000 tx=0x7fc4f4008030 comp rx=0 tx=0).stop 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc50012b590 msgr2=0x7fc50006e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 --2- 172.21.15.22:0/2534090349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc50012b590 0x7fc50006e210 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c480 tx=0x7fc4f000c940 comp rx=0 tx=0).stop 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 shutdown_connections 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 --2- 172.21.15.22:0/2534090349 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fc4ec038060 0x7fc4ec03a520 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 --2- 172.21.15.22:0/2534090349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc50012b590 0x7fc50006e210 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 >> 172.21.15.22:0/2534090349 conn(0x7fc50009ed60 msgr2=0x7fc500130330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 shutdown_connections 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:06.988+0000 7fc506532640 1 -- 172.21.15.22:0/2534090349 wait complete. 2024-05-07T13:59:06.988 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-05-07T13:59:06.164628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416885,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4903,"num_read_kb":4480,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4478,"ondisk_log_size":4478,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177712,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309648,"statfs":{"total":386547056640,"available":386365079552,"internally_reserved":0,"allocated":37240832,"data_stored":36146218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":511,"num_read_kb":466,"num_write":388,"num_write_kb":29374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003777"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369379+0000","last_change":"2024-05-07T13:55:48.336201+0000","last_active":"2024-05-07T13:56:35.369379+0000","last_peered":"2024-05-07T13:56:35.369379+0000","last_clean":"2024-05-07T13:56:35.369379+0000","last_became_active":"2024-05-07T13:55:48.335740+0000","last_became_peered":"2024-05-07T13:55:48.335740+0000","last_unstale":"2024-05-07T13:56:35.369379+0000","last_undegraded":"2024-05-07T13:56:35.369379+0000","last_fullsized":"2024-05-07T13:56:35.369379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'13","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.510112+0000","last_change":"2024-05-07T13:55:50.316599+0000","last_active":"2024-05-07T13:58:59.510112+0000","last_peered":"2024-05-07T13:58:59.510112+0000","last_clean":"2024-05-07T13:58:59.510112+0000","last_became_active":"2024-05-07T13:55:50.316253+0000","last_became_peered":"2024-05-07T13:55:50.316253+0000","last_unstale":"2024-05-07T13:58:59.510112+0000","last_undegraded":"2024-05-07T13:58:59.510112+0000","last_fullsized":"2024-05-07T13:58:59.510112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:27.304492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.390309+0000","last_change":"2024-05-07T13:55:48.324242+0000","last_active":"2024-05-07T13:58:59.390309+0000","last_peered":"2024-05-07T13:58:59.390309+0000","last_clean":"2024-05-07T13:58:59.390309+0000","last_became_active":"2024-05-07T13:55:48.323151+0000","last_became_peered":"2024-05-07T13:55:48.323151+0000","last_unstale":"2024-05-07T13:58:59.390309+0000","last_undegraded":"2024-05-07T13:58:59.390309+0000","last_fullsized":"2024-05-07T13:58:59.390309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:18:09.959294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358436+0000","last_change":"2024-05-07T13:55:50.322812+0000","last_active":"2024-05-07T13:56:35.358436+0000","last_peered":"2024-05-07T13:56:35.358436+0000","last_clean":"2024-05-07T13:56:35.358436+0000","last_became_active":"2024-05-07T13:55:50.322066+0000","last_became_peered":"2024-05-07T13:55:50.322066+0000","last_unstale":"2024-05-07T13:56:35.358436+0000","last_undegraded":"2024-05-07T13:56:35.358436+0000","last_fullsized":"2024-05-07T13:56:35.358436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:40.527236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360959+0000","last_change":"2024-05-07T13:55:48.350450+0000","last_active":"2024-05-07T13:56:35.360959+0000","last_peered":"2024-05-07T13:56:35.360959+0000","last_clean":"2024-05-07T13:56:35.360959+0000","last_became_active":"2024-05-07T13:55:48.347661+0000","last_became_peered":"2024-05-07T13:55:48.347661+0000","last_unstale":"2024-05-07T13:56:35.360959+0000","last_undegraded":"2024-05-07T13:56:35.360959+0000","last_fullsized":"2024-05-07T13:56:35.360959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:43.418566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358314+0000","last_change":"2024-05-07T13:55:50.322032+0000","last_active":"2024-05-07T13:56:35.358314+0000","last_peered":"2024-05-07T13:56:35.358314+0000","last_clean":"2024-05-07T13:56:35.358314+0000","last_became_active":"2024-05-07T13:55:50.321598+0000","last_became_peered":"2024-05-07T13:55:50.321598+0000","last_unstale":"2024-05-07T13:56:35.358314+0000","last_undegraded":"2024-05-07T13:56:35.358314+0000","last_fullsized":"2024-05-07T13:56:35.358314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:59.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.697458+0000","last_change":"2024-05-07T13:55:48.337861+0000","last_active":"2024-05-07T13:57:58.697458+0000","last_peered":"2024-05-07T13:57:58.697458+0000","last_clean":"2024-05-07T13:57:58.697458+0000","last_became_active":"2024-05-07T13:55:48.337418+0000","last_became_peered":"2024-05-07T13:55:48.337418+0000","last_unstale":"2024-05-07T13:57:58.697458+0000","last_undegraded":"2024-05-07T13:57:58.697458+0000","last_fullsized":"2024-05-07T13:57:58.697458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.245251+0000","last_change":"2024-05-07T13:56:35.367287+0000","last_active":"2024-05-07T13:58:59.245251+0000","last_peered":"2024-05-07T13:58:59.245251+0000","last_clean":"2024-05-07T13:58:59.245251+0000","last_became_active":"2024-05-07T13:56:35.366947+0000","last_became_peered":"2024-05-07T13:56:35.366947+0000","last_unstale":"2024-05-07T13:58:59.245251+0000","last_undegraded":"2024-05-07T13:58:59.245251+0000","last_fullsized":"2024-05-07T13:58:59.245251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:38.628455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358752+0000","last_change":"2024-05-07T13:55:48.349880+0000","last_active":"2024-05-07T13:56:35.358752+0000","last_peered":"2024-05-07T13:56:35.358752+0000","last_clean":"2024-05-07T13:56:35.358752+0000","last_became_active":"2024-05-07T13:55:48.347714+0000","last_became_peered":"2024-05-07T13:55:48.347714+0000","last_unstale":"2024-05-07T13:56:35.358752+0000","last_undegraded":"2024-05-07T13:56:35.358752+0000","last_fullsized":"2024-05-07T13:56:35.358752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:35.715822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'8","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364637+0000","last_change":"2024-05-07T13:55:50.314953+0000","last_active":"2024-05-07T13:56:35.364637+0000","last_peered":"2024-05-07T13:56:35.364637+0000","last_clean":"2024-05-07T13:56:35.364637+0000","last_became_active":"2024-05-07T13:55:50.314660+0000","last_became_peered":"2024-05-07T13:55:50.314660+0000","last_unstale":"2024-05-07T13:56:35.364637+0000","last_undegraded":"2024-05-07T13:56:35.364637+0000","last_fullsized":"2024-05-07T13:56:35.364637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:05.386488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359638+0000","last_change":"2024-05-07T13:55:48.338607+0000","last_active":"2024-05-07T13:56:35.359638+0000","last_peered":"2024-05-07T13:56:35.359638+0000","last_clean":"2024-05-07T13:56:35.359638+0000","last_became_active":"2024-05-07T13:55:48.337256+0000","last_became_peered":"2024-05-07T13:55:48.337256+0000","last_unstale":"2024-05-07T13:56:35.359638+0000","last_undegraded":"2024-05-07T13:56:35.359638+0000","last_fullsized":"2024-05-07T13:56:35.359638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:43.039363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502905+0000","last_change":"2024-05-07T13:55:50.322605+0000","last_active":"2024-05-07T13:58:59.502905+0000","last_peered":"2024-05-07T13:58:59.502905+0000","last_clean":"2024-05-07T13:58:59.502905+0000","last_became_active":"2024-05-07T13:55:50.322204+0000","last_became_peered":"2024-05-07T13:55:50.322204+0000","last_unstale":"2024-05-07T13:58:59.502905+0000","last_undegraded":"2024-05-07T13:58:59.502905+0000","last_fullsized":"2024-05-07T13:58:59.502905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:49.695086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357314+0000","last_change":"2024-05-07T13:55:48.348111+0000","last_active":"2024-05-07T13:56:35.357314+0000","last_peered":"2024-05-07T13:56:35.357314+0000","last_clean":"2024-05-07T13:56:35.357314+0000","last_became_active":"2024-05-07T13:55:48.347006+0000","last_became_peered":"2024-05-07T13:55:48.347006+0000","last_unstale":"2024-05-07T13:56:35.357314+0000","last_undegraded":"2024-05-07T13:56:35.357314+0000","last_fullsized":"2024-05-07T13:56:35.357314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:03:02.570573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.739053+0000","last_change":"2024-05-07T13:55:50.313130+0000","last_active":"2024-05-07T13:57:14.739053+0000","last_peered":"2024-05-07T13:57:14.739053+0000","last_clean":"2024-05-07T13:57:14.739053+0000","last_became_active":"2024-05-07T13:55:50.312835+0000","last_became_peered":"2024-05-07T13:55:50.312835+0000","last_unstale":"2024-05-07T13:57:14.739053+0000","last_undegraded":"2024-05-07T13:57:14.739053+0000","last_fullsized":"2024-05-07T13:57:14.739053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358691+0000","last_change":"2024-05-07T13:55:48.325646+0000","last_active":"2024-05-07T13:56:35.358691+0000","last_peered":"2024-05-07T13:56:35.358691+0000","last_clean":"2024-05-07T13:56:35.358691+0000","last_became_active":"2024-05-07T13:55:48.323612+0000","last_became_peered":"2024-05-07T13:55:48.323612+0000","last_unstale":"2024-05-07T13:56:35.358691+0000","last_undegraded":"2024-05-07T13:56:35.358691+0000","last_fullsized":"2024-05-07T13:56:35.358691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.140533+0000","last_change":"2024-05-07T13:55:50.325361+0000","last_active":"2024-05-07T13:58:59.140533+0000","last_peered":"2024-05-07T13:58:59.140533+0000","last_clean":"2024-05-07T13:58:59.140533+0000","last_became_active":"2024-05-07T13:55:50.325055+0000","last_became_peered":"2024-05-07T13:55:50.325055+0000","last_unstale":"2024-05-07T13:58:59.140533+0000","last_undegraded":"2024-05-07T13:58:59.140533+0000","last_fullsized":"2024-05-07T13:58:59.140533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'22","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502985+0000","last_change":"2024-05-07T13:55:50.321695+0000","last_active":"2024-05-07T13:58:59.502985+0000","last_peered":"2024-05-07T13:58:59.502985+0000","last_clean":"2024-05-07T13:58:59.502985+0000","last_became_active":"2024-05-07T13:55:50.321385+0000","last_became_peered":"2024-05-07T13:55:50.321385+0000","last_unstale":"2024-05-07T13:58:59.502985+0000","last_undegraded":"2024-05-07T13:58:59.502985+0000","last_fullsized":"2024-05-07T13:58:59.502985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:35.440672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366609+0000","last_change":"2024-05-07T13:55:48.335649+0000","last_active":"2024-05-07T13:56:35.366609+0000","last_peered":"2024-05-07T13:56:35.366609+0000","last_clean":"2024-05-07T13:56:35.366609+0000","last_became_active":"2024-05-07T13:55:48.335213+0000","last_became_peered":"2024-05-07T13:55:48.335213+0000","last_unstale":"2024-05-07T13:56:35.366609+0000","last_undegraded":"2024-05-07T13:56:35.366609+0000","last_fullsized":"2024-05-07T13:56:35.366609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'15","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415641+0000","last_change":"2024-05-07T13:55:50.313758+0000","last_active":"2024-05-07T13:58:59.415641+0000","last_peered":"2024-05-07T13:58:59.415641+0000","last_clean":"2024-05-07T13:58:59.415641+0000","last_became_active":"2024-05-07T13:55:50.313457+0000","last_became_peered":"2024-05-07T13:55:50.313457+0000","last_unstale":"2024-05-07T13:58:59.415641+0000","last_undegraded":"2024-05-07T13:58:59.415641+0000","last_fullsized":"2024-05-07T13:58:59.415641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370399+0000","last_change":"2024-05-07T13:55:48.341129+0000","last_active":"2024-05-07T13:56:35.370399+0000","last_peered":"2024-05-07T13:56:35.370399+0000","last_clean":"2024-05-07T13:56:35.370399+0000","last_became_active":"2024-05-07T13:55:48.340516+0000","last_became_peered":"2024-05-07T13:55:48.340516+0000","last_unstale":"2024-05-07T13:56:35.370399+0000","last_undegraded":"2024-05-07T13:56:35.370399+0000","last_fullsized":"2024-05-07T13:56:35.370399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.503272+0000","last_change":"2024-05-07T13:55:50.313924+0000","last_active":"2024-05-07T13:58:59.503272+0000","last_peered":"2024-05-07T13:58:59.503272+0000","last_clean":"2024-05-07T13:58:59.503272+0000","last_became_active":"2024-05-07T13:55:50.313442+0000","last_became_peered":"2024-05-07T13:55:50.313442+0000","last_unstale":"2024-05-07T13:58:59.503272+0000","last_undegraded":"2024-05-07T13:58:59.503272+0000","last_fullsized":"2024-05-07T13:58:59.503272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:52.088546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.632765+0000","last_change":"2024-05-07T13:55:48.339008+0000","last_active":"2024-05-07T13:57:58.632765+0000","last_peered":"2024-05-07T13:57:58.632765+0000","last_clean":"2024-05-07T13:57:58.632765+0000","last_became_active":"2024-05-07T13:55:48.338589+0000","last_became_peered":"2024-05-07T13:55:48.338589+0000","last_unstale":"2024-05-07T13:57:58.632765+0000","last_undegraded":"2024-05-07T13:57:58.632765+0000","last_fullsized":"2024-05-07T13:57:58.632765+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'7","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149687+0000","last_change":"2024-05-07T13:55:50.328784+0000","last_active":"2024-05-07T13:58:59.149687+0000","last_peered":"2024-05-07T13:58:59.149687+0000","last_clean":"2024-05-07T13:58:59.149687+0000","last_became_active":"2024-05-07T13:55:50.328471+0000","last_became_peered":"2024-05-07T13:55:50.328471+0000","last_unstale":"2024-05-07T13:58:59.149687+0000","last_undegraded":"2024-05-07T13:58:59.149687+0000","last_fullsized":"2024-05-07T13:58:59.149687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363639+0000","last_change":"2024-05-07T13:55:48.340701+0000","last_active":"2024-05-07T13:56:35.363639+0000","last_peered":"2024-05-07T13:56:35.363639+0000","last_clean":"2024-05-07T13:56:35.363639+0000","last_became_active":"2024-05-07T13:55:48.340284+0000","last_became_peered":"2024-05-07T13:55:48.340284+0000","last_unstale":"2024-05-07T13:56:35.363639+0000","last_undegraded":"2024-05-07T13:56:35.363639+0000","last_fullsized":"2024-05-07T13:56:35.363639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:03:37.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509996+0000","last_change":"2024-05-07T13:55:50.322836+0000","last_active":"2024-05-07T13:58:59.509996+0000","last_peered":"2024-05-07T13:58:59.509996+0000","last_clean":"2024-05-07T13:58:59.509996+0000","last_became_active":"2024-05-07T13:55:50.322513+0000","last_became_peered":"2024-05-07T13:55:50.322513+0000","last_unstale":"2024-05-07T13:58:59.509996+0000","last_undegraded":"2024-05-07T13:58:59.509996+0000","last_fullsized":"2024-05-07T13:58:59.509996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:05.386488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359883+0000","last_change":"2024-05-07T13:55:48.326455+0000","last_active":"2024-05-07T13:56:35.359883+0000","last_peered":"2024-05-07T13:56:35.359883+0000","last_clean":"2024-05-07T13:56:35.359883+0000","last_became_active":"2024-05-07T13:55:48.325321+0000","last_became_peered":"2024-05-07T13:55:48.325321+0000","last_unstale":"2024-05-07T13:56:35.359883+0000","last_undegraded":"2024-05-07T13:56:35.359883+0000","last_fullsized":"2024-05-07T13:56:35.359883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471610+0000","last_change":"2024-05-07T13:55:50.322751+0000","last_active":"2024-05-07T13:58:59.471610+0000","last_peered":"2024-05-07T13:58:59.471610+0000","last_clean":"2024-05-07T13:58:59.471610+0000","last_became_active":"2024-05-07T13:55:50.322476+0000","last_became_peered":"2024-05-07T13:55:50.322476+0000","last_unstale":"2024-05-07T13:58:59.471610+0000","last_undegraded":"2024-05-07T13:58:59.471610+0000","last_fullsized":"2024-05-07T13:58:59.471610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:06.112406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357654+0000","last_change":"2024-05-07T13:55:48.351155+0000","last_active":"2024-05-07T13:56:35.357654+0000","last_peered":"2024-05-07T13:56:35.357654+0000","last_clean":"2024-05-07T13:56:35.357654+0000","last_became_active":"2024-05-07T13:55:48.348714+0000","last_became_peered":"2024-05-07T13:55:48.348714+0000","last_unstale":"2024-05-07T13:56:35.357654+0000","last_undegraded":"2024-05-07T13:56:35.357654+0000","last_fullsized":"2024-05-07T13:56:35.357654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:56.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'37","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.441141+0000","last_change":"2024-05-07T13:55:58.348302+0000","last_active":"2024-05-07T13:58:59.441141+0000","last_peered":"2024-05-07T13:58:59.441141+0000","last_clean":"2024-05-07T13:58:59.441141+0000","last_became_active":"2024-05-07T13:55:58.347993+0000","last_became_peered":"2024-05-07T13:55:58.347993+0000","last_unstale":"2024-05-07T13:58:59.441141+0000","last_undegraded":"2024-05-07T13:58:59.441141+0000","last_fullsized":"2024-05-07T13:58:59.441141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:48:53.516894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358863+0000","last_change":"2024-05-07T13:55:50.323646+0000","last_active":"2024-05-07T13:56:35.358863+0000","last_peered":"2024-05-07T13:56:35.358863+0000","last_clean":"2024-05-07T13:56:35.358863+0000","last_became_active":"2024-05-07T13:55:50.323355+0000","last_became_peered":"2024-05-07T13:55:50.323355+0000","last_unstale":"2024-05-07T13:56:35.358863+0000","last_undegraded":"2024-05-07T13:56:35.358863+0000","last_fullsized":"2024-05-07T13:56:35.358863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:08.563941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.403334+0000","last_change":"2024-05-07T13:55:48.352275+0000","last_active":"2024-05-07T13:58:59.403334+0000","last_peered":"2024-05-07T13:58:59.403334+0000","last_clean":"2024-05-07T13:58:59.403334+0000","last_became_active":"2024-05-07T13:55:48.350161+0000","last_became_peered":"2024-05-07T13:55:48.350161+0000","last_unstale":"2024-05-07T13:58:59.403334+0000","last_undegraded":"2024-05-07T13:58:59.403334+0000","last_fullsized":"2024-05-07T13:58:59.403334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:28.942263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359868+0000","last_change":"2024-05-07T13:55:52.319295+0000","last_active":"2024-05-07T13:56:35.359868+0000","last_peered":"2024-05-07T13:56:35.359868+0000","last_clean":"2024-05-07T13:56:35.359868+0000","last_became_active":"2024-05-07T13:55:52.318966+0000","last_became_peered":"2024-05-07T13:55:52.318966+0000","last_unstale":"2024-05-07T13:56:35.359868+0000","last_undegraded":"2024-05-07T13:56:35.359868+0000","last_fullsized":"2024-05-07T13:56:35.359868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:08:48.912920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.155499+0000","last_change":"2024-05-07T13:55:54.332167+0000","last_active":"2024-05-07T13:57:57.155499+0000","last_peered":"2024-05-07T13:57:57.155499+0000","last_clean":"2024-05-07T13:57:57.155499+0000","last_became_active":"2024-05-07T13:55:54.331835+0000","last_became_peered":"2024-05-07T13:55:54.331835+0000","last_unstale":"2024-05-07T13:57:57.155499+0000","last_undegraded":"2024-05-07T13:57:57.155499+0000","last_fullsized":"2024-05-07T13:57:57.155499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:49:52.843419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366444+0000","last_change":"2024-05-07T13:55:56.338931+0000","last_active":"2024-05-07T13:56:35.366444+0000","last_peered":"2024-05-07T13:56:35.366444+0000","last_clean":"2024-05-07T13:56:35.366444+0000","last_became_active":"2024-05-07T13:55:56.338638+0000","last_became_peered":"2024-05-07T13:55:56.338638+0000","last_unstale":"2024-05-07T13:56:35.366444+0000","last_undegraded":"2024-05-07T13:56:35.366444+0000","last_fullsized":"2024-05-07T13:56:35.366444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:50.175136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'13","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.744345+0000","last_change":"2024-05-07T13:55:58.348663+0000","last_active":"2024-05-07T13:57:14.744345+0000","last_peered":"2024-05-07T13:57:14.744345+0000","last_clean":"2024-05-07T13:57:14.744345+0000","last_became_active":"2024-05-07T13:55:58.348341+0000","last_became_peered":"2024-05-07T13:55:58.348341+0000","last_unstale":"2024-05-07T13:57:14.744345+0000","last_undegraded":"2024-05-07T13:57:14.744345+0000","last_fullsized":"2024-05-07T13:57:14.744345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:46.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360493+0000","last_change":"2024-05-07T13:55:50.325607+0000","last_active":"2024-05-07T13:56:35.360493+0000","last_peered":"2024-05-07T13:56:35.360493+0000","last_clean":"2024-05-07T13:56:35.360493+0000","last_became_active":"2024-05-07T13:55:50.325201+0000","last_became_peered":"2024-05-07T13:55:50.325201+0000","last_unstale":"2024-05-07T13:56:35.360493+0000","last_undegraded":"2024-05-07T13:56:35.360493+0000","last_fullsized":"2024-05-07T13:56:35.360493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:39.839247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359294+0000","last_change":"2024-05-07T13:55:48.339081+0000","last_active":"2024-05-07T13:56:35.359294+0000","last_peered":"2024-05-07T13:56:35.359294+0000","last_clean":"2024-05-07T13:56:35.359294+0000","last_became_active":"2024-05-07T13:55:48.338704+0000","last_became_peered":"2024-05-07T13:55:48.338704+0000","last_unstale":"2024-05-07T13:56:35.359294+0000","last_undegraded":"2024-05-07T13:56:35.359294+0000","last_fullsized":"2024-05-07T13:56:35.359294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:02:32.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.167968+0000","last_change":"2024-05-07T13:56:35.362029+0000","last_active":"2024-05-07T13:56:38.167968+0000","last_peered":"2024-05-07T13:56:38.167968+0000","last_clean":"2024-05-07T13:56:38.167968+0000","last_became_active":"2024-05-07T13:56:35.361623+0000","last_became_peered":"2024-05-07T13:56:35.361623+0000","last_unstale":"2024-05-07T13:56:38.167968+0000","last_undegraded":"2024-05-07T13:56:38.167968+0000","last_fullsized":"2024-05-07T13:56:38.167968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:19.312383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"27'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.365053+0000","last_change":"2024-05-07T13:55:54.333882+0000","last_active":"2024-05-07T13:56:35.365053+0000","last_peered":"2024-05-07T13:56:35.365053+0000","last_clean":"2024-05-07T13:56:35.365053+0000","last_became_active":"2024-05-07T13:55:54.333402+0000","last_became_peered":"2024-05-07T13:55:54.333402+0000","last_unstale":"2024-05-07T13:56:35.365053+0000","last_undegraded":"2024-05-07T13:56:35.365053+0000","last_fullsized":"2024-05-07T13:56:35.365053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:39.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364824+0000","last_change":"2024-05-07T13:55:56.335951+0000","last_active":"2024-05-07T13:56:35.364824+0000","last_peered":"2024-05-07T13:56:35.364824+0000","last_clean":"2024-05-07T13:56:35.364824+0000","last_became_active":"2024-05-07T13:55:56.335463+0000","last_became_peered":"2024-05-07T13:55:56.335463+0000","last_unstale":"2024-05-07T13:56:35.364824+0000","last_undegraded":"2024-05-07T13:56:35.364824+0000","last_fullsized":"2024-05-07T13:56:35.364824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:46.396698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358195+0000","last_change":"2024-05-07T13:55:58.341190+0000","last_active":"2024-05-07T13:56:35.358195+0000","last_peered":"2024-05-07T13:56:35.358195+0000","last_clean":"2024-05-07T13:56:35.358195+0000","last_became_active":"2024-05-07T13:55:58.340688+0000","last_became_peered":"2024-05-07T13:55:58.340688+0000","last_unstale":"2024-05-07T13:56:35.358195+0000","last_undegraded":"2024-05-07T13:56:35.358195+0000","last_fullsized":"2024-05-07T13:56:35.358195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:49:27.158233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509454+0000","last_change":"2024-05-07T13:55:50.324646+0000","last_active":"2024-05-07T13:58:59.509454+0000","last_peered":"2024-05-07T13:58:59.509454+0000","last_clean":"2024-05-07T13:58:59.509454+0000","last_became_active":"2024-05-07T13:55:50.323775+0000","last_became_peered":"2024-05-07T13:55:50.323775+0000","last_unstale":"2024-05-07T13:58:59.509454+0000","last_undegraded":"2024-05-07T13:58:59.509454+0000","last_fullsized":"2024-05-07T13:58:59.509454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:07:56.445202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.393425+0000","last_change":"2024-05-07T13:55:48.350102+0000","last_active":"2024-05-07T13:58:59.393425+0000","last_peered":"2024-05-07T13:58:59.393425+0000","last_clean":"2024-05-07T13:58:59.393425+0000","last_became_active":"2024-05-07T13:55:48.349636+0000","last_became_peered":"2024-05-07T13:55:48.349636+0000","last_unstale":"2024-05-07T13:58:59.393425+0000","last_undegraded":"2024-05-07T13:58:59.393425+0000","last_fullsized":"2024-05-07T13:58:59.393425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:58.430354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.171913+0000","last_change":"2024-05-07T13:56:35.370451+0000","last_active":"2024-05-07T13:56:38.171913+0000","last_peered":"2024-05-07T13:56:38.171913+0000","last_clean":"2024-05-07T13:56:38.171913+0000","last_became_active":"2024-05-07T13:56:35.370109+0000","last_became_peered":"2024-05-07T13:56:35.370109+0000","last_unstale":"2024-05-07T13:56:38.171913+0000","last_undegraded":"2024-05-07T13:56:38.171913+0000","last_fullsized":"2024-05-07T13:56:38.171913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:20.523325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366990+0000","last_change":"2024-05-07T13:55:54.327564+0000","last_active":"2024-05-07T13:56:35.366990+0000","last_peered":"2024-05-07T13:56:35.366990+0000","last_clean":"2024-05-07T13:56:35.366990+0000","last_became_active":"2024-05-07T13:55:54.327178+0000","last_became_peered":"2024-05-07T13:55:54.327178+0000","last_unstale":"2024-05-07T13:56:35.366990+0000","last_undegraded":"2024-05-07T13:56:35.366990+0000","last_fullsized":"2024-05-07T13:56:35.366990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:53.709163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":390,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405101+0000","last_change":"2024-05-07T13:55:56.347848+0000","last_active":"2024-05-07T13:58:57.405101+0000","last_peered":"2024-05-07T13:58:57.405101+0000","last_clean":"2024-05-07T13:58:57.405101+0000","last_became_active":"2024-05-07T13:55:56.345712+0000","last_became_peered":"2024-05-07T13:55:56.345712+0000","last_unstale":"2024-05-07T13:58:57.405101+0000","last_undegraded":"2024-05-07T13:58:57.405101+0000","last_fullsized":"2024-05-07T13:58:57.405101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:18:51.323865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358426+0000","last_change":"2024-05-07T13:55:58.340114+0000","last_active":"2024-05-07T13:56:35.358426+0000","last_peered":"2024-05-07T13:56:35.358426+0000","last_clean":"2024-05-07T13:56:35.358426+0000","last_became_active":"2024-05-07T13:55:58.339825+0000","last_became_peered":"2024-05-07T13:55:58.339825+0000","last_unstale":"2024-05-07T13:56:35.358426+0000","last_undegraded":"2024-05-07T13:56:35.358426+0000","last_fullsized":"2024-05-07T13:56:35.358426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.742507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361998+0000","last_change":"2024-05-07T13:55:50.319097+0000","last_active":"2024-05-07T13:56:35.361998+0000","last_peered":"2024-05-07T13:56:35.361998+0000","last_clean":"2024-05-07T13:56:35.361998+0000","last_became_active":"2024-05-07T13:55:50.318502+0000","last_became_peered":"2024-05-07T13:55:50.318502+0000","last_unstale":"2024-05-07T13:56:35.361998+0000","last_undegraded":"2024-05-07T13:56:35.361998+0000","last_fullsized":"2024-05-07T13:56:35.361998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:27.304492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360217+0000","last_change":"2024-05-07T13:55:48.345523+0000","last_active":"2024-05-07T13:56:35.360217+0000","last_peered":"2024-05-07T13:56:35.360217+0000","last_clean":"2024-05-07T13:56:35.360217+0000","last_became_active":"2024-05-07T13:55:48.345080+0000","last_became_peered":"2024-05-07T13:55:48.345080+0000","last_unstale":"2024-05-07T13:56:35.360217+0000","last_undegraded":"2024-05-07T13:56:35.360217+0000","last_fullsized":"2024-05-07T13:56:35.360217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:40:38.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360412+0000","last_change":"2024-05-07T13:55:52.318507+0000","last_active":"2024-05-07T13:56:35.360412+0000","last_peered":"2024-05-07T13:56:35.360412+0000","last_clean":"2024-05-07T13:56:35.360412+0000","last_became_active":"2024-05-07T13:55:52.318178+0000","last_became_peered":"2024-05-07T13:55:52.318178+0000","last_unstale":"2024-05-07T13:56:35.360412+0000","last_undegraded":"2024-05-07T13:56:35.360412+0000","last_fullsized":"2024-05-07T13:56:35.360412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:00.831525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.185340+0000","last_change":"2024-05-07T13:55:54.330944+0000","last_active":"2024-05-07T13:58:23.185340+0000","last_peered":"2024-05-07T13:58:23.185340+0000","last_clean":"2024-05-07T13:58:23.185340+0000","last_became_active":"2024-05-07T13:55:54.330662+0000","last_became_peered":"2024-05-07T13:55:54.330662+0000","last_unstale":"2024-05-07T13:58:23.185340+0000","last_undegraded":"2024-05-07T13:58:23.185340+0000","last_fullsized":"2024-05-07T13:58:23.185340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:12.578018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.506255+0000","last_change":"2024-05-07T13:55:56.334463+0000","last_active":"2024-05-07T13:58:59.506255+0000","last_peered":"2024-05-07T13:58:59.506255+0000","last_clean":"2024-05-07T13:58:59.506255+0000","last_became_active":"2024-05-07T13:55:56.334111+0000","last_became_peered":"2024-05-07T13:55:56.334111+0000","last_unstale":"2024-05-07T13:58:59.506255+0000","last_undegraded":"2024-05-07T13:58:59.506255+0000","last_fullsized":"2024-05-07T13:58:59.506255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:37:50.578504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'11","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477925+0000","last_change":"2024-05-07T13:55:50.325659+0000","last_active":"2024-05-07T13:58:59.477925+0000","last_peered":"2024-05-07T13:58:59.477925+0000","last_clean":"2024-05-07T13:58:59.477925+0000","last_became_active":"2024-05-07T13:55:50.324820+0000","last_became_peered":"2024-05-07T13:55:50.324820+0000","last_unstale":"2024-05-07T13:58:59.477925+0000","last_undegraded":"2024-05-07T13:58:59.477925+0000","last_fullsized":"2024-05-07T13:58:59.477925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:06.283557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369244+0000","last_change":"2024-05-07T13:55:48.335906+0000","last_active":"2024-05-07T13:56:35.369244+0000","last_peered":"2024-05-07T13:56:35.369244+0000","last_clean":"2024-05-07T13:56:35.369244+0000","last_became_active":"2024-05-07T13:55:48.335443+0000","last_became_peered":"2024-05-07T13:55:48.335443+0000","last_unstale":"2024-05-07T13:56:35.369244+0000","last_undegraded":"2024-05-07T13:56:35.369244+0000","last_fullsized":"2024-05-07T13:56:35.369244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361209+0000","last_change":"2024-05-07T13:55:52.322554+0000","last_active":"2024-05-07T13:56:35.361209+0000","last_peered":"2024-05-07T13:56:35.361209+0000","last_clean":"2024-05-07T13:56:35.361209+0000","last_became_active":"2024-05-07T13:55:52.322188+0000","last_became_peered":"2024-05-07T13:55:52.322188+0000","last_unstale":"2024-05-07T13:56:35.361209+0000","last_undegraded":"2024-05-07T13:56:35.361209+0000","last_fullsized":"2024-05-07T13:56:35.361209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:10.020335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.159540+0000","last_change":"2024-05-07T13:55:54.330742+0000","last_active":"2024-05-07T13:57:57.159540+0000","last_peered":"2024-05-07T13:57:57.159540+0000","last_clean":"2024-05-07T13:57:57.159540+0000","last_became_active":"2024-05-07T13:55:54.330401+0000","last_became_peered":"2024-05-07T13:55:54.330401+0000","last_unstale":"2024-05-07T13:57:57.159540+0000","last_undegraded":"2024-05-07T13:57:57.159540+0000","last_fullsized":"2024-05-07T13:57:57.159540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:16.443532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359580+0000","last_change":"2024-05-07T13:55:56.334861+0000","last_active":"2024-05-07T13:56:35.359580+0000","last_peered":"2024-05-07T13:56:35.359580+0000","last_clean":"2024-05-07T13:56:35.359580+0000","last_became_active":"2024-05-07T13:55:56.334368+0000","last_became_peered":"2024-05-07T13:55:56.334368+0000","last_unstale":"2024-05-07T13:56:35.359580+0000","last_undegraded":"2024-05-07T13:56:35.359580+0000","last_fullsized":"2024-05-07T13:56:35.359580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:57.692076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.746003+0000","last_change":"2024-05-07T13:55:58.346747+0000","last_active":"2024-05-07T13:57:14.746003+0000","last_peered":"2024-05-07T13:57:14.746003+0000","last_clean":"2024-05-07T13:57:14.746003+0000","last_became_active":"2024-05-07T13:55:58.346457+0000","last_became_peered":"2024-05-07T13:55:58.346457+0000","last_unstale":"2024-05-07T13:57:14.746003+0000","last_undegraded":"2024-05-07T13:57:14.746003+0000","last_fullsized":"2024-05-07T13:57:14.746003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:02:07.921627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723506+0000","last_change":"2024-05-07T13:55:50.312874+0000","last_active":"2024-05-07T13:57:58.723506+0000","last_peered":"2024-05-07T13:57:58.723506+0000","last_clean":"2024-05-07T13:57:58.723506+0000","last_became_active":"2024-05-07T13:55:50.312564+0000","last_became_peered":"2024-05-07T13:55:50.312564+0000","last_unstale":"2024-05-07T13:57:58.723506+0000","last_undegraded":"2024-05-07T13:57:58.723506+0000","last_fullsized":"2024-05-07T13:57:58.723506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369832+0000","last_change":"2024-05-07T13:55:48.336211+0000","last_active":"2024-05-07T13:56:35.369832+0000","last_peered":"2024-05-07T13:56:35.369832+0000","last_clean":"2024-05-07T13:56:35.369832+0000","last_became_active":"2024-05-07T13:55:48.335791+0000","last_became_peered":"2024-05-07T13:55:48.335791+0000","last_unstale":"2024-05-07T13:56:35.369832+0000","last_undegraded":"2024-05-07T13:56:35.369832+0000","last_fullsized":"2024-05-07T13:56:35.369832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358813+0000","last_change":"2024-05-07T13:55:52.326024+0000","last_active":"2024-05-07T13:56:35.358813+0000","last_peered":"2024-05-07T13:56:35.358813+0000","last_clean":"2024-05-07T13:56:35.358813+0000","last_became_active":"2024-05-07T13:55:52.325676+0000","last_became_peered":"2024-05-07T13:55:52.325676+0000","last_unstale":"2024-05-07T13:56:35.358813+0000","last_undegraded":"2024-05-07T13:56:35.358813+0000","last_fullsized":"2024-05-07T13:56:35.358813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:11.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'33","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.139118+0000","last_change":"2024-05-07T13:55:54.332289+0000","last_active":"2024-05-07T13:57:57.139118+0000","last_peered":"2024-05-07T13:57:57.139118+0000","last_clean":"2024-05-07T13:57:57.139118+0000","last_became_active":"2024-05-07T13:55:54.331979+0000","last_became_peered":"2024-05-07T13:55:54.331979+0000","last_unstale":"2024-05-07T13:57:57.139118+0000","last_undegraded":"2024-05-07T13:57:57.139118+0000","last_fullsized":"2024-05-07T13:57:57.139118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:00:56.934082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359423+0000","last_change":"2024-05-07T13:55:56.333704+0000","last_active":"2024-05-07T13:56:35.359423+0000","last_peered":"2024-05-07T13:56:35.359423+0000","last_clean":"2024-05-07T13:56:35.359423+0000","last_became_active":"2024-05-07T13:55:56.333357+0000","last_became_peered":"2024-05-07T13:55:56.333357+0000","last_unstale":"2024-05-07T13:56:35.359423+0000","last_undegraded":"2024-05-07T13:56:35.359423+0000","last_fullsized":"2024-05-07T13:56:35.359423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:08:52.926954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:09.129804+0000","last_change":"2024-05-07T13:55:58.345252+0000","last_active":"2024-05-07T13:57:09.129804+0000","last_peered":"2024-05-07T13:57:09.129804+0000","last_clean":"2024-05-07T13:57:09.129804+0000","last_became_active":"2024-05-07T13:55:58.344955+0000","last_became_peered":"2024-05-07T13:55:58.344955+0000","last_unstale":"2024-05-07T13:57:09.129804+0000","last_undegraded":"2024-05-07T13:57:09.129804+0000","last_fullsized":"2024-05-07T13:57:09.129804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:24.188610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.252302+0000","last_change":"2024-05-07T13:55:50.327717+0000","last_active":"2024-05-07T13:58:59.252302+0000","last_peered":"2024-05-07T13:58:59.252302+0000","last_clean":"2024-05-07T13:58:59.252302+0000","last_became_active":"2024-05-07T13:55:50.327059+0000","last_became_peered":"2024-05-07T13:55:50.327059+0000","last_unstale":"2024-05-07T13:58:59.252302+0000","last_undegraded":"2024-05-07T13:58:59.252302+0000","last_fullsized":"2024-05-07T13:58:59.252302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:49.671647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360718+0000","last_change":"2024-05-07T13:55:48.350939+0000","last_active":"2024-05-07T13:56:35.360718+0000","last_peered":"2024-05-07T13:56:35.360718+0000","last_clean":"2024-05-07T13:56:35.360718+0000","last_became_active":"2024-05-07T13:55:48.350442+0000","last_became_peered":"2024-05-07T13:55:48.350442+0000","last_unstale":"2024-05-07T13:56:35.360718+0000","last_undegraded":"2024-05-07T13:56:35.360718+0000","last_fullsized":"2024-05-07T13:56:35.360718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:13.461398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359027+0000","last_change":"2024-05-07T13:55:52.321998+0000","last_active":"2024-05-07T13:56:35.359027+0000","last_peered":"2024-05-07T13:56:35.359027+0000","last_clean":"2024-05-07T13:56:35.359027+0000","last_became_active":"2024-05-07T13:55:52.321674+0000","last_became_peered":"2024-05-07T13:55:52.321674+0000","last_unstale":"2024-05-07T13:56:35.359027+0000","last_undegraded":"2024-05-07T13:56:35.359027+0000","last_fullsized":"2024-05-07T13:56:35.359027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:09.668336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.161433+0000","last_change":"2024-05-07T13:55:54.325770+0000","last_active":"2024-05-07T13:57:57.161433+0000","last_peered":"2024-05-07T13:57:57.161433+0000","last_clean":"2024-05-07T13:57:57.161433+0000","last_became_active":"2024-05-07T13:55:54.325336+0000","last_became_peered":"2024-05-07T13:55:54.325336+0000","last_unstale":"2024-05-07T13:57:57.161433+0000","last_undegraded":"2024-05-07T13:57:57.161433+0000","last_fullsized":"2024-05-07T13:57:57.161433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:56:55.004347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.676575+0000","last_change":"2024-05-07T13:55:56.335209+0000","last_active":"2024-05-07T13:58:59.676575+0000","last_peered":"2024-05-07T13:58:59.676575+0000","last_clean":"2024-05-07T13:58:59.676575+0000","last_became_active":"2024-05-07T13:55:56.334895+0000","last_became_peered":"2024-05-07T13:55:56.334895+0000","last_unstale":"2024-05-07T13:58:59.676575+0000","last_undegraded":"2024-05-07T13:58:59.676575+0000","last_fullsized":"2024-05-07T13:58:59.676575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:42.722681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.928109+0000","last_change":"2024-05-07T13:55:58.341127+0000","last_active":"2024-05-07T13:57:14.928109+0000","last_peered":"2024-05-07T13:57:14.928109+0000","last_clean":"2024-05-07T13:57:14.928109+0000","last_became_active":"2024-05-07T13:55:58.340764+0000","last_became_peered":"2024-05-07T13:55:58.340764+0000","last_unstale":"2024-05-07T13:57:14.928109+0000","last_undegraded":"2024-05-07T13:57:14.928109+0000","last_fullsized":"2024-05-07T13:57:14.928109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:56:59.018427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.591694+0000","last_change":"2024-05-07T13:55:50.313309+0000","last_active":"2024-05-07T13:58:59.591694+0000","last_peered":"2024-05-07T13:58:59.591694+0000","last_clean":"2024-05-07T13:58:59.591694+0000","last_became_active":"2024-05-07T13:55:50.312649+0000","last_became_peered":"2024-05-07T13:55:50.312649+0000","last_unstale":"2024-05-07T13:58:59.591694+0000","last_undegraded":"2024-05-07T13:58:59.591694+0000","last_fullsized":"2024-05-07T13:58:59.591694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:05.135442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358043+0000","last_change":"2024-05-07T13:55:48.347430+0000","last_active":"2024-05-07T13:56:35.358043+0000","last_peered":"2024-05-07T13:56:35.358043+0000","last_clean":"2024-05-07T13:56:35.358043+0000","last_became_active":"2024-05-07T13:55:48.346027+0000","last_became_peered":"2024-05-07T13:55:48.346027+0000","last_unstale":"2024-05-07T13:56:35.358043+0000","last_undegraded":"2024-05-07T13:56:35.358043+0000","last_fullsized":"2024-05-07T13:56:35.358043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:17.757284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359224+0000","last_change":"2024-05-07T13:55:52.325971+0000","last_active":"2024-05-07T13:56:35.359224+0000","last_peered":"2024-05-07T13:56:35.359224+0000","last_clean":"2024-05-07T13:56:35.359224+0000","last_became_active":"2024-05-07T13:55:52.325427+0000","last_became_peered":"2024-05-07T13:55:52.325427+0000","last_unstale":"2024-05-07T13:56:35.359224+0000","last_undegraded":"2024-05-07T13:56:35.359224+0000","last_fullsized":"2024-05-07T13:56:35.359224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:46:31.400962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.163338+0000","last_change":"2024-05-07T13:55:54.334756+0000","last_active":"2024-05-07T13:57:57.163338+0000","last_peered":"2024-05-07T13:57:57.163338+0000","last_clean":"2024-05-07T13:57:57.163338+0000","last_became_active":"2024-05-07T13:55:54.334315+0000","last_became_peered":"2024-05-07T13:55:54.334315+0000","last_unstale":"2024-05-07T13:57:57.163338+0000","last_undegraded":"2024-05-07T13:57:57.163338+0000","last_fullsized":"2024-05-07T13:57:57.163338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:20.597897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358395+0000","last_change":"2024-05-07T13:55:56.330997+0000","last_active":"2024-05-07T13:56:35.358395+0000","last_peered":"2024-05-07T13:56:35.358395+0000","last_clean":"2024-05-07T13:56:35.358395+0000","last_became_active":"2024-05-07T13:55:56.330355+0000","last_became_peered":"2024-05-07T13:55:56.330355+0000","last_unstale":"2024-05-07T13:56:35.358395+0000","last_undegraded":"2024-05-07T13:56:35.358395+0000","last_fullsized":"2024-05-07T13:56:35.358395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:50.175136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.648614+0000","last_change":"2024-05-07T13:55:58.337164+0000","last_active":"2024-05-07T13:58:59.648614+0000","last_peered":"2024-05-07T13:58:59.648614+0000","last_clean":"2024-05-07T13:58:59.648614+0000","last_became_active":"2024-05-07T13:55:58.336692+0000","last_became_peered":"2024-05-07T13:55:58.336692+0000","last_unstale":"2024-05-07T13:58:59.648614+0000","last_undegraded":"2024-05-07T13:58:59.648614+0000","last_fullsized":"2024-05-07T13:58:59.648614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:54:59.700436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.143745+0000","last_change":"2024-05-07T13:55:50.323082+0000","last_active":"2024-05-07T13:58:59.143745+0000","last_peered":"2024-05-07T13:58:59.143745+0000","last_clean":"2024-05-07T13:58:59.143745+0000","last_became_active":"2024-05-07T13:55:50.322764+0000","last_became_peered":"2024-05-07T13:55:50.322764+0000","last_unstale":"2024-05-07T13:58:59.143745+0000","last_undegraded":"2024-05-07T13:58:59.143745+0000","last_fullsized":"2024-05-07T13:58:59.143745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.178785+0000","last_change":"2024-05-07T13:55:48.325995+0000","last_active":"2024-05-07T13:58:03.178785+0000","last_peered":"2024-05-07T13:58:03.178785+0000","last_clean":"2024-05-07T13:58:03.178785+0000","last_became_active":"2024-05-07T13:55:48.325075+0000","last_became_peered":"2024-05-07T13:55:48.325075+0000","last_unstale":"2024-05-07T13:58:03.178785+0000","last_undegraded":"2024-05-07T13:58:03.178785+0000","last_fullsized":"2024-05-07T13:58:03.178785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.368200+0000","last_change":"2024-05-07T13:55:52.322042+0000","last_active":"2024-05-07T13:56:35.368200+0000","last_peered":"2024-05-07T13:56:35.368200+0000","last_clean":"2024-05-07T13:56:35.368200+0000","last_became_active":"2024-05-07T13:55:52.321730+0000","last_became_peered":"2024-05-07T13:55:52.321730+0000","last_unstale":"2024-05-07T13:56:35.368200+0000","last_undegraded":"2024-05-07T13:56:35.368200+0000","last_fullsized":"2024-05-07T13:56:35.368200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:57:20.455708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181998+0000","last_change":"2024-05-07T13:55:54.327401+0000","last_active":"2024-05-07T13:58:13.181998+0000","last_peered":"2024-05-07T13:58:13.181998+0000","last_clean":"2024-05-07T13:58:13.181998+0000","last_became_active":"2024-05-07T13:55:54.324530+0000","last_became_peered":"2024-05-07T13:55:54.324530+0000","last_unstale":"2024-05-07T13:58:13.181998+0000","last_undegraded":"2024-05-07T13:58:13.181998+0000","last_fullsized":"2024-05-07T13:58:13.181998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:18.265571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361297+0000","last_change":"2024-05-07T13:55:56.344241+0000","last_active":"2024-05-07T13:56:35.361297+0000","last_peered":"2024-05-07T13:56:35.361297+0000","last_clean":"2024-05-07T13:56:35.361297+0000","last_became_active":"2024-05-07T13:55:56.343900+0000","last_became_peered":"2024-05-07T13:55:56.343900+0000","last_unstale":"2024-05-07T13:56:35.361297+0000","last_undegraded":"2024-05-07T13:56:35.361297+0000","last_fullsized":"2024-05-07T13:56:35.361297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:44.620800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.179998+0000","last_change":"2024-05-07T13:55:58.352050+0000","last_active":"2024-05-07T13:57:58.179998+0000","last_peered":"2024-05-07T13:57:58.179998+0000","last_clean":"2024-05-07T13:57:58.179998+0000","last_became_active":"2024-05-07T13:55:58.351724+0000","last_became_peered":"2024-05-07T13:55:58.351724+0000","last_unstale":"2024-05-07T13:57:58.179998+0000","last_undegraded":"2024-05-07T13:57:58.179998+0000","last_fullsized":"2024-05-07T13:57:58.179998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:24.287671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.724211+0000","last_change":"2024-05-07T13:55:50.330503+0000","last_active":"2024-05-07T13:57:58.724211+0000","last_peered":"2024-05-07T13:57:58.724211+0000","last_clean":"2024-05-07T13:57:58.724211+0000","last_became_active":"2024-05-07T13:55:50.326050+0000","last_became_peered":"2024-05-07T13:55:50.326050+0000","last_unstale":"2024-05-07T13:57:58.724211+0000","last_undegraded":"2024-05-07T13:57:58.724211+0000","last_fullsized":"2024-05-07T13:57:58.724211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:35.534512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358437+0000","last_change":"2024-05-07T13:55:48.352032+0000","last_active":"2024-05-07T13:56:35.358437+0000","last_peered":"2024-05-07T13:56:35.358437+0000","last_clean":"2024-05-07T13:56:35.358437+0000","last_became_active":"2024-05-07T13:55:48.350335+0000","last_became_peered":"2024-05-07T13:55:48.350335+0000","last_unstale":"2024-05-07T13:56:35.358437+0000","last_undegraded":"2024-05-07T13:56:35.358437+0000","last_fullsized":"2024-05-07T13:56:35.358437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:46.976702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.364086+0000","last_change":"2024-05-07T13:55:52.322369+0000","last_active":"2024-05-07T13:57:58.364086+0000","last_peered":"2024-05-07T13:57:58.364086+0000","last_clean":"2024-05-07T13:57:58.364086+0000","last_became_active":"2024-05-07T13:55:52.322006+0000","last_became_peered":"2024-05-07T13:55:52.322006+0000","last_unstale":"2024-05-07T13:57:58.364086+0000","last_undegraded":"2024-05-07T13:57:58.364086+0000","last_fullsized":"2024-05-07T13:57:58.364086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:14.436330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.170397+0000","last_change":"2024-05-07T13:55:54.320190+0000","last_active":"2024-05-07T13:57:57.170397+0000","last_peered":"2024-05-07T13:57:57.170397+0000","last_clean":"2024-05-07T13:57:57.170397+0000","last_became_active":"2024-05-07T13:55:54.319812+0000","last_became_peered":"2024-05-07T13:55:54.319812+0000","last_unstale":"2024-05-07T13:57:57.170397+0000","last_undegraded":"2024-05-07T13:57:57.170397+0000","last_fullsized":"2024-05-07T13:57:57.170397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:33.788094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.665948+0000","last_change":"2024-05-07T13:55:56.332248+0000","last_active":"2024-05-07T13:58:59.665948+0000","last_peered":"2024-05-07T13:58:59.665948+0000","last_clean":"2024-05-07T13:58:59.665948+0000","last_became_active":"2024-05-07T13:55:56.331966+0000","last_became_peered":"2024-05-07T13:55:56.331966+0000","last_unstale":"2024-05-07T13:58:59.665948+0000","last_undegraded":"2024-05-07T13:58:59.665948+0000","last_fullsized":"2024-05-07T13:58:59.665948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:41.555422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.507257+0000","last_change":"2024-05-07T13:55:58.340997+0000","last_active":"2024-05-07T13:58:59.507257+0000","last_peered":"2024-05-07T13:58:59.507257+0000","last_clean":"2024-05-07T13:58:59.507257+0000","last_became_active":"2024-05-07T13:55:58.340608+0000","last_became_peered":"2024-05-07T13:55:58.340608+0000","last_unstale":"2024-05-07T13:58:59.507257+0000","last_undegraded":"2024-05-07T13:58:59.507257+0000","last_fullsized":"2024-05-07T13:58:59.507257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:04.022939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.246015+0000","last_change":"2024-05-07T13:55:50.322925+0000","last_active":"2024-05-07T13:58:59.246015+0000","last_peered":"2024-05-07T13:58:59.246015+0000","last_clean":"2024-05-07T13:58:59.246015+0000","last_became_active":"2024-05-07T13:55:50.322650+0000","last_became_peered":"2024-05-07T13:55:50.322650+0000","last_unstale":"2024-05-07T13:58:59.246015+0000","last_undegraded":"2024-05-07T13:58:59.246015+0000","last_fullsized":"2024-05-07T13:58:59.246015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357841+0000","last_change":"2024-05-07T13:55:48.349364+0000","last_active":"2024-05-07T13:56:35.357841+0000","last_peered":"2024-05-07T13:56:35.357841+0000","last_clean":"2024-05-07T13:56:35.357841+0000","last_became_active":"2024-05-07T13:55:48.347434+0000","last_became_peered":"2024-05-07T13:55:48.347434+0000","last_unstale":"2024-05-07T13:56:35.357841+0000","last_undegraded":"2024-05-07T13:56:35.357841+0000","last_fullsized":"2024-05-07T13:56:35.357841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:21.121562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.363686+0000","last_change":"2024-05-07T13:55:52.321582+0000","last_active":"2024-05-07T13:57:58.363686+0000","last_peered":"2024-05-07T13:57:58.363686+0000","last_clean":"2024-05-07T13:57:58.363686+0000","last_became_active":"2024-05-07T13:55:52.321251+0000","last_became_peered":"2024-05-07T13:55:52.321251+0000","last_unstale":"2024-05-07T13:57:58.363686+0000","last_undegraded":"2024-05-07T13:57:58.363686+0000","last_fullsized":"2024-05-07T13:57:58.363686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:47.624596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359197+0000","last_change":"2024-05-07T13:55:54.332203+0000","last_active":"2024-05-07T13:56:35.359197+0000","last_peered":"2024-05-07T13:56:35.359197+0000","last_clean":"2024-05-07T13:56:35.359197+0000","last_became_active":"2024-05-07T13:55:54.331844+0000","last_became_peered":"2024-05-07T13:55:54.331844+0000","last_unstale":"2024-05-07T13:56:35.359197+0000","last_undegraded":"2024-05-07T13:56:35.359197+0000","last_fullsized":"2024-05-07T13:56:35.359197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:37:22.283720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.595950+0000","last_change":"2024-05-07T13:55:56.333205+0000","last_active":"2024-05-07T13:58:59.595950+0000","last_peered":"2024-05-07T13:58:59.595950+0000","last_clean":"2024-05-07T13:58:59.595950+0000","last_became_active":"2024-05-07T13:55:56.332858+0000","last_became_peered":"2024-05-07T13:55:56.332858+0000","last_unstale":"2024-05-07T13:58:59.595950+0000","last_undegraded":"2024-05-07T13:58:59.595950+0000","last_fullsized":"2024-05-07T13:58:59.595950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:19.698130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.507540+0000","last_change":"2024-05-07T13:55:58.335655+0000","last_active":"2024-05-07T13:57:58.507540+0000","last_peered":"2024-05-07T13:57:58.507540+0000","last_clean":"2024-05-07T13:57:58.507540+0000","last_became_active":"2024-05-07T13:55:58.335341+0000","last_became_peered":"2024-05-07T13:55:58.335341+0000","last_unstale":"2024-05-07T13:57:58.507540+0000","last_undegraded":"2024-05-07T13:57:58.507540+0000","last_fullsized":"2024-05-07T13:57:58.507540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:07.873806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477769+0000","last_change":"2024-05-07T13:55:50.331652+0000","last_active":"2024-05-07T13:58:59.477769+0000","last_peered":"2024-05-07T13:58:59.477769+0000","last_clean":"2024-05-07T13:58:59.477769+0000","last_became_active":"2024-05-07T13:55:50.331295+0000","last_became_peered":"2024-05-07T13:55:50.331295+0000","last_unstale":"2024-05-07T13:58:59.477769+0000","last_undegraded":"2024-05-07T13:58:59.477769+0000","last_fullsized":"2024-05-07T13:58:59.477769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:51:22.677704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357223+0000","last_change":"2024-05-07T13:55:48.352519+0000","last_active":"2024-05-07T13:56:35.357223+0000","last_peered":"2024-05-07T13:56:35.357223+0000","last_clean":"2024-05-07T13:56:35.357223+0000","last_became_active":"2024-05-07T13:55:48.351055+0000","last_became_peered":"2024-05-07T13:55:48.351055+0000","last_unstale":"2024-05-07T13:56:35.357223+0000","last_undegraded":"2024-05-07T13:56:35.357223+0000","last_fullsized":"2024-05-07T13:56:35.357223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:13:23.846967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"29'4","reported_seq":226,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.352994+0000","last_change":"2024-05-07T13:55:52.320405+0000","last_active":"2024-05-07T13:57:58.352994+0000","last_peered":"2024-05-07T13:57:58.352994+0000","last_clean":"2024-05-07T13:57:58.352994+0000","last_became_active":"2024-05-07T13:55:52.320027+0000","last_became_peered":"2024-05-07T13:55:52.320027+0000","last_unstale":"2024-05-07T13:57:58.352994+0000","last_undegraded":"2024-05-07T13:57:58.352994+0000","last_fullsized":"2024-05-07T13:57:58.352994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:36.196536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'39","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.156522+0000","last_change":"2024-05-07T13:55:54.334106+0000","last_active":"2024-05-07T13:57:57.156522+0000","last_peered":"2024-05-07T13:57:57.156522+0000","last_clean":"2024-05-07T13:57:57.156522+0000","last_became_active":"2024-05-07T13:55:54.333766+0000","last_became_peered":"2024-05-07T13:55:54.333766+0000","last_unstale":"2024-05-07T13:57:57.156522+0000","last_undegraded":"2024-05-07T13:57:57.156522+0000","last_fullsized":"2024-05-07T13:57:57.156522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:56.275417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366808+0000","last_change":"2024-05-07T13:55:56.338510+0000","last_active":"2024-05-07T13:56:35.366808+0000","last_peered":"2024-05-07T13:56:35.366808+0000","last_clean":"2024-05-07T13:56:35.366808+0000","last_became_active":"2024-05-07T13:55:56.338195+0000","last_became_peered":"2024-05-07T13:55:56.338195+0000","last_unstale":"2024-05-07T13:56:35.366808+0000","last_undegraded":"2024-05-07T13:56:35.366808+0000","last_fullsized":"2024-05-07T13:56:35.366808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:41.461582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.544535+0000","last_change":"2024-05-07T13:55:58.346374+0000","last_active":"2024-05-07T13:58:59.544535+0000","last_peered":"2024-05-07T13:58:59.544535+0000","last_clean":"2024-05-07T13:58:59.544535+0000","last_became_active":"2024-05-07T13:55:58.346040+0000","last_became_peered":"2024-05-07T13:55:58.346040+0000","last_unstale":"2024-05-07T13:58:59.544535+0000","last_undegraded":"2024-05-07T13:58:59.544535+0000","last_fullsized":"2024-05-07T13:58:59.544535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.039656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'16","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.143397+0000","last_change":"2024-05-07T13:56:35.374383+0000","last_active":"2024-05-07T13:58:59.143397+0000","last_peered":"2024-05-07T13:58:59.143397+0000","last_clean":"2024-05-07T13:58:59.143397+0000","last_became_active":"2024-05-07T13:56:35.369148+0000","last_became_peered":"2024-05-07T13:56:35.369148+0000","last_unstale":"2024-05-07T13:58:59.143397+0000","last_undegraded":"2024-05-07T13:58:59.143397+0000","last_fullsized":"2024-05-07T13:58:59.143397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:30.011499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359758+0000","last_change":"2024-05-07T13:55:40.043635+0000","last_active":"2024-05-07T13:56:35.359758+0000","last_peered":"2024-05-07T13:56:35.359758+0000","last_clean":"2024-05-07T13:56:35.359758+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:56:35.359758+0000","last_undegraded":"2024-05-07T13:56:35.359758+0000","last_fullsized":"2024-05-07T13:56:35.359758+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:01:05.355008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358964+0000","last_change":"2024-05-07T13:55:40.045474+0000","last_active":"2024-05-07T13:56:35.358964+0000","last_peered":"2024-05-07T13:56:35.358964+0000","last_clean":"2024-05-07T13:56:35.358964+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T13:56:35.358964+0000","last_undegraded":"2024-05-07T13:56:35.358964+0000","last_fullsized":"2024-05-07T13:56:35.358964+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:03.440717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.728528+0000","last_change":"2024-05-07T13:55:48.352406+0000","last_active":"2024-05-07T13:57:14.728528+0000","last_peered":"2024-05-07T13:57:14.728528+0000","last_clean":"2024-05-07T13:57:14.728528+0000","last_became_active":"2024-05-07T13:55:48.350998+0000","last_became_peered":"2024-05-07T13:55:48.350998+0000","last_unstale":"2024-05-07T13:57:14.728528+0000","last_undegraded":"2024-05-07T13:57:14.728528+0000","last_fullsized":"2024-05-07T13:57:14.728528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:52.052094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364056+0000","last_change":"2024-05-07T13:55:52.321728+0000","last_active":"2024-05-07T13:56:35.364056+0000","last_peered":"2024-05-07T13:56:35.364056+0000","last_clean":"2024-05-07T13:56:35.364056+0000","last_became_active":"2024-05-07T13:55:52.321406+0000","last_became_peered":"2024-05-07T13:55:52.321406+0000","last_unstale":"2024-05-07T13:56:35.364056+0000","last_undegraded":"2024-05-07T13:56:35.364056+0000","last_fullsized":"2024-05-07T13:56:35.364056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:35.607190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.167946+0000","last_change":"2024-05-07T13:55:54.329086+0000","last_active":"2024-05-07T13:57:57.167946+0000","last_peered":"2024-05-07T13:57:57.167946+0000","last_clean":"2024-05-07T13:57:57.167946+0000","last_became_active":"2024-05-07T13:55:54.328677+0000","last_became_peered":"2024-05-07T13:55:54.328677+0000","last_unstale":"2024-05-07T13:57:57.167946+0000","last_undegraded":"2024-05-07T13:57:57.167946+0000","last_fullsized":"2024-05-07T13:57:57.167946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:31:48.109295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359644+0000","last_change":"2024-05-07T13:55:56.335298+0000","last_active":"2024-05-07T13:56:35.359644+0000","last_peered":"2024-05-07T13:56:35.359644+0000","last_clean":"2024-05-07T13:56:35.359644+0000","last_became_active":"2024-05-07T13:55:56.335013+0000","last_became_peered":"2024-05-07T13:55:56.335013+0000","last_unstale":"2024-05-07T13:56:35.359644+0000","last_undegraded":"2024-05-07T13:56:35.359644+0000","last_fullsized":"2024-05-07T13:56:35.359644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:04.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'82","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.513260+0000","last_change":"2024-05-07T13:55:58.335516+0000","last_active":"2024-05-07T13:58:59.513260+0000","last_peered":"2024-05-07T13:58:59.513260+0000","last_clean":"2024-05-07T13:58:59.513260+0000","last_became_active":"2024-05-07T13:55:58.335220+0000","last_became_peered":"2024-05-07T13:55:58.335220+0000","last_unstale":"2024-05-07T13:58:59.513260+0000","last_undegraded":"2024-05-07T13:58:59.513260+0000","last_fullsized":"2024-05-07T13:58:59.513260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:01:58.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.476754+0000","last_change":"2024-05-07T13:55:50.324475+0000","last_active":"2024-05-07T13:58:59.476754+0000","last_peered":"2024-05-07T13:58:59.476754+0000","last_clean":"2024-05-07T13:58:59.476754+0000","last_became_active":"2024-05-07T13:55:50.323408+0000","last_became_peered":"2024-05-07T13:55:50.323408+0000","last_unstale":"2024-05-07T13:58:59.476754+0000","last_undegraded":"2024-05-07T13:58:59.476754+0000","last_fullsized":"2024-05-07T13:58:59.476754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:26:01.826472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356763+0000","last_change":"2024-05-07T13:55:40.043428+0000","last_active":"2024-05-07T13:56:35.356763+0000","last_peered":"2024-05-07T13:56:35.356763+0000","last_clean":"2024-05-07T13:56:35.356763+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T13:56:35.356763+0000","last_undegraded":"2024-05-07T13:56:35.356763+0000","last_fullsized":"2024-05-07T13:56:35.356763+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:34.894187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358426+0000","last_change":"2024-05-07T13:55:48.327071+0000","last_active":"2024-05-07T13:56:35.358426+0000","last_peered":"2024-05-07T13:56:35.358426+0000","last_clean":"2024-05-07T13:56:35.358426+0000","last_became_active":"2024-05-07T13:55:48.325905+0000","last_became_peered":"2024-05-07T13:55:48.325905+0000","last_unstale":"2024-05-07T13:56:35.358426+0000","last_undegraded":"2024-05-07T13:56:35.358426+0000","last_fullsized":"2024-05-07T13:56:35.358426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361487+0000","last_change":"2024-05-07T13:55:52.318581+0000","last_active":"2024-05-07T13:56:35.361487+0000","last_peered":"2024-05-07T13:56:35.361487+0000","last_clean":"2024-05-07T13:56:35.361487+0000","last_became_active":"2024-05-07T13:55:52.318221+0000","last_became_peered":"2024-05-07T13:55:52.318221+0000","last_unstale":"2024-05-07T13:56:35.361487+0000","last_undegraded":"2024-05-07T13:56:35.361487+0000","last_fullsized":"2024-05-07T13:56:35.361487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:37:46.564469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405111+0000","last_change":"2024-05-07T13:55:54.330092+0000","last_active":"2024-05-07T13:58:57.405111+0000","last_peered":"2024-05-07T13:58:57.405111+0000","last_clean":"2024-05-07T13:58:57.405111+0000","last_became_active":"2024-05-07T13:55:54.329774+0000","last_became_peered":"2024-05-07T13:55:54.329774+0000","last_unstale":"2024-05-07T13:58:57.405111+0000","last_undegraded":"2024-05-07T13:58:57.405111+0000","last_fullsized":"2024-05-07T13:58:57.405111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:39.454749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359063+0000","last_change":"2024-05-07T13:55:56.344460+0000","last_active":"2024-05-07T13:56:35.359063+0000","last_peered":"2024-05-07T13:56:35.359063+0000","last_clean":"2024-05-07T13:56:35.359063+0000","last_became_active":"2024-05-07T13:55:56.343224+0000","last_became_peered":"2024-05-07T13:55:56.343224+0000","last_unstale":"2024-05-07T13:56:35.359063+0000","last_undegraded":"2024-05-07T13:56:35.359063+0000","last_fullsized":"2024-05-07T13:56:35.359063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:31:00.903367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.721038+0000","last_change":"2024-05-07T13:55:58.345308+0000","last_active":"2024-05-07T13:57:58.721038+0000","last_peered":"2024-05-07T13:57:58.721038+0000","last_clean":"2024-05-07T13:57:58.721038+0000","last_became_active":"2024-05-07T13:55:58.344996+0000","last_became_peered":"2024-05-07T13:55:58.344996+0000","last_unstale":"2024-05-07T13:57:58.721038+0000","last_undegraded":"2024-05-07T13:57:58.721038+0000","last_fullsized":"2024-05-07T13:57:58.721038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:26.544607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502914+0000","last_change":"2024-05-07T13:55:50.318832+0000","last_active":"2024-05-07T13:58:59.502914+0000","last_peered":"2024-05-07T13:58:59.502914+0000","last_clean":"2024-05-07T13:58:59.502914+0000","last_became_active":"2024-05-07T13:55:50.318471+0000","last_became_peered":"2024-05-07T13:55:50.318471+0000","last_unstale":"2024-05-07T13:58:59.502914+0000","last_undegraded":"2024-05-07T13:58:59.502914+0000","last_fullsized":"2024-05-07T13:58:59.502914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:26.371060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362574+0000","last_change":"2024-05-07T13:55:40.043522+0000","last_active":"2024-05-07T13:56:35.362574+0000","last_peered":"2024-05-07T13:56:35.362574+0000","last_clean":"2024-05-07T13:56:35.362574+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:56:35.362574+0000","last_undegraded":"2024-05-07T13:56:35.362574+0000","last_fullsized":"2024-05-07T13:56:35.362574+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:01:05.355008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357954+0000","last_change":"2024-05-07T13:55:48.326648+0000","last_active":"2024-05-07T13:56:35.357954+0000","last_peered":"2024-05-07T13:56:35.357954+0000","last_clean":"2024-05-07T13:56:35.357954+0000","last_became_active":"2024-05-07T13:55:48.325013+0000","last_became_peered":"2024-05-07T13:55:48.325013+0000","last_unstale":"2024-05-07T13:56:35.357954+0000","last_undegraded":"2024-05-07T13:56:35.357954+0000","last_fullsized":"2024-05-07T13:56:35.357954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.377191+0000","last_change":"2024-05-07T13:56:35.376721+0000","last_active":"2024-05-07T13:56:35.377191+0000","last_peered":"2024-05-07T13:56:35.377191+0000","last_clean":"2024-05-07T13:56:35.377191+0000","last_became_active":"2024-05-07T13:56:35.368904+0000","last_became_peered":"2024-05-07T13:56:35.368904+0000","last_unstale":"2024-05-07T13:56:35.377191+0000","last_undegraded":"2024-05-07T13:56:35.377191+0000","last_fullsized":"2024-05-07T13:56:35.377191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:48:47.495613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405246+0000","last_change":"2024-05-07T13:55:54.330092+0000","last_active":"2024-05-07T13:58:57.405246+0000","last_peered":"2024-05-07T13:58:57.405246+0000","last_clean":"2024-05-07T13:58:57.405246+0000","last_became_active":"2024-05-07T13:55:54.329778+0000","last_became_peered":"2024-05-07T13:55:54.329778+0000","last_unstale":"2024-05-07T13:58:57.405246+0000","last_undegraded":"2024-05-07T13:58:57.405246+0000","last_fullsized":"2024-05-07T13:58:57.405246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:49.631798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360263+0000","last_change":"2024-05-07T13:55:56.336320+0000","last_active":"2024-05-07T13:56:35.360263+0000","last_peered":"2024-05-07T13:56:35.360263+0000","last_clean":"2024-05-07T13:56:35.360263+0000","last_became_active":"2024-05-07T13:55:56.336064+0000","last_became_peered":"2024-05-07T13:55:56.336064+0000","last_unstale":"2024-05-07T13:56:35.360263+0000","last_undegraded":"2024-05-07T13:56:35.360263+0000","last_fullsized":"2024-05-07T13:56:35.360263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:40.210571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.473318+0000","last_change":"2024-05-07T13:55:58.350552+0000","last_active":"2024-05-07T13:58:59.473318+0000","last_peered":"2024-05-07T13:58:59.473318+0000","last_clean":"2024-05-07T13:58:59.473318+0000","last_became_active":"2024-05-07T13:55:58.350208+0000","last_became_peered":"2024-05-07T13:55:58.350208+0000","last_unstale":"2024-05-07T13:58:59.473318+0000","last_undegraded":"2024-05-07T13:58:59.473318+0000","last_fullsized":"2024-05-07T13:58:59.473318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:40.675669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.931596+0000","last_change":"2024-05-07T13:55:50.313509+0000","last_active":"2024-05-07T13:57:14.931596+0000","last_peered":"2024-05-07T13:57:14.931596+0000","last_clean":"2024-05-07T13:57:14.931596+0000","last_became_active":"2024-05-07T13:55:50.313163+0000","last_became_peered":"2024-05-07T13:55:50.313163+0000","last_unstale":"2024-05-07T13:57:14.931596+0000","last_undegraded":"2024-05-07T13:57:14.931596+0000","last_fullsized":"2024-05-07T13:57:14.931596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:30.949901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356826+0000","last_change":"2024-05-07T13:55:40.044279+0000","last_active":"2024-05-07T13:56:35.356826+0000","last_peered":"2024-05-07T13:56:35.356826+0000","last_clean":"2024-05-07T13:56:35.356826+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T13:56:35.356826+0000","last_undegraded":"2024-05-07T13:56:35.356826+0000","last_fullsized":"2024-05-07T13:56:35.356826+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:05:53.554681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.365647+0000","last_change":"2024-05-07T13:55:48.338820+0000","last_active":"2024-05-07T13:56:35.365647+0000","last_peered":"2024-05-07T13:56:35.365647+0000","last_clean":"2024-05-07T13:56:35.365647+0000","last_became_active":"2024-05-07T13:55:48.338442+0000","last_became_peered":"2024-05-07T13:55:48.338442+0000","last_unstale":"2024-05-07T13:56:35.365647+0000","last_undegraded":"2024-05-07T13:56:35.365647+0000","last_fullsized":"2024-05-07T13:56:35.365647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:03:37.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360317+0000","last_change":"2024-05-07T13:55:52.321916+0000","last_active":"2024-05-07T13:56:35.360317+0000","last_peered":"2024-05-07T13:56:35.360317+0000","last_clean":"2024-05-07T13:56:35.360317+0000","last_became_active":"2024-05-07T13:55:52.321506+0000","last_became_peered":"2024-05-07T13:55:52.321506+0000","last_unstale":"2024-05-07T13:56:35.360317+0000","last_undegraded":"2024-05-07T13:56:35.360317+0000","last_fullsized":"2024-05-07T13:56:35.360317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:35.607190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'15","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.754593+0000","last_change":"2024-05-07T13:55:54.329113+0000","last_active":"2024-05-07T13:58:58.754593+0000","last_peered":"2024-05-07T13:58:58.754593+0000","last_clean":"2024-05-07T13:58:58.754593+0000","last_became_active":"2024-05-07T13:55:54.328763+0000","last_became_peered":"2024-05-07T13:55:54.328763+0000","last_unstale":"2024-05-07T13:58:58.754593+0000","last_undegraded":"2024-05-07T13:58:58.754593+0000","last_fullsized":"2024-05-07T13:58:58.754593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:29:04.977290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361744+0000","last_change":"2024-05-07T13:55:56.343480+0000","last_active":"2024-05-07T13:56:35.361744+0000","last_peered":"2024-05-07T13:56:35.361744+0000","last_clean":"2024-05-07T13:56:35.361744+0000","last_became_active":"2024-05-07T13:55:56.343131+0000","last_became_peered":"2024-05-07T13:55:56.343131+0000","last_unstale":"2024-05-07T13:56:35.361744+0000","last_undegraded":"2024-05-07T13:56:35.361744+0000","last_fullsized":"2024-05-07T13:56:35.361744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:50.212923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.487763+0000","last_change":"2024-05-07T13:55:58.348390+0000","last_active":"2024-05-07T13:57:58.487763+0000","last_peered":"2024-05-07T13:57:58.487763+0000","last_clean":"2024-05-07T13:57:58.487763+0000","last_became_active":"2024-05-07T13:55:58.348068+0000","last_became_peered":"2024-05-07T13:55:58.348068+0000","last_unstale":"2024-05-07T13:57:58.487763+0000","last_undegraded":"2024-05-07T13:57:58.487763+0000","last_fullsized":"2024-05-07T13:57:58.487763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:21.047817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'14","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408795+0000","last_change":"2024-05-07T13:55:50.324091+0000","last_active":"2024-05-07T13:58:59.408795+0000","last_peered":"2024-05-07T13:58:59.408795+0000","last_clean":"2024-05-07T13:58:59.408795+0000","last_became_active":"2024-05-07T13:55:50.323820+0000","last_became_peered":"2024-05-07T13:55:50.323820+0000","last_unstale":"2024-05-07T13:58:59.408795+0000","last_undegraded":"2024-05-07T13:58:59.408795+0000","last_fullsized":"2024-05-07T13:58:59.408795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367577+0000","last_change":"2024-05-07T13:55:48.338590+0000","last_active":"2024-05-07T13:56:35.367577+0000","last_peered":"2024-05-07T13:56:35.367577+0000","last_clean":"2024-05-07T13:56:35.367577+0000","last_became_active":"2024-05-07T13:55:48.338139+0000","last_became_peered":"2024-05-07T13:55:48.338139+0000","last_unstale":"2024-05-07T13:56:35.367577+0000","last_undegraded":"2024-05-07T13:56:35.367577+0000","last_fullsized":"2024-05-07T13:56:35.367577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:02.747875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359773+0000","last_change":"2024-05-07T13:55:40.043241+0000","last_active":"2024-05-07T13:56:35.359773+0000","last_peered":"2024-05-07T13:56:35.359773+0000","last_clean":"2024-05-07T13:56:35.359773+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:56:35.359773+0000","last_undegraded":"2024-05-07T13:56:35.359773+0000","last_fullsized":"2024-05-07T13:56:35.359773+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:09.446119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178121+0000","last_change":"2024-05-07T13:55:52.321594+0000","last_active":"2024-05-07T13:57:58.178121+0000","last_peered":"2024-05-07T13:57:58.178121+0000","last_clean":"2024-05-07T13:57:58.178121+0000","last_became_active":"2024-05-07T13:55:52.321249+0000","last_became_peered":"2024-05-07T13:55:52.321249+0000","last_unstale":"2024-05-07T13:57:58.178121+0000","last_undegraded":"2024-05-07T13:57:58.178121+0000","last_fullsized":"2024-05-07T13:57:58.178121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:09.429892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'62","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.416916+0000","last_change":"2024-05-07T13:55:54.327059+0000","last_active":"2024-05-07T13:58:59.416916+0000","last_peered":"2024-05-07T13:58:59.416916+0000","last_clean":"2024-05-07T13:58:59.416916+0000","last_became_active":"2024-05-07T13:55:54.326812+0000","last_became_peered":"2024-05-07T13:55:54.326812+0000","last_unstale":"2024-05-07T13:58:59.416916+0000","last_undegraded":"2024-05-07T13:58:59.416916+0000","last_fullsized":"2024-05-07T13:58:59.416916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:43.853324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358924+0000","last_change":"2024-05-07T13:55:56.331774+0000","last_active":"2024-05-07T13:56:35.358924+0000","last_peered":"2024-05-07T13:56:35.358924+0000","last_clean":"2024-05-07T13:56:35.358924+0000","last_became_active":"2024-05-07T13:55:56.331343+0000","last_became_peered":"2024-05-07T13:55:56.331343+0000","last_unstale":"2024-05-07T13:56:35.358924+0000","last_undegraded":"2024-05-07T13:56:35.358924+0000","last_fullsized":"2024-05-07T13:56:35.358924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:45.860157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'11","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.663624+0000","last_change":"2024-05-07T13:55:58.347841+0000","last_active":"2024-05-07T13:57:58.663624+0000","last_peered":"2024-05-07T13:57:58.663624+0000","last_clean":"2024-05-07T13:57:58.663624+0000","last_became_active":"2024-05-07T13:55:58.347566+0000","last_became_peered":"2024-05-07T13:55:58.347566+0000","last_unstale":"2024-05-07T13:57:58.663624+0000","last_undegraded":"2024-05-07T13:57:58.663624+0000","last_fullsized":"2024-05-07T13:57:58.663624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:13:51.441059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'8","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471883+0000","last_change":"2024-05-07T13:55:50.330859+0000","last_active":"2024-05-07T13:58:59.471883+0000","last_peered":"2024-05-07T13:58:59.471883+0000","last_clean":"2024-05-07T13:58:59.471883+0000","last_became_active":"2024-05-07T13:55:50.330547+0000","last_became_peered":"2024-05-07T13:55:50.330547+0000","last_unstale":"2024-05-07T13:58:59.471883+0000","last_undegraded":"2024-05-07T13:58:59.471883+0000","last_fullsized":"2024-05-07T13:58:59.471883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:30.949901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360448+0000","last_change":"2024-05-07T13:55:48.325207+0000","last_active":"2024-05-07T13:56:35.360448+0000","last_peered":"2024-05-07T13:56:35.360448+0000","last_clean":"2024-05-07T13:56:35.360448+0000","last_became_active":"2024-05-07T13:55:48.324378+0000","last_became_peered":"2024-05-07T13:55:48.324378+0000","last_unstale":"2024-05-07T13:56:35.360448+0000","last_undegraded":"2024-05-07T13:56:35.360448+0000","last_fullsized":"2024-05-07T13:56:35.360448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:02:32.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360246+0000","last_change":"2024-05-07T13:55:40.044124+0000","last_active":"2024-05-07T13:56:35.360246+0000","last_peered":"2024-05-07T13:56:35.360246+0000","last_clean":"2024-05-07T13:56:35.360246+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T13:56:35.360246+0000","last_undegraded":"2024-05-07T13:56:35.360246+0000","last_fullsized":"2024-05-07T13:56:35.360246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:38.642853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.171773+0000","last_change":"2024-05-07T13:56:35.366451+0000","last_active":"2024-05-07T13:56:38.171773+0000","last_peered":"2024-05-07T13:56:38.171773+0000","last_clean":"2024-05-07T13:56:38.171773+0000","last_became_active":"2024-05-07T13:56:35.366075+0000","last_became_peered":"2024-05-07T13:56:35.366075+0000","last_unstale":"2024-05-07T13:56:38.171773+0000","last_undegraded":"2024-05-07T13:56:38.171773+0000","last_fullsized":"2024-05-07T13:56:38.171773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:15.026535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"27'14","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361524+0000","last_change":"2024-05-07T13:55:54.331195+0000","last_active":"2024-05-07T13:56:35.361524+0000","last_peered":"2024-05-07T13:56:35.361524+0000","last_clean":"2024-05-07T13:56:35.361524+0000","last_became_active":"2024-05-07T13:55:54.330896+0000","last_became_peered":"2024-05-07T13:55:54.330896+0000","last_unstale":"2024-05-07T13:56:35.361524+0000","last_undegraded":"2024-05-07T13:56:35.361524+0000","last_fullsized":"2024-05-07T13:56:35.361524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:44.541313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.507824+0000","last_change":"2024-05-07T13:55:56.335191+0000","last_active":"2024-05-07T13:58:59.507824+0000","last_peered":"2024-05-07T13:58:59.507824+0000","last_clean":"2024-05-07T13:58:59.507824+0000","last_became_active":"2024-05-07T13:55:56.333242+0000","last_became_peered":"2024-05-07T13:55:56.333242+0000","last_unstale":"2024-05-07T13:58:59.507824+0000","last_undegraded":"2024-05-07T13:58:59.507824+0000","last_fullsized":"2024-05-07T13:58:59.507824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:38.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.438838+0000","last_change":"2024-05-07T13:55:58.346596+0000","last_active":"2024-05-07T13:57:55.438838+0000","last_peered":"2024-05-07T13:57:55.438838+0000","last_clean":"2024-05-07T13:57:55.438838+0000","last_became_active":"2024-05-07T13:55:58.346295+0000","last_became_peered":"2024-05-07T13:55:58.346295+0000","last_unstale":"2024-05-07T13:57:55.438838+0000","last_undegraded":"2024-05-07T13:57:55.438838+0000","last_fullsized":"2024-05-07T13:57:55.438838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:45.742064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.433453+0000","last_change":"2024-05-07T13:55:50.326085+0000","last_active":"2024-05-07T13:57:55.433453+0000","last_peered":"2024-05-07T13:57:55.433453+0000","last_clean":"2024-05-07T13:57:55.433453+0000","last_became_active":"2024-05-07T13:55:50.325665+0000","last_became_peered":"2024-05-07T13:55:50.325665+0000","last_unstale":"2024-05-07T13:57:55.433453+0000","last_undegraded":"2024-05-07T13:57:55.433453+0000","last_fullsized":"2024-05-07T13:57:55.433453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:03.486728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.396425+0000","last_change":"2024-05-07T13:55:48.347535+0000","last_active":"2024-05-07T13:58:59.396425+0000","last_peered":"2024-05-07T13:58:59.396425+0000","last_clean":"2024-05-07T13:58:59.396425+0000","last_became_active":"2024-05-07T13:55:48.346645+0000","last_became_peered":"2024-05-07T13:55:48.346645+0000","last_unstale":"2024-05-07T13:58:59.396425+0000","last_undegraded":"2024-05-07T13:58:59.396425+0000","last_fullsized":"2024-05-07T13:58:59.396425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:01.162350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359789+0000","last_change":"2024-05-07T13:55:40.045556+0000","last_active":"2024-05-07T13:56:35.359789+0000","last_peered":"2024-05-07T13:56:35.359789+0000","last_clean":"2024-05-07T13:56:35.359789+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:56:35.359789+0000","last_undegraded":"2024-05-07T13:56:35.359789+0000","last_fullsized":"2024-05-07T13:56:35.359789+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:10.678478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356709+0000","last_change":"2024-05-07T13:55:52.321677+0000","last_active":"2024-05-07T13:56:35.356709+0000","last_peered":"2024-05-07T13:56:35.356709+0000","last_clean":"2024-05-07T13:56:35.356709+0000","last_became_active":"2024-05-07T13:55:52.321160+0000","last_became_peered":"2024-05-07T13:55:52.321160+0000","last_unstale":"2024-05-07T13:56:35.356709+0000","last_undegraded":"2024-05-07T13:56:35.356709+0000","last_fullsized":"2024-05-07T13:56:35.356709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:38.708646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.725372+0000","last_change":"2024-05-07T13:55:54.330229+0000","last_active":"2024-05-07T13:57:58.725372+0000","last_peered":"2024-05-07T13:57:58.725372+0000","last_clean":"2024-05-07T13:57:58.725372+0000","last_became_active":"2024-05-07T13:55:54.329885+0000","last_became_peered":"2024-05-07T13:55:54.329885+0000","last_unstale":"2024-05-07T13:57:58.725372+0000","last_undegraded":"2024-05-07T13:57:58.725372+0000","last_fullsized":"2024-05-07T13:57:58.725372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:21.319585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.649285+0000","last_change":"2024-05-07T13:55:56.334411+0000","last_active":"2024-05-07T13:58:59.649285+0000","last_peered":"2024-05-07T13:58:59.649285+0000","last_clean":"2024-05-07T13:58:59.649285+0000","last_became_active":"2024-05-07T13:55:56.334023+0000","last_became_peered":"2024-05-07T13:55:56.334023+0000","last_unstale":"2024-05-07T13:58:59.649285+0000","last_undegraded":"2024-05-07T13:58:59.649285+0000","last_fullsized":"2024-05-07T13:58:59.649285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:38.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363496+0000","last_change":"2024-05-07T13:55:58.347319+0000","last_active":"2024-05-07T13:56:35.363496+0000","last_peered":"2024-05-07T13:56:35.363496+0000","last_clean":"2024-05-07T13:56:35.363496+0000","last_became_active":"2024-05-07T13:55:58.346984+0000","last_became_peered":"2024-05-07T13:55:58.346984+0000","last_unstale":"2024-05-07T13:56:35.363496+0000","last_undegraded":"2024-05-07T13:56:35.363496+0000","last_fullsized":"2024-05-07T13:56:35.363496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:09:17.780125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363167+0000","last_change":"2024-05-07T13:55:50.327606+0000","last_active":"2024-05-07T13:56:35.363167+0000","last_peered":"2024-05-07T13:56:35.363167+0000","last_clean":"2024-05-07T13:56:35.363167+0000","last_became_active":"2024-05-07T13:55:50.327283+0000","last_became_peered":"2024-05-07T13:55:50.327283+0000","last_unstale":"2024-05-07T13:56:35.363167+0000","last_undegraded":"2024-05-07T13:56:35.363167+0000","last_fullsized":"2024-05-07T13:56:35.363167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:54.059732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364948+0000","last_change":"2024-05-07T13:55:48.337939+0000","last_active":"2024-05-07T13:56:35.364948+0000","last_peered":"2024-05-07T13:56:35.364948+0000","last_clean":"2024-05-07T13:56:35.364948+0000","last_became_active":"2024-05-07T13:55:48.337553+0000","last_became_peered":"2024-05-07T13:55:48.337553+0000","last_unstale":"2024-05-07T13:56:35.364948+0000","last_undegraded":"2024-05-07T13:56:35.364948+0000","last_fullsized":"2024-05-07T13:56:35.364948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363756+0000","last_change":"2024-05-07T13:55:40.043788+0000","last_active":"2024-05-07T13:56:35.363756+0000","last_peered":"2024-05-07T13:56:35.363756+0000","last_clean":"2024-05-07T13:56:35.363756+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T13:56:35.363756+0000","last_undegraded":"2024-05-07T13:56:35.363756+0000","last_fullsized":"2024-05-07T13:56:35.363756+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:00.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356449+0000","last_change":"2024-05-07T13:55:52.315544+0000","last_active":"2024-05-07T13:56:35.356449+0000","last_peered":"2024-05-07T13:56:35.356449+0000","last_clean":"2024-05-07T13:56:35.356449+0000","last_became_active":"2024-05-07T13:55:52.314793+0000","last_became_peered":"2024-05-07T13:55:52.314793+0000","last_unstale":"2024-05-07T13:56:35.356449+0000","last_undegraded":"2024-05-07T13:56:35.356449+0000","last_fullsized":"2024-05-07T13:56:35.356449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:46.161101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.154539+0000","last_change":"2024-05-07T13:55:54.330188+0000","last_active":"2024-05-07T13:57:57.154539+0000","last_peered":"2024-05-07T13:57:57.154539+0000","last_clean":"2024-05-07T13:57:57.154539+0000","last_became_active":"2024-05-07T13:55:54.329879+0000","last_became_peered":"2024-05-07T13:55:54.329879+0000","last_unstale":"2024-05-07T13:57:57.154539+0000","last_undegraded":"2024-05-07T13:57:57.154539+0000","last_fullsized":"2024-05-07T13:57:57.154539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:37.614392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358335+0000","last_change":"2024-05-07T13:55:56.333232+0000","last_active":"2024-05-07T13:56:35.358335+0000","last_peered":"2024-05-07T13:56:35.358335+0000","last_clean":"2024-05-07T13:56:35.358335+0000","last_became_active":"2024-05-07T13:55:56.332931+0000","last_became_peered":"2024-05-07T13:55:56.332931+0000","last_unstale":"2024-05-07T13:56:35.358335+0000","last_undegraded":"2024-05-07T13:56:35.358335+0000","last_fullsized":"2024-05-07T13:56:35.358335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:05.866559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370012+0000","last_change":"2024-05-07T13:55:58.341180+0000","last_active":"2024-05-07T13:56:35.370012+0000","last_peered":"2024-05-07T13:56:35.370012+0000","last_clean":"2024-05-07T13:56:35.370012+0000","last_became_active":"2024-05-07T13:55:58.340759+0000","last_became_peered":"2024-05-07T13:55:58.340759+0000","last_unstale":"2024-05-07T13:56:35.370012+0000","last_undegraded":"2024-05-07T13:56:35.370012+0000","last_fullsized":"2024-05-07T13:56:35.370012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:48.403945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369103+0000","last_change":"2024-05-07T13:55:58.348875+0000","last_active":"2024-05-07T13:56:35.369103+0000","last_peered":"2024-05-07T13:56:35.369103+0000","last_clean":"2024-05-07T13:56:35.369103+0000","last_became_active":"2024-05-07T13:55:58.348566+0000","last_became_peered":"2024-05-07T13:55:58.348566+0000","last_unstale":"2024-05-07T13:56:35.369103+0000","last_undegraded":"2024-05-07T13:56:35.369103+0000","last_fullsized":"2024-05-07T13:56:35.369103+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:21.705378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723807+0000","last_change":"2024-05-07T13:55:50.329912+0000","last_active":"2024-05-07T13:57:58.723807+0000","last_peered":"2024-05-07T13:57:58.723807+0000","last_clean":"2024-05-07T13:57:58.723807+0000","last_became_active":"2024-05-07T13:55:50.329615+0000","last_became_peered":"2024-05-07T13:55:50.329615+0000","last_unstale":"2024-05-07T13:57:58.723807+0000","last_undegraded":"2024-05-07T13:57:58.723807+0000","last_fullsized":"2024-05-07T13:57:58.723807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358159+0000","last_change":"2024-05-07T13:55:48.348585+0000","last_active":"2024-05-07T13:56:35.358159+0000","last_peered":"2024-05-07T13:56:35.358159+0000","last_clean":"2024-05-07T13:56:35.358159+0000","last_became_active":"2024-05-07T13:55:48.346558+0000","last_became_peered":"2024-05-07T13:55:48.346558+0000","last_unstale":"2024-05-07T13:56:35.358159+0000","last_undegraded":"2024-05-07T13:56:35.358159+0000","last_fullsized":"2024-05-07T13:56:35.358159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:46.733619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362239+0000","last_change":"2024-05-07T13:55:52.324475+0000","last_active":"2024-05-07T13:56:35.362239+0000","last_peered":"2024-05-07T13:56:35.362239+0000","last_clean":"2024-05-07T13:56:35.362239+0000","last_became_active":"2024-05-07T13:55:52.324083+0000","last_became_peered":"2024-05-07T13:55:52.324083+0000","last_unstale":"2024-05-07T13:56:35.362239+0000","last_undegraded":"2024-05-07T13:56:35.362239+0000","last_fullsized":"2024-05-07T13:56:35.362239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:22.175165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.160493+0000","last_change":"2024-05-07T13:55:54.331198+0000","last_active":"2024-05-07T13:57:57.160493+0000","last_peered":"2024-05-07T13:57:57.160493+0000","last_clean":"2024-05-07T13:57:57.160493+0000","last_became_active":"2024-05-07T13:55:54.330906+0000","last_became_peered":"2024-05-07T13:55:54.330906+0000","last_unstale":"2024-05-07T13:57:57.160493+0000","last_undegraded":"2024-05-07T13:57:57.160493+0000","last_fullsized":"2024-05-07T13:57:57.160493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:54:55.686356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358029+0000","last_change":"2024-05-07T13:55:56.348303+0000","last_active":"2024-05-07T13:56:35.358029+0000","last_peered":"2024-05-07T13:56:35.358029+0000","last_clean":"2024-05-07T13:56:35.358029+0000","last_became_active":"2024-05-07T13:55:56.346371+0000","last_became_peered":"2024-05-07T13:55:56.346371+0000","last_unstale":"2024-05-07T13:56:35.358029+0000","last_undegraded":"2024-05-07T13:56:35.358029+0000","last_fullsized":"2024-05-07T13:56:35.358029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:32:39.746591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:56.842330+0000","last_change":"2024-05-07T13:55:58.341454+0000","last_active":"2024-05-07T13:57:56.842330+0000","last_peered":"2024-05-07T13:57:56.842330+0000","last_clean":"2024-05-07T13:57:56.842330+0000","last_became_active":"2024-05-07T13:55:58.341102+0000","last_became_peered":"2024-05-07T13:55:58.341102+0000","last_unstale":"2024-05-07T13:57:56.842330+0000","last_undegraded":"2024-05-07T13:57:56.842330+0000","last_fullsized":"2024-05-07T13:57:56.842330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:24.611977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.931037+0000","last_change":"2024-05-07T13:55:50.330176+0000","last_active":"2024-05-07T13:57:14.931037+0000","last_peered":"2024-05-07T13:57:14.931037+0000","last_clean":"2024-05-07T13:57:14.931037+0000","last_became_active":"2024-05-07T13:55:50.329869+0000","last_became_peered":"2024-05-07T13:55:50.329869+0000","last_unstale":"2024-05-07T13:57:14.931037+0000","last_undegraded":"2024-05-07T13:57:14.931037+0000","last_fullsized":"2024-05-07T13:57:14.931037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:56.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.399682+0000","last_change":"2024-05-07T13:55:48.338314+0000","last_active":"2024-05-07T13:58:59.399682+0000","last_peered":"2024-05-07T13:58:59.399682+0000","last_clean":"2024-05-07T13:58:59.399682+0000","last_became_active":"2024-05-07T13:55:48.336807+0000","last_became_peered":"2024-05-07T13:55:48.336807+0000","last_unstale":"2024-05-07T13:58:59.399682+0000","last_undegraded":"2024-05-07T13:58:59.399682+0000","last_fullsized":"2024-05-07T13:58:59.399682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:40:38.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358047+0000","last_change":"2024-05-07T13:55:52.319258+0000","last_active":"2024-05-07T13:56:35.358047+0000","last_peered":"2024-05-07T13:56:35.358047+0000","last_clean":"2024-05-07T13:56:35.358047+0000","last_became_active":"2024-05-07T13:55:52.318534+0000","last_became_peered":"2024-05-07T13:55:52.318534+0000","last_unstale":"2024-05-07T13:56:35.358047+0000","last_undegraded":"2024-05-07T13:56:35.358047+0000","last_fullsized":"2024-05-07T13:56:35.358047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:59:17.441061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.742005+0000","last_change":"2024-05-07T13:55:54.319908+0000","last_active":"2024-05-07T13:58:58.742005+0000","last_peered":"2024-05-07T13:58:58.742005+0000","last_clean":"2024-05-07T13:58:58.742005+0000","last_became_active":"2024-05-07T13:55:54.319714+0000","last_became_peered":"2024-05-07T13:55:54.319714+0000","last_unstale":"2024-05-07T13:58:58.742005+0000","last_undegraded":"2024-05-07T13:58:58.742005+0000","last_fullsized":"2024-05-07T13:58:58.742005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:06:57.744609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359119+0000","last_change":"2024-05-07T13:55:56.334660+0000","last_active":"2024-05-07T13:56:35.359119+0000","last_peered":"2024-05-07T13:56:35.359119+0000","last_clean":"2024-05-07T13:56:35.359119+0000","last_became_active":"2024-05-07T13:55:56.334342+0000","last_became_peered":"2024-05-07T13:55:56.334342+0000","last_unstale":"2024-05-07T13:56:35.359119+0000","last_undegraded":"2024-05-07T13:56:35.359119+0000","last_fullsized":"2024-05-07T13:56:35.359119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:12.304466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.158018+0000","last_change":"2024-05-07T13:55:58.342684+0000","last_active":"2024-05-07T13:58:59.158018+0000","last_peered":"2024-05-07T13:58:59.158018+0000","last_clean":"2024-05-07T13:58:59.158018+0000","last_became_active":"2024-05-07T13:55:58.342382+0000","last_became_peered":"2024-05-07T13:55:58.342382+0000","last_unstale":"2024-05-07T13:58:59.158018+0000","last_undegraded":"2024-05-07T13:58:59.158018+0000","last_fullsized":"2024-05-07T13:58:59.158018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:58:54.112594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415635+0000","last_change":"2024-05-07T13:56:35.366216+0000","last_active":"2024-05-07T13:58:59.415635+0000","last_peered":"2024-05-07T13:58:59.415635+0000","last_clean":"2024-05-07T13:58:59.415635+0000","last_became_active":"2024-05-07T13:56:35.365890+0000","last_became_peered":"2024-05-07T13:56:35.365890+0000","last_unstale":"2024-05-07T13:58:59.415635+0000","last_undegraded":"2024-05-07T13:58:59.415635+0000","last_fullsized":"2024-05-07T13:58:59.415635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:31:44.095217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.567474+0000","last_change":"2024-05-07T13:55:48.337211+0000","last_active":"2024-05-07T13:57:58.567474+0000","last_peered":"2024-05-07T13:57:58.567474+0000","last_clean":"2024-05-07T13:57:58.567474+0000","last_became_active":"2024-05-07T13:55:48.336730+0000","last_became_peered":"2024-05-07T13:55:48.336730+0000","last_unstale":"2024-05-07T13:57:58.567474+0000","last_undegraded":"2024-05-07T13:57:58.567474+0000","last_fullsized":"2024-05-07T13:57:58.567474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362051+0000","last_change":"2024-05-07T13:55:52.325126+0000","last_active":"2024-05-07T13:56:35.362051+0000","last_peered":"2024-05-07T13:56:35.362051+0000","last_clean":"2024-05-07T13:56:35.362051+0000","last_became_active":"2024-05-07T13:55:52.324639+0000","last_became_peered":"2024-05-07T13:55:52.324639+0000","last_unstale":"2024-05-07T13:56:35.362051+0000","last_undegraded":"2024-05-07T13:56:35.362051+0000","last_fullsized":"2024-05-07T13:56:35.362051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:43:51.986602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'41","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.420602+0000","last_change":"2024-05-07T13:55:54.331164+0000","last_active":"2024-05-07T13:58:59.420602+0000","last_peered":"2024-05-07T13:58:59.420602+0000","last_clean":"2024-05-07T13:58:59.420602+0000","last_became_active":"2024-05-07T13:55:54.330738+0000","last_became_peered":"2024-05-07T13:55:54.330738+0000","last_unstale":"2024-05-07T13:58:59.420602+0000","last_undegraded":"2024-05-07T13:58:59.420602+0000","last_fullsized":"2024-05-07T13:58:59.420602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:10.297634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":65,"num_write":48,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361731+0000","last_change":"2024-05-07T13:55:56.333196+0000","last_active":"2024-05-07T13:56:35.361731+0000","last_peered":"2024-05-07T13:56:35.361731+0000","last_clean":"2024-05-07T13:56:35.361731+0000","last_became_active":"2024-05-07T13:55:56.332844+0000","last_became_peered":"2024-05-07T13:55:56.332844+0000","last_unstale":"2024-05-07T13:56:35.361731+0000","last_undegraded":"2024-05-07T13:56:35.361731+0000","last_fullsized":"2024-05-07T13:56:35.361731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:02:05.914379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357546+0000","last_change":"2024-05-07T13:55:58.348258+0000","last_active":"2024-05-07T13:56:35.357546+0000","last_peered":"2024-05-07T13:56:35.357546+0000","last_clean":"2024-05-07T13:56:35.357546+0000","last_became_active":"2024-05-07T13:55:58.347598+0000","last_became_peered":"2024-05-07T13:55:58.347598+0000","last_unstale":"2024-05-07T13:56:35.357546+0000","last_undegraded":"2024-05-07T13:56:35.357546+0000","last_fullsized":"2024-05-07T13:56:35.357546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:42:16.894503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'14","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723917+0000","last_change":"2024-05-07T13:55:50.326698+0000","last_active":"2024-05-07T13:57:58.723917+0000","last_peered":"2024-05-07T13:57:58.723917+0000","last_clean":"2024-05-07T13:57:58.723917+0000","last_became_active":"2024-05-07T13:55:50.326430+0000","last_became_peered":"2024-05-07T13:55:50.326430+0000","last_unstale":"2024-05-07T13:57:58.723917+0000","last_undegraded":"2024-05-07T13:57:58.723917+0000","last_fullsized":"2024-05-07T13:57:58.723917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:45.617720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366242+0000","last_change":"2024-05-07T13:55:48.332048+0000","last_active":"2024-05-07T13:56:35.366242+0000","last_peered":"2024-05-07T13:56:35.366242+0000","last_clean":"2024-05-07T13:56:35.366242+0000","last_became_active":"2024-05-07T13:55:48.331660+0000","last_became_peered":"2024-05-07T13:55:48.331660+0000","last_unstale":"2024-05-07T13:56:35.366242+0000","last_undegraded":"2024-05-07T13:56:35.366242+0000","last_fullsized":"2024-05-07T13:56:35.366242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356670+0000","last_change":"2024-05-07T13:55:52.320839+0000","last_active":"2024-05-07T13:56:35.356670+0000","last_peered":"2024-05-07T13:56:35.356670+0000","last_clean":"2024-05-07T13:56:35.356670+0000","last_became_active":"2024-05-07T13:55:52.320520+0000","last_became_peered":"2024-05-07T13:55:52.320520+0000","last_unstale":"2024-05-07T13:56:35.356670+0000","last_undegraded":"2024-05-07T13:56:35.356670+0000","last_fullsized":"2024-05-07T13:56:35.356670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:34.956299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.146019+0000","last_change":"2024-05-07T13:55:54.320598+0000","last_active":"2024-05-07T13:57:57.146019+0000","last_peered":"2024-05-07T13:57:57.146019+0000","last_clean":"2024-05-07T13:57:57.146019+0000","last_became_active":"2024-05-07T13:55:54.320266+0000","last_became_peered":"2024-05-07T13:55:54.320266+0000","last_unstale":"2024-05-07T13:57:57.146019+0000","last_undegraded":"2024-05-07T13:57:57.146019+0000","last_fullsized":"2024-05-07T13:57:57.146019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:11.437094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364874+0000","last_change":"2024-05-07T13:55:56.330536+0000","last_active":"2024-05-07T13:56:35.364874+0000","last_peered":"2024-05-07T13:56:35.364874+0000","last_clean":"2024-05-07T13:56:35.364874+0000","last_became_active":"2024-05-07T13:55:56.330251+0000","last_became_peered":"2024-05-07T13:55:56.330251+0000","last_unstale":"2024-05-07T13:56:35.364874+0000","last_undegraded":"2024-05-07T13:56:35.364874+0000","last_fullsized":"2024-05-07T13:56:35.364874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:02.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.141147+0000","last_change":"2024-05-07T13:55:50.323450+0000","last_active":"2024-05-07T13:58:59.141147+0000","last_peered":"2024-05-07T13:58:59.141147+0000","last_clean":"2024-05-07T13:58:59.141147+0000","last_became_active":"2024-05-07T13:55:50.323159+0000","last_became_peered":"2024-05-07T13:55:50.323159+0000","last_unstale":"2024-05-07T13:58:59.141147+0000","last_undegraded":"2024-05-07T13:58:59.141147+0000","last_fullsized":"2024-05-07T13:58:59.141147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:20.168290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356619+0000","last_change":"2024-05-07T13:55:48.352309+0000","last_active":"2024-05-07T13:56:35.356619+0000","last_peered":"2024-05-07T13:56:35.356619+0000","last_clean":"2024-05-07T13:56:35.356619+0000","last_became_active":"2024-05-07T13:55:48.350462+0000","last_became_peered":"2024-05-07T13:55:48.350462+0000","last_unstale":"2024-05-07T13:56:35.356619+0000","last_undegraded":"2024-05-07T13:56:35.356619+0000","last_fullsized":"2024-05-07T13:56:35.356619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:59.353984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359809+0000","last_change":"2024-05-07T13:55:52.321486+0000","last_active":"2024-05-07T13:56:35.359809+0000","last_peered":"2024-05-07T13:56:35.359809+0000","last_clean":"2024-05-07T13:56:35.359809+0000","last_became_active":"2024-05-07T13:55:52.321171+0000","last_became_peered":"2024-05-07T13:55:52.321171+0000","last_unstale":"2024-05-07T13:56:35.359809+0000","last_undegraded":"2024-05-07T13:56:35.359809+0000","last_fullsized":"2024-05-07T13:56:35.359809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:10.570816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.166855+0000","last_change":"2024-05-07T13:55:54.320095+0000","last_active":"2024-05-07T13:57:57.166855+0000","last_peered":"2024-05-07T13:57:57.166855+0000","last_clean":"2024-05-07T13:57:57.166855+0000","last_became_active":"2024-05-07T13:55:54.319819+0000","last_became_peered":"2024-05-07T13:55:54.319819+0000","last_unstale":"2024-05-07T13:57:57.166855+0000","last_undegraded":"2024-05-07T13:57:57.166855+0000","last_fullsized":"2024-05-07T13:57:57.166855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:00.166078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366700+0000","last_change":"2024-05-07T13:55:56.330532+0000","last_active":"2024-05-07T13:56:35.366700+0000","last_peered":"2024-05-07T13:56:35.366700+0000","last_clean":"2024-05-07T13:56:35.366700+0000","last_became_active":"2024-05-07T13:55:56.330190+0000","last_became_peered":"2024-05-07T13:55:56.330190+0000","last_unstale":"2024-05-07T13:56:35.366700+0000","last_undegraded":"2024-05-07T13:56:35.366700+0000","last_fullsized":"2024-05-07T13:56:35.366700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:46.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.660351+0000","last_change":"2024-05-07T13:55:58.341039+0000","last_active":"2024-05-07T13:57:58.660351+0000","last_peered":"2024-05-07T13:57:58.660351+0000","last_clean":"2024-05-07T13:57:58.660351+0000","last_became_active":"2024-05-07T13:55:58.340674+0000","last_became_peered":"2024-05-07T13:55:58.340674+0000","last_unstale":"2024-05-07T13:57:58.660351+0000","last_undegraded":"2024-05-07T13:57:58.660351+0000","last_fullsized":"2024-05-07T13:57:58.660351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:55:16.822393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408545+0000","last_change":"2024-05-07T13:55:50.318936+0000","last_active":"2024-05-07T13:58:59.408545+0000","last_peered":"2024-05-07T13:58:59.408545+0000","last_clean":"2024-05-07T13:58:59.408545+0000","last_became_active":"2024-05-07T13:55:50.318546+0000","last_became_peered":"2024-05-07T13:55:50.318546+0000","last_unstale":"2024-05-07T13:58:59.408545+0000","last_undegraded":"2024-05-07T13:58:59.408545+0000","last_fullsized":"2024-05-07T13:58:59.408545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:51.713206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361299+0000","last_change":"2024-05-07T13:55:48.332704+0000","last_active":"2024-05-07T13:56:35.361299+0000","last_peered":"2024-05-07T13:56:35.361299+0000","last_clean":"2024-05-07T13:56:35.361299+0000","last_became_active":"2024-05-07T13:55:48.331278+0000","last_became_peered":"2024-05-07T13:55:48.331278+0000","last_unstale":"2024-05-07T13:56:35.361299+0000","last_undegraded":"2024-05-07T13:56:35.361299+0000","last_fullsized":"2024-05-07T13:56:35.361299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:34:15.892537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369459+0000","last_change":"2024-05-07T13:55:52.317997+0000","last_active":"2024-05-07T13:56:35.369459+0000","last_peered":"2024-05-07T13:56:35.369459+0000","last_clean":"2024-05-07T13:56:35.369459+0000","last_became_active":"2024-05-07T13:55:52.317564+0000","last_became_peered":"2024-05-07T13:55:52.317564+0000","last_unstale":"2024-05-07T13:56:35.369459+0000","last_undegraded":"2024-05-07T13:56:35.369459+0000","last_fullsized":"2024-05-07T13:56:35.369459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:08.119281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.147002+0000","last_change":"2024-05-07T13:55:54.330150+0000","last_active":"2024-05-07T13:57:57.147002+0000","last_peered":"2024-05-07T13:57:57.147002+0000","last_clean":"2024-05-07T13:57:57.147002+0000","last_became_active":"2024-05-07T13:55:54.329443+0000","last_became_peered":"2024-05-07T13:55:54.329443+0000","last_unstale":"2024-05-07T13:57:57.147002+0000","last_undegraded":"2024-05-07T13:57:57.147002+0000","last_fullsized":"2024-05-07T13:57:57.147002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:38:57.980890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364045+0000","last_change":"2024-05-07T13:55:56.344810+0000","last_active":"2024-05-07T13:56:35.364045+0000","last_peered":"2024-05-07T13:56:35.364045+0000","last_clean":"2024-05-07T13:56:35.364045+0000","last_became_active":"2024-05-07T13:55:56.344470+0000","last_became_peered":"2024-05-07T13:55:56.344470+0000","last_unstale":"2024-05-07T13:56:35.364045+0000","last_undegraded":"2024-05-07T13:56:35.364045+0000","last_fullsized":"2024-05-07T13:56:35.364045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:05.866559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.821748+0000","last_change":"2024-05-07T13:55:58.351086+0000","last_active":"2024-05-07T13:58:58.821748+0000","last_peered":"2024-05-07T13:58:58.821748+0000","last_clean":"2024-05-07T13:58:58.821748+0000","last_became_active":"2024-05-07T13:55:58.350796+0000","last_became_peered":"2024-05-07T13:55:58.350796+0000","last_unstale":"2024-05-07T13:58:58.821748+0000","last_undegraded":"2024-05-07T13:58:58.821748+0000","last_fullsized":"2024-05-07T13:58:58.821748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:13:08.107265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502779+0000","last_change":"2024-05-07T13:55:50.327981+0000","last_active":"2024-05-07T13:58:59.502779+0000","last_peered":"2024-05-07T13:58:59.502779+0000","last_clean":"2024-05-07T13:58:59.502779+0000","last_became_active":"2024-05-07T13:55:50.326424+0000","last_became_peered":"2024-05-07T13:55:50.326424+0000","last_unstale":"2024-05-07T13:58:59.502779+0000","last_undegraded":"2024-05-07T13:58:59.502779+0000","last_fullsized":"2024-05-07T13:58:59.502779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:52.261340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.055616+0000","last_change":"2024-05-07T13:55:48.342464+0000","last_active":"2024-05-07T13:58:59.055616+0000","last_peered":"2024-05-07T13:58:59.055616+0000","last_clean":"2024-05-07T13:58:59.055616+0000","last_became_active":"2024-05-07T13:55:48.342072+0000","last_became_peered":"2024-05-07T13:55:48.342072+0000","last_unstale":"2024-05-07T13:58:59.055616+0000","last_undegraded":"2024-05-07T13:58:59.055616+0000","last_fullsized":"2024-05-07T13:58:59.055616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367888+0000","last_change":"2024-05-07T13:55:52.318946+0000","last_active":"2024-05-07T13:56:35.367888+0000","last_peered":"2024-05-07T13:56:35.367888+0000","last_clean":"2024-05-07T13:56:35.367888+0000","last_became_active":"2024-05-07T13:55:52.318605+0000","last_became_peered":"2024-05-07T13:55:52.318605+0000","last_unstale":"2024-05-07T13:56:35.367888+0000","last_undegraded":"2024-05-07T13:56:35.367888+0000","last_fullsized":"2024-05-07T13:56:35.367888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:09.398107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.164378+0000","last_change":"2024-05-07T13:55:54.326840+0000","last_active":"2024-05-07T13:57:57.164378+0000","last_peered":"2024-05-07T13:57:57.164378+0000","last_clean":"2024-05-07T13:57:57.164378+0000","last_became_active":"2024-05-07T13:55:54.326599+0000","last_became_peered":"2024-05-07T13:55:54.326599+0000","last_unstale":"2024-05-07T13:57:57.164378+0000","last_undegraded":"2024-05-07T13:57:57.164378+0000","last_fullsized":"2024-05-07T13:57:57.164378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:44.541313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359346+0000","last_change":"2024-05-07T13:55:56.334669+0000","last_active":"2024-05-07T13:56:35.359346+0000","last_peered":"2024-05-07T13:56:35.359346+0000","last_clean":"2024-05-07T13:56:35.359346+0000","last_became_active":"2024-05-07T13:55:56.334226+0000","last_became_peered":"2024-05-07T13:55:56.334226+0000","last_unstale":"2024-05-07T13:56:35.359346+0000","last_undegraded":"2024-05-07T13:56:35.359346+0000","last_fullsized":"2024-05-07T13:56:35.359346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:59:21.455096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.719529+0000","last_change":"2024-05-07T13:55:58.352585+0000","last_active":"2024-05-07T13:57:58.719529+0000","last_peered":"2024-05-07T13:57:58.719529+0000","last_clean":"2024-05-07T13:57:58.719529+0000","last_became_active":"2024-05-07T13:55:58.352263+0000","last_became_peered":"2024-05-07T13:55:58.352263+0000","last_unstale":"2024-05-07T13:57:58.719529+0000","last_undegraded":"2024-05-07T13:57:58.719529+0000","last_fullsized":"2024-05-07T13:57:58.719529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:11:22.158209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361243+0000","last_change":"2024-05-07T13:55:50.313466+0000","last_active":"2024-05-07T13:56:35.361243+0000","last_peered":"2024-05-07T13:56:35.361243+0000","last_clean":"2024-05-07T13:56:35.361243+0000","last_became_active":"2024-05-07T13:55:50.312852+0000","last_became_peered":"2024-05-07T13:55:50.312852+0000","last_unstale":"2024-05-07T13:56:35.361243+0000","last_undegraded":"2024-05-07T13:56:35.361243+0000","last_fullsized":"2024-05-07T13:56:35.361243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358505+0000","last_change":"2024-05-07T13:55:48.351068+0000","last_active":"2024-05-07T13:56:35.358505+0000","last_peered":"2024-05-07T13:56:35.358505+0000","last_clean":"2024-05-07T13:56:35.358505+0000","last_became_active":"2024-05-07T13:55:48.348476+0000","last_became_peered":"2024-05-07T13:55:48.348476+0000","last_unstale":"2024-05-07T13:56:35.358505+0000","last_undegraded":"2024-05-07T13:56:35.358505+0000","last_fullsized":"2024-05-07T13:56:35.358505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:24.363423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364249+0000","last_change":"2024-05-07T13:55:52.323853+0000","last_active":"2024-05-07T13:56:35.364249+0000","last_peered":"2024-05-07T13:56:35.364249+0000","last_clean":"2024-05-07T13:56:35.364249+0000","last_became_active":"2024-05-07T13:55:52.322431+0000","last_became_peered":"2024-05-07T13:55:52.322431+0000","last_unstale":"2024-05-07T13:56:35.364249+0000","last_undegraded":"2024-05-07T13:56:35.364249+0000","last_fullsized":"2024-05-07T13:56:35.364249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:10.570816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361154+0000","last_change":"2024-05-07T13:55:54.329901+0000","last_active":"2024-05-07T13:56:35.361154+0000","last_peered":"2024-05-07T13:56:35.361154+0000","last_clean":"2024-05-07T13:56:35.361154+0000","last_became_active":"2024-05-07T13:55:54.329539+0000","last_became_peered":"2024-05-07T13:55:54.329539+0000","last_unstale":"2024-05-07T13:56:35.361154+0000","last_undegraded":"2024-05-07T13:56:35.361154+0000","last_fullsized":"2024-05-07T13:56:35.361154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:26:09.693773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405101+0000","last_change":"2024-05-07T13:55:56.338533+0000","last_active":"2024-05-07T13:58:57.405101+0000","last_peered":"2024-05-07T13:58:57.405101+0000","last_clean":"2024-05-07T13:58:57.405101+0000","last_became_active":"2024-05-07T13:55:56.338021+0000","last_became_peered":"2024-05-07T13:55:56.338021+0000","last_unstale":"2024-05-07T13:58:57.405101+0000","last_undegraded":"2024-05-07T13:58:57.405101+0000","last_fullsized":"2024-05-07T13:58:57.405101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:20.272404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356081+0000","last_change":"2024-05-07T13:55:58.351904+0000","last_active":"2024-05-07T13:56:35.356081+0000","last_peered":"2024-05-07T13:56:35.356081+0000","last_clean":"2024-05-07T13:56:35.356081+0000","last_became_active":"2024-05-07T13:55:58.351616+0000","last_became_peered":"2024-05-07T13:55:58.351616+0000","last_unstale":"2024-05-07T13:56:35.356081+0000","last_undegraded":"2024-05-07T13:56:35.356081+0000","last_fullsized":"2024-05-07T13:56:35.356081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:22.090983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.185290+0000","last_change":"2024-05-07T13:55:50.313284+0000","last_active":"2024-05-07T13:58:23.185290+0000","last_peered":"2024-05-07T13:58:23.185290+0000","last_clean":"2024-05-07T13:58:23.185290+0000","last_became_active":"2024-05-07T13:55:50.313016+0000","last_became_peered":"2024-05-07T13:55:50.313016+0000","last_unstale":"2024-05-07T13:58:23.185290+0000","last_undegraded":"2024-05-07T13:58:23.185290+0000","last_fullsized":"2024-05-07T13:58:23.185290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:15.469036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363748+0000","last_change":"2024-05-07T13:55:48.340087+0000","last_active":"2024-05-07T13:56:35.363748+0000","last_peered":"2024-05-07T13:56:35.363748+0000","last_clean":"2024-05-07T13:56:35.363748+0000","last_became_active":"2024-05-07T13:55:48.339639+0000","last_became_peered":"2024-05-07T13:55:48.339639+0000","last_unstale":"2024-05-07T13:56:35.363748+0000","last_undegraded":"2024-05-07T13:56:35.363748+0000","last_fullsized":"2024-05-07T13:56:35.363748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361140+0000","last_change":"2024-05-07T13:55:52.324874+0000","last_active":"2024-05-07T13:56:35.361140+0000","last_peered":"2024-05-07T13:56:35.361140+0000","last_clean":"2024-05-07T13:56:35.361140+0000","last_became_active":"2024-05-07T13:55:52.324567+0000","last_became_peered":"2024-05-07T13:55:52.324567+0000","last_unstale":"2024-05-07T13:56:35.361140+0000","last_undegraded":"2024-05-07T13:56:35.361140+0000","last_fullsized":"2024-05-07T13:56:35.361140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:01.502846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.136732+0000","last_change":"2024-05-07T13:55:54.329601+0000","last_active":"2024-05-07T13:57:57.136732+0000","last_peered":"2024-05-07T13:57:57.136732+0000","last_clean":"2024-05-07T13:57:57.136732+0000","last_became_active":"2024-05-07T13:55:54.329220+0000","last_became_peered":"2024-05-07T13:55:54.329220+0000","last_unstale":"2024-05-07T13:57:57.136732+0000","last_undegraded":"2024-05-07T13:57:57.136732+0000","last_fullsized":"2024-05-07T13:57:57.136732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:00.166078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358098+0000","last_change":"2024-05-07T13:55:56.333675+0000","last_active":"2024-05-07T13:56:35.358098+0000","last_peered":"2024-05-07T13:56:35.358098+0000","last_clean":"2024-05-07T13:56:35.358098+0000","last_became_active":"2024-05-07T13:55:56.333373+0000","last_became_peered":"2024-05-07T13:55:56.333373+0000","last_unstale":"2024-05-07T13:56:35.358098+0000","last_undegraded":"2024-05-07T13:56:35.358098+0000","last_fullsized":"2024-05-07T13:56:35.358098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:19.698130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366747+0000","last_change":"2024-05-07T13:55:58.347910+0000","last_active":"2024-05-07T13:56:35.366747+0000","last_peered":"2024-05-07T13:56:35.366747+0000","last_clean":"2024-05-07T13:56:35.366747+0000","last_became_active":"2024-05-07T13:55:58.347327+0000","last_became_peered":"2024-05-07T13:55:58.347327+0000","last_unstale":"2024-05-07T13:56:35.366747+0000","last_undegraded":"2024-05-07T13:56:35.366747+0000","last_fullsized":"2024-05-07T13:56:35.366747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:18.476650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359524+0000","last_change":"2024-05-07T13:55:50.311670+0000","last_active":"2024-05-07T13:56:35.359524+0000","last_peered":"2024-05-07T13:56:35.359524+0000","last_clean":"2024-05-07T13:56:35.359524+0000","last_became_active":"2024-05-07T13:55:50.311340+0000","last_became_peered":"2024-05-07T13:55:50.311340+0000","last_unstale":"2024-05-07T13:56:35.359524+0000","last_undegraded":"2024-05-07T13:56:35.359524+0000","last_fullsized":"2024-05-07T13:56:35.359524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:45.426204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360374+0000","last_change":"2024-05-07T13:55:48.351060+0000","last_active":"2024-05-07T13:56:35.360374+0000","last_peered":"2024-05-07T13:56:35.360374+0000","last_clean":"2024-05-07T13:56:35.360374+0000","last_became_active":"2024-05-07T13:55:48.349589+0000","last_became_peered":"2024-05-07T13:55:48.349589+0000","last_unstale":"2024-05-07T13:56:35.360374+0000","last_undegraded":"2024-05-07T13:56:35.360374+0000","last_fullsized":"2024-05-07T13:56:35.360374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:54:44.852941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366095+0000","last_change":"2024-05-07T13:55:52.323978+0000","last_active":"2024-05-07T13:56:35.366095+0000","last_peered":"2024-05-07T13:56:35.366095+0000","last_clean":"2024-05-07T13:56:35.366095+0000","last_became_active":"2024-05-07T13:55:52.323548+0000","last_became_peered":"2024-05-07T13:55:52.323548+0000","last_unstale":"2024-05-07T13:56:35.366095+0000","last_undegraded":"2024-05-07T13:56:35.366095+0000","last_fullsized":"2024-05-07T13:56:35.366095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:51:24.684579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.137962+0000","last_change":"2024-05-07T13:55:54.327074+0000","last_active":"2024-05-07T13:57:57.137962+0000","last_peered":"2024-05-07T13:57:57.137962+0000","last_clean":"2024-05-07T13:57:57.137962+0000","last_became_active":"2024-05-07T13:55:54.326844+0000","last_became_peered":"2024-05-07T13:55:54.326844+0000","last_unstale":"2024-05-07T13:57:57.137962+0000","last_undegraded":"2024-05-07T13:57:57.137962+0000","last_fullsized":"2024-05-07T13:57:57.137962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:07.500805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356419+0000","last_change":"2024-05-07T13:55:56.345203+0000","last_active":"2024-05-07T13:56:35.356419+0000","last_peered":"2024-05-07T13:56:35.356419+0000","last_clean":"2024-05-07T13:56:35.356419+0000","last_became_active":"2024-05-07T13:55:56.344885+0000","last_became_peered":"2024-05-07T13:55:56.344885+0000","last_unstale":"2024-05-07T13:56:35.356419+0000","last_undegraded":"2024-05-07T13:56:35.356419+0000","last_fullsized":"2024-05-07T13:56:35.356419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:23.344207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361365+0000","last_change":"2024-05-07T13:55:58.348158+0000","last_active":"2024-05-07T13:56:35.361365+0000","last_peered":"2024-05-07T13:56:35.361365+0000","last_clean":"2024-05-07T13:56:35.361365+0000","last_became_active":"2024-05-07T13:55:58.347850+0000","last_became_peered":"2024-05-07T13:55:58.347850+0000","last_unstale":"2024-05-07T13:56:35.361365+0000","last_undegraded":"2024-05-07T13:56:35.361365+0000","last_fullsized":"2024-05-07T13:56:35.361365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:53.578201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'20","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502897+0000","last_change":"2024-05-07T13:55:50.325227+0000","last_active":"2024-05-07T13:58:59.502897+0000","last_peered":"2024-05-07T13:58:59.502897+0000","last_clean":"2024-05-07T13:58:59.502897+0000","last_became_active":"2024-05-07T13:55:50.324745+0000","last_became_peered":"2024-05-07T13:55:50.324745+0000","last_unstale":"2024-05-07T13:58:59.502897+0000","last_undegraded":"2024-05-07T13:58:59.502897+0000","last_fullsized":"2024-05-07T13:58:59.502897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:33.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.920397+0000","last_change":"2024-05-07T13:55:48.324008+0000","last_active":"2024-05-07T13:57:14.920397+0000","last_peered":"2024-05-07T13:57:14.920397+0000","last_clean":"2024-05-07T13:57:14.920397+0000","last_became_active":"2024-05-07T13:55:48.323125+0000","last_became_peered":"2024-05-07T13:55:48.323125+0000","last_unstale":"2024-05-07T13:57:14.920397+0000","last_undegraded":"2024-05-07T13:57:14.920397+0000","last_fullsized":"2024-05-07T13:57:14.920397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:00:13.644367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359668+0000","last_change":"2024-05-07T13:55:52.322334+0000","last_active":"2024-05-07T13:56:35.359668+0000","last_peered":"2024-05-07T13:56:35.359668+0000","last_clean":"2024-05-07T13:56:35.359668+0000","last_became_active":"2024-05-07T13:55:52.322012+0000","last_became_peered":"2024-05-07T13:55:52.322012+0000","last_unstale":"2024-05-07T13:56:35.359668+0000","last_undegraded":"2024-05-07T13:56:35.359668+0000","last_fullsized":"2024-05-07T13:56:35.359668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:51.701961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'27","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.162341+0000","last_change":"2024-05-07T13:55:54.327483+0000","last_active":"2024-05-07T13:57:57.162341+0000","last_peered":"2024-05-07T13:57:57.162341+0000","last_clean":"2024-05-07T13:57:57.162341+0000","last_became_active":"2024-05-07T13:55:54.326758+0000","last_became_peered":"2024-05-07T13:55:54.326758+0000","last_unstale":"2024-05-07T13:57:57.162341+0000","last_undegraded":"2024-05-07T13:57:57.162341+0000","last_fullsized":"2024-05-07T13:57:57.162341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:13:47.426980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357488+0000","last_change":"2024-05-07T13:55:56.346233+0000","last_active":"2024-05-07T13:56:35.357488+0000","last_peered":"2024-05-07T13:56:35.357488+0000","last_clean":"2024-05-07T13:56:35.357488+0000","last_became_active":"2024-05-07T13:55:56.345933+0000","last_became_peered":"2024-05-07T13:55:56.345933+0000","last_unstale":"2024-05-07T13:56:35.357488+0000","last_undegraded":"2024-05-07T13:56:35.357488+0000","last_fullsized":"2024-05-07T13:56:35.357488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:38:24.160530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.172834+0000","last_change":"2024-05-07T13:55:58.349147+0000","last_active":"2024-05-07T13:57:57.172834+0000","last_peered":"2024-05-07T13:57:57.172834+0000","last_clean":"2024-05-07T13:57:57.172834+0000","last_became_active":"2024-05-07T13:55:58.348763+0000","last_became_peered":"2024-05-07T13:55:58.348763+0000","last_unstale":"2024-05-07T13:57:57.172834+0000","last_undegraded":"2024-05-07T13:57:57.172834+0000","last_fullsized":"2024-05-07T13:57:57.172834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:37.840451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408575+0000","last_change":"2024-05-07T13:55:50.313977+0000","last_active":"2024-05-07T13:58:59.408575+0000","last_peered":"2024-05-07T13:58:59.408575+0000","last_clean":"2024-05-07T13:58:59.408575+0000","last_became_active":"2024-05-07T13:55:50.312605+0000","last_became_peered":"2024-05-07T13:55:50.312605+0000","last_unstale":"2024-05-07T13:58:59.408575+0000","last_undegraded":"2024-05-07T13:58:59.408575+0000","last_fullsized":"2024-05-07T13:58:59.408575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:54:46.860579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366631+0000","last_change":"2024-05-07T13:55:48.333628+0000","last_active":"2024-05-07T13:56:35.366631+0000","last_peered":"2024-05-07T13:56:35.366631+0000","last_clean":"2024-05-07T13:56:35.366631+0000","last_became_active":"2024-05-07T13:55:48.333254+0000","last_became_peered":"2024-05-07T13:55:48.333254+0000","last_unstale":"2024-05-07T13:56:35.366631+0000","last_undegraded":"2024-05-07T13:56:35.366631+0000","last_fullsized":"2024-05-07T13:56:35.366631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.781719+0000","last_change":"2024-05-07T13:55:52.322300+0000","last_active":"2024-05-07T13:57:55.781719+0000","last_peered":"2024-05-07T13:57:55.781719+0000","last_clean":"2024-05-07T13:57:55.781719+0000","last_became_active":"2024-05-07T13:55:52.321982+0000","last_became_peered":"2024-05-07T13:55:52.321982+0000","last_unstale":"2024-05-07T13:57:55.781719+0000","last_undegraded":"2024-05-07T13:57:55.781719+0000","last_fullsized":"2024-05-07T13:57:55.781719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:07:58.452077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.742866+0000","last_change":"2024-05-07T13:55:54.327217+0000","last_active":"2024-05-07T13:58:58.742866+0000","last_peered":"2024-05-07T13:58:58.742866+0000","last_clean":"2024-05-07T13:58:58.742866+0000","last_became_active":"2024-05-07T13:55:54.326895+0000","last_became_peered":"2024-05-07T13:55:54.326895+0000","last_unstale":"2024-05-07T13:58:58.742866+0000","last_undegraded":"2024-05-07T13:58:58.742866+0000","last_fullsized":"2024-05-07T13:58:58.742866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:20:31.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359452+0000","last_change":"2024-05-07T13:55:56.343265+0000","last_active":"2024-05-07T13:56:35.359452+0000","last_peered":"2024-05-07T13:56:35.359452+0000","last_clean":"2024-05-07T13:56:35.359452+0000","last_became_active":"2024-05-07T13:55:56.343002+0000","last_became_peered":"2024-05-07T13:55:56.343002+0000","last_unstale":"2024-05-07T13:56:35.359452+0000","last_undegraded":"2024-05-07T13:56:35.359452+0000","last_fullsized":"2024-05-07T13:56:35.359452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:46.396698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.593707+0000","last_change":"2024-05-07T13:55:58.348783+0000","last_active":"2024-05-07T13:58:59.593707+0000","last_peered":"2024-05-07T13:58:59.593707+0000","last_clean":"2024-05-07T13:58:59.593707+0000","last_became_active":"2024-05-07T13:55:58.347820+0000","last_became_peered":"2024-05-07T13:55:58.347820+0000","last_unstale":"2024-05-07T13:58:59.593707+0000","last_undegraded":"2024-05-07T13:58:59.593707+0000","last_fullsized":"2024-05-07T13:58:59.593707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:54.677953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471805+0000","last_change":"2024-05-07T13:55:50.330476+0000","last_active":"2024-05-07T13:58:59.471805+0000","last_peered":"2024-05-07T13:58:59.471805+0000","last_clean":"2024-05-07T13:58:59.471805+0000","last_became_active":"2024-05-07T13:55:50.330166+0000","last_became_peered":"2024-05-07T13:55:50.330166+0000","last_unstale":"2024-05-07T13:58:59.471805+0000","last_undegraded":"2024-05-07T13:58:59.471805+0000","last_fullsized":"2024-05-07T13:58:59.471805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:17:53.138578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358590+0000","last_change":"2024-05-07T13:55:48.339261+0000","last_active":"2024-05-07T13:56:35.358590+0000","last_peered":"2024-05-07T13:56:35.358590+0000","last_clean":"2024-05-07T13:56:35.358590+0000","last_became_active":"2024-05-07T13:55:48.338874+0000","last_became_peered":"2024-05-07T13:55:48.338874+0000","last_unstale":"2024-05-07T13:56:35.358590+0000","last_undegraded":"2024-05-07T13:56:35.358590+0000","last_fullsized":"2024-05-07T13:56:35.358590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.142958+0000","last_change":"2024-05-07T13:55:50.311630+0000","last_active":"2024-05-07T13:58:59.142958+0000","last_peered":"2024-05-07T13:58:59.142958+0000","last_clean":"2024-05-07T13:58:59.142958+0000","last_became_active":"2024-05-07T13:55:50.311324+0000","last_became_peered":"2024-05-07T13:55:50.311324+0000","last_unstale":"2024-05-07T13:58:59.142958+0000","last_undegraded":"2024-05-07T13:58:59.142958+0000","last_fullsized":"2024-05-07T13:58:59.142958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:52.088546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358534+0000","last_change":"2024-05-07T13:55:48.327068+0000","last_active":"2024-05-07T13:56:35.358534+0000","last_peered":"2024-05-07T13:56:35.358534+0000","last_clean":"2024-05-07T13:56:35.358534+0000","last_became_active":"2024-05-07T13:55:48.325561+0000","last_became_peered":"2024-05-07T13:55:48.325561+0000","last_unstale":"2024-05-07T13:56:35.358534+0000","last_undegraded":"2024-05-07T13:56:35.358534+0000","last_fullsized":"2024-05-07T13:56:35.358534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180888+0000","last_change":"2024-05-07T13:55:50.326752+0000","last_active":"2024-05-07T13:58:03.180888+0000","last_peered":"2024-05-07T13:58:03.180888+0000","last_clean":"2024-05-07T13:58:03.180888+0000","last_became_active":"2024-05-07T13:55:50.326322+0000","last_became_peered":"2024-05-07T13:55:50.326322+0000","last_unstale":"2024-05-07T13:58:03.180888+0000","last_undegraded":"2024-05-07T13:58:03.180888+0000","last_fullsized":"2024-05-07T13:58:03.180888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:07:36.575334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357230+0000","last_change":"2024-05-07T13:55:48.352058+0000","last_active":"2024-05-07T13:56:35.357230+0000","last_peered":"2024-05-07T13:56:35.357230+0000","last_clean":"2024-05-07T13:56:35.357230+0000","last_became_active":"2024-05-07T13:55:48.350385+0000","last_became_peered":"2024-05-07T13:55:48.350385+0000","last_unstale":"2024-05-07T13:56:35.357230+0000","last_undegraded":"2024-05-07T13:56:35.357230+0000","last_fullsized":"2024-05-07T13:56:35.357230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:17:38.955925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.178821+0000","last_change":"2024-05-07T13:55:50.313167+0000","last_active":"2024-05-07T13:58:03.178821+0000","last_peered":"2024-05-07T13:58:03.178821+0000","last_clean":"2024-05-07T13:58:03.178821+0000","last_became_active":"2024-05-07T13:55:50.312703+0000","last_became_peered":"2024-05-07T13:55:50.312703+0000","last_unstale":"2024-05-07T13:58:03.178821+0000","last_undegraded":"2024-05-07T13:58:03.178821+0000","last_fullsized":"2024-05-07T13:58:03.178821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.177520+0000","last_change":"2024-05-07T13:55:48.325914+0000","last_active":"2024-05-07T13:57:53.177520+0000","last_peered":"2024-05-07T13:57:53.177520+0000","last_clean":"2024-05-07T13:57:53.177520+0000","last_became_active":"2024-05-07T13:55:48.323979+0000","last_became_peered":"2024-05-07T13:55:48.323979+0000","last_unstale":"2024-05-07T13:57:53.177520+0000","last_undegraded":"2024-05-07T13:57:53.177520+0000","last_fullsized":"2024-05-07T13:57:53.177520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.472146+0000","last_change":"2024-05-07T13:55:50.331631+0000","last_active":"2024-05-07T13:58:59.472146+0000","last_peered":"2024-05-07T13:58:59.472146+0000","last_clean":"2024-05-07T13:58:59.472146+0000","last_became_active":"2024-05-07T13:55:50.331311+0000","last_became_peered":"2024-05-07T13:55:50.331311+0000","last_unstale":"2024-05-07T13:58:59.472146+0000","last_undegraded":"2024-05-07T13:58:59.472146+0000","last_fullsized":"2024-05-07T13:58:59.472146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178153+0000","last_change":"2024-05-07T13:55:48.326606+0000","last_active":"2024-05-07T13:57:58.178153+0000","last_peered":"2024-05-07T13:57:58.178153+0000","last_clean":"2024-05-07T13:57:58.178153+0000","last_became_active":"2024-05-07T13:55:48.325858+0000","last_became_peered":"2024-05-07T13:55:48.325858+0000","last_unstale":"2024-05-07T13:57:58.178153+0000","last_undegraded":"2024-05-07T13:57:58.178153+0000","last_fullsized":"2024-05-07T13:57:58.178153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:43.039363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.717865+0000","last_change":"2024-05-07T13:55:50.324360+0000","last_active":"2024-05-07T13:57:58.717865+0000","last_peered":"2024-05-07T13:57:58.717865+0000","last_clean":"2024-05-07T13:57:58.717865+0000","last_became_active":"2024-05-07T13:55:50.323573+0000","last_became_peered":"2024-05-07T13:55:50.323573+0000","last_unstale":"2024-05-07T13:57:58.717865+0000","last_undegraded":"2024-05-07T13:57:58.717865+0000","last_fullsized":"2024-05-07T13:57:58.717865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:57:18.448833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364364+0000","last_change":"2024-05-07T13:55:48.334670+0000","last_active":"2024-05-07T13:56:35.364364+0000","last_peered":"2024-05-07T13:56:35.364364+0000","last_clean":"2024-05-07T13:56:35.364364+0000","last_became_active":"2024-05-07T13:55:48.334268+0000","last_became_peered":"2024-05-07T13:55:48.334268+0000","last_unstale":"2024-05-07T13:56:35.364364+0000","last_undegraded":"2024-05-07T13:56:35.364364+0000","last_fullsized":"2024-05-07T13:56:35.364364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471690+0000","last_change":"2024-05-07T13:55:50.320633+0000","last_active":"2024-05-07T13:58:59.471690+0000","last_peered":"2024-05-07T13:58:59.471690+0000","last_clean":"2024-05-07T13:58:59.471690+0000","last_became_active":"2024-05-07T13:55:50.320242+0000","last_became_peered":"2024-05-07T13:55:50.320242+0000","last_unstale":"2024-05-07T13:58:59.471690+0000","last_undegraded":"2024-05-07T13:58:59.471690+0000","last_fullsized":"2024-05-07T13:58:59.471690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:05.135442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.182163+0000","last_change":"2024-05-07T13:55:48.341172+0000","last_active":"2024-05-07T13:57:58.182163+0000","last_peered":"2024-05-07T13:57:58.182163+0000","last_clean":"2024-05-07T13:57:58.182163+0000","last_became_active":"2024-05-07T13:55:48.340718+0000","last_became_peered":"2024-05-07T13:55:48.340718+0000","last_unstale":"2024-05-07T13:57:58.182163+0000","last_undegraded":"2024-05-07T13:57:58.182163+0000","last_fullsized":"2024-05-07T13:57:58.182163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'11","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149433+0000","last_change":"2024-05-07T13:55:50.320724+0000","last_active":"2024-05-07T13:58:59.149433+0000","last_peered":"2024-05-07T13:58:59.149433+0000","last_clean":"2024-05-07T13:58:59.149433+0000","last_became_active":"2024-05-07T13:55:50.320430+0000","last_became_peered":"2024-05-07T13:55:50.320430+0000","last_unstale":"2024-05-07T13:58:59.149433+0000","last_undegraded":"2024-05-07T13:58:59.149433+0000","last_fullsized":"2024-05-07T13:58:59.149433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:25:44.298994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361383+0000","last_change":"2024-05-07T13:55:48.324349+0000","last_active":"2024-05-07T13:56:35.361383+0000","last_peered":"2024-05-07T13:56:35.361383+0000","last_clean":"2024-05-07T13:56:35.361383+0000","last_became_active":"2024-05-07T13:55:48.323524+0000","last_became_peered":"2024-05-07T13:55:48.323524+0000","last_unstale":"2024-05-07T13:56:35.361383+0000","last_undegraded":"2024-05-07T13:56:35.361383+0000","last_fullsized":"2024-05-07T13:56:35.361383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:02.962105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367054+0000","last_change":"2024-05-07T13:55:50.313308+0000","last_active":"2024-05-07T13:56:35.367054+0000","last_peered":"2024-05-07T13:56:35.367054+0000","last_clean":"2024-05-07T13:56:35.367054+0000","last_became_active":"2024-05-07T13:55:50.313012+0000","last_became_peered":"2024-05-07T13:55:50.313012+0000","last_unstale":"2024-05-07T13:56:35.367054+0000","last_undegraded":"2024-05-07T13:56:35.367054+0000","last_fullsized":"2024-05-07T13:56:35.367054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:18.182290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.430794+0000","last_change":"2024-05-07T13:55:48.353515+0000","last_active":"2024-05-07T13:57:55.430794+0000","last_peered":"2024-05-07T13:57:55.430794+0000","last_clean":"2024-05-07T13:57:55.430794+0000","last_became_active":"2024-05-07T13:55:48.351882+0000","last_became_peered":"2024-05-07T13:55:48.351882+0000","last_unstale":"2024-05-07T13:57:55.430794+0000","last_undegraded":"2024-05-07T13:57:55.430794+0000","last_fullsized":"2024-05-07T13:57:55.430794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:34.947652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408508+0000","last_change":"2024-05-07T13:55:50.326172+0000","last_active":"2024-05-07T13:58:59.408508+0000","last_peered":"2024-05-07T13:58:59.408508+0000","last_clean":"2024-05-07T13:58:59.408508+0000","last_became_active":"2024-05-07T13:55:50.325807+0000","last_became_peered":"2024-05-07T13:55:50.325807+0000","last_unstale":"2024-05-07T13:58:59.408508+0000","last_undegraded":"2024-05-07T13:58:59.408508+0000","last_fullsized":"2024-05-07T13:58:59.408508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:08.013460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358738+0000","last_change":"2024-05-07T13:55:48.326746+0000","last_active":"2024-05-07T13:56:35.358738+0000","last_peered":"2024-05-07T13:56:35.358738+0000","last_clean":"2024-05-07T13:56:35.358738+0000","last_became_active":"2024-05-07T13:55:48.324919+0000","last_became_peered":"2024-05-07T13:55:48.324919+0000","last_unstale":"2024-05-07T13:56:35.358738+0000","last_undegraded":"2024-05-07T13:56:35.358738+0000","last_fullsized":"2024-05-07T13:56:35.358738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723663+0000","last_change":"2024-05-07T13:55:50.326002+0000","last_active":"2024-05-07T13:57:58.723663+0000","last_peered":"2024-05-07T13:57:58.723663+0000","last_clean":"2024-05-07T13:57:58.723663+0000","last_became_active":"2024-05-07T13:55:50.325620+0000","last_became_peered":"2024-05-07T13:55:50.325620+0000","last_unstale":"2024-05-07T13:57:58.723663+0000","last_undegraded":"2024-05-07T13:57:58.723663+0000","last_fullsized":"2024-05-07T13:57:58.723663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:56.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180393+0000","last_change":"2024-05-07T13:55:48.342921+0000","last_active":"2024-05-07T13:58:03.180393+0000","last_peered":"2024-05-07T13:58:03.180393+0000","last_clean":"2024-05-07T13:58:03.180393+0000","last_became_active":"2024-05-07T13:55:48.342508+0000","last_became_peered":"2024-05-07T13:55:48.342508+0000","last_unstale":"2024-05-07T13:58:03.180393+0000","last_undegraded":"2024-05-07T13:58:03.180393+0000","last_fullsized":"2024-05-07T13:58:03.180393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:02.747875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.246679+0000","last_change":"2024-05-07T13:55:50.321908+0000","last_active":"2024-05-07T13:58:59.246679+0000","last_peered":"2024-05-07T13:58:59.246679+0000","last_clean":"2024-05-07T13:58:59.246679+0000","last_became_active":"2024-05-07T13:55:50.321606+0000","last_became_peered":"2024-05-07T13:55:50.321606+0000","last_unstale":"2024-05-07T13:58:59.246679+0000","last_undegraded":"2024-05-07T13:58:59.246679+0000","last_fullsized":"2024-05-07T13:58:59.246679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:26.371060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361244+0000","last_change":"2024-05-07T13:55:48.332694+0000","last_active":"2024-05-07T13:56:35.361244+0000","last_peered":"2024-05-07T13:56:35.361244+0000","last_clean":"2024-05-07T13:56:35.361244+0000","last_became_active":"2024-05-07T13:55:48.332247+0000","last_became_peered":"2024-05-07T13:55:48.332247+0000","last_unstale":"2024-05-07T13:56:35.361244+0000","last_undegraded":"2024-05-07T13:56:35.361244+0000","last_fullsized":"2024-05-07T13:56:35.361244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408527+0000","last_change":"2024-05-07T13:55:50.329959+0000","last_active":"2024-05-07T13:58:59.408527+0000","last_peered":"2024-05-07T13:58:59.408527+0000","last_clean":"2024-05-07T13:58:59.408527+0000","last_became_active":"2024-05-07T13:55:50.329434+0000","last_became_peered":"2024-05-07T13:55:50.329434+0000","last_unstale":"2024-05-07T13:58:59.408527+0000","last_undegraded":"2024-05-07T13:58:59.408527+0000","last_fullsized":"2024-05-07T13:58:59.408527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.498000+0000","last_change":"2024-05-07T13:55:48.348177+0000","last_active":"2024-05-07T13:58:59.498000+0000","last_peered":"2024-05-07T13:58:59.498000+0000","last_clean":"2024-05-07T13:58:59.498000+0000","last_became_active":"2024-05-07T13:55:48.345844+0000","last_became_peered":"2024-05-07T13:55:48.345844+0000","last_unstale":"2024-05-07T13:58:59.498000+0000","last_undegraded":"2024-05-07T13:58:59.498000+0000","last_fullsized":"2024-05-07T13:58:59.498000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:03.127804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363106+0000","last_change":"2024-05-07T13:55:50.313698+0000","last_active":"2024-05-07T13:56:35.363106+0000","last_peered":"2024-05-07T13:56:35.363106+0000","last_clean":"2024-05-07T13:56:35.363106+0000","last_became_active":"2024-05-07T13:55:50.313049+0000","last_became_peered":"2024-05-07T13:55:50.313049+0000","last_unstale":"2024-05-07T13:56:35.363106+0000","last_undegraded":"2024-05-07T13:56:35.363106+0000","last_fullsized":"2024-05-07T13:56:35.363106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:43:49.979727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.121947+0000","last_change":"2024-05-07T13:55:48.349780+0000","last_active":"2024-05-07T13:58:59.121947+0000","last_peered":"2024-05-07T13:58:59.121947+0000","last_clean":"2024-05-07T13:58:59.121947+0000","last_became_active":"2024-05-07T13:55:48.346691+0000","last_became_peered":"2024-05-07T13:55:48.346691+0000","last_unstale":"2024-05-07T13:58:59.121947+0000","last_undegraded":"2024-05-07T13:58:59.121947+0000","last_fullsized":"2024-05-07T13:58:59.121947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:47.664009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'10","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.739245+0000","last_change":"2024-05-07T13:55:50.323717+0000","last_active":"2024-05-07T13:57:14.739245+0000","last_peered":"2024-05-07T13:57:14.739245+0000","last_clean":"2024-05-07T13:57:14.739245+0000","last_became_active":"2024-05-07T13:55:50.322543+0000","last_became_peered":"2024-05-07T13:55:50.322543+0000","last_unstale":"2024-05-07T13:57:14.739245+0000","last_undegraded":"2024-05-07T13:57:14.739245+0000","last_fullsized":"2024-05-07T13:57:14.739245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:12:56.152000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370285+0000","last_change":"2024-05-07T13:55:48.340889+0000","last_active":"2024-05-07T13:56:35.370285+0000","last_peered":"2024-05-07T13:56:35.370285+0000","last_clean":"2024-05-07T13:56:35.370285+0000","last_became_active":"2024-05-07T13:55:48.339909+0000","last_became_peered":"2024-05-07T13:55:48.339909+0000","last_unstale":"2024-05-07T13:56:35.370285+0000","last_undegraded":"2024-05-07T13:56:35.370285+0000","last_fullsized":"2024-05-07T13:56:35.370285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408516+0000","last_change":"2024-05-07T13:55:50.323280+0000","last_active":"2024-05-07T13:58:59.408516+0000","last_peered":"2024-05-07T13:58:59.408516+0000","last_clean":"2024-05-07T13:58:59.408516+0000","last_became_active":"2024-05-07T13:55:50.322967+0000","last_became_peered":"2024-05-07T13:55:50.322967+0000","last_unstale":"2024-05-07T13:58:59.408516+0000","last_undegraded":"2024-05-07T13:58:59.408516+0000","last_fullsized":"2024-05-07T13:58:59.408516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:51.713206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.102826+0000","last_change":"2024-05-07T13:55:48.347208+0000","last_active":"2024-05-07T13:58:59.102826+0000","last_peered":"2024-05-07T13:58:59.102826+0000","last_clean":"2024-05-07T13:58:59.102826+0000","last_became_active":"2024-05-07T13:55:48.346724+0000","last_became_peered":"2024-05-07T13:55:48.346724+0000","last_unstale":"2024-05-07T13:58:59.102826+0000","last_undegraded":"2024-05-07T13:58:59.102826+0000","last_fullsized":"2024-05-07T13:58:59.102826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:03.378851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357777+0000","last_change":"2024-05-07T13:55:48.351645+0000","last_active":"2024-05-07T13:56:35.357777+0000","last_peered":"2024-05-07T13:56:35.357777+0000","last_clean":"2024-05-07T13:56:35.357777+0000","last_became_active":"2024-05-07T13:55:48.349852+0000","last_became_peered":"2024-05-07T13:55:48.349852+0000","last_unstale":"2024-05-07T13:56:35.357777+0000","last_undegraded":"2024-05-07T13:56:35.357777+0000","last_fullsized":"2024-05-07T13:56:35.357777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:37:41.603367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408432+0000","last_change":"2024-05-07T13:55:50.319944+0000","last_active":"2024-05-07T13:58:59.408432+0000","last_peered":"2024-05-07T13:58:59.408432+0000","last_clean":"2024-05-07T13:58:59.408432+0000","last_became_active":"2024-05-07T13:55:50.319033+0000","last_became_peered":"2024-05-07T13:55:50.319033+0000","last_unstale":"2024-05-07T13:58:59.408432+0000","last_undegraded":"2024-05-07T13:58:59.408432+0000","last_fullsized":"2024-05-07T13:58:59.408432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359001+0000","last_change":"2024-05-07T13:55:48.326709+0000","last_active":"2024-05-07T13:56:35.359001+0000","last_peered":"2024-05-07T13:56:35.359001+0000","last_clean":"2024-05-07T13:56:35.359001+0000","last_became_active":"2024-05-07T13:55:48.324081+0000","last_became_peered":"2024-05-07T13:55:48.324081+0000","last_unstale":"2024-05-07T13:56:35.359001+0000","last_undegraded":"2024-05-07T13:56:35.359001+0000","last_fullsized":"2024-05-07T13:56:35.359001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723822+0000","last_change":"2024-05-07T13:55:50.330143+0000","last_active":"2024-05-07T13:57:58.723822+0000","last_peered":"2024-05-07T13:57:58.723822+0000","last_clean":"2024-05-07T13:57:58.723822+0000","last_became_active":"2024-05-07T13:55:50.329848+0000","last_became_peered":"2024-05-07T13:55:50.329848+0000","last_unstale":"2024-05-07T13:57:58.723822+0000","last_undegraded":"2024-05-07T13:57:58.723822+0000","last_fullsized":"2024-05-07T13:57:58.723822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:07.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1403,"num_read_kb":1189,"num_write":533,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1276,"ondisk_log_size":1276,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52492,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319348,"statfs":{"total":96636764160,"available":96583012352,"internally_reserved":0,"allocated":9048064,"data_stored":8742301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":9352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":9576448,"data_stored":9330398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":157,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48876,"kb_used_data":9380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322964,"statfs":{"total":96636764160,"available":96586715136,"internally_reserved":0,"allocated":9605120,"data_stored":9331528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":8800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":9011200,"data_stored":8741991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T13:59:06.998 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-07T13:59:06.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T13:59:07.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.142+0000 7f829b9ed640 1 Processor -- start 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.142+0000 7f829b9ed640 1 -- start start 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.142+0000 7f829b9ed640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f829412c5b0 0x7f829412c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.142+0000 7f829b9ed640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8294113dd0 con 0x7f829412ced0 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.142+0000 7f829b9ed640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8294072290 con 0x7f829412c5b0 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.143+0000 7f8299789640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f829412c5b0 0x7f829412c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.143+0000 7f8298f88640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f829412ced0 0x7f829406e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38152/0 (socket says 172.21.15.22:38152) 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.143+0000 7f8298f88640 1 -- 172.21.15.22:0/2458029779 learned_addr learned my addr 172.21.15.22:0/2458029779 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.143+0000 7f8299789640 1 -- 172.21.15.22:0/2458029779 >> v1:172.21.15.22:6789/0 conn(0x7f829412ced0 legacy=0x7f829406e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.143+0000 7f8299789640 1 -- 172.21.15.22:0/2458029779 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829412c390 con 0x7f829412c5b0 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.143+0000 7f828bfff640 1 -- 172.21.15.22:0/2458029779 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902233479 0 0) 0x7f8294113dd0 con 0x7f829412ced0 2024-05-07T13:59:07.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f8299789640 1 --2- 172.21.15.22:0/2458029779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 0x7f829412c990 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8290009720 tx=0x7f829002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c0e1875f2c4c37 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:07.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f828bfff640 1 -- 172.21.15.22:0/2458029779 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82900316d0 con 0x7f829412c5b0 2024-05-07T13:59:07.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f828bfff640 1 -- 172.21.15.22:0/2458029779 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8290037070 con 0x7f829412c5b0 2024-05-07T13:59:07.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f828bfff640 1 -- 172.21.15.22:0/2458029779 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82900319c0 con 0x7f829412c5b0 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f829b9ed640 1 -- 172.21.15.22:0/2458029779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 msgr2=0x7f829412c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f829b9ed640 1 --2- 172.21.15.22:0/2458029779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 0x7f829412c990 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8290009720 tx=0x7f829002b840 comp rx=0 tx=0).stop 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f829b9ed640 1 -- 172.21.15.22:0/2458029779 shutdown_connections 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f829b9ed640 1 --2- 172.21.15.22:0/2458029779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 0x7f829412c990 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f829b9ed640 1 -- 172.21.15.22:0/2458029779 >> 172.21.15.22:0/2458029779 conn(0x7f8294099380 msgr2=0x7f8294099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f829b9ed640 1 -- 172.21.15.22:0/2458029779 shutdown_connections 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.144+0000 7f829b9ed640 1 -- 172.21.15.22:0/2458029779 wait complete. 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.145+0000 7f829b9ed640 1 Processor -- start 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.145+0000 7f829b9ed640 1 -- start start 2024-05-07T13:59:07.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f829b9ed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 0x7f8294121f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f829b9ed640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8294113b10 con 0x7f829412c5b0 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f8299789640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 0x7f8294121f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f8299789640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 0x7f8294121f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35432/0 (socket says 172.21.15.22:35432) 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f8299789640 1 -- 172.21.15.22:0/3848723386 learned_addr learned my addr 172.21.15.22:0/3848723386 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f8299789640 1 -- 172.21.15.22:0/3848723386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8294129140 con 0x7f829412c5b0 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f8299789640 1 --2- 172.21.15.22:0/3848723386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 0x7f8294121f30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8290009720 tx=0x7f82900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f8289ffb640 1 -- 172.21.15.22:0/3848723386 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8290032770 con 0x7f829412c5b0 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f8289ffb640 1 -- 172.21.15.22:0/3848723386 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8290032910 con 0x7f829412c5b0 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829412b440 con 0x7f829412c5b0 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f8289ffb640 1 -- 172.21.15.22:0/3848723386 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8290032bf0 con 0x7f829412c5b0 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.146+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8294115fe0 con 0x7f829412c5b0 2024-05-07T13:59:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.147+0000 7f8289ffb640 1 -- 172.21.15.22:0/3848723386 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f829004d3f0 con 0x7f829412c5b0 2024-05-07T13:59:07.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.147+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8294062e90 con 0x7f829412c5b0 2024-05-07T13:59:07.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.147+0000 7f8289ffb640 1 --2- 172.21.15.22:0/3848723386 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8278038060 0x7f827803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:07.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.147+0000 7f8289ffb640 1 -- 172.21.15.22:0/3848723386 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f829002f050 con 0x7f829412c5b0 2024-05-07T13:59:07.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.148+0000 7f8298f88640 1 --2- 172.21.15.22:0/3848723386 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8278038060 0x7f827803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:07.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.148+0000 7f8298f88640 1 --2- 172.21.15.22:0/3848723386 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8278038060 0x7f827803a520 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8284000c00 tx=0x7f8284007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:07.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.152+0000 7f8289ffb640 1 -- 172.21.15.22:0/3848723386 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8290040070 con 0x7f829412c5b0 2024-05-07T13:59:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.330+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8294115d90 con 0x7f8278038060 2024-05-07T13:59:07.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.346+0000 7f8289ffb640 1 -- 172.21.15.22:0/3848723386 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665926 (secure 0 0 0) 0x7f82840058d0 con 0x7f8278038060 2024-05-07T13:59:07.341 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:59:07.346 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8278038060 msgr2=0x7f827803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 --2- 172.21.15.22:0/3848723386 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8278038060 0x7f827803a520 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8284000c00 tx=0x7f8284007970 comp rx=0 tx=0).stop 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 msgr2=0x7f8294121f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 --2- 172.21.15.22:0/3848723386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 0x7f8294121f30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8290009720 tx=0x7f82900046c0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 shutdown_connections 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 --2- 172.21.15.22:0/3848723386 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8278038060 0x7f827803a520 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 --2- 172.21.15.22:0/3848723386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f829412c5b0 0x7f8294121f30 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 >> 172.21.15.22:0/3848723386 conn(0x7f8294099380 msgr2=0x7f82941b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 shutdown_connections 2024-05-07T13:59:07.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.350+0000 7f829b9ed640 1 -- 172.21.15.22:0/3848723386 wait complete. 2024-05-07T13:59:07.350 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-05-07T13:59:06.164628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416885,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4903,"num_read_kb":4480,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4478,"ondisk_log_size":4478,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177712,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309648,"statfs":{"total":386547056640,"available":386365079552,"internally_reserved":0,"allocated":37240832,"data_stored":36146218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":511,"num_read_kb":466,"num_write":388,"num_write_kb":29374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003777"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369379+0000","last_change":"2024-05-07T13:55:48.336201+0000","last_active":"2024-05-07T13:56:35.369379+0000","last_peered":"2024-05-07T13:56:35.369379+0000","last_clean":"2024-05-07T13:56:35.369379+0000","last_became_active":"2024-05-07T13:55:48.335740+0000","last_became_peered":"2024-05-07T13:55:48.335740+0000","last_unstale":"2024-05-07T13:56:35.369379+0000","last_undegraded":"2024-05-07T13:56:35.369379+0000","last_fullsized":"2024-05-07T13:56:35.369379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'13","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.510112+0000","last_change":"2024-05-07T13:55:50.316599+0000","last_active":"2024-05-07T13:58:59.510112+0000","last_peered":"2024-05-07T13:58:59.510112+0000","last_clean":"2024-05-07T13:58:59.510112+0000","last_became_active":"2024-05-07T13:55:50.316253+0000","last_became_peered":"2024-05-07T13:55:50.316253+0000","last_unstale":"2024-05-07T13:58:59.510112+0000","last_undegraded":"2024-05-07T13:58:59.510112+0000","last_fullsized":"2024-05-07T13:58:59.510112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:27.304492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.390309+0000","last_change":"2024-05-07T13:55:48.324242+0000","last_active":"2024-05-07T13:58:59.390309+0000","last_peered":"2024-05-07T13:58:59.390309+0000","last_clean":"2024-05-07T13:58:59.390309+0000","last_became_active":"2024-05-07T13:55:48.323151+0000","last_became_peered":"2024-05-07T13:55:48.323151+0000","last_unstale":"2024-05-07T13:58:59.390309+0000","last_undegraded":"2024-05-07T13:58:59.390309+0000","last_fullsized":"2024-05-07T13:58:59.390309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:18:09.959294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358436+0000","last_change":"2024-05-07T13:55:50.322812+0000","last_active":"2024-05-07T13:56:35.358436+0000","last_peered":"2024-05-07T13:56:35.358436+0000","last_clean":"2024-05-07T13:56:35.358436+0000","last_became_active":"2024-05-07T13:55:50.322066+0000","last_became_peered":"2024-05-07T13:55:50.322066+0000","last_unstale":"2024-05-07T13:56:35.358436+0000","last_undegraded":"2024-05-07T13:56:35.358436+0000","last_fullsized":"2024-05-07T13:56:35.358436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:40.527236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360959+0000","last_change":"2024-05-07T13:55:48.350450+0000","last_active":"2024-05-07T13:56:35.360959+0000","last_peered":"2024-05-07T13:56:35.360959+0000","last_clean":"2024-05-07T13:56:35.360959+0000","last_became_active":"2024-05-07T13:55:48.347661+0000","last_became_peered":"2024-05-07T13:55:48.347661+0000","last_unstale":"2024-05-07T13:56:35.360959+0000","last_undegraded":"2024-05-07T13:56:35.360959+0000","last_fullsized":"2024-05-07T13:56:35.360959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:43.418566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358314+0000","last_change":"2024-05-07T13:55:50.322032+0000","last_active":"2024-05-07T13:56:35.358314+0000","last_peered":"2024-05-07T13:56:35.358314+0000","last_clean":"2024-05-07T13:56:35.358314+0000","last_became_active":"2024-05-07T13:55:50.321598+0000","last_became_peered":"2024-05-07T13:55:50.321598+0000","last_unstale":"2024-05-07T13:56:35.358314+0000","last_undegraded":"2024-05-07T13:56:35.358314+0000","last_fullsized":"2024-05-07T13:56:35.358314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:59.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.697458+0000","last_change":"2024-05-07T13:55:48.337861+0000","last_active":"2024-05-07T13:57:58.697458+0000","last_peered":"2024-05-07T13:57:58.697458+0000","last_clean":"2024-05-07T13:57:58.697458+0000","last_became_active":"2024-05-07T13:55:48.337418+0000","last_became_peered":"2024-05-07T13:55:48.337418+0000","last_unstale":"2024-05-07T13:57:58.697458+0000","last_undegraded":"2024-05-07T13:57:58.697458+0000","last_fullsized":"2024-05-07T13:57:58.697458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'4","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.245251+0000","last_change":"2024-05-07T13:56:35.367287+0000","last_active":"2024-05-07T13:58:59.245251+0000","last_peered":"2024-05-07T13:58:59.245251+0000","last_clean":"2024-05-07T13:58:59.245251+0000","last_became_active":"2024-05-07T13:56:35.366947+0000","last_became_peered":"2024-05-07T13:56:35.366947+0000","last_unstale":"2024-05-07T13:58:59.245251+0000","last_undegraded":"2024-05-07T13:58:59.245251+0000","last_fullsized":"2024-05-07T13:58:59.245251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:38.628455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358752+0000","last_change":"2024-05-07T13:55:48.349880+0000","last_active":"2024-05-07T13:56:35.358752+0000","last_peered":"2024-05-07T13:56:35.358752+0000","last_clean":"2024-05-07T13:56:35.358752+0000","last_became_active":"2024-05-07T13:55:48.347714+0000","last_became_peered":"2024-05-07T13:55:48.347714+0000","last_unstale":"2024-05-07T13:56:35.358752+0000","last_undegraded":"2024-05-07T13:56:35.358752+0000","last_fullsized":"2024-05-07T13:56:35.358752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:35.715822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'8","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364637+0000","last_change":"2024-05-07T13:55:50.314953+0000","last_active":"2024-05-07T13:56:35.364637+0000","last_peered":"2024-05-07T13:56:35.364637+0000","last_clean":"2024-05-07T13:56:35.364637+0000","last_became_active":"2024-05-07T13:55:50.314660+0000","last_became_peered":"2024-05-07T13:55:50.314660+0000","last_unstale":"2024-05-07T13:56:35.364637+0000","last_undegraded":"2024-05-07T13:56:35.364637+0000","last_fullsized":"2024-05-07T13:56:35.364637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:05.386488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359638+0000","last_change":"2024-05-07T13:55:48.338607+0000","last_active":"2024-05-07T13:56:35.359638+0000","last_peered":"2024-05-07T13:56:35.359638+0000","last_clean":"2024-05-07T13:56:35.359638+0000","last_became_active":"2024-05-07T13:55:48.337256+0000","last_became_peered":"2024-05-07T13:55:48.337256+0000","last_unstale":"2024-05-07T13:56:35.359638+0000","last_undegraded":"2024-05-07T13:56:35.359638+0000","last_fullsized":"2024-05-07T13:56:35.359638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:43.039363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502905+0000","last_change":"2024-05-07T13:55:50.322605+0000","last_active":"2024-05-07T13:58:59.502905+0000","last_peered":"2024-05-07T13:58:59.502905+0000","last_clean":"2024-05-07T13:58:59.502905+0000","last_became_active":"2024-05-07T13:55:50.322204+0000","last_became_peered":"2024-05-07T13:55:50.322204+0000","last_unstale":"2024-05-07T13:58:59.502905+0000","last_undegraded":"2024-05-07T13:58:59.502905+0000","last_fullsized":"2024-05-07T13:58:59.502905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:49.695086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357314+0000","last_change":"2024-05-07T13:55:48.348111+0000","last_active":"2024-05-07T13:56:35.357314+0000","last_peered":"2024-05-07T13:56:35.357314+0000","last_clean":"2024-05-07T13:56:35.357314+0000","last_became_active":"2024-05-07T13:55:48.347006+0000","last_became_peered":"2024-05-07T13:55:48.347006+0000","last_unstale":"2024-05-07T13:56:35.357314+0000","last_undegraded":"2024-05-07T13:56:35.357314+0000","last_fullsized":"2024-05-07T13:56:35.357314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:03:02.570573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.739053+0000","last_change":"2024-05-07T13:55:50.313130+0000","last_active":"2024-05-07T13:57:14.739053+0000","last_peered":"2024-05-07T13:57:14.739053+0000","last_clean":"2024-05-07T13:57:14.739053+0000","last_became_active":"2024-05-07T13:55:50.312835+0000","last_became_peered":"2024-05-07T13:55:50.312835+0000","last_unstale":"2024-05-07T13:57:14.739053+0000","last_undegraded":"2024-05-07T13:57:14.739053+0000","last_fullsized":"2024-05-07T13:57:14.739053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358691+0000","last_change":"2024-05-07T13:55:48.325646+0000","last_active":"2024-05-07T13:56:35.358691+0000","last_peered":"2024-05-07T13:56:35.358691+0000","last_clean":"2024-05-07T13:56:35.358691+0000","last_became_active":"2024-05-07T13:55:48.323612+0000","last_became_peered":"2024-05-07T13:55:48.323612+0000","last_unstale":"2024-05-07T13:56:35.358691+0000","last_undegraded":"2024-05-07T13:56:35.358691+0000","last_fullsized":"2024-05-07T13:56:35.358691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.140533+0000","last_change":"2024-05-07T13:55:50.325361+0000","last_active":"2024-05-07T13:58:59.140533+0000","last_peered":"2024-05-07T13:58:59.140533+0000","last_clean":"2024-05-07T13:58:59.140533+0000","last_became_active":"2024-05-07T13:55:50.325055+0000","last_became_peered":"2024-05-07T13:55:50.325055+0000","last_unstale":"2024-05-07T13:58:59.140533+0000","last_undegraded":"2024-05-07T13:58:59.140533+0000","last_fullsized":"2024-05-07T13:58:59.140533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'22","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502985+0000","last_change":"2024-05-07T13:55:50.321695+0000","last_active":"2024-05-07T13:58:59.502985+0000","last_peered":"2024-05-07T13:58:59.502985+0000","last_clean":"2024-05-07T13:58:59.502985+0000","last_became_active":"2024-05-07T13:55:50.321385+0000","last_became_peered":"2024-05-07T13:55:50.321385+0000","last_unstale":"2024-05-07T13:58:59.502985+0000","last_undegraded":"2024-05-07T13:58:59.502985+0000","last_fullsized":"2024-05-07T13:58:59.502985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:35.440672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366609+0000","last_change":"2024-05-07T13:55:48.335649+0000","last_active":"2024-05-07T13:56:35.366609+0000","last_peered":"2024-05-07T13:56:35.366609+0000","last_clean":"2024-05-07T13:56:35.366609+0000","last_became_active":"2024-05-07T13:55:48.335213+0000","last_became_peered":"2024-05-07T13:55:48.335213+0000","last_unstale":"2024-05-07T13:56:35.366609+0000","last_undegraded":"2024-05-07T13:56:35.366609+0000","last_fullsized":"2024-05-07T13:56:35.366609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'15","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415641+0000","last_change":"2024-05-07T13:55:50.313758+0000","last_active":"2024-05-07T13:58:59.415641+0000","last_peered":"2024-05-07T13:58:59.415641+0000","last_clean":"2024-05-07T13:58:59.415641+0000","last_became_active":"2024-05-07T13:55:50.313457+0000","last_became_peered":"2024-05-07T13:55:50.313457+0000","last_unstale":"2024-05-07T13:58:59.415641+0000","last_undegraded":"2024-05-07T13:58:59.415641+0000","last_fullsized":"2024-05-07T13:58:59.415641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370399+0000","last_change":"2024-05-07T13:55:48.341129+0000","last_active":"2024-05-07T13:56:35.370399+0000","last_peered":"2024-05-07T13:56:35.370399+0000","last_clean":"2024-05-07T13:56:35.370399+0000","last_became_active":"2024-05-07T13:55:48.340516+0000","last_became_peered":"2024-05-07T13:55:48.340516+0000","last_unstale":"2024-05-07T13:56:35.370399+0000","last_undegraded":"2024-05-07T13:56:35.370399+0000","last_fullsized":"2024-05-07T13:56:35.370399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.503272+0000","last_change":"2024-05-07T13:55:50.313924+0000","last_active":"2024-05-07T13:58:59.503272+0000","last_peered":"2024-05-07T13:58:59.503272+0000","last_clean":"2024-05-07T13:58:59.503272+0000","last_became_active":"2024-05-07T13:55:50.313442+0000","last_became_peered":"2024-05-07T13:55:50.313442+0000","last_unstale":"2024-05-07T13:58:59.503272+0000","last_undegraded":"2024-05-07T13:58:59.503272+0000","last_fullsized":"2024-05-07T13:58:59.503272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:52.088546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.632765+0000","last_change":"2024-05-07T13:55:48.339008+0000","last_active":"2024-05-07T13:57:58.632765+0000","last_peered":"2024-05-07T13:57:58.632765+0000","last_clean":"2024-05-07T13:57:58.632765+0000","last_became_active":"2024-05-07T13:55:48.338589+0000","last_became_peered":"2024-05-07T13:55:48.338589+0000","last_unstale":"2024-05-07T13:57:58.632765+0000","last_undegraded":"2024-05-07T13:57:58.632765+0000","last_fullsized":"2024-05-07T13:57:58.632765+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'7","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149687+0000","last_change":"2024-05-07T13:55:50.328784+0000","last_active":"2024-05-07T13:58:59.149687+0000","last_peered":"2024-05-07T13:58:59.149687+0000","last_clean":"2024-05-07T13:58:59.149687+0000","last_became_active":"2024-05-07T13:55:50.328471+0000","last_became_peered":"2024-05-07T13:55:50.328471+0000","last_unstale":"2024-05-07T13:58:59.149687+0000","last_undegraded":"2024-05-07T13:58:59.149687+0000","last_fullsized":"2024-05-07T13:58:59.149687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363639+0000","last_change":"2024-05-07T13:55:48.340701+0000","last_active":"2024-05-07T13:56:35.363639+0000","last_peered":"2024-05-07T13:56:35.363639+0000","last_clean":"2024-05-07T13:56:35.363639+0000","last_became_active":"2024-05-07T13:55:48.340284+0000","last_became_peered":"2024-05-07T13:55:48.340284+0000","last_unstale":"2024-05-07T13:56:35.363639+0000","last_undegraded":"2024-05-07T13:56:35.363639+0000","last_fullsized":"2024-05-07T13:56:35.363639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:03:37.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509996+0000","last_change":"2024-05-07T13:55:50.322836+0000","last_active":"2024-05-07T13:58:59.509996+0000","last_peered":"2024-05-07T13:58:59.509996+0000","last_clean":"2024-05-07T13:58:59.509996+0000","last_became_active":"2024-05-07T13:55:50.322513+0000","last_became_peered":"2024-05-07T13:55:50.322513+0000","last_unstale":"2024-05-07T13:58:59.509996+0000","last_undegraded":"2024-05-07T13:58:59.509996+0000","last_fullsized":"2024-05-07T13:58:59.509996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:05.386488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359883+0000","last_change":"2024-05-07T13:55:48.326455+0000","last_active":"2024-05-07T13:56:35.359883+0000","last_peered":"2024-05-07T13:56:35.359883+0000","last_clean":"2024-05-07T13:56:35.359883+0000","last_became_active":"2024-05-07T13:55:48.325321+0000","last_became_peered":"2024-05-07T13:55:48.325321+0000","last_unstale":"2024-05-07T13:56:35.359883+0000","last_undegraded":"2024-05-07T13:56:35.359883+0000","last_fullsized":"2024-05-07T13:56:35.359883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471610+0000","last_change":"2024-05-07T13:55:50.322751+0000","last_active":"2024-05-07T13:58:59.471610+0000","last_peered":"2024-05-07T13:58:59.471610+0000","last_clean":"2024-05-07T13:58:59.471610+0000","last_became_active":"2024-05-07T13:55:50.322476+0000","last_became_peered":"2024-05-07T13:55:50.322476+0000","last_unstale":"2024-05-07T13:58:59.471610+0000","last_undegraded":"2024-05-07T13:58:59.471610+0000","last_fullsized":"2024-05-07T13:58:59.471610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:06.112406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357654+0000","last_change":"2024-05-07T13:55:48.351155+0000","last_active":"2024-05-07T13:56:35.357654+0000","last_peered":"2024-05-07T13:56:35.357654+0000","last_clean":"2024-05-07T13:56:35.357654+0000","last_became_active":"2024-05-07T13:55:48.348714+0000","last_became_peered":"2024-05-07T13:55:48.348714+0000","last_unstale":"2024-05-07T13:56:35.357654+0000","last_undegraded":"2024-05-07T13:56:35.357654+0000","last_fullsized":"2024-05-07T13:56:35.357654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:56.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'37","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.441141+0000","last_change":"2024-05-07T13:55:58.348302+0000","last_active":"2024-05-07T13:58:59.441141+0000","last_peered":"2024-05-07T13:58:59.441141+0000","last_clean":"2024-05-07T13:58:59.441141+0000","last_became_active":"2024-05-07T13:55:58.347993+0000","last_became_peered":"2024-05-07T13:55:58.347993+0000","last_unstale":"2024-05-07T13:58:59.441141+0000","last_undegraded":"2024-05-07T13:58:59.441141+0000","last_fullsized":"2024-05-07T13:58:59.441141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:48:53.516894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358863+0000","last_change":"2024-05-07T13:55:50.323646+0000","last_active":"2024-05-07T13:56:35.358863+0000","last_peered":"2024-05-07T13:56:35.358863+0000","last_clean":"2024-05-07T13:56:35.358863+0000","last_became_active":"2024-05-07T13:55:50.323355+0000","last_became_peered":"2024-05-07T13:55:50.323355+0000","last_unstale":"2024-05-07T13:56:35.358863+0000","last_undegraded":"2024-05-07T13:56:35.358863+0000","last_fullsized":"2024-05-07T13:56:35.358863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:08.563941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.403334+0000","last_change":"2024-05-07T13:55:48.352275+0000","last_active":"2024-05-07T13:58:59.403334+0000","last_peered":"2024-05-07T13:58:59.403334+0000","last_clean":"2024-05-07T13:58:59.403334+0000","last_became_active":"2024-05-07T13:55:48.350161+0000","last_became_peered":"2024-05-07T13:55:48.350161+0000","last_unstale":"2024-05-07T13:58:59.403334+0000","last_undegraded":"2024-05-07T13:58:59.403334+0000","last_fullsized":"2024-05-07T13:58:59.403334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:28.942263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359868+0000","last_change":"2024-05-07T13:55:52.319295+0000","last_active":"2024-05-07T13:56:35.359868+0000","last_peered":"2024-05-07T13:56:35.359868+0000","last_clean":"2024-05-07T13:56:35.359868+0000","last_became_active":"2024-05-07T13:55:52.318966+0000","last_became_peered":"2024-05-07T13:55:52.318966+0000","last_unstale":"2024-05-07T13:56:35.359868+0000","last_undegraded":"2024-05-07T13:56:35.359868+0000","last_fullsized":"2024-05-07T13:56:35.359868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:08:48.912920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.155499+0000","last_change":"2024-05-07T13:55:54.332167+0000","last_active":"2024-05-07T13:57:57.155499+0000","last_peered":"2024-05-07T13:57:57.155499+0000","last_clean":"2024-05-07T13:57:57.155499+0000","last_became_active":"2024-05-07T13:55:54.331835+0000","last_became_peered":"2024-05-07T13:55:54.331835+0000","last_unstale":"2024-05-07T13:57:57.155499+0000","last_undegraded":"2024-05-07T13:57:57.155499+0000","last_fullsized":"2024-05-07T13:57:57.155499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:49:52.843419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366444+0000","last_change":"2024-05-07T13:55:56.338931+0000","last_active":"2024-05-07T13:56:35.366444+0000","last_peered":"2024-05-07T13:56:35.366444+0000","last_clean":"2024-05-07T13:56:35.366444+0000","last_became_active":"2024-05-07T13:55:56.338638+0000","last_became_peered":"2024-05-07T13:55:56.338638+0000","last_unstale":"2024-05-07T13:56:35.366444+0000","last_undegraded":"2024-05-07T13:56:35.366444+0000","last_fullsized":"2024-05-07T13:56:35.366444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:50.175136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'13","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.744345+0000","last_change":"2024-05-07T13:55:58.348663+0000","last_active":"2024-05-07T13:57:14.744345+0000","last_peered":"2024-05-07T13:57:14.744345+0000","last_clean":"2024-05-07T13:57:14.744345+0000","last_became_active":"2024-05-07T13:55:58.348341+0000","last_became_peered":"2024-05-07T13:55:58.348341+0000","last_unstale":"2024-05-07T13:57:14.744345+0000","last_undegraded":"2024-05-07T13:57:14.744345+0000","last_fullsized":"2024-05-07T13:57:14.744345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:46.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360493+0000","last_change":"2024-05-07T13:55:50.325607+0000","last_active":"2024-05-07T13:56:35.360493+0000","last_peered":"2024-05-07T13:56:35.360493+0000","last_clean":"2024-05-07T13:56:35.360493+0000","last_became_active":"2024-05-07T13:55:50.325201+0000","last_became_peered":"2024-05-07T13:55:50.325201+0000","last_unstale":"2024-05-07T13:56:35.360493+0000","last_undegraded":"2024-05-07T13:56:35.360493+0000","last_fullsized":"2024-05-07T13:56:35.360493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:39.839247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359294+0000","last_change":"2024-05-07T13:55:48.339081+0000","last_active":"2024-05-07T13:56:35.359294+0000","last_peered":"2024-05-07T13:56:35.359294+0000","last_clean":"2024-05-07T13:56:35.359294+0000","last_became_active":"2024-05-07T13:55:48.338704+0000","last_became_peered":"2024-05-07T13:55:48.338704+0000","last_unstale":"2024-05-07T13:56:35.359294+0000","last_undegraded":"2024-05-07T13:56:35.359294+0000","last_fullsized":"2024-05-07T13:56:35.359294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:02:32.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.167968+0000","last_change":"2024-05-07T13:56:35.362029+0000","last_active":"2024-05-07T13:56:38.167968+0000","last_peered":"2024-05-07T13:56:38.167968+0000","last_clean":"2024-05-07T13:56:38.167968+0000","last_became_active":"2024-05-07T13:56:35.361623+0000","last_became_peered":"2024-05-07T13:56:35.361623+0000","last_unstale":"2024-05-07T13:56:38.167968+0000","last_undegraded":"2024-05-07T13:56:38.167968+0000","last_fullsized":"2024-05-07T13:56:38.167968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:19.312383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"27'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.365053+0000","last_change":"2024-05-07T13:55:54.333882+0000","last_active":"2024-05-07T13:56:35.365053+0000","last_peered":"2024-05-07T13:56:35.365053+0000","last_clean":"2024-05-07T13:56:35.365053+0000","last_became_active":"2024-05-07T13:55:54.333402+0000","last_became_peered":"2024-05-07T13:55:54.333402+0000","last_unstale":"2024-05-07T13:56:35.365053+0000","last_undegraded":"2024-05-07T13:56:35.365053+0000","last_fullsized":"2024-05-07T13:56:35.365053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:39.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364824+0000","last_change":"2024-05-07T13:55:56.335951+0000","last_active":"2024-05-07T13:56:35.364824+0000","last_peered":"2024-05-07T13:56:35.364824+0000","last_clean":"2024-05-07T13:56:35.364824+0000","last_became_active":"2024-05-07T13:55:56.335463+0000","last_became_peered":"2024-05-07T13:55:56.335463+0000","last_unstale":"2024-05-07T13:56:35.364824+0000","last_undegraded":"2024-05-07T13:56:35.364824+0000","last_fullsized":"2024-05-07T13:56:35.364824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:46.396698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358195+0000","last_change":"2024-05-07T13:55:58.341190+0000","last_active":"2024-05-07T13:56:35.358195+0000","last_peered":"2024-05-07T13:56:35.358195+0000","last_clean":"2024-05-07T13:56:35.358195+0000","last_became_active":"2024-05-07T13:55:58.340688+0000","last_became_peered":"2024-05-07T13:55:58.340688+0000","last_unstale":"2024-05-07T13:56:35.358195+0000","last_undegraded":"2024-05-07T13:56:35.358195+0000","last_fullsized":"2024-05-07T13:56:35.358195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:49:27.158233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509454+0000","last_change":"2024-05-07T13:55:50.324646+0000","last_active":"2024-05-07T13:58:59.509454+0000","last_peered":"2024-05-07T13:58:59.509454+0000","last_clean":"2024-05-07T13:58:59.509454+0000","last_became_active":"2024-05-07T13:55:50.323775+0000","last_became_peered":"2024-05-07T13:55:50.323775+0000","last_unstale":"2024-05-07T13:58:59.509454+0000","last_undegraded":"2024-05-07T13:58:59.509454+0000","last_fullsized":"2024-05-07T13:58:59.509454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:07:56.445202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.393425+0000","last_change":"2024-05-07T13:55:48.350102+0000","last_active":"2024-05-07T13:58:59.393425+0000","last_peered":"2024-05-07T13:58:59.393425+0000","last_clean":"2024-05-07T13:58:59.393425+0000","last_became_active":"2024-05-07T13:55:48.349636+0000","last_became_peered":"2024-05-07T13:55:48.349636+0000","last_unstale":"2024-05-07T13:58:59.393425+0000","last_undegraded":"2024-05-07T13:58:59.393425+0000","last_fullsized":"2024-05-07T13:58:59.393425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:58.430354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.171913+0000","last_change":"2024-05-07T13:56:35.370451+0000","last_active":"2024-05-07T13:56:38.171913+0000","last_peered":"2024-05-07T13:56:38.171913+0000","last_clean":"2024-05-07T13:56:38.171913+0000","last_became_active":"2024-05-07T13:56:35.370109+0000","last_became_peered":"2024-05-07T13:56:35.370109+0000","last_unstale":"2024-05-07T13:56:38.171913+0000","last_undegraded":"2024-05-07T13:56:38.171913+0000","last_fullsized":"2024-05-07T13:56:38.171913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:20.523325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366990+0000","last_change":"2024-05-07T13:55:54.327564+0000","last_active":"2024-05-07T13:56:35.366990+0000","last_peered":"2024-05-07T13:56:35.366990+0000","last_clean":"2024-05-07T13:56:35.366990+0000","last_became_active":"2024-05-07T13:55:54.327178+0000","last_became_peered":"2024-05-07T13:55:54.327178+0000","last_unstale":"2024-05-07T13:56:35.366990+0000","last_undegraded":"2024-05-07T13:56:35.366990+0000","last_fullsized":"2024-05-07T13:56:35.366990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:53.709163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":390,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405101+0000","last_change":"2024-05-07T13:55:56.347848+0000","last_active":"2024-05-07T13:58:57.405101+0000","last_peered":"2024-05-07T13:58:57.405101+0000","last_clean":"2024-05-07T13:58:57.405101+0000","last_became_active":"2024-05-07T13:55:56.345712+0000","last_became_peered":"2024-05-07T13:55:56.345712+0000","last_unstale":"2024-05-07T13:58:57.405101+0000","last_undegraded":"2024-05-07T13:58:57.405101+0000","last_fullsized":"2024-05-07T13:58:57.405101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:18:51.323865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358426+0000","last_change":"2024-05-07T13:55:58.340114+0000","last_active":"2024-05-07T13:56:35.358426+0000","last_peered":"2024-05-07T13:56:35.358426+0000","last_clean":"2024-05-07T13:56:35.358426+0000","last_became_active":"2024-05-07T13:55:58.339825+0000","last_became_peered":"2024-05-07T13:55:58.339825+0000","last_unstale":"2024-05-07T13:56:35.358426+0000","last_undegraded":"2024-05-07T13:56:35.358426+0000","last_fullsized":"2024-05-07T13:56:35.358426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.742507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361998+0000","last_change":"2024-05-07T13:55:50.319097+0000","last_active":"2024-05-07T13:56:35.361998+0000","last_peered":"2024-05-07T13:56:35.361998+0000","last_clean":"2024-05-07T13:56:35.361998+0000","last_became_active":"2024-05-07T13:55:50.318502+0000","last_became_peered":"2024-05-07T13:55:50.318502+0000","last_unstale":"2024-05-07T13:56:35.361998+0000","last_undegraded":"2024-05-07T13:56:35.361998+0000","last_fullsized":"2024-05-07T13:56:35.361998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:27.304492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360217+0000","last_change":"2024-05-07T13:55:48.345523+0000","last_active":"2024-05-07T13:56:35.360217+0000","last_peered":"2024-05-07T13:56:35.360217+0000","last_clean":"2024-05-07T13:56:35.360217+0000","last_became_active":"2024-05-07T13:55:48.345080+0000","last_became_peered":"2024-05-07T13:55:48.345080+0000","last_unstale":"2024-05-07T13:56:35.360217+0000","last_undegraded":"2024-05-07T13:56:35.360217+0000","last_fullsized":"2024-05-07T13:56:35.360217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:40:38.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360412+0000","last_change":"2024-05-07T13:55:52.318507+0000","last_active":"2024-05-07T13:56:35.360412+0000","last_peered":"2024-05-07T13:56:35.360412+0000","last_clean":"2024-05-07T13:56:35.360412+0000","last_became_active":"2024-05-07T13:55:52.318178+0000","last_became_peered":"2024-05-07T13:55:52.318178+0000","last_unstale":"2024-05-07T13:56:35.360412+0000","last_undegraded":"2024-05-07T13:56:35.360412+0000","last_fullsized":"2024-05-07T13:56:35.360412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:00.831525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.185340+0000","last_change":"2024-05-07T13:55:54.330944+0000","last_active":"2024-05-07T13:58:23.185340+0000","last_peered":"2024-05-07T13:58:23.185340+0000","last_clean":"2024-05-07T13:58:23.185340+0000","last_became_active":"2024-05-07T13:55:54.330662+0000","last_became_peered":"2024-05-07T13:55:54.330662+0000","last_unstale":"2024-05-07T13:58:23.185340+0000","last_undegraded":"2024-05-07T13:58:23.185340+0000","last_fullsized":"2024-05-07T13:58:23.185340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:12.578018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.506255+0000","last_change":"2024-05-07T13:55:56.334463+0000","last_active":"2024-05-07T13:58:59.506255+0000","last_peered":"2024-05-07T13:58:59.506255+0000","last_clean":"2024-05-07T13:58:59.506255+0000","last_became_active":"2024-05-07T13:55:56.334111+0000","last_became_peered":"2024-05-07T13:55:56.334111+0000","last_unstale":"2024-05-07T13:58:59.506255+0000","last_undegraded":"2024-05-07T13:58:59.506255+0000","last_fullsized":"2024-05-07T13:58:59.506255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:37:50.578504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'11","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477925+0000","last_change":"2024-05-07T13:55:50.325659+0000","last_active":"2024-05-07T13:58:59.477925+0000","last_peered":"2024-05-07T13:58:59.477925+0000","last_clean":"2024-05-07T13:58:59.477925+0000","last_became_active":"2024-05-07T13:55:50.324820+0000","last_became_peered":"2024-05-07T13:55:50.324820+0000","last_unstale":"2024-05-07T13:58:59.477925+0000","last_undegraded":"2024-05-07T13:58:59.477925+0000","last_fullsized":"2024-05-07T13:58:59.477925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:06.283557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369244+0000","last_change":"2024-05-07T13:55:48.335906+0000","last_active":"2024-05-07T13:56:35.369244+0000","last_peered":"2024-05-07T13:56:35.369244+0000","last_clean":"2024-05-07T13:56:35.369244+0000","last_became_active":"2024-05-07T13:55:48.335443+0000","last_became_peered":"2024-05-07T13:55:48.335443+0000","last_unstale":"2024-05-07T13:56:35.369244+0000","last_undegraded":"2024-05-07T13:56:35.369244+0000","last_fullsized":"2024-05-07T13:56:35.369244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361209+0000","last_change":"2024-05-07T13:55:52.322554+0000","last_active":"2024-05-07T13:56:35.361209+0000","last_peered":"2024-05-07T13:56:35.361209+0000","last_clean":"2024-05-07T13:56:35.361209+0000","last_became_active":"2024-05-07T13:55:52.322188+0000","last_became_peered":"2024-05-07T13:55:52.322188+0000","last_unstale":"2024-05-07T13:56:35.361209+0000","last_undegraded":"2024-05-07T13:56:35.361209+0000","last_fullsized":"2024-05-07T13:56:35.361209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:10.020335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.159540+0000","last_change":"2024-05-07T13:55:54.330742+0000","last_active":"2024-05-07T13:57:57.159540+0000","last_peered":"2024-05-07T13:57:57.159540+0000","last_clean":"2024-05-07T13:57:57.159540+0000","last_became_active":"2024-05-07T13:55:54.330401+0000","last_became_peered":"2024-05-07T13:55:54.330401+0000","last_unstale":"2024-05-07T13:57:57.159540+0000","last_undegraded":"2024-05-07T13:57:57.159540+0000","last_fullsized":"2024-05-07T13:57:57.159540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:16.443532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359580+0000","last_change":"2024-05-07T13:55:56.334861+0000","last_active":"2024-05-07T13:56:35.359580+0000","last_peered":"2024-05-07T13:56:35.359580+0000","last_clean":"2024-05-07T13:56:35.359580+0000","last_became_active":"2024-05-07T13:55:56.334368+0000","last_became_peered":"2024-05-07T13:55:56.334368+0000","last_unstale":"2024-05-07T13:56:35.359580+0000","last_undegraded":"2024-05-07T13:56:35.359580+0000","last_fullsized":"2024-05-07T13:56:35.359580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:57.692076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.746003+0000","last_change":"2024-05-07T13:55:58.346747+0000","last_active":"2024-05-07T13:57:14.746003+0000","last_peered":"2024-05-07T13:57:14.746003+0000","last_clean":"2024-05-07T13:57:14.746003+0000","last_became_active":"2024-05-07T13:55:58.346457+0000","last_became_peered":"2024-05-07T13:55:58.346457+0000","last_unstale":"2024-05-07T13:57:14.746003+0000","last_undegraded":"2024-05-07T13:57:14.746003+0000","last_fullsized":"2024-05-07T13:57:14.746003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:02:07.921627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723506+0000","last_change":"2024-05-07T13:55:50.312874+0000","last_active":"2024-05-07T13:57:58.723506+0000","last_peered":"2024-05-07T13:57:58.723506+0000","last_clean":"2024-05-07T13:57:58.723506+0000","last_became_active":"2024-05-07T13:55:50.312564+0000","last_became_peered":"2024-05-07T13:55:50.312564+0000","last_unstale":"2024-05-07T13:57:58.723506+0000","last_undegraded":"2024-05-07T13:57:58.723506+0000","last_fullsized":"2024-05-07T13:57:58.723506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369832+0000","last_change":"2024-05-07T13:55:48.336211+0000","last_active":"2024-05-07T13:56:35.369832+0000","last_peered":"2024-05-07T13:56:35.369832+0000","last_clean":"2024-05-07T13:56:35.369832+0000","last_became_active":"2024-05-07T13:55:48.335791+0000","last_became_peered":"2024-05-07T13:55:48.335791+0000","last_unstale":"2024-05-07T13:56:35.369832+0000","last_undegraded":"2024-05-07T13:56:35.369832+0000","last_fullsized":"2024-05-07T13:56:35.369832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358813+0000","last_change":"2024-05-07T13:55:52.326024+0000","last_active":"2024-05-07T13:56:35.358813+0000","last_peered":"2024-05-07T13:56:35.358813+0000","last_clean":"2024-05-07T13:56:35.358813+0000","last_became_active":"2024-05-07T13:55:52.325676+0000","last_became_peered":"2024-05-07T13:55:52.325676+0000","last_unstale":"2024-05-07T13:56:35.358813+0000","last_undegraded":"2024-05-07T13:56:35.358813+0000","last_fullsized":"2024-05-07T13:56:35.358813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:11.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'33","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.139118+0000","last_change":"2024-05-07T13:55:54.332289+0000","last_active":"2024-05-07T13:57:57.139118+0000","last_peered":"2024-05-07T13:57:57.139118+0000","last_clean":"2024-05-07T13:57:57.139118+0000","last_became_active":"2024-05-07T13:55:54.331979+0000","last_became_peered":"2024-05-07T13:55:54.331979+0000","last_unstale":"2024-05-07T13:57:57.139118+0000","last_undegraded":"2024-05-07T13:57:57.139118+0000","last_fullsized":"2024-05-07T13:57:57.139118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:00:56.934082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359423+0000","last_change":"2024-05-07T13:55:56.333704+0000","last_active":"2024-05-07T13:56:35.359423+0000","last_peered":"2024-05-07T13:56:35.359423+0000","last_clean":"2024-05-07T13:56:35.359423+0000","last_became_active":"2024-05-07T13:55:56.333357+0000","last_became_peered":"2024-05-07T13:55:56.333357+0000","last_unstale":"2024-05-07T13:56:35.359423+0000","last_undegraded":"2024-05-07T13:56:35.359423+0000","last_fullsized":"2024-05-07T13:56:35.359423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:08:52.926954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:09.129804+0000","last_change":"2024-05-07T13:55:58.345252+0000","last_active":"2024-05-07T13:57:09.129804+0000","last_peered":"2024-05-07T13:57:09.129804+0000","last_clean":"2024-05-07T13:57:09.129804+0000","last_became_active":"2024-05-07T13:55:58.344955+0000","last_became_peered":"2024-05-07T13:55:58.344955+0000","last_unstale":"2024-05-07T13:57:09.129804+0000","last_undegraded":"2024-05-07T13:57:09.129804+0000","last_fullsized":"2024-05-07T13:57:09.129804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:24.188610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.252302+0000","last_change":"2024-05-07T13:55:50.327717+0000","last_active":"2024-05-07T13:58:59.252302+0000","last_peered":"2024-05-07T13:58:59.252302+0000","last_clean":"2024-05-07T13:58:59.252302+0000","last_became_active":"2024-05-07T13:55:50.327059+0000","last_became_peered":"2024-05-07T13:55:50.327059+0000","last_unstale":"2024-05-07T13:58:59.252302+0000","last_undegraded":"2024-05-07T13:58:59.252302+0000","last_fullsized":"2024-05-07T13:58:59.252302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:49.671647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360718+0000","last_change":"2024-05-07T13:55:48.350939+0000","last_active":"2024-05-07T13:56:35.360718+0000","last_peered":"2024-05-07T13:56:35.360718+0000","last_clean":"2024-05-07T13:56:35.360718+0000","last_became_active":"2024-05-07T13:55:48.350442+0000","last_became_peered":"2024-05-07T13:55:48.350442+0000","last_unstale":"2024-05-07T13:56:35.360718+0000","last_undegraded":"2024-05-07T13:56:35.360718+0000","last_fullsized":"2024-05-07T13:56:35.360718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:13.461398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359027+0000","last_change":"2024-05-07T13:55:52.321998+0000","last_active":"2024-05-07T13:56:35.359027+0000","last_peered":"2024-05-07T13:56:35.359027+0000","last_clean":"2024-05-07T13:56:35.359027+0000","last_became_active":"2024-05-07T13:55:52.321674+0000","last_became_peered":"2024-05-07T13:55:52.321674+0000","last_unstale":"2024-05-07T13:56:35.359027+0000","last_undegraded":"2024-05-07T13:56:35.359027+0000","last_fullsized":"2024-05-07T13:56:35.359027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:09.668336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.161433+0000","last_change":"2024-05-07T13:55:54.325770+0000","last_active":"2024-05-07T13:57:57.161433+0000","last_peered":"2024-05-07T13:57:57.161433+0000","last_clean":"2024-05-07T13:57:57.161433+0000","last_became_active":"2024-05-07T13:55:54.325336+0000","last_became_peered":"2024-05-07T13:55:54.325336+0000","last_unstale":"2024-05-07T13:57:57.161433+0000","last_undegraded":"2024-05-07T13:57:57.161433+0000","last_fullsized":"2024-05-07T13:57:57.161433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:56:55.004347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":354,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.676575+0000","last_change":"2024-05-07T13:55:56.335209+0000","last_active":"2024-05-07T13:58:59.676575+0000","last_peered":"2024-05-07T13:58:59.676575+0000","last_clean":"2024-05-07T13:58:59.676575+0000","last_became_active":"2024-05-07T13:55:56.334895+0000","last_became_peered":"2024-05-07T13:55:56.334895+0000","last_unstale":"2024-05-07T13:58:59.676575+0000","last_undegraded":"2024-05-07T13:58:59.676575+0000","last_fullsized":"2024-05-07T13:58:59.676575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:42.722681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.928109+0000","last_change":"2024-05-07T13:55:58.341127+0000","last_active":"2024-05-07T13:57:14.928109+0000","last_peered":"2024-05-07T13:57:14.928109+0000","last_clean":"2024-05-07T13:57:14.928109+0000","last_became_active":"2024-05-07T13:55:58.340764+0000","last_became_peered":"2024-05-07T13:55:58.340764+0000","last_unstale":"2024-05-07T13:57:14.928109+0000","last_undegraded":"2024-05-07T13:57:14.928109+0000","last_fullsized":"2024-05-07T13:57:14.928109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:56:59.018427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.591694+0000","last_change":"2024-05-07T13:55:50.313309+0000","last_active":"2024-05-07T13:58:59.591694+0000","last_peered":"2024-05-07T13:58:59.591694+0000","last_clean":"2024-05-07T13:58:59.591694+0000","last_became_active":"2024-05-07T13:55:50.312649+0000","last_became_peered":"2024-05-07T13:55:50.312649+0000","last_unstale":"2024-05-07T13:58:59.591694+0000","last_undegraded":"2024-05-07T13:58:59.591694+0000","last_fullsized":"2024-05-07T13:58:59.591694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:05.135442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358043+0000","last_change":"2024-05-07T13:55:48.347430+0000","last_active":"2024-05-07T13:56:35.358043+0000","last_peered":"2024-05-07T13:56:35.358043+0000","last_clean":"2024-05-07T13:56:35.358043+0000","last_became_active":"2024-05-07T13:55:48.346027+0000","last_became_peered":"2024-05-07T13:55:48.346027+0000","last_unstale":"2024-05-07T13:56:35.358043+0000","last_undegraded":"2024-05-07T13:56:35.358043+0000","last_fullsized":"2024-05-07T13:56:35.358043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:17.757284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359224+0000","last_change":"2024-05-07T13:55:52.325971+0000","last_active":"2024-05-07T13:56:35.359224+0000","last_peered":"2024-05-07T13:56:35.359224+0000","last_clean":"2024-05-07T13:56:35.359224+0000","last_became_active":"2024-05-07T13:55:52.325427+0000","last_became_peered":"2024-05-07T13:55:52.325427+0000","last_unstale":"2024-05-07T13:56:35.359224+0000","last_undegraded":"2024-05-07T13:56:35.359224+0000","last_fullsized":"2024-05-07T13:56:35.359224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:46:31.400962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.163338+0000","last_change":"2024-05-07T13:55:54.334756+0000","last_active":"2024-05-07T13:57:57.163338+0000","last_peered":"2024-05-07T13:57:57.163338+0000","last_clean":"2024-05-07T13:57:57.163338+0000","last_became_active":"2024-05-07T13:55:54.334315+0000","last_became_peered":"2024-05-07T13:55:54.334315+0000","last_unstale":"2024-05-07T13:57:57.163338+0000","last_undegraded":"2024-05-07T13:57:57.163338+0000","last_fullsized":"2024-05-07T13:57:57.163338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:20.597897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358395+0000","last_change":"2024-05-07T13:55:56.330997+0000","last_active":"2024-05-07T13:56:35.358395+0000","last_peered":"2024-05-07T13:56:35.358395+0000","last_clean":"2024-05-07T13:56:35.358395+0000","last_became_active":"2024-05-07T13:55:56.330355+0000","last_became_peered":"2024-05-07T13:55:56.330355+0000","last_unstale":"2024-05-07T13:56:35.358395+0000","last_undegraded":"2024-05-07T13:56:35.358395+0000","last_fullsized":"2024-05-07T13:56:35.358395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:50.175136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.648614+0000","last_change":"2024-05-07T13:55:58.337164+0000","last_active":"2024-05-07T13:58:59.648614+0000","last_peered":"2024-05-07T13:58:59.648614+0000","last_clean":"2024-05-07T13:58:59.648614+0000","last_became_active":"2024-05-07T13:55:58.336692+0000","last_became_peered":"2024-05-07T13:55:58.336692+0000","last_unstale":"2024-05-07T13:58:59.648614+0000","last_undegraded":"2024-05-07T13:58:59.648614+0000","last_fullsized":"2024-05-07T13:58:59.648614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:54:59.700436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.143745+0000","last_change":"2024-05-07T13:55:50.323082+0000","last_active":"2024-05-07T13:58:59.143745+0000","last_peered":"2024-05-07T13:58:59.143745+0000","last_clean":"2024-05-07T13:58:59.143745+0000","last_became_active":"2024-05-07T13:55:50.322764+0000","last_became_peered":"2024-05-07T13:55:50.322764+0000","last_unstale":"2024-05-07T13:58:59.143745+0000","last_undegraded":"2024-05-07T13:58:59.143745+0000","last_fullsized":"2024-05-07T13:58:59.143745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.178785+0000","last_change":"2024-05-07T13:55:48.325995+0000","last_active":"2024-05-07T13:58:03.178785+0000","last_peered":"2024-05-07T13:58:03.178785+0000","last_clean":"2024-05-07T13:58:03.178785+0000","last_became_active":"2024-05-07T13:55:48.325075+0000","last_became_peered":"2024-05-07T13:55:48.325075+0000","last_unstale":"2024-05-07T13:58:03.178785+0000","last_undegraded":"2024-05-07T13:58:03.178785+0000","last_fullsized":"2024-05-07T13:58:03.178785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.368200+0000","last_change":"2024-05-07T13:55:52.322042+0000","last_active":"2024-05-07T13:56:35.368200+0000","last_peered":"2024-05-07T13:56:35.368200+0000","last_clean":"2024-05-07T13:56:35.368200+0000","last_became_active":"2024-05-07T13:55:52.321730+0000","last_became_peered":"2024-05-07T13:55:52.321730+0000","last_unstale":"2024-05-07T13:56:35.368200+0000","last_undegraded":"2024-05-07T13:56:35.368200+0000","last_fullsized":"2024-05-07T13:56:35.368200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:57:20.455708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181998+0000","last_change":"2024-05-07T13:55:54.327401+0000","last_active":"2024-05-07T13:58:13.181998+0000","last_peered":"2024-05-07T13:58:13.181998+0000","last_clean":"2024-05-07T13:58:13.181998+0000","last_became_active":"2024-05-07T13:55:54.324530+0000","last_became_peered":"2024-05-07T13:55:54.324530+0000","last_unstale":"2024-05-07T13:58:13.181998+0000","last_undegraded":"2024-05-07T13:58:13.181998+0000","last_fullsized":"2024-05-07T13:58:13.181998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:18.265571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361297+0000","last_change":"2024-05-07T13:55:56.344241+0000","last_active":"2024-05-07T13:56:35.361297+0000","last_peered":"2024-05-07T13:56:35.361297+0000","last_clean":"2024-05-07T13:56:35.361297+0000","last_became_active":"2024-05-07T13:55:56.343900+0000","last_became_peered":"2024-05-07T13:55:56.343900+0000","last_unstale":"2024-05-07T13:56:35.361297+0000","last_undegraded":"2024-05-07T13:56:35.361297+0000","last_fullsized":"2024-05-07T13:56:35.361297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:44.620800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.179998+0000","last_change":"2024-05-07T13:55:58.352050+0000","last_active":"2024-05-07T13:57:58.179998+0000","last_peered":"2024-05-07T13:57:58.179998+0000","last_clean":"2024-05-07T13:57:58.179998+0000","last_became_active":"2024-05-07T13:55:58.351724+0000","last_became_peered":"2024-05-07T13:55:58.351724+0000","last_unstale":"2024-05-07T13:57:58.179998+0000","last_undegraded":"2024-05-07T13:57:58.179998+0000","last_fullsized":"2024-05-07T13:57:58.179998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:24.287671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.724211+0000","last_change":"2024-05-07T13:55:50.330503+0000","last_active":"2024-05-07T13:57:58.724211+0000","last_peered":"2024-05-07T13:57:58.724211+0000","last_clean":"2024-05-07T13:57:58.724211+0000","last_became_active":"2024-05-07T13:55:50.326050+0000","last_became_peered":"2024-05-07T13:55:50.326050+0000","last_unstale":"2024-05-07T13:57:58.724211+0000","last_undegraded":"2024-05-07T13:57:58.724211+0000","last_fullsized":"2024-05-07T13:57:58.724211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:35.534512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358437+0000","last_change":"2024-05-07T13:55:48.352032+0000","last_active":"2024-05-07T13:56:35.358437+0000","last_peered":"2024-05-07T13:56:35.358437+0000","last_clean":"2024-05-07T13:56:35.358437+0000","last_became_active":"2024-05-07T13:55:48.350335+0000","last_became_peered":"2024-05-07T13:55:48.350335+0000","last_unstale":"2024-05-07T13:56:35.358437+0000","last_undegraded":"2024-05-07T13:56:35.358437+0000","last_fullsized":"2024-05-07T13:56:35.358437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:46.976702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.364086+0000","last_change":"2024-05-07T13:55:52.322369+0000","last_active":"2024-05-07T13:57:58.364086+0000","last_peered":"2024-05-07T13:57:58.364086+0000","last_clean":"2024-05-07T13:57:58.364086+0000","last_became_active":"2024-05-07T13:55:52.322006+0000","last_became_peered":"2024-05-07T13:55:52.322006+0000","last_unstale":"2024-05-07T13:57:58.364086+0000","last_undegraded":"2024-05-07T13:57:58.364086+0000","last_fullsized":"2024-05-07T13:57:58.364086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:14.436330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.170397+0000","last_change":"2024-05-07T13:55:54.320190+0000","last_active":"2024-05-07T13:57:57.170397+0000","last_peered":"2024-05-07T13:57:57.170397+0000","last_clean":"2024-05-07T13:57:57.170397+0000","last_became_active":"2024-05-07T13:55:54.319812+0000","last_became_peered":"2024-05-07T13:55:54.319812+0000","last_unstale":"2024-05-07T13:57:57.170397+0000","last_undegraded":"2024-05-07T13:57:57.170397+0000","last_fullsized":"2024-05-07T13:57:57.170397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:33.788094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.665948+0000","last_change":"2024-05-07T13:55:56.332248+0000","last_active":"2024-05-07T13:58:59.665948+0000","last_peered":"2024-05-07T13:58:59.665948+0000","last_clean":"2024-05-07T13:58:59.665948+0000","last_became_active":"2024-05-07T13:55:56.331966+0000","last_became_peered":"2024-05-07T13:55:56.331966+0000","last_unstale":"2024-05-07T13:58:59.665948+0000","last_undegraded":"2024-05-07T13:58:59.665948+0000","last_fullsized":"2024-05-07T13:58:59.665948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:41.555422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.507257+0000","last_change":"2024-05-07T13:55:58.340997+0000","last_active":"2024-05-07T13:58:59.507257+0000","last_peered":"2024-05-07T13:58:59.507257+0000","last_clean":"2024-05-07T13:58:59.507257+0000","last_became_active":"2024-05-07T13:55:58.340608+0000","last_became_peered":"2024-05-07T13:55:58.340608+0000","last_unstale":"2024-05-07T13:58:59.507257+0000","last_undegraded":"2024-05-07T13:58:59.507257+0000","last_fullsized":"2024-05-07T13:58:59.507257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:04.022939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.246015+0000","last_change":"2024-05-07T13:55:50.322925+0000","last_active":"2024-05-07T13:58:59.246015+0000","last_peered":"2024-05-07T13:58:59.246015+0000","last_clean":"2024-05-07T13:58:59.246015+0000","last_became_active":"2024-05-07T13:55:50.322650+0000","last_became_peered":"2024-05-07T13:55:50.322650+0000","last_unstale":"2024-05-07T13:58:59.246015+0000","last_undegraded":"2024-05-07T13:58:59.246015+0000","last_fullsized":"2024-05-07T13:58:59.246015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357841+0000","last_change":"2024-05-07T13:55:48.349364+0000","last_active":"2024-05-07T13:56:35.357841+0000","last_peered":"2024-05-07T13:56:35.357841+0000","last_clean":"2024-05-07T13:56:35.357841+0000","last_became_active":"2024-05-07T13:55:48.347434+0000","last_became_peered":"2024-05-07T13:55:48.347434+0000","last_unstale":"2024-05-07T13:56:35.357841+0000","last_undegraded":"2024-05-07T13:56:35.357841+0000","last_fullsized":"2024-05-07T13:56:35.357841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:21.121562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.363686+0000","last_change":"2024-05-07T13:55:52.321582+0000","last_active":"2024-05-07T13:57:58.363686+0000","last_peered":"2024-05-07T13:57:58.363686+0000","last_clean":"2024-05-07T13:57:58.363686+0000","last_became_active":"2024-05-07T13:55:52.321251+0000","last_became_peered":"2024-05-07T13:55:52.321251+0000","last_unstale":"2024-05-07T13:57:58.363686+0000","last_undegraded":"2024-05-07T13:57:58.363686+0000","last_fullsized":"2024-05-07T13:57:58.363686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:47.624596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359197+0000","last_change":"2024-05-07T13:55:54.332203+0000","last_active":"2024-05-07T13:56:35.359197+0000","last_peered":"2024-05-07T13:56:35.359197+0000","last_clean":"2024-05-07T13:56:35.359197+0000","last_became_active":"2024-05-07T13:55:54.331844+0000","last_became_peered":"2024-05-07T13:55:54.331844+0000","last_unstale":"2024-05-07T13:56:35.359197+0000","last_undegraded":"2024-05-07T13:56:35.359197+0000","last_fullsized":"2024-05-07T13:56:35.359197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:37:22.283720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.595950+0000","last_change":"2024-05-07T13:55:56.333205+0000","last_active":"2024-05-07T13:58:59.595950+0000","last_peered":"2024-05-07T13:58:59.595950+0000","last_clean":"2024-05-07T13:58:59.595950+0000","last_became_active":"2024-05-07T13:55:56.332858+0000","last_became_peered":"2024-05-07T13:55:56.332858+0000","last_unstale":"2024-05-07T13:58:59.595950+0000","last_undegraded":"2024-05-07T13:58:59.595950+0000","last_fullsized":"2024-05-07T13:58:59.595950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:19.698130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.507540+0000","last_change":"2024-05-07T13:55:58.335655+0000","last_active":"2024-05-07T13:57:58.507540+0000","last_peered":"2024-05-07T13:57:58.507540+0000","last_clean":"2024-05-07T13:57:58.507540+0000","last_became_active":"2024-05-07T13:55:58.335341+0000","last_became_peered":"2024-05-07T13:55:58.335341+0000","last_unstale":"2024-05-07T13:57:58.507540+0000","last_undegraded":"2024-05-07T13:57:58.507540+0000","last_fullsized":"2024-05-07T13:57:58.507540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:07.873806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477769+0000","last_change":"2024-05-07T13:55:50.331652+0000","last_active":"2024-05-07T13:58:59.477769+0000","last_peered":"2024-05-07T13:58:59.477769+0000","last_clean":"2024-05-07T13:58:59.477769+0000","last_became_active":"2024-05-07T13:55:50.331295+0000","last_became_peered":"2024-05-07T13:55:50.331295+0000","last_unstale":"2024-05-07T13:58:59.477769+0000","last_undegraded":"2024-05-07T13:58:59.477769+0000","last_fullsized":"2024-05-07T13:58:59.477769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:51:22.677704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357223+0000","last_change":"2024-05-07T13:55:48.352519+0000","last_active":"2024-05-07T13:56:35.357223+0000","last_peered":"2024-05-07T13:56:35.357223+0000","last_clean":"2024-05-07T13:56:35.357223+0000","last_became_active":"2024-05-07T13:55:48.351055+0000","last_became_peered":"2024-05-07T13:55:48.351055+0000","last_unstale":"2024-05-07T13:56:35.357223+0000","last_undegraded":"2024-05-07T13:56:35.357223+0000","last_fullsized":"2024-05-07T13:56:35.357223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:13:23.846967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"29'4","reported_seq":226,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.352994+0000","last_change":"2024-05-07T13:55:52.320405+0000","last_active":"2024-05-07T13:57:58.352994+0000","last_peered":"2024-05-07T13:57:58.352994+0000","last_clean":"2024-05-07T13:57:58.352994+0000","last_became_active":"2024-05-07T13:55:52.320027+0000","last_became_peered":"2024-05-07T13:55:52.320027+0000","last_unstale":"2024-05-07T13:57:58.352994+0000","last_undegraded":"2024-05-07T13:57:58.352994+0000","last_fullsized":"2024-05-07T13:57:58.352994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:36.196536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'39","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.156522+0000","last_change":"2024-05-07T13:55:54.334106+0000","last_active":"2024-05-07T13:57:57.156522+0000","last_peered":"2024-05-07T13:57:57.156522+0000","last_clean":"2024-05-07T13:57:57.156522+0000","last_became_active":"2024-05-07T13:55:54.333766+0000","last_became_peered":"2024-05-07T13:55:54.333766+0000","last_unstale":"2024-05-07T13:57:57.156522+0000","last_undegraded":"2024-05-07T13:57:57.156522+0000","last_fullsized":"2024-05-07T13:57:57.156522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:56.275417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366808+0000","last_change":"2024-05-07T13:55:56.338510+0000","last_active":"2024-05-07T13:56:35.366808+0000","last_peered":"2024-05-07T13:56:35.366808+0000","last_clean":"2024-05-07T13:56:35.366808+0000","last_became_active":"2024-05-07T13:55:56.338195+0000","last_became_peered":"2024-05-07T13:55:56.338195+0000","last_unstale":"2024-05-07T13:56:35.366808+0000","last_undegraded":"2024-05-07T13:56:35.366808+0000","last_fullsized":"2024-05-07T13:56:35.366808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:41.461582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.544535+0000","last_change":"2024-05-07T13:55:58.346374+0000","last_active":"2024-05-07T13:58:59.544535+0000","last_peered":"2024-05-07T13:58:59.544535+0000","last_clean":"2024-05-07T13:58:59.544535+0000","last_became_active":"2024-05-07T13:55:58.346040+0000","last_became_peered":"2024-05-07T13:55:58.346040+0000","last_unstale":"2024-05-07T13:58:59.544535+0000","last_undegraded":"2024-05-07T13:58:59.544535+0000","last_fullsized":"2024-05-07T13:58:59.544535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.039656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'16","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.143397+0000","last_change":"2024-05-07T13:56:35.374383+0000","last_active":"2024-05-07T13:58:59.143397+0000","last_peered":"2024-05-07T13:58:59.143397+0000","last_clean":"2024-05-07T13:58:59.143397+0000","last_became_active":"2024-05-07T13:56:35.369148+0000","last_became_peered":"2024-05-07T13:56:35.369148+0000","last_unstale":"2024-05-07T13:58:59.143397+0000","last_undegraded":"2024-05-07T13:58:59.143397+0000","last_fullsized":"2024-05-07T13:58:59.143397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:30.011499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359758+0000","last_change":"2024-05-07T13:55:40.043635+0000","last_active":"2024-05-07T13:56:35.359758+0000","last_peered":"2024-05-07T13:56:35.359758+0000","last_clean":"2024-05-07T13:56:35.359758+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:56:35.359758+0000","last_undegraded":"2024-05-07T13:56:35.359758+0000","last_fullsized":"2024-05-07T13:56:35.359758+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:01:05.355008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358964+0000","last_change":"2024-05-07T13:55:40.045474+0000","last_active":"2024-05-07T13:56:35.358964+0000","last_peered":"2024-05-07T13:56:35.358964+0000","last_clean":"2024-05-07T13:56:35.358964+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T13:56:35.358964+0000","last_undegraded":"2024-05-07T13:56:35.358964+0000","last_fullsized":"2024-05-07T13:56:35.358964+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:03.440717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.728528+0000","last_change":"2024-05-07T13:55:48.352406+0000","last_active":"2024-05-07T13:57:14.728528+0000","last_peered":"2024-05-07T13:57:14.728528+0000","last_clean":"2024-05-07T13:57:14.728528+0000","last_became_active":"2024-05-07T13:55:48.350998+0000","last_became_peered":"2024-05-07T13:55:48.350998+0000","last_unstale":"2024-05-07T13:57:14.728528+0000","last_undegraded":"2024-05-07T13:57:14.728528+0000","last_fullsized":"2024-05-07T13:57:14.728528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:52.052094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364056+0000","last_change":"2024-05-07T13:55:52.321728+0000","last_active":"2024-05-07T13:56:35.364056+0000","last_peered":"2024-05-07T13:56:35.364056+0000","last_clean":"2024-05-07T13:56:35.364056+0000","last_became_active":"2024-05-07T13:55:52.321406+0000","last_became_peered":"2024-05-07T13:55:52.321406+0000","last_unstale":"2024-05-07T13:56:35.364056+0000","last_undegraded":"2024-05-07T13:56:35.364056+0000","last_fullsized":"2024-05-07T13:56:35.364056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:35.607190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.167946+0000","last_change":"2024-05-07T13:55:54.329086+0000","last_active":"2024-05-07T13:57:57.167946+0000","last_peered":"2024-05-07T13:57:57.167946+0000","last_clean":"2024-05-07T13:57:57.167946+0000","last_became_active":"2024-05-07T13:55:54.328677+0000","last_became_peered":"2024-05-07T13:55:54.328677+0000","last_unstale":"2024-05-07T13:57:57.167946+0000","last_undegraded":"2024-05-07T13:57:57.167946+0000","last_fullsized":"2024-05-07T13:57:57.167946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:31:48.109295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359644+0000","last_change":"2024-05-07T13:55:56.335298+0000","last_active":"2024-05-07T13:56:35.359644+0000","last_peered":"2024-05-07T13:56:35.359644+0000","last_clean":"2024-05-07T13:56:35.359644+0000","last_became_active":"2024-05-07T13:55:56.335013+0000","last_became_peered":"2024-05-07T13:55:56.335013+0000","last_unstale":"2024-05-07T13:56:35.359644+0000","last_undegraded":"2024-05-07T13:56:35.359644+0000","last_fullsized":"2024-05-07T13:56:35.359644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:04.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'82","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.513260+0000","last_change":"2024-05-07T13:55:58.335516+0000","last_active":"2024-05-07T13:58:59.513260+0000","last_peered":"2024-05-07T13:58:59.513260+0000","last_clean":"2024-05-07T13:58:59.513260+0000","last_became_active":"2024-05-07T13:55:58.335220+0000","last_became_peered":"2024-05-07T13:55:58.335220+0000","last_unstale":"2024-05-07T13:58:59.513260+0000","last_undegraded":"2024-05-07T13:58:59.513260+0000","last_fullsized":"2024-05-07T13:58:59.513260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:01:58.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.476754+0000","last_change":"2024-05-07T13:55:50.324475+0000","last_active":"2024-05-07T13:58:59.476754+0000","last_peered":"2024-05-07T13:58:59.476754+0000","last_clean":"2024-05-07T13:58:59.476754+0000","last_became_active":"2024-05-07T13:55:50.323408+0000","last_became_peered":"2024-05-07T13:55:50.323408+0000","last_unstale":"2024-05-07T13:58:59.476754+0000","last_undegraded":"2024-05-07T13:58:59.476754+0000","last_fullsized":"2024-05-07T13:58:59.476754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:26:01.826472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356763+0000","last_change":"2024-05-07T13:55:40.043428+0000","last_active":"2024-05-07T13:56:35.356763+0000","last_peered":"2024-05-07T13:56:35.356763+0000","last_clean":"2024-05-07T13:56:35.356763+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T13:56:35.356763+0000","last_undegraded":"2024-05-07T13:56:35.356763+0000","last_fullsized":"2024-05-07T13:56:35.356763+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:34.894187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358426+0000","last_change":"2024-05-07T13:55:48.327071+0000","last_active":"2024-05-07T13:56:35.358426+0000","last_peered":"2024-05-07T13:56:35.358426+0000","last_clean":"2024-05-07T13:56:35.358426+0000","last_became_active":"2024-05-07T13:55:48.325905+0000","last_became_peered":"2024-05-07T13:55:48.325905+0000","last_unstale":"2024-05-07T13:56:35.358426+0000","last_undegraded":"2024-05-07T13:56:35.358426+0000","last_fullsized":"2024-05-07T13:56:35.358426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361487+0000","last_change":"2024-05-07T13:55:52.318581+0000","last_active":"2024-05-07T13:56:35.361487+0000","last_peered":"2024-05-07T13:56:35.361487+0000","last_clean":"2024-05-07T13:56:35.361487+0000","last_became_active":"2024-05-07T13:55:52.318221+0000","last_became_peered":"2024-05-07T13:55:52.318221+0000","last_unstale":"2024-05-07T13:56:35.361487+0000","last_undegraded":"2024-05-07T13:56:35.361487+0000","last_fullsized":"2024-05-07T13:56:35.361487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:37:46.564469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405111+0000","last_change":"2024-05-07T13:55:54.330092+0000","last_active":"2024-05-07T13:58:57.405111+0000","last_peered":"2024-05-07T13:58:57.405111+0000","last_clean":"2024-05-07T13:58:57.405111+0000","last_became_active":"2024-05-07T13:55:54.329774+0000","last_became_peered":"2024-05-07T13:55:54.329774+0000","last_unstale":"2024-05-07T13:58:57.405111+0000","last_undegraded":"2024-05-07T13:58:57.405111+0000","last_fullsized":"2024-05-07T13:58:57.405111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:39.454749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359063+0000","last_change":"2024-05-07T13:55:56.344460+0000","last_active":"2024-05-07T13:56:35.359063+0000","last_peered":"2024-05-07T13:56:35.359063+0000","last_clean":"2024-05-07T13:56:35.359063+0000","last_became_active":"2024-05-07T13:55:56.343224+0000","last_became_peered":"2024-05-07T13:55:56.343224+0000","last_unstale":"2024-05-07T13:56:35.359063+0000","last_undegraded":"2024-05-07T13:56:35.359063+0000","last_fullsized":"2024-05-07T13:56:35.359063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:31:00.903367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.721038+0000","last_change":"2024-05-07T13:55:58.345308+0000","last_active":"2024-05-07T13:57:58.721038+0000","last_peered":"2024-05-07T13:57:58.721038+0000","last_clean":"2024-05-07T13:57:58.721038+0000","last_became_active":"2024-05-07T13:55:58.344996+0000","last_became_peered":"2024-05-07T13:55:58.344996+0000","last_unstale":"2024-05-07T13:57:58.721038+0000","last_undegraded":"2024-05-07T13:57:58.721038+0000","last_fullsized":"2024-05-07T13:57:58.721038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:26.544607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502914+0000","last_change":"2024-05-07T13:55:50.318832+0000","last_active":"2024-05-07T13:58:59.502914+0000","last_peered":"2024-05-07T13:58:59.502914+0000","last_clean":"2024-05-07T13:58:59.502914+0000","last_became_active":"2024-05-07T13:55:50.318471+0000","last_became_peered":"2024-05-07T13:55:50.318471+0000","last_unstale":"2024-05-07T13:58:59.502914+0000","last_undegraded":"2024-05-07T13:58:59.502914+0000","last_fullsized":"2024-05-07T13:58:59.502914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:26.371060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362574+0000","last_change":"2024-05-07T13:55:40.043522+0000","last_active":"2024-05-07T13:56:35.362574+0000","last_peered":"2024-05-07T13:56:35.362574+0000","last_clean":"2024-05-07T13:56:35.362574+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:56:35.362574+0000","last_undegraded":"2024-05-07T13:56:35.362574+0000","last_fullsized":"2024-05-07T13:56:35.362574+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:01:05.355008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357954+0000","last_change":"2024-05-07T13:55:48.326648+0000","last_active":"2024-05-07T13:56:35.357954+0000","last_peered":"2024-05-07T13:56:35.357954+0000","last_clean":"2024-05-07T13:56:35.357954+0000","last_became_active":"2024-05-07T13:55:48.325013+0000","last_became_peered":"2024-05-07T13:55:48.325013+0000","last_unstale":"2024-05-07T13:56:35.357954+0000","last_undegraded":"2024-05-07T13:56:35.357954+0000","last_fullsized":"2024-05-07T13:56:35.357954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.377191+0000","last_change":"2024-05-07T13:56:35.376721+0000","last_active":"2024-05-07T13:56:35.377191+0000","last_peered":"2024-05-07T13:56:35.377191+0000","last_clean":"2024-05-07T13:56:35.377191+0000","last_became_active":"2024-05-07T13:56:35.368904+0000","last_became_peered":"2024-05-07T13:56:35.368904+0000","last_unstale":"2024-05-07T13:56:35.377191+0000","last_undegraded":"2024-05-07T13:56:35.377191+0000","last_fullsized":"2024-05-07T13:56:35.377191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:48:47.495613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405246+0000","last_change":"2024-05-07T13:55:54.330092+0000","last_active":"2024-05-07T13:58:57.405246+0000","last_peered":"2024-05-07T13:58:57.405246+0000","last_clean":"2024-05-07T13:58:57.405246+0000","last_became_active":"2024-05-07T13:55:54.329778+0000","last_became_peered":"2024-05-07T13:55:54.329778+0000","last_unstale":"2024-05-07T13:58:57.405246+0000","last_undegraded":"2024-05-07T13:58:57.405246+0000","last_fullsized":"2024-05-07T13:58:57.405246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:49.631798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360263+0000","last_change":"2024-05-07T13:55:56.336320+0000","last_active":"2024-05-07T13:56:35.360263+0000","last_peered":"2024-05-07T13:56:35.360263+0000","last_clean":"2024-05-07T13:56:35.360263+0000","last_became_active":"2024-05-07T13:55:56.336064+0000","last_became_peered":"2024-05-07T13:55:56.336064+0000","last_unstale":"2024-05-07T13:56:35.360263+0000","last_undegraded":"2024-05-07T13:56:35.360263+0000","last_fullsized":"2024-05-07T13:56:35.360263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:40.210571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.473318+0000","last_change":"2024-05-07T13:55:58.350552+0000","last_active":"2024-05-07T13:58:59.473318+0000","last_peered":"2024-05-07T13:58:59.473318+0000","last_clean":"2024-05-07T13:58:59.473318+0000","last_became_active":"2024-05-07T13:55:58.350208+0000","last_became_peered":"2024-05-07T13:55:58.350208+0000","last_unstale":"2024-05-07T13:58:59.473318+0000","last_undegraded":"2024-05-07T13:58:59.473318+0000","last_fullsized":"2024-05-07T13:58:59.473318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:40.675669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.931596+0000","last_change":"2024-05-07T13:55:50.313509+0000","last_active":"2024-05-07T13:57:14.931596+0000","last_peered":"2024-05-07T13:57:14.931596+0000","last_clean":"2024-05-07T13:57:14.931596+0000","last_became_active":"2024-05-07T13:55:50.313163+0000","last_became_peered":"2024-05-07T13:55:50.313163+0000","last_unstale":"2024-05-07T13:57:14.931596+0000","last_undegraded":"2024-05-07T13:57:14.931596+0000","last_fullsized":"2024-05-07T13:57:14.931596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:30.949901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356826+0000","last_change":"2024-05-07T13:55:40.044279+0000","last_active":"2024-05-07T13:56:35.356826+0000","last_peered":"2024-05-07T13:56:35.356826+0000","last_clean":"2024-05-07T13:56:35.356826+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T13:56:35.356826+0000","last_undegraded":"2024-05-07T13:56:35.356826+0000","last_fullsized":"2024-05-07T13:56:35.356826+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:05:53.554681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.365647+0000","last_change":"2024-05-07T13:55:48.338820+0000","last_active":"2024-05-07T13:56:35.365647+0000","last_peered":"2024-05-07T13:56:35.365647+0000","last_clean":"2024-05-07T13:56:35.365647+0000","last_became_active":"2024-05-07T13:55:48.338442+0000","last_became_peered":"2024-05-07T13:55:48.338442+0000","last_unstale":"2024-05-07T13:56:35.365647+0000","last_undegraded":"2024-05-07T13:56:35.365647+0000","last_fullsized":"2024-05-07T13:56:35.365647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:03:37.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360317+0000","last_change":"2024-05-07T13:55:52.321916+0000","last_active":"2024-05-07T13:56:35.360317+0000","last_peered":"2024-05-07T13:56:35.360317+0000","last_clean":"2024-05-07T13:56:35.360317+0000","last_became_active":"2024-05-07T13:55:52.321506+0000","last_became_peered":"2024-05-07T13:55:52.321506+0000","last_unstale":"2024-05-07T13:56:35.360317+0000","last_undegraded":"2024-05-07T13:56:35.360317+0000","last_fullsized":"2024-05-07T13:56:35.360317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:35.607190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'15","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.754593+0000","last_change":"2024-05-07T13:55:54.329113+0000","last_active":"2024-05-07T13:58:58.754593+0000","last_peered":"2024-05-07T13:58:58.754593+0000","last_clean":"2024-05-07T13:58:58.754593+0000","last_became_active":"2024-05-07T13:55:54.328763+0000","last_became_peered":"2024-05-07T13:55:54.328763+0000","last_unstale":"2024-05-07T13:58:58.754593+0000","last_undegraded":"2024-05-07T13:58:58.754593+0000","last_fullsized":"2024-05-07T13:58:58.754593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:29:04.977290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361744+0000","last_change":"2024-05-07T13:55:56.343480+0000","last_active":"2024-05-07T13:56:35.361744+0000","last_peered":"2024-05-07T13:56:35.361744+0000","last_clean":"2024-05-07T13:56:35.361744+0000","last_became_active":"2024-05-07T13:55:56.343131+0000","last_became_peered":"2024-05-07T13:55:56.343131+0000","last_unstale":"2024-05-07T13:56:35.361744+0000","last_undegraded":"2024-05-07T13:56:35.361744+0000","last_fullsized":"2024-05-07T13:56:35.361744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:50.212923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.487763+0000","last_change":"2024-05-07T13:55:58.348390+0000","last_active":"2024-05-07T13:57:58.487763+0000","last_peered":"2024-05-07T13:57:58.487763+0000","last_clean":"2024-05-07T13:57:58.487763+0000","last_became_active":"2024-05-07T13:55:58.348068+0000","last_became_peered":"2024-05-07T13:55:58.348068+0000","last_unstale":"2024-05-07T13:57:58.487763+0000","last_undegraded":"2024-05-07T13:57:58.487763+0000","last_fullsized":"2024-05-07T13:57:58.487763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:21.047817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'14","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408795+0000","last_change":"2024-05-07T13:55:50.324091+0000","last_active":"2024-05-07T13:58:59.408795+0000","last_peered":"2024-05-07T13:58:59.408795+0000","last_clean":"2024-05-07T13:58:59.408795+0000","last_became_active":"2024-05-07T13:55:50.323820+0000","last_became_peered":"2024-05-07T13:55:50.323820+0000","last_unstale":"2024-05-07T13:58:59.408795+0000","last_undegraded":"2024-05-07T13:58:59.408795+0000","last_fullsized":"2024-05-07T13:58:59.408795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367577+0000","last_change":"2024-05-07T13:55:48.338590+0000","last_active":"2024-05-07T13:56:35.367577+0000","last_peered":"2024-05-07T13:56:35.367577+0000","last_clean":"2024-05-07T13:56:35.367577+0000","last_became_active":"2024-05-07T13:55:48.338139+0000","last_became_peered":"2024-05-07T13:55:48.338139+0000","last_unstale":"2024-05-07T13:56:35.367577+0000","last_undegraded":"2024-05-07T13:56:35.367577+0000","last_fullsized":"2024-05-07T13:56:35.367577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:02.747875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359773+0000","last_change":"2024-05-07T13:55:40.043241+0000","last_active":"2024-05-07T13:56:35.359773+0000","last_peered":"2024-05-07T13:56:35.359773+0000","last_clean":"2024-05-07T13:56:35.359773+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:56:35.359773+0000","last_undegraded":"2024-05-07T13:56:35.359773+0000","last_fullsized":"2024-05-07T13:56:35.359773+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:09.446119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178121+0000","last_change":"2024-05-07T13:55:52.321594+0000","last_active":"2024-05-07T13:57:58.178121+0000","last_peered":"2024-05-07T13:57:58.178121+0000","last_clean":"2024-05-07T13:57:58.178121+0000","last_became_active":"2024-05-07T13:55:52.321249+0000","last_became_peered":"2024-05-07T13:55:52.321249+0000","last_unstale":"2024-05-07T13:57:58.178121+0000","last_undegraded":"2024-05-07T13:57:58.178121+0000","last_fullsized":"2024-05-07T13:57:58.178121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:09.429892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'62","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.416916+0000","last_change":"2024-05-07T13:55:54.327059+0000","last_active":"2024-05-07T13:58:59.416916+0000","last_peered":"2024-05-07T13:58:59.416916+0000","last_clean":"2024-05-07T13:58:59.416916+0000","last_became_active":"2024-05-07T13:55:54.326812+0000","last_became_peered":"2024-05-07T13:55:54.326812+0000","last_unstale":"2024-05-07T13:58:59.416916+0000","last_undegraded":"2024-05-07T13:58:59.416916+0000","last_fullsized":"2024-05-07T13:58:59.416916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:43.853324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358924+0000","last_change":"2024-05-07T13:55:56.331774+0000","last_active":"2024-05-07T13:56:35.358924+0000","last_peered":"2024-05-07T13:56:35.358924+0000","last_clean":"2024-05-07T13:56:35.358924+0000","last_became_active":"2024-05-07T13:55:56.331343+0000","last_became_peered":"2024-05-07T13:55:56.331343+0000","last_unstale":"2024-05-07T13:56:35.358924+0000","last_undegraded":"2024-05-07T13:56:35.358924+0000","last_fullsized":"2024-05-07T13:56:35.358924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:45.860157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'11","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.663624+0000","last_change":"2024-05-07T13:55:58.347841+0000","last_active":"2024-05-07T13:57:58.663624+0000","last_peered":"2024-05-07T13:57:58.663624+0000","last_clean":"2024-05-07T13:57:58.663624+0000","last_became_active":"2024-05-07T13:55:58.347566+0000","last_became_peered":"2024-05-07T13:55:58.347566+0000","last_unstale":"2024-05-07T13:57:58.663624+0000","last_undegraded":"2024-05-07T13:57:58.663624+0000","last_fullsized":"2024-05-07T13:57:58.663624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:13:51.441059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'8","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471883+0000","last_change":"2024-05-07T13:55:50.330859+0000","last_active":"2024-05-07T13:58:59.471883+0000","last_peered":"2024-05-07T13:58:59.471883+0000","last_clean":"2024-05-07T13:58:59.471883+0000","last_became_active":"2024-05-07T13:55:50.330547+0000","last_became_peered":"2024-05-07T13:55:50.330547+0000","last_unstale":"2024-05-07T13:58:59.471883+0000","last_undegraded":"2024-05-07T13:58:59.471883+0000","last_fullsized":"2024-05-07T13:58:59.471883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:30.949901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360448+0000","last_change":"2024-05-07T13:55:48.325207+0000","last_active":"2024-05-07T13:56:35.360448+0000","last_peered":"2024-05-07T13:56:35.360448+0000","last_clean":"2024-05-07T13:56:35.360448+0000","last_became_active":"2024-05-07T13:55:48.324378+0000","last_became_peered":"2024-05-07T13:55:48.324378+0000","last_unstale":"2024-05-07T13:56:35.360448+0000","last_undegraded":"2024-05-07T13:56:35.360448+0000","last_fullsized":"2024-05-07T13:56:35.360448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:02:32.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360246+0000","last_change":"2024-05-07T13:55:40.044124+0000","last_active":"2024-05-07T13:56:35.360246+0000","last_peered":"2024-05-07T13:56:35.360246+0000","last_clean":"2024-05-07T13:56:35.360246+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T13:56:35.360246+0000","last_undegraded":"2024-05-07T13:56:35.360246+0000","last_fullsized":"2024-05-07T13:56:35.360246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:38.642853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.171773+0000","last_change":"2024-05-07T13:56:35.366451+0000","last_active":"2024-05-07T13:56:38.171773+0000","last_peered":"2024-05-07T13:56:38.171773+0000","last_clean":"2024-05-07T13:56:38.171773+0000","last_became_active":"2024-05-07T13:56:35.366075+0000","last_became_peered":"2024-05-07T13:56:35.366075+0000","last_unstale":"2024-05-07T13:56:38.171773+0000","last_undegraded":"2024-05-07T13:56:38.171773+0000","last_fullsized":"2024-05-07T13:56:38.171773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:15.026535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"27'14","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361524+0000","last_change":"2024-05-07T13:55:54.331195+0000","last_active":"2024-05-07T13:56:35.361524+0000","last_peered":"2024-05-07T13:56:35.361524+0000","last_clean":"2024-05-07T13:56:35.361524+0000","last_became_active":"2024-05-07T13:55:54.330896+0000","last_became_peered":"2024-05-07T13:55:54.330896+0000","last_unstale":"2024-05-07T13:56:35.361524+0000","last_undegraded":"2024-05-07T13:56:35.361524+0000","last_fullsized":"2024-05-07T13:56:35.361524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:44.541313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":374,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.507824+0000","last_change":"2024-05-07T13:55:56.335191+0000","last_active":"2024-05-07T13:58:59.507824+0000","last_peered":"2024-05-07T13:58:59.507824+0000","last_clean":"2024-05-07T13:58:59.507824+0000","last_became_active":"2024-05-07T13:55:56.333242+0000","last_became_peered":"2024-05-07T13:55:56.333242+0000","last_unstale":"2024-05-07T13:58:59.507824+0000","last_undegraded":"2024-05-07T13:58:59.507824+0000","last_fullsized":"2024-05-07T13:58:59.507824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:38.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.438838+0000","last_change":"2024-05-07T13:55:58.346596+0000","last_active":"2024-05-07T13:57:55.438838+0000","last_peered":"2024-05-07T13:57:55.438838+0000","last_clean":"2024-05-07T13:57:55.438838+0000","last_became_active":"2024-05-07T13:55:58.346295+0000","last_became_peered":"2024-05-07T13:55:58.346295+0000","last_unstale":"2024-05-07T13:57:55.438838+0000","last_undegraded":"2024-05-07T13:57:55.438838+0000","last_fullsized":"2024-05-07T13:57:55.438838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:45.742064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.433453+0000","last_change":"2024-05-07T13:55:50.326085+0000","last_active":"2024-05-07T13:57:55.433453+0000","last_peered":"2024-05-07T13:57:55.433453+0000","last_clean":"2024-05-07T13:57:55.433453+0000","last_became_active":"2024-05-07T13:55:50.325665+0000","last_became_peered":"2024-05-07T13:55:50.325665+0000","last_unstale":"2024-05-07T13:57:55.433453+0000","last_undegraded":"2024-05-07T13:57:55.433453+0000","last_fullsized":"2024-05-07T13:57:55.433453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:03.486728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.396425+0000","last_change":"2024-05-07T13:55:48.347535+0000","last_active":"2024-05-07T13:58:59.396425+0000","last_peered":"2024-05-07T13:58:59.396425+0000","last_clean":"2024-05-07T13:58:59.396425+0000","last_became_active":"2024-05-07T13:55:48.346645+0000","last_became_peered":"2024-05-07T13:55:48.346645+0000","last_unstale":"2024-05-07T13:58:59.396425+0000","last_undegraded":"2024-05-07T13:58:59.396425+0000","last_fullsized":"2024-05-07T13:58:59.396425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:01.162350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359789+0000","last_change":"2024-05-07T13:55:40.045556+0000","last_active":"2024-05-07T13:56:35.359789+0000","last_peered":"2024-05-07T13:56:35.359789+0000","last_clean":"2024-05-07T13:56:35.359789+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:56:35.359789+0000","last_undegraded":"2024-05-07T13:56:35.359789+0000","last_fullsized":"2024-05-07T13:56:35.359789+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:10.678478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356709+0000","last_change":"2024-05-07T13:55:52.321677+0000","last_active":"2024-05-07T13:56:35.356709+0000","last_peered":"2024-05-07T13:56:35.356709+0000","last_clean":"2024-05-07T13:56:35.356709+0000","last_became_active":"2024-05-07T13:55:52.321160+0000","last_became_peered":"2024-05-07T13:55:52.321160+0000","last_unstale":"2024-05-07T13:56:35.356709+0000","last_undegraded":"2024-05-07T13:56:35.356709+0000","last_fullsized":"2024-05-07T13:56:35.356709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:38.708646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.725372+0000","last_change":"2024-05-07T13:55:54.330229+0000","last_active":"2024-05-07T13:57:58.725372+0000","last_peered":"2024-05-07T13:57:58.725372+0000","last_clean":"2024-05-07T13:57:58.725372+0000","last_became_active":"2024-05-07T13:55:54.329885+0000","last_became_peered":"2024-05-07T13:55:54.329885+0000","last_unstale":"2024-05-07T13:57:58.725372+0000","last_undegraded":"2024-05-07T13:57:58.725372+0000","last_fullsized":"2024-05-07T13:57:58.725372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:21.319585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.649285+0000","last_change":"2024-05-07T13:55:56.334411+0000","last_active":"2024-05-07T13:58:59.649285+0000","last_peered":"2024-05-07T13:58:59.649285+0000","last_clean":"2024-05-07T13:58:59.649285+0000","last_became_active":"2024-05-07T13:55:56.334023+0000","last_became_peered":"2024-05-07T13:55:56.334023+0000","last_unstale":"2024-05-07T13:58:59.649285+0000","last_undegraded":"2024-05-07T13:58:59.649285+0000","last_fullsized":"2024-05-07T13:58:59.649285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:38.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363496+0000","last_change":"2024-05-07T13:55:58.347319+0000","last_active":"2024-05-07T13:56:35.363496+0000","last_peered":"2024-05-07T13:56:35.363496+0000","last_clean":"2024-05-07T13:56:35.363496+0000","last_became_active":"2024-05-07T13:55:58.346984+0000","last_became_peered":"2024-05-07T13:55:58.346984+0000","last_unstale":"2024-05-07T13:56:35.363496+0000","last_undegraded":"2024-05-07T13:56:35.363496+0000","last_fullsized":"2024-05-07T13:56:35.363496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:09:17.780125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363167+0000","last_change":"2024-05-07T13:55:50.327606+0000","last_active":"2024-05-07T13:56:35.363167+0000","last_peered":"2024-05-07T13:56:35.363167+0000","last_clean":"2024-05-07T13:56:35.363167+0000","last_became_active":"2024-05-07T13:55:50.327283+0000","last_became_peered":"2024-05-07T13:55:50.327283+0000","last_unstale":"2024-05-07T13:56:35.363167+0000","last_undegraded":"2024-05-07T13:56:35.363167+0000","last_fullsized":"2024-05-07T13:56:35.363167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:54.059732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364948+0000","last_change":"2024-05-07T13:55:48.337939+0000","last_active":"2024-05-07T13:56:35.364948+0000","last_peered":"2024-05-07T13:56:35.364948+0000","last_clean":"2024-05-07T13:56:35.364948+0000","last_became_active":"2024-05-07T13:55:48.337553+0000","last_became_peered":"2024-05-07T13:55:48.337553+0000","last_unstale":"2024-05-07T13:56:35.364948+0000","last_undegraded":"2024-05-07T13:56:35.364948+0000","last_fullsized":"2024-05-07T13:56:35.364948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363756+0000","last_change":"2024-05-07T13:55:40.043788+0000","last_active":"2024-05-07T13:56:35.363756+0000","last_peered":"2024-05-07T13:56:35.363756+0000","last_clean":"2024-05-07T13:56:35.363756+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T13:56:35.363756+0000","last_undegraded":"2024-05-07T13:56:35.363756+0000","last_fullsized":"2024-05-07T13:56:35.363756+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:00.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356449+0000","last_change":"2024-05-07T13:55:52.315544+0000","last_active":"2024-05-07T13:56:35.356449+0000","last_peered":"2024-05-07T13:56:35.356449+0000","last_clean":"2024-05-07T13:56:35.356449+0000","last_became_active":"2024-05-07T13:55:52.314793+0000","last_became_peered":"2024-05-07T13:55:52.314793+0000","last_unstale":"2024-05-07T13:56:35.356449+0000","last_undegraded":"2024-05-07T13:56:35.356449+0000","last_fullsized":"2024-05-07T13:56:35.356449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:46.161101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.154539+0000","last_change":"2024-05-07T13:55:54.330188+0000","last_active":"2024-05-07T13:57:57.154539+0000","last_peered":"2024-05-07T13:57:57.154539+0000","last_clean":"2024-05-07T13:57:57.154539+0000","last_became_active":"2024-05-07T13:55:54.329879+0000","last_became_peered":"2024-05-07T13:55:54.329879+0000","last_unstale":"2024-05-07T13:57:57.154539+0000","last_undegraded":"2024-05-07T13:57:57.154539+0000","last_fullsized":"2024-05-07T13:57:57.154539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:37.614392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358335+0000","last_change":"2024-05-07T13:55:56.333232+0000","last_active":"2024-05-07T13:56:35.358335+0000","last_peered":"2024-05-07T13:56:35.358335+0000","last_clean":"2024-05-07T13:56:35.358335+0000","last_became_active":"2024-05-07T13:55:56.332931+0000","last_became_peered":"2024-05-07T13:55:56.332931+0000","last_unstale":"2024-05-07T13:56:35.358335+0000","last_undegraded":"2024-05-07T13:56:35.358335+0000","last_fullsized":"2024-05-07T13:56:35.358335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:05.866559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370012+0000","last_change":"2024-05-07T13:55:58.341180+0000","last_active":"2024-05-07T13:56:35.370012+0000","last_peered":"2024-05-07T13:56:35.370012+0000","last_clean":"2024-05-07T13:56:35.370012+0000","last_became_active":"2024-05-07T13:55:58.340759+0000","last_became_peered":"2024-05-07T13:55:58.340759+0000","last_unstale":"2024-05-07T13:56:35.370012+0000","last_undegraded":"2024-05-07T13:56:35.370012+0000","last_fullsized":"2024-05-07T13:56:35.370012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:48.403945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369103+0000","last_change":"2024-05-07T13:55:58.348875+0000","last_active":"2024-05-07T13:56:35.369103+0000","last_peered":"2024-05-07T13:56:35.369103+0000","last_clean":"2024-05-07T13:56:35.369103+0000","last_became_active":"2024-05-07T13:55:58.348566+0000","last_became_peered":"2024-05-07T13:55:58.348566+0000","last_unstale":"2024-05-07T13:56:35.369103+0000","last_undegraded":"2024-05-07T13:56:35.369103+0000","last_fullsized":"2024-05-07T13:56:35.369103+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:21.705378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723807+0000","last_change":"2024-05-07T13:55:50.329912+0000","last_active":"2024-05-07T13:57:58.723807+0000","last_peered":"2024-05-07T13:57:58.723807+0000","last_clean":"2024-05-07T13:57:58.723807+0000","last_became_active":"2024-05-07T13:55:50.329615+0000","last_became_peered":"2024-05-07T13:55:50.329615+0000","last_unstale":"2024-05-07T13:57:58.723807+0000","last_undegraded":"2024-05-07T13:57:58.723807+0000","last_fullsized":"2024-05-07T13:57:58.723807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358159+0000","last_change":"2024-05-07T13:55:48.348585+0000","last_active":"2024-05-07T13:56:35.358159+0000","last_peered":"2024-05-07T13:56:35.358159+0000","last_clean":"2024-05-07T13:56:35.358159+0000","last_became_active":"2024-05-07T13:55:48.346558+0000","last_became_peered":"2024-05-07T13:55:48.346558+0000","last_unstale":"2024-05-07T13:56:35.358159+0000","last_undegraded":"2024-05-07T13:56:35.358159+0000","last_fullsized":"2024-05-07T13:56:35.358159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:46.733619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362239+0000","last_change":"2024-05-07T13:55:52.324475+0000","last_active":"2024-05-07T13:56:35.362239+0000","last_peered":"2024-05-07T13:56:35.362239+0000","last_clean":"2024-05-07T13:56:35.362239+0000","last_became_active":"2024-05-07T13:55:52.324083+0000","last_became_peered":"2024-05-07T13:55:52.324083+0000","last_unstale":"2024-05-07T13:56:35.362239+0000","last_undegraded":"2024-05-07T13:56:35.362239+0000","last_fullsized":"2024-05-07T13:56:35.362239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:22.175165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.160493+0000","last_change":"2024-05-07T13:55:54.331198+0000","last_active":"2024-05-07T13:57:57.160493+0000","last_peered":"2024-05-07T13:57:57.160493+0000","last_clean":"2024-05-07T13:57:57.160493+0000","last_became_active":"2024-05-07T13:55:54.330906+0000","last_became_peered":"2024-05-07T13:55:54.330906+0000","last_unstale":"2024-05-07T13:57:57.160493+0000","last_undegraded":"2024-05-07T13:57:57.160493+0000","last_fullsized":"2024-05-07T13:57:57.160493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:54:55.686356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358029+0000","last_change":"2024-05-07T13:55:56.348303+0000","last_active":"2024-05-07T13:56:35.358029+0000","last_peered":"2024-05-07T13:56:35.358029+0000","last_clean":"2024-05-07T13:56:35.358029+0000","last_became_active":"2024-05-07T13:55:56.346371+0000","last_became_peered":"2024-05-07T13:55:56.346371+0000","last_unstale":"2024-05-07T13:56:35.358029+0000","last_undegraded":"2024-05-07T13:56:35.358029+0000","last_fullsized":"2024-05-07T13:56:35.358029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:32:39.746591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:56.842330+0000","last_change":"2024-05-07T13:55:58.341454+0000","last_active":"2024-05-07T13:57:56.842330+0000","last_peered":"2024-05-07T13:57:56.842330+0000","last_clean":"2024-05-07T13:57:56.842330+0000","last_became_active":"2024-05-07T13:55:58.341102+0000","last_became_peered":"2024-05-07T13:55:58.341102+0000","last_unstale":"2024-05-07T13:57:56.842330+0000","last_undegraded":"2024-05-07T13:57:56.842330+0000","last_fullsized":"2024-05-07T13:57:56.842330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:24.611977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.931037+0000","last_change":"2024-05-07T13:55:50.330176+0000","last_active":"2024-05-07T13:57:14.931037+0000","last_peered":"2024-05-07T13:57:14.931037+0000","last_clean":"2024-05-07T13:57:14.931037+0000","last_became_active":"2024-05-07T13:55:50.329869+0000","last_became_peered":"2024-05-07T13:55:50.329869+0000","last_unstale":"2024-05-07T13:57:14.931037+0000","last_undegraded":"2024-05-07T13:57:14.931037+0000","last_fullsized":"2024-05-07T13:57:14.931037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:56.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.399682+0000","last_change":"2024-05-07T13:55:48.338314+0000","last_active":"2024-05-07T13:58:59.399682+0000","last_peered":"2024-05-07T13:58:59.399682+0000","last_clean":"2024-05-07T13:58:59.399682+0000","last_became_active":"2024-05-07T13:55:48.336807+0000","last_became_peered":"2024-05-07T13:55:48.336807+0000","last_unstale":"2024-05-07T13:58:59.399682+0000","last_undegraded":"2024-05-07T13:58:59.399682+0000","last_fullsized":"2024-05-07T13:58:59.399682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:40:38.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358047+0000","last_change":"2024-05-07T13:55:52.319258+0000","last_active":"2024-05-07T13:56:35.358047+0000","last_peered":"2024-05-07T13:56:35.358047+0000","last_clean":"2024-05-07T13:56:35.358047+0000","last_became_active":"2024-05-07T13:55:52.318534+0000","last_became_peered":"2024-05-07T13:55:52.318534+0000","last_unstale":"2024-05-07T13:56:35.358047+0000","last_undegraded":"2024-05-07T13:56:35.358047+0000","last_fullsized":"2024-05-07T13:56:35.358047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:59:17.441061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.742005+0000","last_change":"2024-05-07T13:55:54.319908+0000","last_active":"2024-05-07T13:58:58.742005+0000","last_peered":"2024-05-07T13:58:58.742005+0000","last_clean":"2024-05-07T13:58:58.742005+0000","last_became_active":"2024-05-07T13:55:54.319714+0000","last_became_peered":"2024-05-07T13:55:54.319714+0000","last_unstale":"2024-05-07T13:58:58.742005+0000","last_undegraded":"2024-05-07T13:58:58.742005+0000","last_fullsized":"2024-05-07T13:58:58.742005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:06:57.744609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359119+0000","last_change":"2024-05-07T13:55:56.334660+0000","last_active":"2024-05-07T13:56:35.359119+0000","last_peered":"2024-05-07T13:56:35.359119+0000","last_clean":"2024-05-07T13:56:35.359119+0000","last_became_active":"2024-05-07T13:55:56.334342+0000","last_became_peered":"2024-05-07T13:55:56.334342+0000","last_unstale":"2024-05-07T13:56:35.359119+0000","last_undegraded":"2024-05-07T13:56:35.359119+0000","last_fullsized":"2024-05-07T13:56:35.359119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:12.304466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.158018+0000","last_change":"2024-05-07T13:55:58.342684+0000","last_active":"2024-05-07T13:58:59.158018+0000","last_peered":"2024-05-07T13:58:59.158018+0000","last_clean":"2024-05-07T13:58:59.158018+0000","last_became_active":"2024-05-07T13:55:58.342382+0000","last_became_peered":"2024-05-07T13:55:58.342382+0000","last_unstale":"2024-05-07T13:58:59.158018+0000","last_undegraded":"2024-05-07T13:58:59.158018+0000","last_fullsized":"2024-05-07T13:58:59.158018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:58:54.112594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415635+0000","last_change":"2024-05-07T13:56:35.366216+0000","last_active":"2024-05-07T13:58:59.415635+0000","last_peered":"2024-05-07T13:58:59.415635+0000","last_clean":"2024-05-07T13:58:59.415635+0000","last_became_active":"2024-05-07T13:56:35.365890+0000","last_became_peered":"2024-05-07T13:56:35.365890+0000","last_unstale":"2024-05-07T13:58:59.415635+0000","last_undegraded":"2024-05-07T13:58:59.415635+0000","last_fullsized":"2024-05-07T13:58:59.415635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:31:44.095217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.567474+0000","last_change":"2024-05-07T13:55:48.337211+0000","last_active":"2024-05-07T13:57:58.567474+0000","last_peered":"2024-05-07T13:57:58.567474+0000","last_clean":"2024-05-07T13:57:58.567474+0000","last_became_active":"2024-05-07T13:55:48.336730+0000","last_became_peered":"2024-05-07T13:55:48.336730+0000","last_unstale":"2024-05-07T13:57:58.567474+0000","last_undegraded":"2024-05-07T13:57:58.567474+0000","last_fullsized":"2024-05-07T13:57:58.567474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362051+0000","last_change":"2024-05-07T13:55:52.325126+0000","last_active":"2024-05-07T13:56:35.362051+0000","last_peered":"2024-05-07T13:56:35.362051+0000","last_clean":"2024-05-07T13:56:35.362051+0000","last_became_active":"2024-05-07T13:55:52.324639+0000","last_became_peered":"2024-05-07T13:55:52.324639+0000","last_unstale":"2024-05-07T13:56:35.362051+0000","last_undegraded":"2024-05-07T13:56:35.362051+0000","last_fullsized":"2024-05-07T13:56:35.362051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:43:51.986602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'41","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.420602+0000","last_change":"2024-05-07T13:55:54.331164+0000","last_active":"2024-05-07T13:58:59.420602+0000","last_peered":"2024-05-07T13:58:59.420602+0000","last_clean":"2024-05-07T13:58:59.420602+0000","last_became_active":"2024-05-07T13:55:54.330738+0000","last_became_peered":"2024-05-07T13:55:54.330738+0000","last_unstale":"2024-05-07T13:58:59.420602+0000","last_undegraded":"2024-05-07T13:58:59.420602+0000","last_fullsized":"2024-05-07T13:58:59.420602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:10.297634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":65,"num_write":48,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361731+0000","last_change":"2024-05-07T13:55:56.333196+0000","last_active":"2024-05-07T13:56:35.361731+0000","last_peered":"2024-05-07T13:56:35.361731+0000","last_clean":"2024-05-07T13:56:35.361731+0000","last_became_active":"2024-05-07T13:55:56.332844+0000","last_became_peered":"2024-05-07T13:55:56.332844+0000","last_unstale":"2024-05-07T13:56:35.361731+0000","last_undegraded":"2024-05-07T13:56:35.361731+0000","last_fullsized":"2024-05-07T13:56:35.361731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:02:05.914379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357546+0000","last_change":"2024-05-07T13:55:58.348258+0000","last_active":"2024-05-07T13:56:35.357546+0000","last_peered":"2024-05-07T13:56:35.357546+0000","last_clean":"2024-05-07T13:56:35.357546+0000","last_became_active":"2024-05-07T13:55:58.347598+0000","last_became_peered":"2024-05-07T13:55:58.347598+0000","last_unstale":"2024-05-07T13:56:35.357546+0000","last_undegraded":"2024-05-07T13:56:35.357546+0000","last_fullsized":"2024-05-07T13:56:35.357546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:42:16.894503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'14","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723917+0000","last_change":"2024-05-07T13:55:50.326698+0000","last_active":"2024-05-07T13:57:58.723917+0000","last_peered":"2024-05-07T13:57:58.723917+0000","last_clean":"2024-05-07T13:57:58.723917+0000","last_became_active":"2024-05-07T13:55:50.326430+0000","last_became_peered":"2024-05-07T13:55:50.326430+0000","last_unstale":"2024-05-07T13:57:58.723917+0000","last_undegraded":"2024-05-07T13:57:58.723917+0000","last_fullsized":"2024-05-07T13:57:58.723917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:45.617720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366242+0000","last_change":"2024-05-07T13:55:48.332048+0000","last_active":"2024-05-07T13:56:35.366242+0000","last_peered":"2024-05-07T13:56:35.366242+0000","last_clean":"2024-05-07T13:56:35.366242+0000","last_became_active":"2024-05-07T13:55:48.331660+0000","last_became_peered":"2024-05-07T13:55:48.331660+0000","last_unstale":"2024-05-07T13:56:35.366242+0000","last_undegraded":"2024-05-07T13:56:35.366242+0000","last_fullsized":"2024-05-07T13:56:35.366242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356670+0000","last_change":"2024-05-07T13:55:52.320839+0000","last_active":"2024-05-07T13:56:35.356670+0000","last_peered":"2024-05-07T13:56:35.356670+0000","last_clean":"2024-05-07T13:56:35.356670+0000","last_became_active":"2024-05-07T13:55:52.320520+0000","last_became_peered":"2024-05-07T13:55:52.320520+0000","last_unstale":"2024-05-07T13:56:35.356670+0000","last_undegraded":"2024-05-07T13:56:35.356670+0000","last_fullsized":"2024-05-07T13:56:35.356670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:34.956299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.146019+0000","last_change":"2024-05-07T13:55:54.320598+0000","last_active":"2024-05-07T13:57:57.146019+0000","last_peered":"2024-05-07T13:57:57.146019+0000","last_clean":"2024-05-07T13:57:57.146019+0000","last_became_active":"2024-05-07T13:55:54.320266+0000","last_became_peered":"2024-05-07T13:55:54.320266+0000","last_unstale":"2024-05-07T13:57:57.146019+0000","last_undegraded":"2024-05-07T13:57:57.146019+0000","last_fullsized":"2024-05-07T13:57:57.146019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:11.437094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364874+0000","last_change":"2024-05-07T13:55:56.330536+0000","last_active":"2024-05-07T13:56:35.364874+0000","last_peered":"2024-05-07T13:56:35.364874+0000","last_clean":"2024-05-07T13:56:35.364874+0000","last_became_active":"2024-05-07T13:55:56.330251+0000","last_became_peered":"2024-05-07T13:55:56.330251+0000","last_unstale":"2024-05-07T13:56:35.364874+0000","last_undegraded":"2024-05-07T13:56:35.364874+0000","last_fullsized":"2024-05-07T13:56:35.364874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:02.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.141147+0000","last_change":"2024-05-07T13:55:50.323450+0000","last_active":"2024-05-07T13:58:59.141147+0000","last_peered":"2024-05-07T13:58:59.141147+0000","last_clean":"2024-05-07T13:58:59.141147+0000","last_became_active":"2024-05-07T13:55:50.323159+0000","last_became_peered":"2024-05-07T13:55:50.323159+0000","last_unstale":"2024-05-07T13:58:59.141147+0000","last_undegraded":"2024-05-07T13:58:59.141147+0000","last_fullsized":"2024-05-07T13:58:59.141147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:20.168290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356619+0000","last_change":"2024-05-07T13:55:48.352309+0000","last_active":"2024-05-07T13:56:35.356619+0000","last_peered":"2024-05-07T13:56:35.356619+0000","last_clean":"2024-05-07T13:56:35.356619+0000","last_became_active":"2024-05-07T13:55:48.350462+0000","last_became_peered":"2024-05-07T13:55:48.350462+0000","last_unstale":"2024-05-07T13:56:35.356619+0000","last_undegraded":"2024-05-07T13:56:35.356619+0000","last_fullsized":"2024-05-07T13:56:35.356619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:59.353984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359809+0000","last_change":"2024-05-07T13:55:52.321486+0000","last_active":"2024-05-07T13:56:35.359809+0000","last_peered":"2024-05-07T13:56:35.359809+0000","last_clean":"2024-05-07T13:56:35.359809+0000","last_became_active":"2024-05-07T13:55:52.321171+0000","last_became_peered":"2024-05-07T13:55:52.321171+0000","last_unstale":"2024-05-07T13:56:35.359809+0000","last_undegraded":"2024-05-07T13:56:35.359809+0000","last_fullsized":"2024-05-07T13:56:35.359809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:10.570816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.166855+0000","last_change":"2024-05-07T13:55:54.320095+0000","last_active":"2024-05-07T13:57:57.166855+0000","last_peered":"2024-05-07T13:57:57.166855+0000","last_clean":"2024-05-07T13:57:57.166855+0000","last_became_active":"2024-05-07T13:55:54.319819+0000","last_became_peered":"2024-05-07T13:55:54.319819+0000","last_unstale":"2024-05-07T13:57:57.166855+0000","last_undegraded":"2024-05-07T13:57:57.166855+0000","last_fullsized":"2024-05-07T13:57:57.166855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:00.166078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366700+0000","last_change":"2024-05-07T13:55:56.330532+0000","last_active":"2024-05-07T13:56:35.366700+0000","last_peered":"2024-05-07T13:56:35.366700+0000","last_clean":"2024-05-07T13:56:35.366700+0000","last_became_active":"2024-05-07T13:55:56.330190+0000","last_became_peered":"2024-05-07T13:55:56.330190+0000","last_unstale":"2024-05-07T13:56:35.366700+0000","last_undegraded":"2024-05-07T13:56:35.366700+0000","last_fullsized":"2024-05-07T13:56:35.366700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:46.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.660351+0000","last_change":"2024-05-07T13:55:58.341039+0000","last_active":"2024-05-07T13:57:58.660351+0000","last_peered":"2024-05-07T13:57:58.660351+0000","last_clean":"2024-05-07T13:57:58.660351+0000","last_became_active":"2024-05-07T13:55:58.340674+0000","last_became_peered":"2024-05-07T13:55:58.340674+0000","last_unstale":"2024-05-07T13:57:58.660351+0000","last_undegraded":"2024-05-07T13:57:58.660351+0000","last_fullsized":"2024-05-07T13:57:58.660351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:55:16.822393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408545+0000","last_change":"2024-05-07T13:55:50.318936+0000","last_active":"2024-05-07T13:58:59.408545+0000","last_peered":"2024-05-07T13:58:59.408545+0000","last_clean":"2024-05-07T13:58:59.408545+0000","last_became_active":"2024-05-07T13:55:50.318546+0000","last_became_peered":"2024-05-07T13:55:50.318546+0000","last_unstale":"2024-05-07T13:58:59.408545+0000","last_undegraded":"2024-05-07T13:58:59.408545+0000","last_fullsized":"2024-05-07T13:58:59.408545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:51.713206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361299+0000","last_change":"2024-05-07T13:55:48.332704+0000","last_active":"2024-05-07T13:56:35.361299+0000","last_peered":"2024-05-07T13:56:35.361299+0000","last_clean":"2024-05-07T13:56:35.361299+0000","last_became_active":"2024-05-07T13:55:48.331278+0000","last_became_peered":"2024-05-07T13:55:48.331278+0000","last_unstale":"2024-05-07T13:56:35.361299+0000","last_undegraded":"2024-05-07T13:56:35.361299+0000","last_fullsized":"2024-05-07T13:56:35.361299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:34:15.892537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369459+0000","last_change":"2024-05-07T13:55:52.317997+0000","last_active":"2024-05-07T13:56:35.369459+0000","last_peered":"2024-05-07T13:56:35.369459+0000","last_clean":"2024-05-07T13:56:35.369459+0000","last_became_active":"2024-05-07T13:55:52.317564+0000","last_became_peered":"2024-05-07T13:55:52.317564+0000","last_unstale":"2024-05-07T13:56:35.369459+0000","last_undegraded":"2024-05-07T13:56:35.369459+0000","last_fullsized":"2024-05-07T13:56:35.369459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:08.119281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.147002+0000","last_change":"2024-05-07T13:55:54.330150+0000","last_active":"2024-05-07T13:57:57.147002+0000","last_peered":"2024-05-07T13:57:57.147002+0000","last_clean":"2024-05-07T13:57:57.147002+0000","last_became_active":"2024-05-07T13:55:54.329443+0000","last_became_peered":"2024-05-07T13:55:54.329443+0000","last_unstale":"2024-05-07T13:57:57.147002+0000","last_undegraded":"2024-05-07T13:57:57.147002+0000","last_fullsized":"2024-05-07T13:57:57.147002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:38:57.980890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364045+0000","last_change":"2024-05-07T13:55:56.344810+0000","last_active":"2024-05-07T13:56:35.364045+0000","last_peered":"2024-05-07T13:56:35.364045+0000","last_clean":"2024-05-07T13:56:35.364045+0000","last_became_active":"2024-05-07T13:55:56.344470+0000","last_became_peered":"2024-05-07T13:55:56.344470+0000","last_unstale":"2024-05-07T13:56:35.364045+0000","last_undegraded":"2024-05-07T13:56:35.364045+0000","last_fullsized":"2024-05-07T13:56:35.364045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:05.866559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.821748+0000","last_change":"2024-05-07T13:55:58.351086+0000","last_active":"2024-05-07T13:58:58.821748+0000","last_peered":"2024-05-07T13:58:58.821748+0000","last_clean":"2024-05-07T13:58:58.821748+0000","last_became_active":"2024-05-07T13:55:58.350796+0000","last_became_peered":"2024-05-07T13:55:58.350796+0000","last_unstale":"2024-05-07T13:58:58.821748+0000","last_undegraded":"2024-05-07T13:58:58.821748+0000","last_fullsized":"2024-05-07T13:58:58.821748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:13:08.107265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502779+0000","last_change":"2024-05-07T13:55:50.327981+0000","last_active":"2024-05-07T13:58:59.502779+0000","last_peered":"2024-05-07T13:58:59.502779+0000","last_clean":"2024-05-07T13:58:59.502779+0000","last_became_active":"2024-05-07T13:55:50.326424+0000","last_became_peered":"2024-05-07T13:55:50.326424+0000","last_unstale":"2024-05-07T13:58:59.502779+0000","last_undegraded":"2024-05-07T13:58:59.502779+0000","last_fullsized":"2024-05-07T13:58:59.502779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:52.261340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.055616+0000","last_change":"2024-05-07T13:55:48.342464+0000","last_active":"2024-05-07T13:58:59.055616+0000","last_peered":"2024-05-07T13:58:59.055616+0000","last_clean":"2024-05-07T13:58:59.055616+0000","last_became_active":"2024-05-07T13:55:48.342072+0000","last_became_peered":"2024-05-07T13:55:48.342072+0000","last_unstale":"2024-05-07T13:58:59.055616+0000","last_undegraded":"2024-05-07T13:58:59.055616+0000","last_fullsized":"2024-05-07T13:58:59.055616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367888+0000","last_change":"2024-05-07T13:55:52.318946+0000","last_active":"2024-05-07T13:56:35.367888+0000","last_peered":"2024-05-07T13:56:35.367888+0000","last_clean":"2024-05-07T13:56:35.367888+0000","last_became_active":"2024-05-07T13:55:52.318605+0000","last_became_peered":"2024-05-07T13:55:52.318605+0000","last_unstale":"2024-05-07T13:56:35.367888+0000","last_undegraded":"2024-05-07T13:56:35.367888+0000","last_fullsized":"2024-05-07T13:56:35.367888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:09.398107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'32","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.164378+0000","last_change":"2024-05-07T13:55:54.326840+0000","last_active":"2024-05-07T13:57:57.164378+0000","last_peered":"2024-05-07T13:57:57.164378+0000","last_clean":"2024-05-07T13:57:57.164378+0000","last_became_active":"2024-05-07T13:55:54.326599+0000","last_became_peered":"2024-05-07T13:55:54.326599+0000","last_unstale":"2024-05-07T13:57:57.164378+0000","last_undegraded":"2024-05-07T13:57:57.164378+0000","last_fullsized":"2024-05-07T13:57:57.164378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:44.541313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359346+0000","last_change":"2024-05-07T13:55:56.334669+0000","last_active":"2024-05-07T13:56:35.359346+0000","last_peered":"2024-05-07T13:56:35.359346+0000","last_clean":"2024-05-07T13:56:35.359346+0000","last_became_active":"2024-05-07T13:55:56.334226+0000","last_became_peered":"2024-05-07T13:55:56.334226+0000","last_unstale":"2024-05-07T13:56:35.359346+0000","last_undegraded":"2024-05-07T13:56:35.359346+0000","last_fullsized":"2024-05-07T13:56:35.359346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:59:21.455096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.719529+0000","last_change":"2024-05-07T13:55:58.352585+0000","last_active":"2024-05-07T13:57:58.719529+0000","last_peered":"2024-05-07T13:57:58.719529+0000","last_clean":"2024-05-07T13:57:58.719529+0000","last_became_active":"2024-05-07T13:55:58.352263+0000","last_became_peered":"2024-05-07T13:55:58.352263+0000","last_unstale":"2024-05-07T13:57:58.719529+0000","last_undegraded":"2024-05-07T13:57:58.719529+0000","last_fullsized":"2024-05-07T13:57:58.719529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:11:22.158209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361243+0000","last_change":"2024-05-07T13:55:50.313466+0000","last_active":"2024-05-07T13:56:35.361243+0000","last_peered":"2024-05-07T13:56:35.361243+0000","last_clean":"2024-05-07T13:56:35.361243+0000","last_became_active":"2024-05-07T13:55:50.312852+0000","last_became_peered":"2024-05-07T13:55:50.312852+0000","last_unstale":"2024-05-07T13:56:35.361243+0000","last_undegraded":"2024-05-07T13:56:35.361243+0000","last_fullsized":"2024-05-07T13:56:35.361243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358505+0000","last_change":"2024-05-07T13:55:48.351068+0000","last_active":"2024-05-07T13:56:35.358505+0000","last_peered":"2024-05-07T13:56:35.358505+0000","last_clean":"2024-05-07T13:56:35.358505+0000","last_became_active":"2024-05-07T13:55:48.348476+0000","last_became_peered":"2024-05-07T13:55:48.348476+0000","last_unstale":"2024-05-07T13:56:35.358505+0000","last_undegraded":"2024-05-07T13:56:35.358505+0000","last_fullsized":"2024-05-07T13:56:35.358505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:24.363423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364249+0000","last_change":"2024-05-07T13:55:52.323853+0000","last_active":"2024-05-07T13:56:35.364249+0000","last_peered":"2024-05-07T13:56:35.364249+0000","last_clean":"2024-05-07T13:56:35.364249+0000","last_became_active":"2024-05-07T13:55:52.322431+0000","last_became_peered":"2024-05-07T13:55:52.322431+0000","last_unstale":"2024-05-07T13:56:35.364249+0000","last_undegraded":"2024-05-07T13:56:35.364249+0000","last_fullsized":"2024-05-07T13:56:35.364249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:10.570816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361154+0000","last_change":"2024-05-07T13:55:54.329901+0000","last_active":"2024-05-07T13:56:35.361154+0000","last_peered":"2024-05-07T13:56:35.361154+0000","last_clean":"2024-05-07T13:56:35.361154+0000","last_became_active":"2024-05-07T13:55:54.329539+0000","last_became_peered":"2024-05-07T13:55:54.329539+0000","last_unstale":"2024-05-07T13:56:35.361154+0000","last_undegraded":"2024-05-07T13:56:35.361154+0000","last_fullsized":"2024-05-07T13:56:35.361154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:26:09.693773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":406,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405101+0000","last_change":"2024-05-07T13:55:56.338533+0000","last_active":"2024-05-07T13:58:57.405101+0000","last_peered":"2024-05-07T13:58:57.405101+0000","last_clean":"2024-05-07T13:58:57.405101+0000","last_became_active":"2024-05-07T13:55:56.338021+0000","last_became_peered":"2024-05-07T13:55:56.338021+0000","last_unstale":"2024-05-07T13:58:57.405101+0000","last_undegraded":"2024-05-07T13:58:57.405101+0000","last_fullsized":"2024-05-07T13:58:57.405101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:20.272404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356081+0000","last_change":"2024-05-07T13:55:58.351904+0000","last_active":"2024-05-07T13:56:35.356081+0000","last_peered":"2024-05-07T13:56:35.356081+0000","last_clean":"2024-05-07T13:56:35.356081+0000","last_became_active":"2024-05-07T13:55:58.351616+0000","last_became_peered":"2024-05-07T13:55:58.351616+0000","last_unstale":"2024-05-07T13:56:35.356081+0000","last_undegraded":"2024-05-07T13:56:35.356081+0000","last_fullsized":"2024-05-07T13:56:35.356081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:22.090983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.185290+0000","last_change":"2024-05-07T13:55:50.313284+0000","last_active":"2024-05-07T13:58:23.185290+0000","last_peered":"2024-05-07T13:58:23.185290+0000","last_clean":"2024-05-07T13:58:23.185290+0000","last_became_active":"2024-05-07T13:55:50.313016+0000","last_became_peered":"2024-05-07T13:55:50.313016+0000","last_unstale":"2024-05-07T13:58:23.185290+0000","last_undegraded":"2024-05-07T13:58:23.185290+0000","last_fullsized":"2024-05-07T13:58:23.185290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:15.469036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363748+0000","last_change":"2024-05-07T13:55:48.340087+0000","last_active":"2024-05-07T13:56:35.363748+0000","last_peered":"2024-05-07T13:56:35.363748+0000","last_clean":"2024-05-07T13:56:35.363748+0000","last_became_active":"2024-05-07T13:55:48.339639+0000","last_became_peered":"2024-05-07T13:55:48.339639+0000","last_unstale":"2024-05-07T13:56:35.363748+0000","last_undegraded":"2024-05-07T13:56:35.363748+0000","last_fullsized":"2024-05-07T13:56:35.363748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361140+0000","last_change":"2024-05-07T13:55:52.324874+0000","last_active":"2024-05-07T13:56:35.361140+0000","last_peered":"2024-05-07T13:56:35.361140+0000","last_clean":"2024-05-07T13:56:35.361140+0000","last_became_active":"2024-05-07T13:55:52.324567+0000","last_became_peered":"2024-05-07T13:55:52.324567+0000","last_unstale":"2024-05-07T13:56:35.361140+0000","last_undegraded":"2024-05-07T13:56:35.361140+0000","last_fullsized":"2024-05-07T13:56:35.361140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:01.502846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.136732+0000","last_change":"2024-05-07T13:55:54.329601+0000","last_active":"2024-05-07T13:57:57.136732+0000","last_peered":"2024-05-07T13:57:57.136732+0000","last_clean":"2024-05-07T13:57:57.136732+0000","last_became_active":"2024-05-07T13:55:54.329220+0000","last_became_peered":"2024-05-07T13:55:54.329220+0000","last_unstale":"2024-05-07T13:57:57.136732+0000","last_undegraded":"2024-05-07T13:57:57.136732+0000","last_fullsized":"2024-05-07T13:57:57.136732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:00.166078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358098+0000","last_change":"2024-05-07T13:55:56.333675+0000","last_active":"2024-05-07T13:56:35.358098+0000","last_peered":"2024-05-07T13:56:35.358098+0000","last_clean":"2024-05-07T13:56:35.358098+0000","last_became_active":"2024-05-07T13:55:56.333373+0000","last_became_peered":"2024-05-07T13:55:56.333373+0000","last_unstale":"2024-05-07T13:56:35.358098+0000","last_undegraded":"2024-05-07T13:56:35.358098+0000","last_fullsized":"2024-05-07T13:56:35.358098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:19.698130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366747+0000","last_change":"2024-05-07T13:55:58.347910+0000","last_active":"2024-05-07T13:56:35.366747+0000","last_peered":"2024-05-07T13:56:35.366747+0000","last_clean":"2024-05-07T13:56:35.366747+0000","last_became_active":"2024-05-07T13:55:58.347327+0000","last_became_peered":"2024-05-07T13:55:58.347327+0000","last_unstale":"2024-05-07T13:56:35.366747+0000","last_undegraded":"2024-05-07T13:56:35.366747+0000","last_fullsized":"2024-05-07T13:56:35.366747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:18.476650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359524+0000","last_change":"2024-05-07T13:55:50.311670+0000","last_active":"2024-05-07T13:56:35.359524+0000","last_peered":"2024-05-07T13:56:35.359524+0000","last_clean":"2024-05-07T13:56:35.359524+0000","last_became_active":"2024-05-07T13:55:50.311340+0000","last_became_peered":"2024-05-07T13:55:50.311340+0000","last_unstale":"2024-05-07T13:56:35.359524+0000","last_undegraded":"2024-05-07T13:56:35.359524+0000","last_fullsized":"2024-05-07T13:56:35.359524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:45.426204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360374+0000","last_change":"2024-05-07T13:55:48.351060+0000","last_active":"2024-05-07T13:56:35.360374+0000","last_peered":"2024-05-07T13:56:35.360374+0000","last_clean":"2024-05-07T13:56:35.360374+0000","last_became_active":"2024-05-07T13:55:48.349589+0000","last_became_peered":"2024-05-07T13:55:48.349589+0000","last_unstale":"2024-05-07T13:56:35.360374+0000","last_undegraded":"2024-05-07T13:56:35.360374+0000","last_fullsized":"2024-05-07T13:56:35.360374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:54:44.852941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366095+0000","last_change":"2024-05-07T13:55:52.323978+0000","last_active":"2024-05-07T13:56:35.366095+0000","last_peered":"2024-05-07T13:56:35.366095+0000","last_clean":"2024-05-07T13:56:35.366095+0000","last_became_active":"2024-05-07T13:55:52.323548+0000","last_became_peered":"2024-05-07T13:55:52.323548+0000","last_unstale":"2024-05-07T13:56:35.366095+0000","last_undegraded":"2024-05-07T13:56:35.366095+0000","last_fullsized":"2024-05-07T13:56:35.366095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:51:24.684579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.137962+0000","last_change":"2024-05-07T13:55:54.327074+0000","last_active":"2024-05-07T13:57:57.137962+0000","last_peered":"2024-05-07T13:57:57.137962+0000","last_clean":"2024-05-07T13:57:57.137962+0000","last_became_active":"2024-05-07T13:55:54.326844+0000","last_became_peered":"2024-05-07T13:55:54.326844+0000","last_unstale":"2024-05-07T13:57:57.137962+0000","last_undegraded":"2024-05-07T13:57:57.137962+0000","last_fullsized":"2024-05-07T13:57:57.137962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:07.500805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356419+0000","last_change":"2024-05-07T13:55:56.345203+0000","last_active":"2024-05-07T13:56:35.356419+0000","last_peered":"2024-05-07T13:56:35.356419+0000","last_clean":"2024-05-07T13:56:35.356419+0000","last_became_active":"2024-05-07T13:55:56.344885+0000","last_became_peered":"2024-05-07T13:55:56.344885+0000","last_unstale":"2024-05-07T13:56:35.356419+0000","last_undegraded":"2024-05-07T13:56:35.356419+0000","last_fullsized":"2024-05-07T13:56:35.356419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:23.344207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361365+0000","last_change":"2024-05-07T13:55:58.348158+0000","last_active":"2024-05-07T13:56:35.361365+0000","last_peered":"2024-05-07T13:56:35.361365+0000","last_clean":"2024-05-07T13:56:35.361365+0000","last_became_active":"2024-05-07T13:55:58.347850+0000","last_became_peered":"2024-05-07T13:55:58.347850+0000","last_unstale":"2024-05-07T13:56:35.361365+0000","last_undegraded":"2024-05-07T13:56:35.361365+0000","last_fullsized":"2024-05-07T13:56:35.361365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:53.578201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'20","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502897+0000","last_change":"2024-05-07T13:55:50.325227+0000","last_active":"2024-05-07T13:58:59.502897+0000","last_peered":"2024-05-07T13:58:59.502897+0000","last_clean":"2024-05-07T13:58:59.502897+0000","last_became_active":"2024-05-07T13:55:50.324745+0000","last_became_peered":"2024-05-07T13:55:50.324745+0000","last_unstale":"2024-05-07T13:58:59.502897+0000","last_undegraded":"2024-05-07T13:58:59.502897+0000","last_fullsized":"2024-05-07T13:58:59.502897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:33.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.920397+0000","last_change":"2024-05-07T13:55:48.324008+0000","last_active":"2024-05-07T13:57:14.920397+0000","last_peered":"2024-05-07T13:57:14.920397+0000","last_clean":"2024-05-07T13:57:14.920397+0000","last_became_active":"2024-05-07T13:55:48.323125+0000","last_became_peered":"2024-05-07T13:55:48.323125+0000","last_unstale":"2024-05-07T13:57:14.920397+0000","last_undegraded":"2024-05-07T13:57:14.920397+0000","last_fullsized":"2024-05-07T13:57:14.920397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:00:13.644367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359668+0000","last_change":"2024-05-07T13:55:52.322334+0000","last_active":"2024-05-07T13:56:35.359668+0000","last_peered":"2024-05-07T13:56:35.359668+0000","last_clean":"2024-05-07T13:56:35.359668+0000","last_became_active":"2024-05-07T13:55:52.322012+0000","last_became_peered":"2024-05-07T13:55:52.322012+0000","last_unstale":"2024-05-07T13:56:35.359668+0000","last_undegraded":"2024-05-07T13:56:35.359668+0000","last_fullsized":"2024-05-07T13:56:35.359668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:51.701961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'27","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.162341+0000","last_change":"2024-05-07T13:55:54.327483+0000","last_active":"2024-05-07T13:57:57.162341+0000","last_peered":"2024-05-07T13:57:57.162341+0000","last_clean":"2024-05-07T13:57:57.162341+0000","last_became_active":"2024-05-07T13:55:54.326758+0000","last_became_peered":"2024-05-07T13:55:54.326758+0000","last_unstale":"2024-05-07T13:57:57.162341+0000","last_undegraded":"2024-05-07T13:57:57.162341+0000","last_fullsized":"2024-05-07T13:57:57.162341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:13:47.426980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357488+0000","last_change":"2024-05-07T13:55:56.346233+0000","last_active":"2024-05-07T13:56:35.357488+0000","last_peered":"2024-05-07T13:56:35.357488+0000","last_clean":"2024-05-07T13:56:35.357488+0000","last_became_active":"2024-05-07T13:55:56.345933+0000","last_became_peered":"2024-05-07T13:55:56.345933+0000","last_unstale":"2024-05-07T13:56:35.357488+0000","last_undegraded":"2024-05-07T13:56:35.357488+0000","last_fullsized":"2024-05-07T13:56:35.357488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:38:24.160530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.172834+0000","last_change":"2024-05-07T13:55:58.349147+0000","last_active":"2024-05-07T13:57:57.172834+0000","last_peered":"2024-05-07T13:57:57.172834+0000","last_clean":"2024-05-07T13:57:57.172834+0000","last_became_active":"2024-05-07T13:55:58.348763+0000","last_became_peered":"2024-05-07T13:55:58.348763+0000","last_unstale":"2024-05-07T13:57:57.172834+0000","last_undegraded":"2024-05-07T13:57:57.172834+0000","last_fullsized":"2024-05-07T13:57:57.172834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:37.840451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408575+0000","last_change":"2024-05-07T13:55:50.313977+0000","last_active":"2024-05-07T13:58:59.408575+0000","last_peered":"2024-05-07T13:58:59.408575+0000","last_clean":"2024-05-07T13:58:59.408575+0000","last_became_active":"2024-05-07T13:55:50.312605+0000","last_became_peered":"2024-05-07T13:55:50.312605+0000","last_unstale":"2024-05-07T13:58:59.408575+0000","last_undegraded":"2024-05-07T13:58:59.408575+0000","last_fullsized":"2024-05-07T13:58:59.408575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:54:46.860579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366631+0000","last_change":"2024-05-07T13:55:48.333628+0000","last_active":"2024-05-07T13:56:35.366631+0000","last_peered":"2024-05-07T13:56:35.366631+0000","last_clean":"2024-05-07T13:56:35.366631+0000","last_became_active":"2024-05-07T13:55:48.333254+0000","last_became_peered":"2024-05-07T13:55:48.333254+0000","last_unstale":"2024-05-07T13:56:35.366631+0000","last_undegraded":"2024-05-07T13:56:35.366631+0000","last_fullsized":"2024-05-07T13:56:35.366631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.781719+0000","last_change":"2024-05-07T13:55:52.322300+0000","last_active":"2024-05-07T13:57:55.781719+0000","last_peered":"2024-05-07T13:57:55.781719+0000","last_clean":"2024-05-07T13:57:55.781719+0000","last_became_active":"2024-05-07T13:55:52.321982+0000","last_became_peered":"2024-05-07T13:55:52.321982+0000","last_unstale":"2024-05-07T13:57:55.781719+0000","last_undegraded":"2024-05-07T13:57:55.781719+0000","last_fullsized":"2024-05-07T13:57:55.781719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:07:58.452077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.742866+0000","last_change":"2024-05-07T13:55:54.327217+0000","last_active":"2024-05-07T13:58:58.742866+0000","last_peered":"2024-05-07T13:58:58.742866+0000","last_clean":"2024-05-07T13:58:58.742866+0000","last_became_active":"2024-05-07T13:55:54.326895+0000","last_became_peered":"2024-05-07T13:55:54.326895+0000","last_unstale":"2024-05-07T13:58:58.742866+0000","last_undegraded":"2024-05-07T13:58:58.742866+0000","last_fullsized":"2024-05-07T13:58:58.742866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:20:31.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359452+0000","last_change":"2024-05-07T13:55:56.343265+0000","last_active":"2024-05-07T13:56:35.359452+0000","last_peered":"2024-05-07T13:56:35.359452+0000","last_clean":"2024-05-07T13:56:35.359452+0000","last_became_active":"2024-05-07T13:55:56.343002+0000","last_became_peered":"2024-05-07T13:55:56.343002+0000","last_unstale":"2024-05-07T13:56:35.359452+0000","last_undegraded":"2024-05-07T13:56:35.359452+0000","last_fullsized":"2024-05-07T13:56:35.359452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:46.396698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.593707+0000","last_change":"2024-05-07T13:55:58.348783+0000","last_active":"2024-05-07T13:58:59.593707+0000","last_peered":"2024-05-07T13:58:59.593707+0000","last_clean":"2024-05-07T13:58:59.593707+0000","last_became_active":"2024-05-07T13:55:58.347820+0000","last_became_peered":"2024-05-07T13:55:58.347820+0000","last_unstale":"2024-05-07T13:58:59.593707+0000","last_undegraded":"2024-05-07T13:58:59.593707+0000","last_fullsized":"2024-05-07T13:58:59.593707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:54.677953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471805+0000","last_change":"2024-05-07T13:55:50.330476+0000","last_active":"2024-05-07T13:58:59.471805+0000","last_peered":"2024-05-07T13:58:59.471805+0000","last_clean":"2024-05-07T13:58:59.471805+0000","last_became_active":"2024-05-07T13:55:50.330166+0000","last_became_peered":"2024-05-07T13:55:50.330166+0000","last_unstale":"2024-05-07T13:58:59.471805+0000","last_undegraded":"2024-05-07T13:58:59.471805+0000","last_fullsized":"2024-05-07T13:58:59.471805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:17:53.138578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358590+0000","last_change":"2024-05-07T13:55:48.339261+0000","last_active":"2024-05-07T13:56:35.358590+0000","last_peered":"2024-05-07T13:56:35.358590+0000","last_clean":"2024-05-07T13:56:35.358590+0000","last_became_active":"2024-05-07T13:55:48.338874+0000","last_became_peered":"2024-05-07T13:55:48.338874+0000","last_unstale":"2024-05-07T13:56:35.358590+0000","last_undegraded":"2024-05-07T13:56:35.358590+0000","last_fullsized":"2024-05-07T13:56:35.358590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.142958+0000","last_change":"2024-05-07T13:55:50.311630+0000","last_active":"2024-05-07T13:58:59.142958+0000","last_peered":"2024-05-07T13:58:59.142958+0000","last_clean":"2024-05-07T13:58:59.142958+0000","last_became_active":"2024-05-07T13:55:50.311324+0000","last_became_peered":"2024-05-07T13:55:50.311324+0000","last_unstale":"2024-05-07T13:58:59.142958+0000","last_undegraded":"2024-05-07T13:58:59.142958+0000","last_fullsized":"2024-05-07T13:58:59.142958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:52.088546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358534+0000","last_change":"2024-05-07T13:55:48.327068+0000","last_active":"2024-05-07T13:56:35.358534+0000","last_peered":"2024-05-07T13:56:35.358534+0000","last_clean":"2024-05-07T13:56:35.358534+0000","last_became_active":"2024-05-07T13:55:48.325561+0000","last_became_peered":"2024-05-07T13:55:48.325561+0000","last_unstale":"2024-05-07T13:56:35.358534+0000","last_undegraded":"2024-05-07T13:56:35.358534+0000","last_fullsized":"2024-05-07T13:56:35.358534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180888+0000","last_change":"2024-05-07T13:55:50.326752+0000","last_active":"2024-05-07T13:58:03.180888+0000","last_peered":"2024-05-07T13:58:03.180888+0000","last_clean":"2024-05-07T13:58:03.180888+0000","last_became_active":"2024-05-07T13:55:50.326322+0000","last_became_peered":"2024-05-07T13:55:50.326322+0000","last_unstale":"2024-05-07T13:58:03.180888+0000","last_undegraded":"2024-05-07T13:58:03.180888+0000","last_fullsized":"2024-05-07T13:58:03.180888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:07:36.575334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357230+0000","last_change":"2024-05-07T13:55:48.352058+0000","last_active":"2024-05-07T13:56:35.357230+0000","last_peered":"2024-05-07T13:56:35.357230+0000","last_clean":"2024-05-07T13:56:35.357230+0000","last_became_active":"2024-05-07T13:55:48.350385+0000","last_became_peered":"2024-05-07T13:55:48.350385+0000","last_unstale":"2024-05-07T13:56:35.357230+0000","last_undegraded":"2024-05-07T13:56:35.357230+0000","last_fullsized":"2024-05-07T13:56:35.357230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:17:38.955925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.178821+0000","last_change":"2024-05-07T13:55:50.313167+0000","last_active":"2024-05-07T13:58:03.178821+0000","last_peered":"2024-05-07T13:58:03.178821+0000","last_clean":"2024-05-07T13:58:03.178821+0000","last_became_active":"2024-05-07T13:55:50.312703+0000","last_became_peered":"2024-05-07T13:55:50.312703+0000","last_unstale":"2024-05-07T13:58:03.178821+0000","last_undegraded":"2024-05-07T13:58:03.178821+0000","last_fullsized":"2024-05-07T13:58:03.178821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.177520+0000","last_change":"2024-05-07T13:55:48.325914+0000","last_active":"2024-05-07T13:57:53.177520+0000","last_peered":"2024-05-07T13:57:53.177520+0000","last_clean":"2024-05-07T13:57:53.177520+0000","last_became_active":"2024-05-07T13:55:48.323979+0000","last_became_peered":"2024-05-07T13:55:48.323979+0000","last_unstale":"2024-05-07T13:57:53.177520+0000","last_undegraded":"2024-05-07T13:57:53.177520+0000","last_fullsized":"2024-05-07T13:57:53.177520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.472146+0000","last_change":"2024-05-07T13:55:50.331631+0000","last_active":"2024-05-07T13:58:59.472146+0000","last_peered":"2024-05-07T13:58:59.472146+0000","last_clean":"2024-05-07T13:58:59.472146+0000","last_became_active":"2024-05-07T13:55:50.331311+0000","last_became_peered":"2024-05-07T13:55:50.331311+0000","last_unstale":"2024-05-07T13:58:59.472146+0000","last_undegraded":"2024-05-07T13:58:59.472146+0000","last_fullsized":"2024-05-07T13:58:59.472146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178153+0000","last_change":"2024-05-07T13:55:48.326606+0000","last_active":"2024-05-07T13:57:58.178153+0000","last_peered":"2024-05-07T13:57:58.178153+0000","last_clean":"2024-05-07T13:57:58.178153+0000","last_became_active":"2024-05-07T13:55:48.325858+0000","last_became_peered":"2024-05-07T13:55:48.325858+0000","last_unstale":"2024-05-07T13:57:58.178153+0000","last_undegraded":"2024-05-07T13:57:58.178153+0000","last_fullsized":"2024-05-07T13:57:58.178153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:43.039363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.717865+0000","last_change":"2024-05-07T13:55:50.324360+0000","last_active":"2024-05-07T13:57:58.717865+0000","last_peered":"2024-05-07T13:57:58.717865+0000","last_clean":"2024-05-07T13:57:58.717865+0000","last_became_active":"2024-05-07T13:55:50.323573+0000","last_became_peered":"2024-05-07T13:55:50.323573+0000","last_unstale":"2024-05-07T13:57:58.717865+0000","last_undegraded":"2024-05-07T13:57:58.717865+0000","last_fullsized":"2024-05-07T13:57:58.717865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:57:18.448833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364364+0000","last_change":"2024-05-07T13:55:48.334670+0000","last_active":"2024-05-07T13:56:35.364364+0000","last_peered":"2024-05-07T13:56:35.364364+0000","last_clean":"2024-05-07T13:56:35.364364+0000","last_became_active":"2024-05-07T13:55:48.334268+0000","last_became_peered":"2024-05-07T13:55:48.334268+0000","last_unstale":"2024-05-07T13:56:35.364364+0000","last_undegraded":"2024-05-07T13:56:35.364364+0000","last_fullsized":"2024-05-07T13:56:35.364364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471690+0000","last_change":"2024-05-07T13:55:50.320633+0000","last_active":"2024-05-07T13:58:59.471690+0000","last_peered":"2024-05-07T13:58:59.471690+0000","last_clean":"2024-05-07T13:58:59.471690+0000","last_became_active":"2024-05-07T13:55:50.320242+0000","last_became_peered":"2024-05-07T13:55:50.320242+0000","last_unstale":"2024-05-07T13:58:59.471690+0000","last_undegraded":"2024-05-07T13:58:59.471690+0000","last_fullsized":"2024-05-07T13:58:59.471690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:05.135442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.182163+0000","last_change":"2024-05-07T13:55:48.341172+0000","last_active":"2024-05-07T13:57:58.182163+0000","last_peered":"2024-05-07T13:57:58.182163+0000","last_clean":"2024-05-07T13:57:58.182163+0000","last_became_active":"2024-05-07T13:55:48.340718+0000","last_became_peered":"2024-05-07T13:55:48.340718+0000","last_unstale":"2024-05-07T13:57:58.182163+0000","last_undegraded":"2024-05-07T13:57:58.182163+0000","last_fullsized":"2024-05-07T13:57:58.182163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'11","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149433+0000","last_change":"2024-05-07T13:55:50.320724+0000","last_active":"2024-05-07T13:58:59.149433+0000","last_peered":"2024-05-07T13:58:59.149433+0000","last_clean":"2024-05-07T13:58:59.149433+0000","last_became_active":"2024-05-07T13:55:50.320430+0000","last_became_peered":"2024-05-07T13:55:50.320430+0000","last_unstale":"2024-05-07T13:58:59.149433+0000","last_undegraded":"2024-05-07T13:58:59.149433+0000","last_fullsized":"2024-05-07T13:58:59.149433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:25:44.298994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361383+0000","last_change":"2024-05-07T13:55:48.324349+0000","last_active":"2024-05-07T13:56:35.361383+0000","last_peered":"2024-05-07T13:56:35.361383+0000","last_clean":"2024-05-07T13:56:35.361383+0000","last_became_active":"2024-05-07T13:55:48.323524+0000","last_became_peered":"2024-05-07T13:55:48.323524+0000","last_unstale":"2024-05-07T13:56:35.361383+0000","last_undegraded":"2024-05-07T13:56:35.361383+0000","last_fullsized":"2024-05-07T13:56:35.361383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:02.962105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367054+0000","last_change":"2024-05-07T13:55:50.313308+0000","last_active":"2024-05-07T13:56:35.367054+0000","last_peered":"2024-05-07T13:56:35.367054+0000","last_clean":"2024-05-07T13:56:35.367054+0000","last_became_active":"2024-05-07T13:55:50.313012+0000","last_became_peered":"2024-05-07T13:55:50.313012+0000","last_unstale":"2024-05-07T13:56:35.367054+0000","last_undegraded":"2024-05-07T13:56:35.367054+0000","last_fullsized":"2024-05-07T13:56:35.367054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:18.182290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.430794+0000","last_change":"2024-05-07T13:55:48.353515+0000","last_active":"2024-05-07T13:57:55.430794+0000","last_peered":"2024-05-07T13:57:55.430794+0000","last_clean":"2024-05-07T13:57:55.430794+0000","last_became_active":"2024-05-07T13:55:48.351882+0000","last_became_peered":"2024-05-07T13:55:48.351882+0000","last_unstale":"2024-05-07T13:57:55.430794+0000","last_undegraded":"2024-05-07T13:57:55.430794+0000","last_fullsized":"2024-05-07T13:57:55.430794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:34.947652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408508+0000","last_change":"2024-05-07T13:55:50.326172+0000","last_active":"2024-05-07T13:58:59.408508+0000","last_peered":"2024-05-07T13:58:59.408508+0000","last_clean":"2024-05-07T13:58:59.408508+0000","last_became_active":"2024-05-07T13:55:50.325807+0000","last_became_peered":"2024-05-07T13:55:50.325807+0000","last_unstale":"2024-05-07T13:58:59.408508+0000","last_undegraded":"2024-05-07T13:58:59.408508+0000","last_fullsized":"2024-05-07T13:58:59.408508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:08.013460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358738+0000","last_change":"2024-05-07T13:55:48.326746+0000","last_active":"2024-05-07T13:56:35.358738+0000","last_peered":"2024-05-07T13:56:35.358738+0000","last_clean":"2024-05-07T13:56:35.358738+0000","last_became_active":"2024-05-07T13:55:48.324919+0000","last_became_peered":"2024-05-07T13:55:48.324919+0000","last_unstale":"2024-05-07T13:56:35.358738+0000","last_undegraded":"2024-05-07T13:56:35.358738+0000","last_fullsized":"2024-05-07T13:56:35.358738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723663+0000","last_change":"2024-05-07T13:55:50.326002+0000","last_active":"2024-05-07T13:57:58.723663+0000","last_peered":"2024-05-07T13:57:58.723663+0000","last_clean":"2024-05-07T13:57:58.723663+0000","last_became_active":"2024-05-07T13:55:50.325620+0000","last_became_peered":"2024-05-07T13:55:50.325620+0000","last_unstale":"2024-05-07T13:57:58.723663+0000","last_undegraded":"2024-05-07T13:57:58.723663+0000","last_fullsized":"2024-05-07T13:57:58.723663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:56.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180393+0000","last_change":"2024-05-07T13:55:48.342921+0000","last_active":"2024-05-07T13:58:03.180393+0000","last_peered":"2024-05-07T13:58:03.180393+0000","last_clean":"2024-05-07T13:58:03.180393+0000","last_became_active":"2024-05-07T13:55:48.342508+0000","last_became_peered":"2024-05-07T13:55:48.342508+0000","last_unstale":"2024-05-07T13:58:03.180393+0000","last_undegraded":"2024-05-07T13:58:03.180393+0000","last_fullsized":"2024-05-07T13:58:03.180393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:02.747875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.246679+0000","last_change":"2024-05-07T13:55:50.321908+0000","last_active":"2024-05-07T13:58:59.246679+0000","last_peered":"2024-05-07T13:58:59.246679+0000","last_clean":"2024-05-07T13:58:59.246679+0000","last_became_active":"2024-05-07T13:55:50.321606+0000","last_became_peered":"2024-05-07T13:55:50.321606+0000","last_unstale":"2024-05-07T13:58:59.246679+0000","last_undegraded":"2024-05-07T13:58:59.246679+0000","last_fullsized":"2024-05-07T13:58:59.246679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:26.371060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361244+0000","last_change":"2024-05-07T13:55:48.332694+0000","last_active":"2024-05-07T13:56:35.361244+0000","last_peered":"2024-05-07T13:56:35.361244+0000","last_clean":"2024-05-07T13:56:35.361244+0000","last_became_active":"2024-05-07T13:55:48.332247+0000","last_became_peered":"2024-05-07T13:55:48.332247+0000","last_unstale":"2024-05-07T13:56:35.361244+0000","last_undegraded":"2024-05-07T13:56:35.361244+0000","last_fullsized":"2024-05-07T13:56:35.361244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408527+0000","last_change":"2024-05-07T13:55:50.329959+0000","last_active":"2024-05-07T13:58:59.408527+0000","last_peered":"2024-05-07T13:58:59.408527+0000","last_clean":"2024-05-07T13:58:59.408527+0000","last_became_active":"2024-05-07T13:55:50.329434+0000","last_became_peered":"2024-05-07T13:55:50.329434+0000","last_unstale":"2024-05-07T13:58:59.408527+0000","last_undegraded":"2024-05-07T13:58:59.408527+0000","last_fullsized":"2024-05-07T13:58:59.408527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.498000+0000","last_change":"2024-05-07T13:55:48.348177+0000","last_active":"2024-05-07T13:58:59.498000+0000","last_peered":"2024-05-07T13:58:59.498000+0000","last_clean":"2024-05-07T13:58:59.498000+0000","last_became_active":"2024-05-07T13:55:48.345844+0000","last_became_peered":"2024-05-07T13:55:48.345844+0000","last_unstale":"2024-05-07T13:58:59.498000+0000","last_undegraded":"2024-05-07T13:58:59.498000+0000","last_fullsized":"2024-05-07T13:58:59.498000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:03.127804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363106+0000","last_change":"2024-05-07T13:55:50.313698+0000","last_active":"2024-05-07T13:56:35.363106+0000","last_peered":"2024-05-07T13:56:35.363106+0000","last_clean":"2024-05-07T13:56:35.363106+0000","last_became_active":"2024-05-07T13:55:50.313049+0000","last_became_peered":"2024-05-07T13:55:50.313049+0000","last_unstale":"2024-05-07T13:56:35.363106+0000","last_undegraded":"2024-05-07T13:56:35.363106+0000","last_fullsized":"2024-05-07T13:56:35.363106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:43:49.979727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.121947+0000","last_change":"2024-05-07T13:55:48.349780+0000","last_active":"2024-05-07T13:58:59.121947+0000","last_peered":"2024-05-07T13:58:59.121947+0000","last_clean":"2024-05-07T13:58:59.121947+0000","last_became_active":"2024-05-07T13:55:48.346691+0000","last_became_peered":"2024-05-07T13:55:48.346691+0000","last_unstale":"2024-05-07T13:58:59.121947+0000","last_undegraded":"2024-05-07T13:58:59.121947+0000","last_fullsized":"2024-05-07T13:58:59.121947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:47.664009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'10","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.739245+0000","last_change":"2024-05-07T13:55:50.323717+0000","last_active":"2024-05-07T13:57:14.739245+0000","last_peered":"2024-05-07T13:57:14.739245+0000","last_clean":"2024-05-07T13:57:14.739245+0000","last_became_active":"2024-05-07T13:55:50.322543+0000","last_became_peered":"2024-05-07T13:55:50.322543+0000","last_unstale":"2024-05-07T13:57:14.739245+0000","last_undegraded":"2024-05-07T13:57:14.739245+0000","last_fullsized":"2024-05-07T13:57:14.739245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:12:56.152000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370285+0000","last_change":"2024-05-07T13:55:48.340889+0000","last_active":"2024-05-07T13:56:35.370285+0000","last_peered":"2024-05-07T13:56:35.370285+0000","last_clean":"2024-05-07T13:56:35.370285+0000","last_became_active":"2024-05-07T13:55:48.339909+0000","last_became_peered":"2024-05-07T13:55:48.339909+0000","last_unstale":"2024-05-07T13:56:35.370285+0000","last_undegraded":"2024-05-07T13:56:35.370285+0000","last_fullsized":"2024-05-07T13:56:35.370285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408516+0000","last_change":"2024-05-07T13:55:50.323280+0000","last_active":"2024-05-07T13:58:59.408516+0000","last_peered":"2024-05-07T13:58:59.408516+0000","last_clean":"2024-05-07T13:58:59.408516+0000","last_became_active":"2024-05-07T13:55:50.322967+0000","last_became_peered":"2024-05-07T13:55:50.322967+0000","last_unstale":"2024-05-07T13:58:59.408516+0000","last_undegraded":"2024-05-07T13:58:59.408516+0000","last_fullsized":"2024-05-07T13:58:59.408516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:51.713206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.102826+0000","last_change":"2024-05-07T13:55:48.347208+0000","last_active":"2024-05-07T13:58:59.102826+0000","last_peered":"2024-05-07T13:58:59.102826+0000","last_clean":"2024-05-07T13:58:59.102826+0000","last_became_active":"2024-05-07T13:55:48.346724+0000","last_became_peered":"2024-05-07T13:55:48.346724+0000","last_unstale":"2024-05-07T13:58:59.102826+0000","last_undegraded":"2024-05-07T13:58:59.102826+0000","last_fullsized":"2024-05-07T13:58:59.102826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:03.378851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357777+0000","last_change":"2024-05-07T13:55:48.351645+0000","last_active":"2024-05-07T13:56:35.357777+0000","last_peered":"2024-05-07T13:56:35.357777+0000","last_clean":"2024-05-07T13:56:35.357777+0000","last_became_active":"2024-05-07T13:55:48.349852+0000","last_became_peered":"2024-05-07T13:55:48.349852+0000","last_unstale":"2024-05-07T13:56:35.357777+0000","last_undegraded":"2024-05-07T13:56:35.357777+0000","last_fullsized":"2024-05-07T13:56:35.357777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:37:41.603367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408432+0000","last_change":"2024-05-07T13:55:50.319944+0000","last_active":"2024-05-07T13:58:59.408432+0000","last_peered":"2024-05-07T13:58:59.408432+0000","last_clean":"2024-05-07T13:58:59.408432+0000","last_became_active":"2024-05-07T13:55:50.319033+0000","last_became_peered":"2024-05-07T13:55:50.319033+0000","last_unstale":"2024-05-07T13:58:59.408432+0000","last_undegraded":"2024-05-07T13:58:59.408432+0000","last_fullsized":"2024-05-07T13:58:59.408432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359001+0000","last_change":"2024-05-07T13:55:48.326709+0000","last_active":"2024-05-07T13:56:35.359001+0000","last_peered":"2024-05-07T13:56:35.359001+0000","last_clean":"2024-05-07T13:56:35.359001+0000","last_became_active":"2024-05-07T13:55:48.324081+0000","last_became_peered":"2024-05-07T13:55:48.324081+0000","last_unstale":"2024-05-07T13:56:35.359001+0000","last_undegraded":"2024-05-07T13:56:35.359001+0000","last_fullsized":"2024-05-07T13:56:35.359001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723822+0000","last_change":"2024-05-07T13:55:50.330143+0000","last_active":"2024-05-07T13:57:58.723822+0000","last_peered":"2024-05-07T13:57:58.723822+0000","last_clean":"2024-05-07T13:57:58.723822+0000","last_became_active":"2024-05-07T13:55:50.329848+0000","last_became_peered":"2024-05-07T13:55:50.329848+0000","last_unstale":"2024-05-07T13:57:58.723822+0000","last_undegraded":"2024-05-07T13:57:58.723822+0000","last_fullsized":"2024-05-07T13:57:58.723822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:07.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1403,"num_read_kb":1189,"num_write":533,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1276,"ondisk_log_size":1276,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52492,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319348,"statfs":{"total":96636764160,"available":96583012352,"internally_reserved":0,"allocated":9048064,"data_stored":8742301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":9352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":9576448,"data_stored":9330398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":157,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48876,"kb_used_data":9380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322964,"statfs":{"total":96636764160,"available":96586715136,"internally_reserved":0,"allocated":9605120,"data_stored":9331528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":8800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":9011200,"data_stored":8741991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T13:59:07.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T13:59:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.504+0000 7f9fac07b640 1 Processor -- start 2024-05-07T13:59:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.505+0000 7f9fac07b640 1 -- start start 2024-05-07T13:59:07.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.505+0000 7f9fac07b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9fa40723d0 0x7f9fa406e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:07.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.505+0000 7f9fac07b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa412a9b0 con 0x7f9fa412ade0 2024-05-07T13:59:07.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.505+0000 7f9fac07b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa4070f10 con 0x7f9fa40723d0 2024-05-07T13:59:07.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.505+0000 7f9fa9e17640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9fa40723d0 0x7f9fa406e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:07.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.505+0000 7f9fa9616640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9fa412ade0 0x7f9fa412b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38164/0 (socket says 172.21.15.22:38164) 2024-05-07T13:59:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.505+0000 7f9fa9616640 1 -- 172.21.15.22:0/2810287952 learned_addr learned my addr 172.21.15.22:0/2810287952 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.506+0000 7f9fa9e17640 1 -- 172.21.15.22:0/2810287952 >> v1:172.21.15.22:6789/0 conn(0x7f9fa412ade0 legacy=0x7f9fa412b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.506+0000 7f9fa9e17640 1 -- 172.21.15.22:0/2810287952 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa4070740 con 0x7f9fa40723d0 2024-05-07T13:59:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.506+0000 7f9fa9e17640 1 --2- 172.21.15.22:0/2810287952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 0x7f9fa406e470 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009720 tx=0x7f9fa002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80438e8da57bec83 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.506+0000 7f9fa8e15640 1 -- 172.21.15.22:0/2810287952 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa0035020 con 0x7f9fa40723d0 2024-05-07T13:59:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.506+0000 7f9fa8e15640 1 -- 172.21.15.22:0/2810287952 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa0031760 con 0x7f9fa40723d0 2024-05-07T13:59:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.506+0000 7f9fa8e15640 1 -- 172.21.15.22:0/2810287952 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa0031a60 con 0x7f9fa40723d0 2024-05-07T13:59:07.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.507+0000 7f9fac07b640 1 -- 172.21.15.22:0/2810287952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 msgr2=0x7f9fa406e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:07.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.507+0000 7f9fac07b640 1 --2- 172.21.15.22:0/2810287952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 0x7f9fa406e470 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009720 tx=0x7f9fa002b8d0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.507+0000 7f9fac07b640 1 -- 172.21.15.22:0/2810287952 shutdown_connections 2024-05-07T13:59:07.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.507+0000 7f9fac07b640 1 --2- 172.21.15.22:0/2810287952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 0x7f9fa406e470 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.507+0000 7f9fac07b640 1 -- 172.21.15.22:0/2810287952 >> 172.21.15.22:0/2810287952 conn(0x7f9fa4099380 msgr2=0x7f9fa4099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:07.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.507+0000 7f9fac07b640 1 -- 172.21.15.22:0/2810287952 shutdown_connections 2024-05-07T13:59:07.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.507+0000 7f9fac07b640 1 -- 172.21.15.22:0/2810287952 wait complete. 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.508+0000 7f9fac07b640 1 Processor -- start 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.508+0000 7f9fac07b640 1 -- start start 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.508+0000 7f9fac07b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 0x7f9fa4113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.508+0000 7f9fac07b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4071e00 con 0x7f9fa40723d0 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.508+0000 7f9fa9e17640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 0x7f9fa4113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.508+0000 7f9fa9e17640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 0x7f9fa4113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35450/0 (socket says 172.21.15.22:35450) 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.508+0000 7f9fa9e17640 1 -- 172.21.15.22:0/3122888652 learned_addr learned my addr 172.21.15.22:0/3122888652 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.509+0000 7f9fa9e17640 1 -- 172.21.15.22:0/3122888652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa4115b50 con 0x7f9fa40723d0 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.509+0000 7f9fa9e17640 1 --2- 172.21.15.22:0/3122888652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 0x7f9fa4113bd0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0031730 tx=0x7f9fa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.509+0000 7f9f9a7fc640 1 -- 172.21.15.22:0/3122888652 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa003a920 con 0x7f9fa40723d0 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.509+0000 7f9f9a7fc640 1 -- 172.21.15.22:0/3122888652 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa003ab00 con 0x7f9fa40723d0 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.509+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa4116f50 con 0x7f9fa40723d0 2024-05-07T13:59:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.509+0000 7f9f9a7fc640 1 -- 172.21.15.22:0/3122888652 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa003ae20 con 0x7f9fa40723d0 2024-05-07T13:59:07.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.509+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa41142f0 con 0x7f9fa40723d0 2024-05-07T13:59:07.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.510+0000 7f9f9a7fc640 1 -- 172.21.15.22:0/3122888652 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9fa004b060 con 0x7f9fa40723d0 2024-05-07T13:59:07.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.510+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa4062e90 con 0x7f9fa40723d0 2024-05-07T13:59:07.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.510+0000 7f9f9a7fc640 1 --2- 172.21.15.22:0/3122888652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9f88038060 0x7f9f8803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:07.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.510+0000 7f9f9a7fc640 1 -- 172.21.15.22:0/3122888652 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9fa006d740 con 0x7f9fa40723d0 2024-05-07T13:59:07.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.510+0000 7f9fa9616640 1 --2- 172.21.15.22:0/3122888652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9f88038060 0x7f9f8803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:07.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.511+0000 7f9fa9616640 1 --2- 172.21.15.22:0/3122888652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9f88038060 0x7f9f8803a520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f94007fd0 tx=0x7f9f94007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:07.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.515+0000 7f9f9a7fc640 1 -- 172.21.15.22:0/3122888652 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9fa003f070 con 0x7f9fa40723d0 2024-05-07T13:59:07.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.696+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fa409c170 con 0x7f9fa40723d0 2024-05-07T13:59:07.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.698+0000 7f9f9a7fc640 1 -- 172.21.15.22:0/3122888652 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20957 (secure 0 0 0) 0x7f9fa00393b0 con 0x7f9fa40723d0 2024-05-07T13:59:07.688 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:59:07.688 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":29,"fsid":"454556b8-fea2-4140-96b4-1e350fef55bd","created":"2024-05-07T13:55:29.783021+0000","modified":"2024-05-07T13:56:35.352861+0000","last_up_change":"2024-05-07T13:55:38.033428+0000","last_in_change":"2024-05-07T13:55:30.874816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T13:55:38.145424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T13:55:38.719622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-07T13:55:46.318188+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-07T13:55:48.672863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-07T13:55:50.641711+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-07T13:55:52.421115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-07T13:55:54.364885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-07T13:55:56.435674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfafa174-71f4-467c-a8c9-5a236b7ce235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6801","nonce":2215278347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6803","nonce":2215278347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6807","nonce":2215278347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":2215278347},{"type":"v1","addr":"172.21.15.22:6805","nonce":2215278347}]},"public_addr":"172.21.15.22:6801/2215278347","cluster_addr":"172.21.15.22:6803/2215278347","heartbeat_back_addr":"172.21.15.22:6807/2215278347","heartbeat_front_addr":"172.21.15.22:6805/2215278347","state":["exists","up"]},{"osd":1,"uuid":"50061477-74f3-4cad-83da-eeee2d48855f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6801","nonce":3441257969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6803","nonce":3441257969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6807","nonce":3441257969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3441257969},{"type":"v1","addr":"172.21.15.50:6805","nonce":3441257969}]},"public_addr":"172.21.15.50:6801/3441257969","cluster_addr":"172.21.15.50:6803/3441257969","heartbeat_back_addr":"172.21.15.50:6807/3441257969","heartbeat_front_addr":"172.21.15.50:6805/3441257969","state":["exists","up"]},{"osd":2,"uuid":"20fbf061-68f0-40bb-8c65-b73c4e479b8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6809","nonce":2034796854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6811","nonce":2034796854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6817","nonce":2034796854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2034796854},{"type":"v1","addr":"172.21.15.50:6813","nonce":2034796854}]},"public_addr":"172.21.15.50:6809/2034796854","cluster_addr":"172.21.15.50:6811/2034796854","heartbeat_back_addr":"172.21.15.50:6817/2034796854","heartbeat_front_addr":"172.21.15.50:6813/2034796854","state":["exists","up"]},{"osd":3,"uuid":"8a563741-f524-4dcb-930d-b520f14dc3fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6816","nonce":3553060046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6819","nonce":3553060046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6823","nonce":3553060046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3553060046},{"type":"v1","addr":"172.21.15.50:6821","nonce":3553060046}]},"public_addr":"172.21.15.50:6816/3553060046","cluster_addr":"172.21.15.50:6819/3553060046","heartbeat_back_addr":"172.21.15.50:6823/3553060046","heartbeat_front_addr":"172.21.15.50:6821/3553060046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.939423+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.996698+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.961901+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T13:55:35.953145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.2","mappings":[{"from":3,"to":2}]},{"pgid":"5.6","mappings":[{"from":0,"to":1}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]},{"pgid":"5.17","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9f88038060 msgr2=0x7f9f8803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 --2- 172.21.15.22:0/3122888652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9f88038060 0x7f9f8803a520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f94007fd0 tx=0x7f9f94007ac0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 msgr2=0x7f9fa4113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 --2- 172.21.15.22:0/3122888652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 0x7f9fa4113bd0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0031730 tx=0x7f9fa00046c0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 shutdown_connections 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 --2- 172.21.15.22:0/3122888652 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f9f88038060 0x7f9f8803a520 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 --2- 172.21.15.22:0/3122888652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa40723d0 0x7f9fa4113bd0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 >> 172.21.15.22:0/3122888652 conn(0x7f9fa4099380 msgr2=0x7f9fa4121ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 shutdown_connections 2024-05-07T13:59:07.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:07.700+0000 7f9fac07b640 1 -- 172.21.15.22:0/3122888652 wait complete. 2024-05-07T13:59:08.699 INFO:tasks.ceph:Scrubbing osd.0 2024-05-07T13:59:08.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-07T13:59:08.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.831+0000 7fd3f863b640 1 Processor -- start 2024-05-07T13:59:08.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.831+0000 7fd3f863b640 1 -- start start 2024-05-07T13:59:08.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f863b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3f0127ee0 0x7fd3f01282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:08.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f863b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f006e6e0 con 0x7fd3f012af70 2024-05-07T13:59:08.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f863b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd3f0127a90 con 0x7fd3f0127ee0 2024-05-07T13:59:08.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f63d7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3f0127ee0 0x7fd3f01282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:08.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f5bd6640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd3f012af70 0x7fd3f012b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38176/0 (socket says 172.21.15.22:38176) 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f5bd6640 1 -- 172.21.15.22:0/3154358128 learned_addr learned my addr 172.21.15.22:0/3154358128 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f53d5640 1 -- 172.21.15.22:0/3154358128 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984603099 0 0) 0x7fd3f006e6e0 con 0x7fd3f012af70 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f53d5640 1 -- 172.21.15.22:0/3154358128 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3dc003520 con 0x7fd3f012af70 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f63d7640 1 -- 172.21.15.22:0/3154358128 >> v1:172.21.15.22:6789/0 conn(0x7fd3f012af70 legacy=0x7fd3f012b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.832+0000 7fd3f63d7640 1 -- 172.21.15.22:0/3154358128 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f0128800 con 0x7fd3f0127ee0 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.833+0000 7fd3f63d7640 1 --2- 172.21.15.22:0/3154358128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 0x7fd3f01282c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009720 tx=0x7fd3ec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1aa1cf5e801048a server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.833+0000 7fd3f53d5640 1 -- 172.21.15.22:0/3154358128 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec0316d0 con 0x7fd3f0127ee0 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.833+0000 7fd3f53d5640 1 -- 172.21.15.22:0/3154358128 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec037070 con 0x7fd3f0127ee0 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.833+0000 7fd3f53d5640 1 -- 172.21.15.22:0/3154358128 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec0319c0 con 0x7fd3f0127ee0 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.834+0000 7fd3f863b640 1 -- 172.21.15.22:0/3154358128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 msgr2=0x7fd3f01282c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.834+0000 7fd3f863b640 1 --2- 172.21.15.22:0/3154358128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 0x7fd3f01282c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009720 tx=0x7fd3ec02b840 comp rx=0 tx=0).stop 2024-05-07T13:59:08.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.834+0000 7fd3f863b640 1 -- 172.21.15.22:0/3154358128 shutdown_connections 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.834+0000 7fd3f863b640 1 --2- 172.21.15.22:0/3154358128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 0x7fd3f01282c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.834+0000 7fd3f863b640 1 -- 172.21.15.22:0/3154358128 >> 172.21.15.22:0/3154358128 conn(0x7fd3f00991a0 msgr2=0x7fd3f00995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.834+0000 7fd3f863b640 1 -- 172.21.15.22:0/3154358128 shutdown_connections 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.834+0000 7fd3f863b640 1 -- 172.21.15.22:0/3154358128 wait complete. 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.835+0000 7fd3f863b640 1 Processor -- start 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.835+0000 7fd3f863b640 1 -- start start 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.835+0000 7fd3f863b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 0x7fd3f0112ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.835+0000 7fd3f863b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f0071e90 con 0x7fd3f0127ee0 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.835+0000 7fd3f63d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 0x7fd3f0112ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.835+0000 7fd3f63d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 0x7fd3f0112ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35470/0 (socket says 172.21.15.22:35470) 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.835+0000 7fd3f63d7640 1 -- 172.21.15.22:0/246426367 learned_addr learned my addr 172.21.15.22:0/246426367 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.836+0000 7fd3f63d7640 1 -- 172.21.15.22:0/246426367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f0114bc0 con 0x7fd3f0127ee0 2024-05-07T13:59:08.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.836+0000 7fd3f63d7640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 0x7fd3f0112ee0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec000c00 tx=0x7fd3ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.836+0000 7fd3e6ffd640 1 -- 172.21.15.22:0/246426367 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec032640 con 0x7fd3f0127ee0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.836+0000 7fd3e6ffd640 1 -- 172.21.15.22:0/246426367 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec0327e0 con 0x7fd3f0127ee0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.836+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f0114330 con 0x7fd3f0127ee0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.836+0000 7fd3e6ffd640 1 -- 172.21.15.22:0/246426367 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ec032ae0 con 0x7fd3f0127ee0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.836+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f0124860 con 0x7fd3f0127ee0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.837+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3f0062e90 con 0x7fd3f0127ee0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.837+0000 7fd3e6ffd640 1 -- 172.21.15.22:0/246426367 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd3ec04c060 con 0x7fd3f0127ee0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.837+0000 7fd3e6ffd640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd3d4038060 0x7fd3d403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.837+0000 7fd3e6ffd640 1 -- 172.21.15.22:0/246426367 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fd3ec02f050 con 0x7fd3f0127ee0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.837+0000 7fd3e6ffd640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd3d4044530 0x7fd3d40469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.837+0000 7fd3e6ffd640 1 -- 172.21.15.22:0/246426367 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3ec004490 con 0x7fd3d4044530 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.837+0000 7fd3e6ffd640 1 -- 172.21.15.22:0/246426367 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3ec06f610 con 0x7fd3f0127ee0 2024-05-07T13:59:08.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.837+0000 7fd3f6bd8640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd3d4044530 0x7fd3d40469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:08.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.838+0000 7fd3f5bd6640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd3d4038060 0x7fd3d403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:08.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.838+0000 7fd3f6bd8640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd3d4044530 0x7fd3d40469d0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:08.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.838+0000 7fd3f5bd6640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd3d4038060 0x7fd3d403a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0001610 tx=0x7fd3e0007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:08.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.838+0000 7fd3e6ffd640 1 -- 172.21.15.22:0/246426367 <== osd.0 v2:172.21.15.22:6800/2215278347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3ec004490 con 0x7fd3d4044530 2024-05-07T13:59:08.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 --> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd3f0121df0 con 0x7fd3d4044530 2024-05-07T13:59:08.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3e6ffd640 1 -- 172.21.15.22:0/246426367 <== osd.0 v2:172.21.15.22:6800/2215278347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd3f0121df0 con 0x7fd3d4044530 2024-05-07T13:59:08.840 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-07T13:59:08.840 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T13:59:08.840 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd3d4044530 msgr2=0x7fd3d40469d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd3d4044530 0x7fd3d40469d0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd3d4038060 msgr2=0x7fd3d403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd3d4038060 0x7fd3d403a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0001610 tx=0x7fd3e0007970 comp rx=0 tx=0).stop 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 msgr2=0x7fd3f0112ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 0x7fd3f0112ee0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec000c00 tx=0x7fd3ec0046c0 comp rx=0 tx=0).stop 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 shutdown_connections 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:6800/2215278347,v1:172.21.15.22:6801/2215278347] conn(0x7fd3d4044530 0x7fd3d40469d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7fd3d4038060 0x7fd3d403a520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 --2- 172.21.15.22:0/246426367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3f0127ee0 0x7fd3f0112ee0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 >> 172.21.15.22:0/246426367 conn(0x7fd3f00991a0 msgr2=0x7fd3f006ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 shutdown_connections 2024-05-07T13:59:08.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.852+0000 7fd3f863b640 1 -- 172.21.15.22:0/246426367 wait complete. 2024-05-07T13:59:08.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-07T13:59:08.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.967+0000 7f751df52640 1 Processor -- start 2024-05-07T13:59:08.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.967+0000 7f751df52640 1 -- start start 2024-05-07T13:59:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.967+0000 7f751df52640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f751806df70 0x7f75181316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.967+0000 7f751df52640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7518098840 con 0x7f751806d480 2024-05-07T13:59:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.967+0000 7f751df52640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7518072040 con 0x7f751806df70 2024-05-07T13:59:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.968+0000 7f7516ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f751806df70 0x7f75181316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.968+0000 7f75177fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f751806d480 0x7f751806d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38182/0 (socket says 172.21.15.22:38182) 2024-05-07T13:59:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.968+0000 7f75177fe640 1 -- 172.21.15.22:0/36706066 learned_addr learned my addr 172.21.15.22:0/36706066 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.968+0000 7f7516ffd640 1 -- 172.21.15.22:0/36706066 >> v1:172.21.15.22:6789/0 conn(0x7f751806d480 legacy=0x7f751806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.968+0000 7f7516ffd640 1 -- 172.21.15.22:0/36706066 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7518070b20 con 0x7f751806df70 2024-05-07T13:59:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.968+0000 7f75167fc640 1 -- 172.21.15.22:0/36706066 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2526832217 0 0) 0x7f7518098840 con 0x7f751806d480 2024-05-07T13:59:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f7516ffd640 1 --2- 172.21.15.22:0/36706066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806df70 0x7f75181316a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f750c009720 tx=0x7f750c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c7fffe63d0fc20 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f75167fc640 1 -- 172.21.15.22:0/36706066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750c0316d0 con 0x7f751806df70 2024-05-07T13:59:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f75167fc640 1 -- 172.21.15.22:0/36706066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c037070 con 0x7f751806df70 2024-05-07T13:59:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f75167fc640 1 -- 172.21.15.22:0/36706066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f750c0319c0 con 0x7f751806df70 2024-05-07T13:59:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f751df52640 1 -- 172.21.15.22:0/36706066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806df70 msgr2=0x7f75181316a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f751df52640 1 --2- 172.21.15.22:0/36706066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806df70 0x7f75181316a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f750c009720 tx=0x7f750c02b840 comp rx=0 tx=0).stop 2024-05-07T13:59:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f751df52640 1 -- 172.21.15.22:0/36706066 shutdown_connections 2024-05-07T13:59:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f751df52640 1 --2- 172.21.15.22:0/36706066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806df70 0x7f75181316a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f751df52640 1 -- 172.21.15.22:0/36706066 >> 172.21.15.22:0/36706066 conn(0x7f75180996c0 msgr2=0x7f7518099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f751df52640 1 -- 172.21.15.22:0/36706066 shutdown_connections 2024-05-07T13:59:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.969+0000 7f751df52640 1 -- 172.21.15.22:0/36706066 wait complete. 2024-05-07T13:59:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.970+0000 7f751df52640 1 Processor -- start 2024-05-07T13:59:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.970+0000 7f751df52640 1 -- start start 2024-05-07T13:59:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f751df52640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806d480 0x7f751812cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f751df52640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7518071270 con 0x7f751806d480 2024-05-07T13:59:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f75177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806d480 0x7f751812cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f75177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806d480 0x7f751812cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35484/0 (socket says 172.21.15.22:35484) 2024-05-07T13:59:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f75177fe640 1 -- 172.21.15.22:0/2299604592 learned_addr learned my addr 172.21.15.22:0/2299604592 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f75177fe640 1 -- 172.21.15.22:0/2299604592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7518131130 con 0x7f751806d480 2024-05-07T13:59:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f75177fe640 1 --2- 172.21.15.22:0/2299604592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806d480 0x7f751812cf20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f750800c420 tx=0x7f750800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f74fffff640 1 -- 172.21.15.22:0/2299604592 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7508018070 con 0x7f751806d480 2024-05-07T13:59:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f74fffff640 1 -- 172.21.15.22:0/2299604592 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75080074d0 con 0x7f751806d480 2024-05-07T13:59:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7518130740 con 0x7f751806d480 2024-05-07T13:59:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f74fffff640 1 -- 172.21.15.22:0/2299604592 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7508004950 con 0x7f751806d480 2024-05-07T13:59:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.971+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751812fa60 con 0x7f751806d480 2024-05-07T13:59:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.973+0000 7f74fffff640 1 -- 172.21.15.22:0/2299604592 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f750801b070 con 0x7f751806d480 2024-05-07T13:59:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.973+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751812e080 con 0x7f751806d480 2024-05-07T13:59:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.973+0000 7f74fffff640 1 --2- 172.21.15.22:0/2299604592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7504038060 0x7f750403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.973+0000 7f74fffff640 1 -- 172.21.15.22:0/2299604592 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f750804ad90 con 0x7f751806d480 2024-05-07T13:59:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.973+0000 7f7516ffd640 1 --2- 172.21.15.22:0/2299604592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7504038060 0x7f750403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.974+0000 7f7516ffd640 1 --2- 172.21.15.22:0/2299604592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7504038060 0x7f750403a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f750c036000 tx=0x7f750c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:08.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:08.978+0000 7f74fffff640 1 -- 172.21.15.22:0/2299604592 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f751812fa60 con 0x7f751806d480 2024-05-07T13:59:09.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.163+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f751812e750 con 0x7f7504038060 2024-05-07T13:59:09.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.164+0000 7f74fffff640 1 -- 172.21.15.22:0/2299604592 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f751812e750 con 0x7f7504038060 2024-05-07T13:59:09.151 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 0 to deep-scrub 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7504038060 msgr2=0x7f750403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 --2- 172.21.15.22:0/2299604592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7504038060 0x7f750403a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f750c036000 tx=0x7f750c008030 comp rx=0 tx=0).stop 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806d480 msgr2=0x7f751812cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 --2- 172.21.15.22:0/2299604592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806d480 0x7f751812cf20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f750800c420 tx=0x7f750800c8e0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 shutdown_connections 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 --2- 172.21.15.22:0/2299604592 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f7504038060 0x7f750403a520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 --2- 172.21.15.22:0/2299604592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751806d480 0x7f751812cf20 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 >> 172.21.15.22:0/2299604592 conn(0x7f75180996c0 msgr2=0x7f751809b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 shutdown_connections 2024-05-07T13:59:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.166+0000 7f751df52640 1 -- 172.21.15.22:0/2299604592 wait complete. 2024-05-07T13:59:09.165 INFO:tasks.ceph:Scrubbing osd.1 2024-05-07T13:59:09.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-07T13:59:09.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.283+0000 7f54fad25640 1 Processor -- start 2024-05-07T13:59:09.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.283+0000 7f54fad25640 1 -- start start 2024-05-07T13:59:09.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.284+0000 7f54fad25640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f54f406e2e0 0x7f54f41336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.284+0000 7f54fad25640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f406e7c0 con 0x7f54f406d7f0 2024-05-07T13:59:09.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.284+0000 7f54fad25640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f54f406f9f0 con 0x7f54f406e2e0 2024-05-07T13:59:09.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.284+0000 7f54f3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f54f406e2e0 0x7f54f41336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.284+0000 7f54f8ac1640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f54f406d7f0 0x7f54f406dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38188/0 (socket says 172.21.15.22:38188) 2024-05-07T13:59:09.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.284+0000 7f54f8ac1640 1 -- 172.21.15.22:0/3604884670 learned_addr learned my addr 172.21.15.22:0/3604884670 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:09.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.284+0000 7f54f3fff640 1 -- 172.21.15.22:0/3604884670 >> v1:172.21.15.22:6789/0 conn(0x7f54f406d7f0 legacy=0x7f54f406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.284+0000 7f54f3fff640 1 -- 172.21.15.22:0/3604884670 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f406f210 con 0x7f54f406e2e0 2024-05-07T13:59:09.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.284+0000 7f54f37fe640 1 -- 172.21.15.22:0/3604884670 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696205198 0 0) 0x7f54f406e7c0 con 0x7f54f406d7f0 2024-05-07T13:59:09.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.285+0000 7f54f3fff640 1 --2- 172.21.15.22:0/3604884670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406e2e0 0x7f54f41336a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009720 tx=0x7f54e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bb3b98cba2036a server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.285+0000 7f54f37fe640 1 -- 172.21.15.22:0/3604884670 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e80316d0 con 0x7f54f406e2e0 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.285+0000 7f54f37fe640 1 -- 172.21.15.22:0/3604884670 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e8037070 con 0x7f54f406e2e0 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.285+0000 7f54f37fe640 1 -- 172.21.15.22:0/3604884670 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e80319c0 con 0x7f54f406e2e0 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.286+0000 7f54fad25640 1 -- 172.21.15.22:0/3604884670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406e2e0 msgr2=0x7f54f41336a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.286+0000 7f54fad25640 1 --2- 172.21.15.22:0/3604884670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406e2e0 0x7f54f41336a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009720 tx=0x7f54e802b840 comp rx=0 tx=0).stop 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.286+0000 7f54fad25640 1 -- 172.21.15.22:0/3604884670 shutdown_connections 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.286+0000 7f54fad25640 1 --2- 172.21.15.22:0/3604884670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406e2e0 0x7f54f41336a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.286+0000 7f54fad25640 1 -- 172.21.15.22:0/3604884670 >> 172.21.15.22:0/3604884670 conn(0x7f54f40a0b40 msgr2=0x7f54f40a0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.286+0000 7f54fad25640 1 -- 172.21.15.22:0/3604884670 shutdown_connections 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.286+0000 7f54fad25640 1 -- 172.21.15.22:0/3604884670 wait complete. 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.286+0000 7f54fad25640 1 Processor -- start 2024-05-07T13:59:09.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.287+0000 7f54fad25640 1 -- start start 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.287+0000 7f54fad25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406d7f0 0x7f54f409a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.287+0000 7f54fad25640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f54f4133df0 con 0x7f54f406d7f0 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.287+0000 7f54f8ac1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406d7f0 0x7f54f409a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.287+0000 7f54f8ac1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406d7f0 0x7f54f409a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35502/0 (socket says 172.21.15.22:35502) 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.287+0000 7f54f8ac1640 1 -- 172.21.15.22:0/4284729833 learned_addr learned my addr 172.21.15.22:0/4284729833 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.287+0000 7f54f8ac1640 1 -- 172.21.15.22:0/4284729833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f409e390 con 0x7f54f406d7f0 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.288+0000 7f54f8ac1640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406d7f0 0x7f54f409a7f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f54e400c420 tx=0x7f54e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.288+0000 7f54f17fa640 1 -- 172.21.15.22:0/4284729833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e4018070 con 0x7f54f406d7f0 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.288+0000 7f54f17fa640 1 -- 172.21.15.22:0/4284729833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e40074d0 con 0x7f54f406d7f0 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.288+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f4133410 con 0x7f54f406d7f0 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.288+0000 7f54f17fa640 1 -- 172.21.15.22:0/4284729833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e4004950 con 0x7f54f406d7f0 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.288+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f4131e20 con 0x7f54f406d7f0 2024-05-07T13:59:09.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.289+0000 7f54f17fa640 1 -- 172.21.15.22:0/4284729833 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f54e401b070 con 0x7f54f406d7f0 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.289+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54f4062e90 con 0x7f54f406d7f0 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.289+0000 7f54f17fa640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f54e0038060 0x7f54e003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.289+0000 7f54f17fa640 1 -- 172.21.15.22:0/4284729833 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f54e404add0 con 0x7f54f406d7f0 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.289+0000 7f54f17fa640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f54e00444b0 0x7f54e0046950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.289+0000 7f54f17fa640 1 -- 172.21.15.22:0/4284729833 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54e4017ec0 con 0x7f54e00444b0 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.289+0000 7f54f17fa640 1 -- 172.21.15.22:0/4284729833 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f54e4004af0 con 0x7f54f406d7f0 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.289+0000 7f54f3fff640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f54e0038060 0x7f54e003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.289+0000 7f54f92c2640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f54e00444b0 0x7f54e0046950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.290+0000 7f54f92c2640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f54e00444b0 0x7f54e0046950 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.290+0000 7f54f3fff640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f54e0038060 0x7f54e003a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f54e8036000 tx=0x7f54e8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.290+0000 7f54f17fa640 1 -- 172.21.15.22:0/4284729833 <== osd.1 v2:172.21.15.50:6800/3441257969 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54e4017ec0 con 0x7f54e00444b0 2024-05-07T13:59:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 --> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54f406e7c0 con 0x7f54e00444b0 2024-05-07T13:59:09.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54f17fa640 1 -- 172.21.15.22:0/4284729833 <== osd.1 v2:172.21.15.50:6800/3441257969 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f54f406e7c0 con 0x7f54e00444b0 2024-05-07T13:59:09.292 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-07T13:59:09.292 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T13:59:09.292 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-07T13:59:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f54e00444b0 msgr2=0x7f54e0046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f54e00444b0 0x7f54e0046950 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f54e0038060 msgr2=0x7f54e003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f54e0038060 0x7f54e003a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f54e8036000 tx=0x7f54e8008030 comp rx=0 tx=0).stop 2024-05-07T13:59:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406d7f0 msgr2=0x7f54f409a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406d7f0 0x7f54f409a7f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f54e400c420 tx=0x7f54e400c8e0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 shutdown_connections 2024-05-07T13:59:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6800/3441257969,v1:172.21.15.50:6801/3441257969] conn(0x7f54e00444b0 0x7f54e0046950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f54e0038060 0x7f54e003a520 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 --2- 172.21.15.22:0/4284729833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54f406d7f0 0x7f54f409a7f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 >> 172.21.15.22:0/4284729833 conn(0x7f54f40a0b40 msgr2=0x7f54f412ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 shutdown_connections 2024-05-07T13:59:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.304+0000 7f54fad25640 1 -- 172.21.15.22:0/4284729833 wait complete. 2024-05-07T13:59:09.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-07T13:59:09.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.418+0000 7f8d72b15640 1 Processor -- start 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.418+0000 7f8d72b15640 1 -- start start 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.418+0000 7f8d72b15640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d6c06d480 0x7f8d6c06d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.418+0000 7f8d72b15640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6c098840 con 0x7f8d6c0710f0 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.418+0000 7f8d72b15640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6c072040 con 0x7f8d6c06d480 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.418+0000 7f8d708b1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d6c06d480 0x7f8d6c06d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.418+0000 7f8d6bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8d6c0710f0 0x7f8d6c096090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38194/0 (socket says 172.21.15.22:38194) 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.418+0000 7f8d708b1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d6c06d480 0x7f8d6c06d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35516/0 (socket says 172.21.15.22:35516) 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.418+0000 7f8d6bfff640 1 -- 172.21.15.22:0/1947343947 learned_addr learned my addr 172.21.15.22:0/1947343947 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.419+0000 7f8d708b1640 1 -- 172.21.15.22:0/1947343947 >> v1:172.21.15.22:6789/0 conn(0x7f8d6c0710f0 legacy=0x7f8d6c096090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.419+0000 7f8d708b1640 1 -- 172.21.15.22:0/1947343947 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c070b20 con 0x7f8d6c06d480 2024-05-07T13:59:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.419+0000 7f8d6b7fe640 1 -- 172.21.15.22:0/1947343947 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243994020 0 0) 0x7f8d6c098840 con 0x7f8d6c0710f0 2024-05-07T13:59:09.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.419+0000 7f8d708b1640 1 --2- 172.21.15.22:0/1947343947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 0x7f8d6c06d860 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009720 tx=0x7f8d6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6aa96ea98c3cbf server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.419+0000 7f8d6b7fe640 1 -- 172.21.15.22:0/1947343947 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d600316d0 con 0x7f8d6c06d480 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.420+0000 7f8d6b7fe640 1 -- 172.21.15.22:0/1947343947 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d60037070 con 0x7f8d6c06d480 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.420+0000 7f8d6b7fe640 1 -- 172.21.15.22:0/1947343947 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d600319c0 con 0x7f8d6c06d480 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.420+0000 7f8d72b15640 1 -- 172.21.15.22:0/1947343947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 msgr2=0x7f8d6c06d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.420+0000 7f8d72b15640 1 --2- 172.21.15.22:0/1947343947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 0x7f8d6c06d860 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009720 tx=0x7f8d6002b840 comp rx=0 tx=0).stop 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.420+0000 7f8d72b15640 1 -- 172.21.15.22:0/1947343947 shutdown_connections 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.420+0000 7f8d72b15640 1 --2- 172.21.15.22:0/1947343947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 0x7f8d6c06d860 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.420+0000 7f8d72b15640 1 -- 172.21.15.22:0/1947343947 >> 172.21.15.22:0/1947343947 conn(0x7f8d6c0996c0 msgr2=0x7f8d6c099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.420+0000 7f8d72b15640 1 -- 172.21.15.22:0/1947343947 shutdown_connections 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.420+0000 7f8d72b15640 1 -- 172.21.15.22:0/1947343947 wait complete. 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.421+0000 7f8d72b15640 1 Processor -- start 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.421+0000 7f8d72b15640 1 -- start start 2024-05-07T13:59:09.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d72b15640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 0x7f8d6c1240e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d72b15640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c06df20 con 0x7f8d6c06d480 2024-05-07T13:59:09.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d708b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 0x7f8d6c1240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d708b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 0x7f8d6c1240e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35530/0 (socket says 172.21.15.22:35530) 2024-05-07T13:59:09.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d708b1640 1 -- 172.21.15.22:0/4265486784 learned_addr learned my addr 172.21.15.22:0/4265486784 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:09.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d708b1640 1 -- 172.21.15.22:0/4265486784 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c125e80 con 0x7f8d6c06d480 2024-05-07T13:59:09.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d708b1640 1 --2- 172.21.15.22:0/4265486784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 0x7f8d6c1240e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009720 tx=0x7f8d600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d697fa640 1 -- 172.21.15.22:0/4265486784 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d60032770 con 0x7f8d6c06d480 2024-05-07T13:59:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d697fa640 1 -- 172.21.15.22:0/4265486784 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d60032910 con 0x7f8d6c06d480 2024-05-07T13:59:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c08a2b0 con 0x7f8d6c06d480 2024-05-07T13:59:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d697fa640 1 -- 172.21.15.22:0/4265486784 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d60032bf0 con 0x7f8d6c06d480 2024-05-07T13:59:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.422+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c124620 con 0x7f8d6c06d480 2024-05-07T13:59:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.423+0000 7f8d697fa640 1 -- 172.21.15.22:0/4265486784 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8d6004c060 con 0x7f8d6c06d480 2024-05-07T13:59:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.423+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c126670 con 0x7f8d6c06d480 2024-05-07T13:59:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.423+0000 7f8d697fa640 1 --2- 172.21.15.22:0/4265486784 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d500380b0 0x7f8d5003a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.423+0000 7f8d697fa640 1 -- 172.21.15.22:0/4265486784 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8d6002f050 con 0x7f8d6c06d480 2024-05-07T13:59:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.424+0000 7f8d6bfff640 1 --2- 172.21.15.22:0/4265486784 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d500380b0 0x7f8d5003a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.424+0000 7f8d6bfff640 1 --2- 172.21.15.22:0/4265486784 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d500380b0 0x7f8d5003a570 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8d580011e0 tx=0x7f8d58007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.428+0000 7f8d697fa640 1 -- 172.21.15.22:0/4265486784 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8d60040070 con 0x7f8d6c06d480 2024-05-07T13:59:09.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.611+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f8d6c062e90 con 0x7f8d500380b0 2024-05-07T13:59:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.613+0000 7f8d697fa640 1 -- 172.21.15.22:0/4265486784 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8d6c062e90 con 0x7f8d500380b0 2024-05-07T13:59:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 1 to deep-scrub 2024-05-07T13:59:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d500380b0 msgr2=0x7f8d5003a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 --2- 172.21.15.22:0/4265486784 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d500380b0 0x7f8d5003a570 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8d580011e0 tx=0x7f8d58007930 comp rx=0 tx=0).stop 2024-05-07T13:59:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 msgr2=0x7f8d6c1240e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 --2- 172.21.15.22:0/4265486784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 0x7f8d6c1240e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009720 tx=0x7f8d600046c0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 shutdown_connections 2024-05-07T13:59:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 --2- 172.21.15.22:0/4265486784 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f8d500380b0 0x7f8d5003a570 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 --2- 172.21.15.22:0/4265486784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c06d480 0x7f8d6c1240e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 >> 172.21.15.22:0/4265486784 conn(0x7f8d6c0996c0 msgr2=0x7f8d6c1b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 shutdown_connections 2024-05-07T13:59:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.614+0000 7f8d72b15640 1 -- 172.21.15.22:0/4265486784 wait complete. 2024-05-07T13:59:09.613 INFO:tasks.ceph:Scrubbing osd.2 2024-05-07T13:59:09.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-07T13:59:09.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.731+0000 7f160412b640 1 Processor -- start 2024-05-07T13:59:09.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.731+0000 7f160412b640 1 -- start start 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.732+0000 7f160412b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f15fc12e9a0 0x7f15fc12ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.732+0000 7f160412b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15fc071aa0 con 0x7f15fc06e470 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.732+0000 7f160412b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f15fc071870 con 0x7f15fc12e9a0 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.732+0000 7f1601ec7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f15fc12e9a0 0x7f15fc12ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.732+0000 7f16016c6640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f15fc06e470 0x7f15fc06e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38204/0 (socket says 172.21.15.22:38204) 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.732+0000 7f1601ec7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f15fc12e9a0 0x7f15fc12ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35538/0 (socket says 172.21.15.22:35538) 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.732+0000 7f16016c6640 1 -- 172.21.15.22:0/1004865249 learned_addr learned my addr 172.21.15.22:0/1004865249 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.732+0000 7f1601ec7640 1 -- 172.21.15.22:0/1004865249 >> v1:172.21.15.22:6789/0 conn(0x7f15fc06e470 legacy=0x7f15fc06e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.732+0000 7f1601ec7640 1 -- 172.21.15.22:0/1004865249 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc070be0 con 0x7f15fc12e9a0 2024-05-07T13:59:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.733+0000 7f1601ec7640 1 --2- 172.21.15.22:0/1004865249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc12e9a0 0x7f15fc12ed80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009720 tx=0x7f15f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8508c6eff322fa server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.733+0000 7f1600ec5640 1 -- 172.21.15.22:0/1004865249 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f8035020 con 0x7f15fc12e9a0 2024-05-07T13:59:09.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.733+0000 7f1600ec5640 1 -- 172.21.15.22:0/1004865249 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f8031760 con 0x7f15fc12e9a0 2024-05-07T13:59:09.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.733+0000 7f1600ec5640 1 -- 172.21.15.22:0/1004865249 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f8031a60 con 0x7f15fc12e9a0 2024-05-07T13:59:09.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.733+0000 7f160412b640 1 -- 172.21.15.22:0/1004865249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc12e9a0 msgr2=0x7f15fc12ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.733+0000 7f160412b640 1 --2- 172.21.15.22:0/1004865249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc12e9a0 0x7f15fc12ed80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009720 tx=0x7f15f802b8d0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.734+0000 7f160412b640 1 -- 172.21.15.22:0/1004865249 shutdown_connections 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.734+0000 7f160412b640 1 --2- 172.21.15.22:0/1004865249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc12e9a0 0x7f15fc12ed80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.734+0000 7f160412b640 1 -- 172.21.15.22:0/1004865249 >> 172.21.15.22:0/1004865249 conn(0x7f15fc0991a0 msgr2=0x7f15fc0995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.734+0000 7f160412b640 1 -- 172.21.15.22:0/1004865249 shutdown_connections 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.734+0000 7f160412b640 1 -- 172.21.15.22:0/1004865249 wait complete. 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.734+0000 7f160412b640 1 Processor -- start 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.734+0000 7f160412b640 1 -- start start 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f160412b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc06e470 0x7f15fc1c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f160412b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc06f380 con 0x7f15fc06e470 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f1601ec7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc06e470 0x7f15fc1c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f1601ec7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc06e470 0x7f15fc1c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35550/0 (socket says 172.21.15.22:35550) 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f1601ec7640 1 -- 172.21.15.22:0/3553576015 learned_addr learned my addr 172.21.15.22:0/3553576015 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:09.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f1601ec7640 1 -- 172.21.15.22:0/3553576015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc120a00 con 0x7f15fc06e470 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f1601ec7640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc06e470 0x7f15fc1c33d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009840 tx=0x7f15f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f15f27fc640 1 -- 172.21.15.22:0/3553576015 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f803b930 con 0x7f15fc06e470 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f15f27fc640 1 -- 172.21.15.22:0/3553576015 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f803bb10 con 0x7f15fc06e470 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f15f27fc640 1 -- 172.21.15.22:0/3553576015 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f803be30 con 0x7f15fc06e470 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.735+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15fc121690 con 0x7f15fc06e470 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.736+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15fc1c3910 con 0x7f15fc06e470 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.736+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15fc062e90 con 0x7f15fc06e470 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.736+0000 7f15f27fc640 1 -- 172.21.15.22:0/3553576015 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f15f804c060 con 0x7f15fc06e470 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.737+0000 7f15f27fc640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f15e0038060 0x7f15e003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.737+0000 7f15f27fc640 1 -- 172.21.15.22:0/3553576015 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f15f806da00 con 0x7f15fc06e470 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.737+0000 7f15f27fc640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f15e00444d0 0x7f15e0046970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.737+0000 7f15f27fc640 1 -- 172.21.15.22:0/3553576015 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15f8007e60 con 0x7f15e00444d0 2024-05-07T13:59:09.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.737+0000 7f15f27fc640 1 -- 172.21.15.22:0/3553576015 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15f80722a0 con 0x7f15fc06e470 2024-05-07T13:59:09.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.737+0000 7f16016c6640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f15e0038060 0x7f15e003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.737+0000 7f16026c8640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f15e00444d0 0x7f15e0046970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.738+0000 7f16026c8640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f15e00444d0 0x7f15e0046970 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.738+0000 7f16016c6640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f15e0038060 0x7f15e003a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f15ec007fd0 tx=0x7f15ec007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.738+0000 7f15f27fc640 1 -- 172.21.15.22:0/3553576015 <== osd.2 v2:172.21.15.50:6808/2034796854 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f15f8007e60 con 0x7f15e00444d0 2024-05-07T13:59:09.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.751+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 --> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f15fc12b680 con 0x7f15e00444d0 2024-05-07T13:59:09.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.752+0000 7f15f27fc640 1 -- 172.21.15.22:0/3553576015 <== osd.2 v2:172.21.15.50:6808/2034796854 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f15fc12b680 con 0x7f15e00444d0 2024-05-07T13:59:09.740 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-07T13:59:09.740 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T13:59:09.741 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-07T13:59:09.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f15e00444d0 msgr2=0x7f15e0046970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f15e00444d0 0x7f15e0046970 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f15e0038060 msgr2=0x7f15e003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f15e0038060 0x7f15e003a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f15ec007fd0 tx=0x7f15ec007ac0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc06e470 msgr2=0x7f15fc1c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc06e470 0x7f15fc1c33d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009840 tx=0x7f15f80046c0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 shutdown_connections 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6808/2034796854,v1:172.21.15.50:6809/2034796854] conn(0x7f15e00444d0 0x7f15e0046970 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f15e0038060 0x7f15e003a520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 --2- 172.21.15.22:0/3553576015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15fc06e470 0x7f15fc1c33d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 >> 172.21.15.22:0/3553576015 conn(0x7f15fc0991a0 msgr2=0x7f15fc12cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 shutdown_connections 2024-05-07T13:59:09.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.753+0000 7f160412b640 1 -- 172.21.15.22:0/3553576015 wait complete. 2024-05-07T13:59:09.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-07T13:59:09.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.866+0000 7f46afb00640 1 Processor -- start 2024-05-07T13:59:09.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.867+0000 7f46afb00640 1 -- start start 2024-05-07T13:59:09.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.867+0000 7f46afb00640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f46a812db20 0x7f46a812ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.867+0000 7f46afb00640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a806f120 con 0x7f46a806d6f0 2024-05-07T13:59:09.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.867+0000 7f46afb00640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f46a806e800 con 0x7f46a812db20 2024-05-07T13:59:09.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.867+0000 7f46ad09b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f46a812db20 0x7f46a812ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.867+0000 7f46ad89c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f46a806d6f0 0x7f46a806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38220/0 (socket says 172.21.15.22:38220) 2024-05-07T13:59:09.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.867+0000 7f46ad89c640 1 -- 172.21.15.22:0/630404691 learned_addr learned my addr 172.21.15.22:0/630404691 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:09.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.868+0000 7f46ad09b640 1 -- 172.21.15.22:0/630404691 >> v1:172.21.15.22:6789/0 conn(0x7f46a806d6f0 legacy=0x7f46a806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.868+0000 7f46ad09b640 1 -- 172.21.15.22:0/630404691 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a8071b20 con 0x7f46a812db20 2024-05-07T13:59:09.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.868+0000 7f46ac89a640 1 -- 172.21.15.22:0/630404691 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310049871 0 0) 0x7f46a806f120 con 0x7f46a806d6f0 2024-05-07T13:59:09.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.868+0000 7f46ad09b640 1 --2- 172.21.15.22:0/630404691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a812db20 0x7f46a812ff10 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4698009750 tx=0x7f469802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb5acf0f8050a78 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.868+0000 7f46ac89a640 1 -- 172.21.15.22:0/630404691 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46980316d0 con 0x7f46a812db20 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.868+0000 7f46ac89a640 1 -- 172.21.15.22:0/630404691 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4698037070 con 0x7f46a812db20 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.868+0000 7f46ac89a640 1 -- 172.21.15.22:0/630404691 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46980319c0 con 0x7f46a812db20 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.869+0000 7f46afb00640 1 -- 172.21.15.22:0/630404691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a812db20 msgr2=0x7f46a812ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.869+0000 7f46afb00640 1 --2- 172.21.15.22:0/630404691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a812db20 0x7f46a812ff10 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4698009750 tx=0x7f469802b840 comp rx=0 tx=0).stop 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.869+0000 7f46afb00640 1 -- 172.21.15.22:0/630404691 shutdown_connections 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.869+0000 7f46afb00640 1 --2- 172.21.15.22:0/630404691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a812db20 0x7f46a812ff10 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.869+0000 7f46afb00640 1 -- 172.21.15.22:0/630404691 >> 172.21.15.22:0/630404691 conn(0x7f46a80996c0 msgr2=0x7f46a8099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.869+0000 7f46afb00640 1 -- 172.21.15.22:0/630404691 shutdown_connections 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.869+0000 7f46afb00640 1 -- 172.21.15.22:0/630404691 wait complete. 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.870+0000 7f46afb00640 1 Processor -- start 2024-05-07T13:59:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.870+0000 7f46afb00640 1 -- start start 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.870+0000 7f46afb00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a806d6f0 0x7f46a8121860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.870+0000 7f46afb00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f46a8071660 con 0x7f46a806d6f0 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.870+0000 7f46ad89c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a806d6f0 0x7f46a8121860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.870+0000 7f46ad89c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a806d6f0 0x7f46a8121860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35582/0 (socket says 172.21.15.22:35582) 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.870+0000 7f46ad89c640 1 -- 172.21.15.22:0/3937295688 learned_addr learned my addr 172.21.15.22:0/3937295688 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.871+0000 7f46ad89c640 1 -- 172.21.15.22:0/3937295688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a812d390 con 0x7f46a806d6f0 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.871+0000 7f46ad89c640 1 --2- 172.21.15.22:0/3937295688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a806d6f0 0x7f46a8121860 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f46a400c370 tx=0x7f46a400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.871+0000 7f469e7fc640 1 -- 172.21.15.22:0/3937295688 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a4007410 con 0x7f46a806d6f0 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.871+0000 7f469e7fc640 1 -- 172.21.15.22:0/3937295688 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a40075d0 con 0x7f46a806d6f0 2024-05-07T13:59:09.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.871+0000 7f469e7fc640 1 -- 172.21.15.22:0/3937295688 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a4004950 con 0x7f46a806d6f0 2024-05-07T13:59:09.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.871+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a808f5e0 con 0x7f46a806d6f0 2024-05-07T13:59:09.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.871+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a8121da0 con 0x7f46a806d6f0 2024-05-07T13:59:09.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.872+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a8062e90 con 0x7f46a806d6f0 2024-05-07T13:59:09.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.872+0000 7f469e7fc640 1 -- 172.21.15.22:0/3937295688 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f46a4011070 con 0x7f46a806d6f0 2024-05-07T13:59:09.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.872+0000 7f469e7fc640 1 --2- 172.21.15.22:0/3937295688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f468c038060 0x7f468c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:09.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.872+0000 7f469e7fc640 1 -- 172.21.15.22:0/3937295688 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f46a404b5e0 con 0x7f46a806d6f0 2024-05-07T13:59:09.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.873+0000 7f46ad09b640 1 --2- 172.21.15.22:0/3937295688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f468c038060 0x7f468c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:09.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.873+0000 7f46ad09b640 1 --2- 172.21.15.22:0/3937295688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f468c038060 0x7f468c03a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4698036000 tx=0x7f4698008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:09.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:09.877+0000 7f469e7fc640 1 -- 172.21.15.22:0/3937295688 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f46a4011c60 con 0x7f46a806d6f0 2024-05-07T13:59:10.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.061+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f46a808e990 con 0x7f468c038060 2024-05-07T13:59:10.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.061+0000 7f469e7fc640 1 -- 172.21.15.22:0/3937295688 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4698037040 con 0x7f468c038060 2024-05-07T13:59:10.049 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 2 to deep-scrub 2024-05-07T13:59:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f468c038060 msgr2=0x7f468c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 --2- 172.21.15.22:0/3937295688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f468c038060 0x7f468c03a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4698036000 tx=0x7f4698008030 comp rx=0 tx=0).stop 2024-05-07T13:59:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a806d6f0 msgr2=0x7f46a8121860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 --2- 172.21.15.22:0/3937295688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a806d6f0 0x7f46a8121860 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f46a400c370 tx=0x7f46a400c830 comp rx=0 tx=0).stop 2024-05-07T13:59:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 shutdown_connections 2024-05-07T13:59:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 --2- 172.21.15.22:0/3937295688 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f468c038060 0x7f468c03a520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 --2- 172.21.15.22:0/3937295688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a806d6f0 0x7f46a8121860 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 >> 172.21.15.22:0/3937295688 conn(0x7f46a80996c0 msgr2=0x7f46a8125b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:10.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 shutdown_connections 2024-05-07T13:59:10.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.064+0000 7f46afb00640 1 -- 172.21.15.22:0/3937295688 wait complete. 2024-05-07T13:59:10.062 INFO:tasks.ceph:Scrubbing osd.3 2024-05-07T13:59:10.063 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.182+0000 7f12e1ada640 1 Processor -- start 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.182+0000 7f12e1ada640 1 -- start start 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.182+0000 7f12e1ada640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f12dc096470 0x7f12dc096850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.182+0000 7f12e1ada640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12dc072710 con 0x7f12dc06de70 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.182+0000 7f12e1ada640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f12dc06f310 con 0x7f12dc096470 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.183+0000 7f12db7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f12dc096470 0x7f12dc096850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.183+0000 7f12daffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f12dc06de70 0x7f12dc06e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38222/0 (socket says 172.21.15.22:38222) 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.183+0000 7f12daffd640 1 -- 172.21.15.22:0/1171679982 learned_addr learned my addr 172.21.15.22:0/1171679982 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.183+0000 7f12db7fe640 1 -- 172.21.15.22:0/1171679982 >> v1:172.21.15.22:6789/0 conn(0x7f12dc06de70 legacy=0x7f12dc06e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.183+0000 7f12db7fe640 1 -- 172.21.15.22:0/1171679982 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc071cd0 con 0x7f12dc096470 2024-05-07T13:59:10.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12db7fe640 1 --2- 172.21.15.22:0/1171679982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc096470 0x7f12dc096850 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009720 tx=0x7f12cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c162e31d83687f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12da7fc640 1 -- 172.21.15.22:0/1171679982 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12cc0316d0 con 0x7f12dc096470 2024-05-07T13:59:10.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12da7fc640 1 -- 172.21.15.22:0/1171679982 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12cc037070 con 0x7f12dc096470 2024-05-07T13:59:10.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12da7fc640 1 -- 172.21.15.22:0/1171679982 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12cc0319c0 con 0x7f12dc096470 2024-05-07T13:59:10.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12e1ada640 1 -- 172.21.15.22:0/1171679982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc096470 msgr2=0x7f12dc096850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12e1ada640 1 --2- 172.21.15.22:0/1171679982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc096470 0x7f12dc096850 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009720 tx=0x7f12cc02b840 comp rx=0 tx=0).stop 2024-05-07T13:59:10.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12e1ada640 1 -- 172.21.15.22:0/1171679982 shutdown_connections 2024-05-07T13:59:10.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12e1ada640 1 --2- 172.21.15.22:0/1171679982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc096470 0x7f12dc096850 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12e1ada640 1 -- 172.21.15.22:0/1171679982 >> 172.21.15.22:0/1171679982 conn(0x7f12dc09cf90 msgr2=0x7f12dc09d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:10.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12e1ada640 1 -- 172.21.15.22:0/1171679982 shutdown_connections 2024-05-07T13:59:10.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.184+0000 7f12e1ada640 1 -- 172.21.15.22:0/1171679982 wait complete. 2024-05-07T13:59:10.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.185+0000 7f12e1ada640 1 Processor -- start 2024-05-07T13:59:10.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.185+0000 7f12e1ada640 1 -- start start 2024-05-07T13:59:10.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12e1ada640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc06de70 0x7f12dc06f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12e1ada640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc096d90 con 0x7f12dc06de70 2024-05-07T13:59:10.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12db7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc06de70 0x7f12dc06f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12db7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc06de70 0x7f12dc06f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35600/0 (socket says 172.21.15.22:35600) 2024-05-07T13:59:10.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12db7fe640 1 -- 172.21.15.22:0/2140874107 learned_addr learned my addr 172.21.15.22:0/2140874107 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:10.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12db7fe640 1 -- 172.21.15.22:0/2140874107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc092210 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12db7fe640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc06de70 0x7f12dc06f850 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009840 tx=0x7f12cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12c3fff640 1 -- 172.21.15.22:0/2140874107 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12cc032770 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12c3fff640 1 -- 172.21.15.22:0/2140874107 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12cc032910 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc071250 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12c3fff640 1 -- 172.21.15.22:0/2140874107 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12cc032c30 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.186+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc092520 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.187+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12dc062e90 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.187+0000 7f12c3fff640 1 -- 172.21.15.22:0/2140874107 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f12cc04c060 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.188+0000 7f12c3fff640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f12c8038060 0x7f12c803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.188+0000 7f12c3fff640 1 -- 172.21.15.22:0/2140874107 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f12cc02f050 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.188+0000 7f12c3fff640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7f12c8044530 0x7f12c80469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.188+0000 7f12c3fff640 1 -- 172.21.15.22:0/2140874107 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12cc044e70 con 0x7f12c8044530 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.188+0000 7f12c3fff640 1 -- 172.21.15.22:0/2140874107 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12cc074050 con 0x7f12dc06de70 2024-05-07T13:59:10.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.188+0000 7f12daffd640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f12c8038060 0x7f12c803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.188+0000 7f12dbfff640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7f12c8044530 0x7f12c80469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.188+0000 7f12dbfff640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7f12c8044530 0x7f12c80469d0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.189+0000 7f12daffd640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f12c8038060 0x7f12c803a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007fd0 tx=0x7f12d0007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.189+0000 7f12c3fff640 1 -- 172.21.15.22:0/2140874107 <== osd.3 v2:172.21.15.50:6814/3553060046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f12cc044e70 con 0x7f12c8044530 2024-05-07T13:59:10.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.203+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 --> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f12dc1295f0 con 0x7f12c8044530 2024-05-07T13:59:10.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.203+0000 7f12c3fff640 1 -- 172.21.15.22:0/2140874107 <== osd.3 v2:172.21.15.50:6814/3553060046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f12d400adb0 con 0x7f12c8044530 2024-05-07T13:59:10.191 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-07T13:59:10.191 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T13:59:10.191 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-07T13:59:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.203+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7f12c8044530 msgr2=0x7f12c80469d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.203+0000 7f12e1ada640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7f12c8044530 0x7f12c80469d0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.203+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f12c8038060 msgr2=0x7f12c803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.203+0000 7f12e1ada640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f12c8038060 0x7f12c803a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007fd0 tx=0x7f12d0007ac0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.204+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc06de70 msgr2=0x7f12dc06f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.204+0000 7f12e1ada640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc06de70 0x7f12dc06f850 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009840 tx=0x7f12cc0046c0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.204+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 shutdown_connections 2024-05-07T13:59:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.204+0000 7f12e1ada640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6814/3553060046,v1:172.21.15.50:6816/3553060046] conn(0x7f12c8044530 0x7f12c80469d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.204+0000 7f12e1ada640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f12c8038060 0x7f12c803a520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.204+0000 7f12e1ada640 1 --2- 172.21.15.22:0/2140874107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12dc06de70 0x7f12dc06f850 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.204+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 >> 172.21.15.22:0/2140874107 conn(0x7f12dc09cf90 msgr2=0x7f12dc127ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.204+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 shutdown_connections 2024-05-07T13:59:10.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.204+0000 7f12e1ada640 1 -- 172.21.15.22:0/2140874107 wait complete. 2024-05-07T13:59:10.202 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-07T13:59:10.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.317+0000 7f7818738640 1 Processor -- start 2024-05-07T13:59:10.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.317+0000 7f7818738640 1 -- start start 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.318+0000 7f7818738640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f781006d6f0 0x7f781006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.318+0000 7f7818738640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f781006f120 con 0x7f781006e010 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.318+0000 7f7818738640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f781006e800 con 0x7f781006d6f0 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.318+0000 7f78164d4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f781006d6f0 0x7f781006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.318+0000 7f7815cd3640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f781006e010 0x7f7810070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38234/0 (socket says 172.21.15.22:38234) 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.318+0000 7f7815cd3640 1 -- 172.21.15.22:0/2041436331 learned_addr learned my addr 172.21.15.22:0/2041436331 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.318+0000 7f78164d4640 1 -- 172.21.15.22:0/2041436331 >> v1:172.21.15.22:6789/0 conn(0x7f781006e010 legacy=0x7f7810070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.318+0000 7f78164d4640 1 -- 172.21.15.22:0/2041436331 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7810071b20 con 0x7f781006d6f0 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.319+0000 7f78164d4640 1 --2- 172.21.15.22:0/2041436331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 0x7f781006dad0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f780000bfa0 tx=0x7f780002e0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3b79c638833c7f server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.319+0000 7f78154d2640 1 -- 172.21.15.22:0/2041436331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f780002e9d0 con 0x7f781006d6f0 2024-05-07T13:59:10.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.319+0000 7f78154d2640 1 -- 172.21.15.22:0/2041436331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f780002eb70 con 0x7f781006d6f0 2024-05-07T13:59:10.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.319+0000 7f78154d2640 1 -- 172.21.15.22:0/2041436331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7800009540 con 0x7f781006d6f0 2024-05-07T13:59:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.320+0000 7f7818738640 1 -- 172.21.15.22:0/2041436331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 msgr2=0x7f781006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.320+0000 7f7818738640 1 --2- 172.21.15.22:0/2041436331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 0x7f781006dad0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f780000bfa0 tx=0x7f780002e0b0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.320+0000 7f7818738640 1 -- 172.21.15.22:0/2041436331 shutdown_connections 2024-05-07T13:59:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.320+0000 7f7818738640 1 --2- 172.21.15.22:0/2041436331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 0x7f781006dad0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.320+0000 7f7818738640 1 -- 172.21.15.22:0/2041436331 >> 172.21.15.22:0/2041436331 conn(0x7f78100996c0 msgr2=0x7f7810099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.320+0000 7f7818738640 1 -- 172.21.15.22:0/2041436331 shutdown_connections 2024-05-07T13:59:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.320+0000 7f7818738640 1 -- 172.21.15.22:0/2041436331 wait complete. 2024-05-07T13:59:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.321+0000 7f7818738640 1 Processor -- start 2024-05-07T13:59:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.321+0000 7f7818738640 1 -- start start 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.321+0000 7f7818738640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 0x7f78100937a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.321+0000 7f7818738640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78100985d0 con 0x7f781006d6f0 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.321+0000 7f78164d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 0x7f78100937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.321+0000 7f78164d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 0x7f78100937a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35622/0 (socket says 172.21.15.22:35622) 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.321+0000 7f78164d4640 1 -- 172.21.15.22:0/2870464613 learned_addr learned my addr 172.21.15.22:0/2870464613 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.322+0000 7f78164d4640 1 -- 172.21.15.22:0/2870464613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7810094eb0 con 0x7f781006d6f0 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.322+0000 7f78164d4640 1 --2- 172.21.15.22:0/2870464613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 0x7f78100937a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7800000f80 tx=0x7f7800004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.322+0000 7f780effd640 1 -- 172.21.15.22:0/2870464613 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7800045020 con 0x7f781006d6f0 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.322+0000 7f780effd640 1 -- 172.21.15.22:0/2870464613 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7800040790 con 0x7f781006d6f0 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.322+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7810095590 con 0x7f781006d6f0 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.322+0000 7f780effd640 1 -- 172.21.15.22:0/2870464613 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7800040a90 con 0x7f781006d6f0 2024-05-07T13:59:10.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.322+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7810093ce0 con 0x7f781006d6f0 2024-05-07T13:59:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.323+0000 7f780effd640 1 -- 172.21.15.22:0/2870464613 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7800048020 con 0x7f781006d6f0 2024-05-07T13:59:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.323+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7810062e90 con 0x7f781006d6f0 2024-05-07T13:59:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.323+0000 7f780effd640 1 --2- 172.21.15.22:0/2870464613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f77fc038060 0x7f77fc03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.323+0000 7f780effd640 1 -- 172.21.15.22:0/2870464613 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f780003c040 con 0x7f781006d6f0 2024-05-07T13:59:10.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.323+0000 7f7815cd3640 1 --2- 172.21.15.22:0/2870464613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f77fc038060 0x7f77fc03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.324+0000 7f7815cd3640 1 --2- 172.21.15.22:0/2870464613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f77fc038060 0x7f77fc03a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7804007fd0 tx=0x7f7804007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.328+0000 7f780effd640 1 -- 172.21.15.22:0/2870464613 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f780004f030 con 0x7f781006d6f0 2024-05-07T13:59:10.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.514+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f78100703a0 con 0x7f77fc038060 2024-05-07T13:59:10.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.515+0000 7f780effd640 1 -- 172.21.15.22:0/2870464613 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f78100703a0 con 0x7f77fc038060 2024-05-07T13:59:10.503 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 3 to deep-scrub 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f77fc038060 msgr2=0x7f77fc03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 --2- 172.21.15.22:0/2870464613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f77fc038060 0x7f77fc03a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7804007fd0 tx=0x7f7804007ac0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 msgr2=0x7f78100937a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 --2- 172.21.15.22:0/2870464613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 0x7f78100937a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f7800000f80 tx=0x7f7800004a40 comp rx=0 tx=0).stop 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 shutdown_connections 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 --2- 172.21.15.22:0/2870464613 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f77fc038060 0x7f77fc03a520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 --2- 172.21.15.22:0/2870464613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f781006d6f0 0x7f78100937a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 >> 172.21.15.22:0/2870464613 conn(0x7f78100996c0 msgr2=0x7f781008c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 shutdown_connections 2024-05-07T13:59:10.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.517+0000 7f7818738640 1 -- 172.21.15.22:0/2870464613 wait complete. 2024-05-07T13:59:10.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T13:59:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.630+0000 7f45a2882640 1 Processor -- start 2024-05-07T13:59:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.630+0000 7f45a2882640 1 -- start start 2024-05-07T13:59:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.631+0000 7f45a2882640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f459c131640 0x7f459c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.631+0000 7f45a2882640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f459c06e710 con 0x7f459c06d7f0 2024-05-07T13:59:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.631+0000 7f45a2882640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f459c06f2a0 con 0x7f459c131640 2024-05-07T13:59:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.631+0000 7f459b7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f459c131640 0x7f459c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.631+0000 7f459bfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f459c06d7f0 0x7f459c06dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38242/0 (socket says 172.21.15.22:38242) 2024-05-07T13:59:10.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.631+0000 7f459bfff640 1 -- 172.21.15.22:0/3862832172 learned_addr learned my addr 172.21.15.22:0/3862832172 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:10.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.631+0000 7f459b7fe640 1 -- 172.21.15.22:0/3862832172 >> v1:172.21.15.22:6789/0 conn(0x7f459c06d7f0 legacy=0x7f459c06dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.631+0000 7f459b7fe640 1 -- 172.21.15.22:0/3862832172 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c06f4e0 con 0x7f459c131640 2024-05-07T13:59:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.632+0000 7f459b7fe640 1 --2- 172.21.15.22:0/3862832172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c131640 0x7f459c133a30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f4590009720 tx=0x7f459002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545ce06869afb4d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.632+0000 7f459affd640 1 -- 172.21.15.22:0/3862832172 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45900316d0 con 0x7f459c131640 2024-05-07T13:59:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.632+0000 7f459affd640 1 -- 172.21.15.22:0/3862832172 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4590037070 con 0x7f459c131640 2024-05-07T13:59:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.632+0000 7f459affd640 1 -- 172.21.15.22:0/3862832172 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45900319c0 con 0x7f459c131640 2024-05-07T13:59:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.633+0000 7f45a2882640 1 -- 172.21.15.22:0/3862832172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c131640 msgr2=0x7f459c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.633+0000 7f45a2882640 1 --2- 172.21.15.22:0/3862832172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c131640 0x7f459c133a30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f4590009720 tx=0x7f459002b840 comp rx=0 tx=0).stop 2024-05-07T13:59:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.633+0000 7f45a2882640 1 -- 172.21.15.22:0/3862832172 shutdown_connections 2024-05-07T13:59:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.633+0000 7f45a2882640 1 --2- 172.21.15.22:0/3862832172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c131640 0x7f459c133a30 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.633+0000 7f45a2882640 1 -- 172.21.15.22:0/3862832172 >> 172.21.15.22:0/3862832172 conn(0x7f459c0a0b40 msgr2=0x7f459c0a0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:10.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.633+0000 7f45a2882640 1 -- 172.21.15.22:0/3862832172 shutdown_connections 2024-05-07T13:59:10.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.633+0000 7f45a2882640 1 -- 172.21.15.22:0/3862832172 wait complete. 2024-05-07T13:59:10.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.633+0000 7f45a2882640 1 Processor -- start 2024-05-07T13:59:10.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.634+0000 7f45a2882640 1 -- start start 2024-05-07T13:59:10.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.634+0000 7f45a2882640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c06d7f0 0x7f459c127ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.634+0000 7f45a2882640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f459c06e460 con 0x7f459c06d7f0 2024-05-07T13:59:10.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.634+0000 7f459bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c06d7f0 0x7f459c127ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.634+0000 7f459bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c06d7f0 0x7f459c127ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35636/0 (socket says 172.21.15.22:35636) 2024-05-07T13:59:10.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.634+0000 7f459bfff640 1 -- 172.21.15.22:0/2747671837 learned_addr learned my addr 172.21.15.22:0/2747671837 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:10.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.634+0000 7f459bfff640 1 -- 172.21.15.22:0/2747671837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c12b190 con 0x7f459c06d7f0 2024-05-07T13:59:10.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.635+0000 7f459bfff640 1 --2- 172.21.15.22:0/2747671837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c06d7f0 0x7f459c127ec0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f458c00c380 tx=0x7f458c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.635+0000 7f4598ff9640 1 -- 172.21.15.22:0/2747671837 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f458c005c10 con 0x7f459c06d7f0 2024-05-07T13:59:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.635+0000 7f4598ff9640 1 -- 172.21.15.22:0/2747671837 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c005db0 con 0x7f459c06d7f0 2024-05-07T13:59:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.635+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459c12a450 con 0x7f459c06d7f0 2024-05-07T13:59:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.635+0000 7f4598ff9640 1 -- 172.21.15.22:0/2747671837 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f458c004930 con 0x7f459c06d7f0 2024-05-07T13:59:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.635+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459c12a8f0 con 0x7f459c06d7f0 2024-05-07T13:59:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.636+0000 7f4598ff9640 1 -- 172.21.15.22:0/2747671837 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f458c01a020 con 0x7f459c06d7f0 2024-05-07T13:59:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.636+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459c09e490 con 0x7f459c06d7f0 2024-05-07T13:59:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.636+0000 7f4598ff9640 1 --2- 172.21.15.22:0/2747671837 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4588038060 0x7f458803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.636+0000 7f4598ff9640 1 -- 172.21.15.22:0/2747671837 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f458c04b210 con 0x7f459c06d7f0 2024-05-07T13:59:10.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.636+0000 7f459b7fe640 1 --2- 172.21.15.22:0/2747671837 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4588038060 0x7f458803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:10.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.637+0000 7f459b7fe640 1 --2- 172.21.15.22:0/2747671837 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4588038060 0x7f458803a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4590009720 tx=0x7f4590008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:10.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.641+0000 7f4598ff9640 1 -- 172.21.15.22:0/2747671837 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f459c09e490 con 0x7f459c06d7f0 2024-05-07T13:59:10.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.819+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f459c133620 con 0x7f4588038060 2024-05-07T13:59:10.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.835+0000 7f4598ff9640 1 -- 172.21.15.22:0/2747671837 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665799 (secure 0 0 0) 0x7f459c133620 con 0x7f4588038060 2024-05-07T13:59:10.830 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:59:10.838 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T13:59:10.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4588038060 msgr2=0x7f458803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 --2- 172.21.15.22:0/2747671837 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4588038060 0x7f458803a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4590009720 tx=0x7f4590008030 comp rx=0 tx=0).stop 2024-05-07T13:59:10.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c06d7f0 msgr2=0x7f459c127ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:10.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 --2- 172.21.15.22:0/2747671837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c06d7f0 0x7f459c127ec0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f458c00c380 tx=0x7f458c00c840 comp rx=0 tx=0).stop 2024-05-07T13:59:10.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 shutdown_connections 2024-05-07T13:59:10.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 --2- 172.21.15.22:0/2747671837 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4588038060 0x7f458803a520 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 --2- 172.21.15.22:0/2747671837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f459c06d7f0 0x7f459c127ec0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:10.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 >> 172.21.15.22:0/2747671837 conn(0x7f459c0a0b40 msgr2=0x7f459c09d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:10.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 shutdown_connections 2024-05-07T13:59:10.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:10.840+0000 7f45a2882640 1 -- 172.21.15.22:0/2747671837 wait complete. 2024-05-07T13:59:10.843 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-05-07T13:59:10.165445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5119,"num_read_kb":4700,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4608,"ondisk_log_size":4608,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144096,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343264,"statfs":{"total":386547056640,"available":386399502336,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":727,"num_read_kb":686,"num_write":461,"num_write_kb":29375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003388"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369379+0000","last_change":"2024-05-07T13:55:48.336201+0000","last_active":"2024-05-07T13:56:35.369379+0000","last_peered":"2024-05-07T13:56:35.369379+0000","last_clean":"2024-05-07T13:56:35.369379+0000","last_became_active":"2024-05-07T13:55:48.335740+0000","last_became_peered":"2024-05-07T13:55:48.335740+0000","last_unstale":"2024-05-07T13:56:35.369379+0000","last_undegraded":"2024-05-07T13:56:35.369379+0000","last_fullsized":"2024-05-07T13:56:35.369379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'13","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.510112+0000","last_change":"2024-05-07T13:55:50.316599+0000","last_active":"2024-05-07T13:58:59.510112+0000","last_peered":"2024-05-07T13:58:59.510112+0000","last_clean":"2024-05-07T13:58:59.510112+0000","last_became_active":"2024-05-07T13:55:50.316253+0000","last_became_peered":"2024-05-07T13:55:50.316253+0000","last_unstale":"2024-05-07T13:58:59.510112+0000","last_undegraded":"2024-05-07T13:58:59.510112+0000","last_fullsized":"2024-05-07T13:58:59.510112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:27.304492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.390309+0000","last_change":"2024-05-07T13:55:48.324242+0000","last_active":"2024-05-07T13:58:59.390309+0000","last_peered":"2024-05-07T13:58:59.390309+0000","last_clean":"2024-05-07T13:58:59.390309+0000","last_became_active":"2024-05-07T13:55:48.323151+0000","last_became_peered":"2024-05-07T13:55:48.323151+0000","last_unstale":"2024-05-07T13:58:59.390309+0000","last_undegraded":"2024-05-07T13:58:59.390309+0000","last_fullsized":"2024-05-07T13:58:59.390309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:18:09.959294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358436+0000","last_change":"2024-05-07T13:55:50.322812+0000","last_active":"2024-05-07T13:56:35.358436+0000","last_peered":"2024-05-07T13:56:35.358436+0000","last_clean":"2024-05-07T13:56:35.358436+0000","last_became_active":"2024-05-07T13:55:50.322066+0000","last_became_peered":"2024-05-07T13:55:50.322066+0000","last_unstale":"2024-05-07T13:56:35.358436+0000","last_undegraded":"2024-05-07T13:56:35.358436+0000","last_fullsized":"2024-05-07T13:56:35.358436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:40.527236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360959+0000","last_change":"2024-05-07T13:55:48.350450+0000","last_active":"2024-05-07T13:56:35.360959+0000","last_peered":"2024-05-07T13:56:35.360959+0000","last_clean":"2024-05-07T13:56:35.360959+0000","last_became_active":"2024-05-07T13:55:48.347661+0000","last_became_peered":"2024-05-07T13:55:48.347661+0000","last_unstale":"2024-05-07T13:56:35.360959+0000","last_undegraded":"2024-05-07T13:56:35.360959+0000","last_fullsized":"2024-05-07T13:56:35.360959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:43.418566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358314+0000","last_change":"2024-05-07T13:55:50.322032+0000","last_active":"2024-05-07T13:56:35.358314+0000","last_peered":"2024-05-07T13:56:35.358314+0000","last_clean":"2024-05-07T13:56:35.358314+0000","last_became_active":"2024-05-07T13:55:50.321598+0000","last_became_peered":"2024-05-07T13:55:50.321598+0000","last_unstale":"2024-05-07T13:56:35.358314+0000","last_undegraded":"2024-05-07T13:56:35.358314+0000","last_fullsized":"2024-05-07T13:56:35.358314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:19:59.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.697458+0000","last_change":"2024-05-07T13:55:48.337861+0000","last_active":"2024-05-07T13:57:58.697458+0000","last_peered":"2024-05-07T13:57:58.697458+0000","last_clean":"2024-05-07T13:57:58.697458+0000","last_became_active":"2024-05-07T13:55:48.337418+0000","last_became_peered":"2024-05-07T13:55:48.337418+0000","last_unstale":"2024-05-07T13:57:58.697458+0000","last_undegraded":"2024-05-07T13:57:58.697458+0000","last_fullsized":"2024-05-07T13:57:58.697458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.252156+0000","last_change":"2024-05-07T13:56:35.367287+0000","last_active":"2024-05-07T13:58:59.252156+0000","last_peered":"2024-05-07T13:58:59.252156+0000","last_clean":"2024-05-07T13:58:59.252156+0000","last_became_active":"2024-05-07T13:56:35.366947+0000","last_became_peered":"2024-05-07T13:56:35.366947+0000","last_unstale":"2024-05-07T13:58:59.252156+0000","last_undegraded":"2024-05-07T13:58:59.252156+0000","last_fullsized":"2024-05-07T13:58:59.252156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:38.628455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358752+0000","last_change":"2024-05-07T13:55:48.349880+0000","last_active":"2024-05-07T13:56:35.358752+0000","last_peered":"2024-05-07T13:56:35.358752+0000","last_clean":"2024-05-07T13:56:35.358752+0000","last_became_active":"2024-05-07T13:55:48.347714+0000","last_became_peered":"2024-05-07T13:55:48.347714+0000","last_unstale":"2024-05-07T13:56:35.358752+0000","last_undegraded":"2024-05-07T13:56:35.358752+0000","last_fullsized":"2024-05-07T13:56:35.358752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:35.715822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'8","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364637+0000","last_change":"2024-05-07T13:55:50.314953+0000","last_active":"2024-05-07T13:56:35.364637+0000","last_peered":"2024-05-07T13:56:35.364637+0000","last_clean":"2024-05-07T13:56:35.364637+0000","last_became_active":"2024-05-07T13:55:50.314660+0000","last_became_peered":"2024-05-07T13:55:50.314660+0000","last_unstale":"2024-05-07T13:56:35.364637+0000","last_undegraded":"2024-05-07T13:56:35.364637+0000","last_fullsized":"2024-05-07T13:56:35.364637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:05.386488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359638+0000","last_change":"2024-05-07T13:55:48.338607+0000","last_active":"2024-05-07T13:56:35.359638+0000","last_peered":"2024-05-07T13:56:35.359638+0000","last_clean":"2024-05-07T13:56:35.359638+0000","last_became_active":"2024-05-07T13:55:48.337256+0000","last_became_peered":"2024-05-07T13:55:48.337256+0000","last_unstale":"2024-05-07T13:56:35.359638+0000","last_undegraded":"2024-05-07T13:56:35.359638+0000","last_fullsized":"2024-05-07T13:56:35.359638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:43.039363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502905+0000","last_change":"2024-05-07T13:55:50.322605+0000","last_active":"2024-05-07T13:58:59.502905+0000","last_peered":"2024-05-07T13:58:59.502905+0000","last_clean":"2024-05-07T13:58:59.502905+0000","last_became_active":"2024-05-07T13:55:50.322204+0000","last_became_peered":"2024-05-07T13:55:50.322204+0000","last_unstale":"2024-05-07T13:58:59.502905+0000","last_undegraded":"2024-05-07T13:58:59.502905+0000","last_fullsized":"2024-05-07T13:58:59.502905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:49.695086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357314+0000","last_change":"2024-05-07T13:55:48.348111+0000","last_active":"2024-05-07T13:56:35.357314+0000","last_peered":"2024-05-07T13:56:35.357314+0000","last_clean":"2024-05-07T13:56:35.357314+0000","last_became_active":"2024-05-07T13:55:48.347006+0000","last_became_peered":"2024-05-07T13:55:48.347006+0000","last_unstale":"2024-05-07T13:56:35.357314+0000","last_undegraded":"2024-05-07T13:56:35.357314+0000","last_fullsized":"2024-05-07T13:56:35.357314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:03:02.570573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.739053+0000","last_change":"2024-05-07T13:55:50.313130+0000","last_active":"2024-05-07T13:57:14.739053+0000","last_peered":"2024-05-07T13:57:14.739053+0000","last_clean":"2024-05-07T13:57:14.739053+0000","last_became_active":"2024-05-07T13:55:50.312835+0000","last_became_peered":"2024-05-07T13:55:50.312835+0000","last_unstale":"2024-05-07T13:57:14.739053+0000","last_undegraded":"2024-05-07T13:57:14.739053+0000","last_fullsized":"2024-05-07T13:57:14.739053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358691+0000","last_change":"2024-05-07T13:55:48.325646+0000","last_active":"2024-05-07T13:56:35.358691+0000","last_peered":"2024-05-07T13:56:35.358691+0000","last_clean":"2024-05-07T13:56:35.358691+0000","last_became_active":"2024-05-07T13:55:48.323612+0000","last_became_peered":"2024-05-07T13:55:48.323612+0000","last_unstale":"2024-05-07T13:56:35.358691+0000","last_undegraded":"2024-05-07T13:56:35.358691+0000","last_fullsized":"2024-05-07T13:56:35.358691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.140533+0000","last_change":"2024-05-07T13:55:50.325361+0000","last_active":"2024-05-07T13:58:59.140533+0000","last_peered":"2024-05-07T13:58:59.140533+0000","last_clean":"2024-05-07T13:58:59.140533+0000","last_became_active":"2024-05-07T13:55:50.325055+0000","last_became_peered":"2024-05-07T13:55:50.325055+0000","last_unstale":"2024-05-07T13:58:59.140533+0000","last_undegraded":"2024-05-07T13:58:59.140533+0000","last_fullsized":"2024-05-07T13:58:59.140533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'22","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502985+0000","last_change":"2024-05-07T13:55:50.321695+0000","last_active":"2024-05-07T13:58:59.502985+0000","last_peered":"2024-05-07T13:58:59.502985+0000","last_clean":"2024-05-07T13:58:59.502985+0000","last_became_active":"2024-05-07T13:55:50.321385+0000","last_became_peered":"2024-05-07T13:55:50.321385+0000","last_unstale":"2024-05-07T13:58:59.502985+0000","last_undegraded":"2024-05-07T13:58:59.502985+0000","last_fullsized":"2024-05-07T13:58:59.502985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:35.440672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366609+0000","last_change":"2024-05-07T13:55:48.335649+0000","last_active":"2024-05-07T13:56:35.366609+0000","last_peered":"2024-05-07T13:56:35.366609+0000","last_clean":"2024-05-07T13:56:35.366609+0000","last_became_active":"2024-05-07T13:55:48.335213+0000","last_became_peered":"2024-05-07T13:55:48.335213+0000","last_unstale":"2024-05-07T13:56:35.366609+0000","last_undegraded":"2024-05-07T13:56:35.366609+0000","last_fullsized":"2024-05-07T13:56:35.366609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'15","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415641+0000","last_change":"2024-05-07T13:55:50.313758+0000","last_active":"2024-05-07T13:58:59.415641+0000","last_peered":"2024-05-07T13:58:59.415641+0000","last_clean":"2024-05-07T13:58:59.415641+0000","last_became_active":"2024-05-07T13:55:50.313457+0000","last_became_peered":"2024-05-07T13:55:50.313457+0000","last_unstale":"2024-05-07T13:58:59.415641+0000","last_undegraded":"2024-05-07T13:58:59.415641+0000","last_fullsized":"2024-05-07T13:58:59.415641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370399+0000","last_change":"2024-05-07T13:55:48.341129+0000","last_active":"2024-05-07T13:56:35.370399+0000","last_peered":"2024-05-07T13:56:35.370399+0000","last_clean":"2024-05-07T13:56:35.370399+0000","last_became_active":"2024-05-07T13:55:48.340516+0000","last_became_peered":"2024-05-07T13:55:48.340516+0000","last_unstale":"2024-05-07T13:56:35.370399+0000","last_undegraded":"2024-05-07T13:56:35.370399+0000","last_fullsized":"2024-05-07T13:56:35.370399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'12","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.503272+0000","last_change":"2024-05-07T13:55:50.313924+0000","last_active":"2024-05-07T13:58:59.503272+0000","last_peered":"2024-05-07T13:58:59.503272+0000","last_clean":"2024-05-07T13:58:59.503272+0000","last_became_active":"2024-05-07T13:55:50.313442+0000","last_became_peered":"2024-05-07T13:55:50.313442+0000","last_unstale":"2024-05-07T13:58:59.503272+0000","last_undegraded":"2024-05-07T13:58:59.503272+0000","last_fullsized":"2024-05-07T13:58:59.503272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:52.088546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.632765+0000","last_change":"2024-05-07T13:55:48.339008+0000","last_active":"2024-05-07T13:57:58.632765+0000","last_peered":"2024-05-07T13:57:58.632765+0000","last_clean":"2024-05-07T13:57:58.632765+0000","last_became_active":"2024-05-07T13:55:48.338589+0000","last_became_peered":"2024-05-07T13:55:48.338589+0000","last_unstale":"2024-05-07T13:57:58.632765+0000","last_undegraded":"2024-05-07T13:57:58.632765+0000","last_fullsized":"2024-05-07T13:57:58.632765+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'7","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149687+0000","last_change":"2024-05-07T13:55:50.328784+0000","last_active":"2024-05-07T13:58:59.149687+0000","last_peered":"2024-05-07T13:58:59.149687+0000","last_clean":"2024-05-07T13:58:59.149687+0000","last_became_active":"2024-05-07T13:55:50.328471+0000","last_became_peered":"2024-05-07T13:55:50.328471+0000","last_unstale":"2024-05-07T13:58:59.149687+0000","last_undegraded":"2024-05-07T13:58:59.149687+0000","last_fullsized":"2024-05-07T13:58:59.149687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363639+0000","last_change":"2024-05-07T13:55:48.340701+0000","last_active":"2024-05-07T13:56:35.363639+0000","last_peered":"2024-05-07T13:56:35.363639+0000","last_clean":"2024-05-07T13:56:35.363639+0000","last_became_active":"2024-05-07T13:55:48.340284+0000","last_became_peered":"2024-05-07T13:55:48.340284+0000","last_unstale":"2024-05-07T13:56:35.363639+0000","last_undegraded":"2024-05-07T13:56:35.363639+0000","last_fullsized":"2024-05-07T13:56:35.363639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:03:37.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509996+0000","last_change":"2024-05-07T13:55:50.322836+0000","last_active":"2024-05-07T13:58:59.509996+0000","last_peered":"2024-05-07T13:58:59.509996+0000","last_clean":"2024-05-07T13:58:59.509996+0000","last_became_active":"2024-05-07T13:55:50.322513+0000","last_became_peered":"2024-05-07T13:55:50.322513+0000","last_unstale":"2024-05-07T13:58:59.509996+0000","last_undegraded":"2024-05-07T13:58:59.509996+0000","last_fullsized":"2024-05-07T13:58:59.509996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:05.386488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359883+0000","last_change":"2024-05-07T13:55:48.326455+0000","last_active":"2024-05-07T13:56:35.359883+0000","last_peered":"2024-05-07T13:56:35.359883+0000","last_clean":"2024-05-07T13:56:35.359883+0000","last_became_active":"2024-05-07T13:55:48.325321+0000","last_became_peered":"2024-05-07T13:55:48.325321+0000","last_unstale":"2024-05-07T13:56:35.359883+0000","last_undegraded":"2024-05-07T13:56:35.359883+0000","last_fullsized":"2024-05-07T13:56:35.359883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471610+0000","last_change":"2024-05-07T13:55:50.322751+0000","last_active":"2024-05-07T13:58:59.471610+0000","last_peered":"2024-05-07T13:58:59.471610+0000","last_clean":"2024-05-07T13:58:59.471610+0000","last_became_active":"2024-05-07T13:55:50.322476+0000","last_became_peered":"2024-05-07T13:55:50.322476+0000","last_unstale":"2024-05-07T13:58:59.471610+0000","last_undegraded":"2024-05-07T13:58:59.471610+0000","last_fullsized":"2024-05-07T13:58:59.471610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:06.112406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357654+0000","last_change":"2024-05-07T13:55:48.351155+0000","last_active":"2024-05-07T13:56:35.357654+0000","last_peered":"2024-05-07T13:56:35.357654+0000","last_clean":"2024-05-07T13:56:35.357654+0000","last_became_active":"2024-05-07T13:55:48.348714+0000","last_became_peered":"2024-05-07T13:55:48.348714+0000","last_unstale":"2024-05-07T13:56:35.357654+0000","last_undegraded":"2024-05-07T13:56:35.357654+0000","last_fullsized":"2024-05-07T13:56:35.357654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:56.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'37","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.441141+0000","last_change":"2024-05-07T13:55:58.348302+0000","last_active":"2024-05-07T13:58:59.441141+0000","last_peered":"2024-05-07T13:58:59.441141+0000","last_clean":"2024-05-07T13:58:59.441141+0000","last_became_active":"2024-05-07T13:55:58.347993+0000","last_became_peered":"2024-05-07T13:55:58.347993+0000","last_unstale":"2024-05-07T13:58:59.441141+0000","last_undegraded":"2024-05-07T13:58:59.441141+0000","last_fullsized":"2024-05-07T13:58:59.441141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:48:53.516894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358863+0000","last_change":"2024-05-07T13:55:50.323646+0000","last_active":"2024-05-07T13:56:35.358863+0000","last_peered":"2024-05-07T13:56:35.358863+0000","last_clean":"2024-05-07T13:56:35.358863+0000","last_became_active":"2024-05-07T13:55:50.323355+0000","last_became_peered":"2024-05-07T13:55:50.323355+0000","last_unstale":"2024-05-07T13:56:35.358863+0000","last_undegraded":"2024-05-07T13:56:35.358863+0000","last_fullsized":"2024-05-07T13:56:35.358863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:08.563941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.403334+0000","last_change":"2024-05-07T13:55:48.352275+0000","last_active":"2024-05-07T13:58:59.403334+0000","last_peered":"2024-05-07T13:58:59.403334+0000","last_clean":"2024-05-07T13:58:59.403334+0000","last_became_active":"2024-05-07T13:55:48.350161+0000","last_became_peered":"2024-05-07T13:55:48.350161+0000","last_unstale":"2024-05-07T13:58:59.403334+0000","last_undegraded":"2024-05-07T13:58:59.403334+0000","last_fullsized":"2024-05-07T13:58:59.403334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:28.942263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359868+0000","last_change":"2024-05-07T13:55:52.319295+0000","last_active":"2024-05-07T13:56:35.359868+0000","last_peered":"2024-05-07T13:56:35.359868+0000","last_clean":"2024-05-07T13:56:35.359868+0000","last_became_active":"2024-05-07T13:55:52.318966+0000","last_became_peered":"2024-05-07T13:55:52.318966+0000","last_unstale":"2024-05-07T13:56:35.359868+0000","last_undegraded":"2024-05-07T13:56:35.359868+0000","last_fullsized":"2024-05-07T13:56:35.359868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:08:48.912920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'34","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.248097+0000","last_change":"2024-05-07T13:55:54.332167+0000","last_active":"2024-05-07T13:59:06.248097+0000","last_peered":"2024-05-07T13:59:06.248097+0000","last_clean":"2024-05-07T13:59:06.248097+0000","last_became_active":"2024-05-07T13:55:54.331835+0000","last_became_peered":"2024-05-07T13:55:54.331835+0000","last_unstale":"2024-05-07T13:59:06.248097+0000","last_undegraded":"2024-05-07T13:59:06.248097+0000","last_fullsized":"2024-05-07T13:59:06.248097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:49:52.843419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366444+0000","last_change":"2024-05-07T13:55:56.338931+0000","last_active":"2024-05-07T13:56:35.366444+0000","last_peered":"2024-05-07T13:56:35.366444+0000","last_clean":"2024-05-07T13:56:35.366444+0000","last_became_active":"2024-05-07T13:55:56.338638+0000","last_became_peered":"2024-05-07T13:55:56.338638+0000","last_unstale":"2024-05-07T13:56:35.366444+0000","last_undegraded":"2024-05-07T13:56:35.366444+0000","last_fullsized":"2024-05-07T13:56:35.366444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:50.175136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'13","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.744345+0000","last_change":"2024-05-07T13:55:58.348663+0000","last_active":"2024-05-07T13:57:14.744345+0000","last_peered":"2024-05-07T13:57:14.744345+0000","last_clean":"2024-05-07T13:57:14.744345+0000","last_became_active":"2024-05-07T13:55:58.348341+0000","last_became_peered":"2024-05-07T13:55:58.348341+0000","last_unstale":"2024-05-07T13:57:14.744345+0000","last_undegraded":"2024-05-07T13:57:14.744345+0000","last_fullsized":"2024-05-07T13:57:14.744345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:46.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360493+0000","last_change":"2024-05-07T13:55:50.325607+0000","last_active":"2024-05-07T13:56:35.360493+0000","last_peered":"2024-05-07T13:56:35.360493+0000","last_clean":"2024-05-07T13:56:35.360493+0000","last_became_active":"2024-05-07T13:55:50.325201+0000","last_became_peered":"2024-05-07T13:55:50.325201+0000","last_unstale":"2024-05-07T13:56:35.360493+0000","last_undegraded":"2024-05-07T13:56:35.360493+0000","last_fullsized":"2024-05-07T13:56:35.360493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:39.839247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359294+0000","last_change":"2024-05-07T13:55:48.339081+0000","last_active":"2024-05-07T13:56:35.359294+0000","last_peered":"2024-05-07T13:56:35.359294+0000","last_clean":"2024-05-07T13:56:35.359294+0000","last_became_active":"2024-05-07T13:55:48.338704+0000","last_became_peered":"2024-05-07T13:55:48.338704+0000","last_unstale":"2024-05-07T13:56:35.359294+0000","last_undegraded":"2024-05-07T13:56:35.359294+0000","last_fullsized":"2024-05-07T13:56:35.359294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:02:32.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.167968+0000","last_change":"2024-05-07T13:56:35.362029+0000","last_active":"2024-05-07T13:56:38.167968+0000","last_peered":"2024-05-07T13:56:38.167968+0000","last_clean":"2024-05-07T13:56:38.167968+0000","last_became_active":"2024-05-07T13:56:35.361623+0000","last_became_peered":"2024-05-07T13:56:35.361623+0000","last_unstale":"2024-05-07T13:56:38.167968+0000","last_undegraded":"2024-05-07T13:56:38.167968+0000","last_fullsized":"2024-05-07T13:56:38.167968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:19.312383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"27'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.365053+0000","last_change":"2024-05-07T13:55:54.333882+0000","last_active":"2024-05-07T13:56:35.365053+0000","last_peered":"2024-05-07T13:56:35.365053+0000","last_clean":"2024-05-07T13:56:35.365053+0000","last_became_active":"2024-05-07T13:55:54.333402+0000","last_became_peered":"2024-05-07T13:55:54.333402+0000","last_unstale":"2024-05-07T13:56:35.365053+0000","last_undegraded":"2024-05-07T13:56:35.365053+0000","last_fullsized":"2024-05-07T13:56:35.365053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:39.548590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364824+0000","last_change":"2024-05-07T13:55:56.335951+0000","last_active":"2024-05-07T13:56:35.364824+0000","last_peered":"2024-05-07T13:56:35.364824+0000","last_clean":"2024-05-07T13:56:35.364824+0000","last_became_active":"2024-05-07T13:55:56.335463+0000","last_became_peered":"2024-05-07T13:55:56.335463+0000","last_unstale":"2024-05-07T13:56:35.364824+0000","last_undegraded":"2024-05-07T13:56:35.364824+0000","last_fullsized":"2024-05-07T13:56:35.364824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:46.396698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358195+0000","last_change":"2024-05-07T13:55:58.341190+0000","last_active":"2024-05-07T13:56:35.358195+0000","last_peered":"2024-05-07T13:56:35.358195+0000","last_clean":"2024-05-07T13:56:35.358195+0000","last_became_active":"2024-05-07T13:55:58.340688+0000","last_became_peered":"2024-05-07T13:55:58.340688+0000","last_unstale":"2024-05-07T13:56:35.358195+0000","last_undegraded":"2024-05-07T13:56:35.358195+0000","last_fullsized":"2024-05-07T13:56:35.358195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:49:27.158233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509454+0000","last_change":"2024-05-07T13:55:50.324646+0000","last_active":"2024-05-07T13:58:59.509454+0000","last_peered":"2024-05-07T13:58:59.509454+0000","last_clean":"2024-05-07T13:58:59.509454+0000","last_became_active":"2024-05-07T13:55:50.323775+0000","last_became_peered":"2024-05-07T13:55:50.323775+0000","last_unstale":"2024-05-07T13:58:59.509454+0000","last_undegraded":"2024-05-07T13:58:59.509454+0000","last_fullsized":"2024-05-07T13:58:59.509454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:07:56.445202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.393425+0000","last_change":"2024-05-07T13:55:48.350102+0000","last_active":"2024-05-07T13:58:59.393425+0000","last_peered":"2024-05-07T13:58:59.393425+0000","last_clean":"2024-05-07T13:58:59.393425+0000","last_became_active":"2024-05-07T13:55:48.349636+0000","last_became_peered":"2024-05-07T13:55:48.349636+0000","last_unstale":"2024-05-07T13:58:59.393425+0000","last_undegraded":"2024-05-07T13:58:59.393425+0000","last_fullsized":"2024-05-07T13:58:59.393425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:58.430354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.171913+0000","last_change":"2024-05-07T13:56:35.370451+0000","last_active":"2024-05-07T13:56:38.171913+0000","last_peered":"2024-05-07T13:56:38.171913+0000","last_clean":"2024-05-07T13:56:38.171913+0000","last_became_active":"2024-05-07T13:56:35.370109+0000","last_became_peered":"2024-05-07T13:56:35.370109+0000","last_unstale":"2024-05-07T13:56:38.171913+0000","last_undegraded":"2024-05-07T13:56:38.171913+0000","last_fullsized":"2024-05-07T13:56:38.171913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:20.523325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366990+0000","last_change":"2024-05-07T13:55:54.327564+0000","last_active":"2024-05-07T13:56:35.366990+0000","last_peered":"2024-05-07T13:56:35.366990+0000","last_clean":"2024-05-07T13:56:35.366990+0000","last_became_active":"2024-05-07T13:55:54.327178+0000","last_became_peered":"2024-05-07T13:55:54.327178+0000","last_unstale":"2024-05-07T13:56:35.366990+0000","last_undegraded":"2024-05-07T13:56:35.366990+0000","last_fullsized":"2024-05-07T13:56:35.366990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:53.709163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":393,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.114742+0000","last_change":"2024-05-07T13:55:56.347848+0000","last_active":"2024-05-07T13:59:06.114742+0000","last_peered":"2024-05-07T13:59:06.114742+0000","last_clean":"2024-05-07T13:59:06.114742+0000","last_became_active":"2024-05-07T13:55:56.345712+0000","last_became_peered":"2024-05-07T13:55:56.345712+0000","last_unstale":"2024-05-07T13:59:06.114742+0000","last_undegraded":"2024-05-07T13:59:06.114742+0000","last_fullsized":"2024-05-07T13:59:06.114742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:18:51.323865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358426+0000","last_change":"2024-05-07T13:55:58.340114+0000","last_active":"2024-05-07T13:56:35.358426+0000","last_peered":"2024-05-07T13:56:35.358426+0000","last_clean":"2024-05-07T13:56:35.358426+0000","last_became_active":"2024-05-07T13:55:58.339825+0000","last_became_peered":"2024-05-07T13:55:58.339825+0000","last_unstale":"2024-05-07T13:56:35.358426+0000","last_undegraded":"2024-05-07T13:56:35.358426+0000","last_fullsized":"2024-05-07T13:56:35.358426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:12:49.742507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361998+0000","last_change":"2024-05-07T13:55:50.319097+0000","last_active":"2024-05-07T13:56:35.361998+0000","last_peered":"2024-05-07T13:56:35.361998+0000","last_clean":"2024-05-07T13:56:35.361998+0000","last_became_active":"2024-05-07T13:55:50.318502+0000","last_became_peered":"2024-05-07T13:55:50.318502+0000","last_unstale":"2024-05-07T13:56:35.361998+0000","last_undegraded":"2024-05-07T13:56:35.361998+0000","last_fullsized":"2024-05-07T13:56:35.361998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:27.304492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360217+0000","last_change":"2024-05-07T13:55:48.345523+0000","last_active":"2024-05-07T13:56:35.360217+0000","last_peered":"2024-05-07T13:56:35.360217+0000","last_clean":"2024-05-07T13:56:35.360217+0000","last_became_active":"2024-05-07T13:55:48.345080+0000","last_became_peered":"2024-05-07T13:55:48.345080+0000","last_unstale":"2024-05-07T13:56:35.360217+0000","last_undegraded":"2024-05-07T13:56:35.360217+0000","last_fullsized":"2024-05-07T13:56:35.360217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:40:38.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360412+0000","last_change":"2024-05-07T13:55:52.318507+0000","last_active":"2024-05-07T13:56:35.360412+0000","last_peered":"2024-05-07T13:56:35.360412+0000","last_clean":"2024-05-07T13:56:35.360412+0000","last_became_active":"2024-05-07T13:55:52.318178+0000","last_became_peered":"2024-05-07T13:55:52.318178+0000","last_unstale":"2024-05-07T13:56:35.360412+0000","last_undegraded":"2024-05-07T13:56:35.360412+0000","last_fullsized":"2024-05-07T13:56:35.360412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:00.831525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'34","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.232511+0000","last_change":"2024-05-07T13:55:54.330944+0000","last_active":"2024-05-07T13:59:06.232511+0000","last_peered":"2024-05-07T13:59:06.232511+0000","last_clean":"2024-05-07T13:59:06.232511+0000","last_became_active":"2024-05-07T13:55:54.330662+0000","last_became_peered":"2024-05-07T13:55:54.330662+0000","last_unstale":"2024-05-07T13:59:06.232511+0000","last_undegraded":"2024-05-07T13:59:06.232511+0000","last_fullsized":"2024-05-07T13:59:06.232511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:12.578018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":404,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.119670+0000","last_change":"2024-05-07T13:55:56.334463+0000","last_active":"2024-05-07T13:59:06.119670+0000","last_peered":"2024-05-07T13:59:06.119670+0000","last_clean":"2024-05-07T13:59:06.119670+0000","last_became_active":"2024-05-07T13:55:56.334111+0000","last_became_peered":"2024-05-07T13:55:56.334111+0000","last_unstale":"2024-05-07T13:59:06.119670+0000","last_undegraded":"2024-05-07T13:59:06.119670+0000","last_fullsized":"2024-05-07T13:59:06.119670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:37:50.578504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'11","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477925+0000","last_change":"2024-05-07T13:55:50.325659+0000","last_active":"2024-05-07T13:58:59.477925+0000","last_peered":"2024-05-07T13:58:59.477925+0000","last_clean":"2024-05-07T13:58:59.477925+0000","last_became_active":"2024-05-07T13:55:50.324820+0000","last_became_peered":"2024-05-07T13:55:50.324820+0000","last_unstale":"2024-05-07T13:58:59.477925+0000","last_undegraded":"2024-05-07T13:58:59.477925+0000","last_fullsized":"2024-05-07T13:58:59.477925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:06.283557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369244+0000","last_change":"2024-05-07T13:55:48.335906+0000","last_active":"2024-05-07T13:56:35.369244+0000","last_peered":"2024-05-07T13:56:35.369244+0000","last_clean":"2024-05-07T13:56:35.369244+0000","last_became_active":"2024-05-07T13:55:48.335443+0000","last_became_peered":"2024-05-07T13:55:48.335443+0000","last_unstale":"2024-05-07T13:56:35.369244+0000","last_undegraded":"2024-05-07T13:56:35.369244+0000","last_fullsized":"2024-05-07T13:56:35.369244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361209+0000","last_change":"2024-05-07T13:55:52.322554+0000","last_active":"2024-05-07T13:56:35.361209+0000","last_peered":"2024-05-07T13:56:35.361209+0000","last_clean":"2024-05-07T13:56:35.361209+0000","last_became_active":"2024-05-07T13:55:52.322188+0000","last_became_peered":"2024-05-07T13:55:52.322188+0000","last_unstale":"2024-05-07T13:56:35.361209+0000","last_undegraded":"2024-05-07T13:56:35.361209+0000","last_fullsized":"2024-05-07T13:56:35.361209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:10.020335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'43","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.260664+0000","last_change":"2024-05-07T13:55:54.330742+0000","last_active":"2024-05-07T13:59:06.260664+0000","last_peered":"2024-05-07T13:59:06.260664+0000","last_clean":"2024-05-07T13:59:06.260664+0000","last_became_active":"2024-05-07T13:55:54.330401+0000","last_became_peered":"2024-05-07T13:55:54.330401+0000","last_unstale":"2024-05-07T13:59:06.260664+0000","last_undegraded":"2024-05-07T13:59:06.260664+0000","last_fullsized":"2024-05-07T13:59:06.260664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:16.443532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359580+0000","last_change":"2024-05-07T13:55:56.334861+0000","last_active":"2024-05-07T13:56:35.359580+0000","last_peered":"2024-05-07T13:56:35.359580+0000","last_clean":"2024-05-07T13:56:35.359580+0000","last_became_active":"2024-05-07T13:55:56.334368+0000","last_became_peered":"2024-05-07T13:55:56.334368+0000","last_unstale":"2024-05-07T13:56:35.359580+0000","last_undegraded":"2024-05-07T13:56:35.359580+0000","last_fullsized":"2024-05-07T13:56:35.359580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:57.692076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.746003+0000","last_change":"2024-05-07T13:55:58.346747+0000","last_active":"2024-05-07T13:57:14.746003+0000","last_peered":"2024-05-07T13:57:14.746003+0000","last_clean":"2024-05-07T13:57:14.746003+0000","last_became_active":"2024-05-07T13:55:58.346457+0000","last_became_peered":"2024-05-07T13:55:58.346457+0000","last_unstale":"2024-05-07T13:57:14.746003+0000","last_undegraded":"2024-05-07T13:57:14.746003+0000","last_fullsized":"2024-05-07T13:57:14.746003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:02:07.921627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723506+0000","last_change":"2024-05-07T13:55:50.312874+0000","last_active":"2024-05-07T13:57:58.723506+0000","last_peered":"2024-05-07T13:57:58.723506+0000","last_clean":"2024-05-07T13:57:58.723506+0000","last_became_active":"2024-05-07T13:55:50.312564+0000","last_became_peered":"2024-05-07T13:55:50.312564+0000","last_unstale":"2024-05-07T13:57:58.723506+0000","last_undegraded":"2024-05-07T13:57:58.723506+0000","last_fullsized":"2024-05-07T13:57:58.723506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369832+0000","last_change":"2024-05-07T13:55:48.336211+0000","last_active":"2024-05-07T13:56:35.369832+0000","last_peered":"2024-05-07T13:56:35.369832+0000","last_clean":"2024-05-07T13:56:35.369832+0000","last_became_active":"2024-05-07T13:55:48.335791+0000","last_became_peered":"2024-05-07T13:55:48.335791+0000","last_unstale":"2024-05-07T13:56:35.369832+0000","last_undegraded":"2024-05-07T13:56:35.369832+0000","last_fullsized":"2024-05-07T13:56:35.369832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358813+0000","last_change":"2024-05-07T13:55:52.326024+0000","last_active":"2024-05-07T13:56:35.358813+0000","last_peered":"2024-05-07T13:56:35.358813+0000","last_clean":"2024-05-07T13:56:35.358813+0000","last_became_active":"2024-05-07T13:55:52.325676+0000","last_became_peered":"2024-05-07T13:55:52.325676+0000","last_unstale":"2024-05-07T13:56:35.358813+0000","last_undegraded":"2024-05-07T13:56:35.358813+0000","last_fullsized":"2024-05-07T13:56:35.358813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:11.861031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'36","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.194318+0000","last_change":"2024-05-07T13:55:54.332289+0000","last_active":"2024-05-07T13:59:06.194318+0000","last_peered":"2024-05-07T13:59:06.194318+0000","last_clean":"2024-05-07T13:59:06.194318+0000","last_became_active":"2024-05-07T13:55:54.331979+0000","last_became_peered":"2024-05-07T13:55:54.331979+0000","last_unstale":"2024-05-07T13:59:06.194318+0000","last_undegraded":"2024-05-07T13:59:06.194318+0000","last_fullsized":"2024-05-07T13:59:06.194318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:00:56.934082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359423+0000","last_change":"2024-05-07T13:55:56.333704+0000","last_active":"2024-05-07T13:56:35.359423+0000","last_peered":"2024-05-07T13:56:35.359423+0000","last_clean":"2024-05-07T13:56:35.359423+0000","last_became_active":"2024-05-07T13:55:56.333357+0000","last_became_peered":"2024-05-07T13:55:56.333357+0000","last_unstale":"2024-05-07T13:56:35.359423+0000","last_undegraded":"2024-05-07T13:56:35.359423+0000","last_fullsized":"2024-05-07T13:56:35.359423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:08:52.926954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:09.129804+0000","last_change":"2024-05-07T13:55:58.345252+0000","last_active":"2024-05-07T13:57:09.129804+0000","last_peered":"2024-05-07T13:57:09.129804+0000","last_clean":"2024-05-07T13:57:09.129804+0000","last_became_active":"2024-05-07T13:55:58.344955+0000","last_became_peered":"2024-05-07T13:55:58.344955+0000","last_unstale":"2024-05-07T13:57:09.129804+0000","last_undegraded":"2024-05-07T13:57:09.129804+0000","last_fullsized":"2024-05-07T13:57:09.129804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:29:24.188610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.252302+0000","last_change":"2024-05-07T13:55:50.327717+0000","last_active":"2024-05-07T13:58:59.252302+0000","last_peered":"2024-05-07T13:58:59.252302+0000","last_clean":"2024-05-07T13:58:59.252302+0000","last_became_active":"2024-05-07T13:55:50.327059+0000","last_became_peered":"2024-05-07T13:55:50.327059+0000","last_unstale":"2024-05-07T13:58:59.252302+0000","last_undegraded":"2024-05-07T13:58:59.252302+0000","last_fullsized":"2024-05-07T13:58:59.252302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:49.671647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360718+0000","last_change":"2024-05-07T13:55:48.350939+0000","last_active":"2024-05-07T13:56:35.360718+0000","last_peered":"2024-05-07T13:56:35.360718+0000","last_clean":"2024-05-07T13:56:35.360718+0000","last_became_active":"2024-05-07T13:55:48.350442+0000","last_became_peered":"2024-05-07T13:55:48.350442+0000","last_unstale":"2024-05-07T13:56:35.360718+0000","last_undegraded":"2024-05-07T13:56:35.360718+0000","last_fullsized":"2024-05-07T13:56:35.360718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:13.461398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359027+0000","last_change":"2024-05-07T13:55:52.321998+0000","last_active":"2024-05-07T13:56:35.359027+0000","last_peered":"2024-05-07T13:56:35.359027+0000","last_clean":"2024-05-07T13:56:35.359027+0000","last_became_active":"2024-05-07T13:55:52.321674+0000","last_became_peered":"2024-05-07T13:55:52.321674+0000","last_unstale":"2024-05-07T13:56:35.359027+0000","last_undegraded":"2024-05-07T13:56:35.359027+0000","last_fullsized":"2024-05-07T13:56:35.359027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:09.668336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'39","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.266684+0000","last_change":"2024-05-07T13:55:54.325770+0000","last_active":"2024-05-07T13:59:06.266684+0000","last_peered":"2024-05-07T13:59:06.266684+0000","last_clean":"2024-05-07T13:59:06.266684+0000","last_became_active":"2024-05-07T13:55:54.325336+0000","last_became_peered":"2024-05-07T13:55:54.325336+0000","last_unstale":"2024-05-07T13:59:06.266684+0000","last_undegraded":"2024-05-07T13:59:06.266684+0000","last_fullsized":"2024-05-07T13:59:06.266684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:56:55.004347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":357,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.120919+0000","last_change":"2024-05-07T13:55:56.335209+0000","last_active":"2024-05-07T13:59:06.120919+0000","last_peered":"2024-05-07T13:59:06.120919+0000","last_clean":"2024-05-07T13:59:06.120919+0000","last_became_active":"2024-05-07T13:55:56.334895+0000","last_became_peered":"2024-05-07T13:55:56.334895+0000","last_unstale":"2024-05-07T13:59:06.120919+0000","last_undegraded":"2024-05-07T13:59:06.120919+0000","last_fullsized":"2024-05-07T13:59:06.120919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:42.722681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.928109+0000","last_change":"2024-05-07T13:55:58.341127+0000","last_active":"2024-05-07T13:57:14.928109+0000","last_peered":"2024-05-07T13:57:14.928109+0000","last_clean":"2024-05-07T13:57:14.928109+0000","last_became_active":"2024-05-07T13:55:58.340764+0000","last_became_peered":"2024-05-07T13:55:58.340764+0000","last_unstale":"2024-05-07T13:57:14.928109+0000","last_undegraded":"2024-05-07T13:57:14.928109+0000","last_fullsized":"2024-05-07T13:57:14.928109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:56:59.018427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.591694+0000","last_change":"2024-05-07T13:55:50.313309+0000","last_active":"2024-05-07T13:58:59.591694+0000","last_peered":"2024-05-07T13:58:59.591694+0000","last_clean":"2024-05-07T13:58:59.591694+0000","last_became_active":"2024-05-07T13:55:50.312649+0000","last_became_peered":"2024-05-07T13:55:50.312649+0000","last_unstale":"2024-05-07T13:58:59.591694+0000","last_undegraded":"2024-05-07T13:58:59.591694+0000","last_fullsized":"2024-05-07T13:58:59.591694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:05.135442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358043+0000","last_change":"2024-05-07T13:55:48.347430+0000","last_active":"2024-05-07T13:56:35.358043+0000","last_peered":"2024-05-07T13:56:35.358043+0000","last_clean":"2024-05-07T13:56:35.358043+0000","last_became_active":"2024-05-07T13:55:48.346027+0000","last_became_peered":"2024-05-07T13:55:48.346027+0000","last_unstale":"2024-05-07T13:56:35.358043+0000","last_undegraded":"2024-05-07T13:56:35.358043+0000","last_fullsized":"2024-05-07T13:56:35.358043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:17.757284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359224+0000","last_change":"2024-05-07T13:55:52.325971+0000","last_active":"2024-05-07T13:56:35.359224+0000","last_peered":"2024-05-07T13:56:35.359224+0000","last_clean":"2024-05-07T13:56:35.359224+0000","last_became_active":"2024-05-07T13:55:52.325427+0000","last_became_peered":"2024-05-07T13:55:52.325427+0000","last_unstale":"2024-05-07T13:56:35.359224+0000","last_undegraded":"2024-05-07T13:56:35.359224+0000","last_fullsized":"2024-05-07T13:56:35.359224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:46:31.400962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'60","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.203034+0000","last_change":"2024-05-07T13:55:54.334756+0000","last_active":"2024-05-07T13:59:06.203034+0000","last_peered":"2024-05-07T13:59:06.203034+0000","last_clean":"2024-05-07T13:59:06.203034+0000","last_became_active":"2024-05-07T13:55:54.334315+0000","last_became_peered":"2024-05-07T13:55:54.334315+0000","last_unstale":"2024-05-07T13:59:06.203034+0000","last_undegraded":"2024-05-07T13:59:06.203034+0000","last_fullsized":"2024-05-07T13:59:06.203034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:20.597897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358395+0000","last_change":"2024-05-07T13:55:56.330997+0000","last_active":"2024-05-07T13:56:35.358395+0000","last_peered":"2024-05-07T13:56:35.358395+0000","last_clean":"2024-05-07T13:56:35.358395+0000","last_became_active":"2024-05-07T13:55:56.330355+0000","last_became_peered":"2024-05-07T13:55:56.330355+0000","last_unstale":"2024-05-07T13:56:35.358395+0000","last_undegraded":"2024-05-07T13:56:35.358395+0000","last_fullsized":"2024-05-07T13:56:35.358395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:50.175136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.648614+0000","last_change":"2024-05-07T13:55:58.337164+0000","last_active":"2024-05-07T13:58:59.648614+0000","last_peered":"2024-05-07T13:58:59.648614+0000","last_clean":"2024-05-07T13:58:59.648614+0000","last_became_active":"2024-05-07T13:55:58.336692+0000","last_became_peered":"2024-05-07T13:55:58.336692+0000","last_unstale":"2024-05-07T13:58:59.648614+0000","last_undegraded":"2024-05-07T13:58:59.648614+0000","last_fullsized":"2024-05-07T13:58:59.648614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:54:59.700436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.143745+0000","last_change":"2024-05-07T13:55:50.323082+0000","last_active":"2024-05-07T13:58:59.143745+0000","last_peered":"2024-05-07T13:58:59.143745+0000","last_clean":"2024-05-07T13:58:59.143745+0000","last_became_active":"2024-05-07T13:55:50.322764+0000","last_became_peered":"2024-05-07T13:55:50.322764+0000","last_unstale":"2024-05-07T13:58:59.143745+0000","last_undegraded":"2024-05-07T13:58:59.143745+0000","last_fullsized":"2024-05-07T13:58:59.143745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.029490+0000","last_change":"2024-05-07T13:55:48.325995+0000","last_active":"2024-05-07T13:58:59.029490+0000","last_peered":"2024-05-07T13:58:59.029490+0000","last_clean":"2024-05-07T13:58:59.029490+0000","last_became_active":"2024-05-07T13:55:48.325075+0000","last_became_peered":"2024-05-07T13:55:48.325075+0000","last_unstale":"2024-05-07T13:58:59.029490+0000","last_undegraded":"2024-05-07T13:58:59.029490+0000","last_fullsized":"2024-05-07T13:58:59.029490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.368200+0000","last_change":"2024-05-07T13:55:52.322042+0000","last_active":"2024-05-07T13:56:35.368200+0000","last_peered":"2024-05-07T13:56:35.368200+0000","last_clean":"2024-05-07T13:56:35.368200+0000","last_became_active":"2024-05-07T13:55:52.321730+0000","last_became_peered":"2024-05-07T13:55:52.321730+0000","last_unstale":"2024-05-07T13:56:35.368200+0000","last_undegraded":"2024-05-07T13:56:35.368200+0000","last_fullsized":"2024-05-07T13:56:35.368200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:57:20.455708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'37","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.212880+0000","last_change":"2024-05-07T13:55:54.327401+0000","last_active":"2024-05-07T13:59:06.212880+0000","last_peered":"2024-05-07T13:59:06.212880+0000","last_clean":"2024-05-07T13:59:06.212880+0000","last_became_active":"2024-05-07T13:55:54.324530+0000","last_became_peered":"2024-05-07T13:55:54.324530+0000","last_unstale":"2024-05-07T13:59:06.212880+0000","last_undegraded":"2024-05-07T13:59:06.212880+0000","last_fullsized":"2024-05-07T13:59:06.212880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:18.265571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361297+0000","last_change":"2024-05-07T13:55:56.344241+0000","last_active":"2024-05-07T13:56:35.361297+0000","last_peered":"2024-05-07T13:56:35.361297+0000","last_clean":"2024-05-07T13:56:35.361297+0000","last_became_active":"2024-05-07T13:55:56.343900+0000","last_became_peered":"2024-05-07T13:55:56.343900+0000","last_unstale":"2024-05-07T13:56:35.361297+0000","last_undegraded":"2024-05-07T13:56:35.361297+0000","last_fullsized":"2024-05-07T13:56:35.361297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:44.620800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.179998+0000","last_change":"2024-05-07T13:55:58.352050+0000","last_active":"2024-05-07T13:57:58.179998+0000","last_peered":"2024-05-07T13:57:58.179998+0000","last_clean":"2024-05-07T13:57:58.179998+0000","last_became_active":"2024-05-07T13:55:58.351724+0000","last_became_peered":"2024-05-07T13:55:58.351724+0000","last_unstale":"2024-05-07T13:57:58.179998+0000","last_undegraded":"2024-05-07T13:57:58.179998+0000","last_fullsized":"2024-05-07T13:57:58.179998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:46:24.287671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.724211+0000","last_change":"2024-05-07T13:55:50.330503+0000","last_active":"2024-05-07T13:57:58.724211+0000","last_peered":"2024-05-07T13:57:58.724211+0000","last_clean":"2024-05-07T13:57:58.724211+0000","last_became_active":"2024-05-07T13:55:50.326050+0000","last_became_peered":"2024-05-07T13:55:50.326050+0000","last_unstale":"2024-05-07T13:57:58.724211+0000","last_undegraded":"2024-05-07T13:57:58.724211+0000","last_fullsized":"2024-05-07T13:57:58.724211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:35.534512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358437+0000","last_change":"2024-05-07T13:55:48.352032+0000","last_active":"2024-05-07T13:56:35.358437+0000","last_peered":"2024-05-07T13:56:35.358437+0000","last_clean":"2024-05-07T13:56:35.358437+0000","last_became_active":"2024-05-07T13:55:48.350335+0000","last_became_peered":"2024-05-07T13:55:48.350335+0000","last_unstale":"2024-05-07T13:56:35.358437+0000","last_undegraded":"2024-05-07T13:56:35.358437+0000","last_fullsized":"2024-05-07T13:56:35.358437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:06:46.976702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"20'1","reported_seq":220,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.084705+0000","last_change":"2024-05-07T13:55:52.322369+0000","last_active":"2024-05-07T13:59:06.084705+0000","last_peered":"2024-05-07T13:59:06.084705+0000","last_clean":"2024-05-07T13:59:06.084705+0000","last_became_active":"2024-05-07T13:55:52.322006+0000","last_became_peered":"2024-05-07T13:55:52.322006+0000","last_unstale":"2024-05-07T13:59:06.084705+0000","last_undegraded":"2024-05-07T13:59:06.084705+0000","last_fullsized":"2024-05-07T13:59:06.084705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:14.436330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'39","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.184517+0000","last_change":"2024-05-07T13:55:54.320190+0000","last_active":"2024-05-07T13:59:06.184517+0000","last_peered":"2024-05-07T13:59:06.184517+0000","last_clean":"2024-05-07T13:59:06.184517+0000","last_became_active":"2024-05-07T13:55:54.319812+0000","last_became_peered":"2024-05-07T13:55:54.319812+0000","last_unstale":"2024-05-07T13:59:06.184517+0000","last_undegraded":"2024-05-07T13:59:06.184517+0000","last_fullsized":"2024-05-07T13:59:06.184517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:06:33.788094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":433,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.115909+0000","last_change":"2024-05-07T13:55:56.332248+0000","last_active":"2024-05-07T13:59:06.115909+0000","last_peered":"2024-05-07T13:59:06.115909+0000","last_clean":"2024-05-07T13:59:06.115909+0000","last_became_active":"2024-05-07T13:55:56.331966+0000","last_became_peered":"2024-05-07T13:55:56.331966+0000","last_unstale":"2024-05-07T13:59:06.115909+0000","last_undegraded":"2024-05-07T13:59:06.115909+0000","last_fullsized":"2024-05-07T13:59:06.115909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:09:41.555422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.507257+0000","last_change":"2024-05-07T13:55:58.340997+0000","last_active":"2024-05-07T13:58:59.507257+0000","last_peered":"2024-05-07T13:58:59.507257+0000","last_clean":"2024-05-07T13:58:59.507257+0000","last_became_active":"2024-05-07T13:55:58.340608+0000","last_became_peered":"2024-05-07T13:55:58.340608+0000","last_unstale":"2024-05-07T13:58:59.507257+0000","last_undegraded":"2024-05-07T13:58:59.507257+0000","last_fullsized":"2024-05-07T13:58:59.507257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:04.022939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.246015+0000","last_change":"2024-05-07T13:55:50.322925+0000","last_active":"2024-05-07T13:58:59.246015+0000","last_peered":"2024-05-07T13:58:59.246015+0000","last_clean":"2024-05-07T13:58:59.246015+0000","last_became_active":"2024-05-07T13:55:50.322650+0000","last_became_peered":"2024-05-07T13:55:50.322650+0000","last_unstale":"2024-05-07T13:58:59.246015+0000","last_undegraded":"2024-05-07T13:58:59.246015+0000","last_fullsized":"2024-05-07T13:58:59.246015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:19.764922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357841+0000","last_change":"2024-05-07T13:55:48.349364+0000","last_active":"2024-05-07T13:56:35.357841+0000","last_peered":"2024-05-07T13:56:35.357841+0000","last_clean":"2024-05-07T13:56:35.357841+0000","last_became_active":"2024-05-07T13:55:48.347434+0000","last_became_peered":"2024-05-07T13:55:48.347434+0000","last_unstale":"2024-05-07T13:56:35.357841+0000","last_undegraded":"2024-05-07T13:56:35.357841+0000","last_fullsized":"2024-05-07T13:56:35.357841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:21.121562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":417,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.094768+0000","last_change":"2024-05-07T13:55:52.321582+0000","last_active":"2024-05-07T13:59:06.094768+0000","last_peered":"2024-05-07T13:59:06.094768+0000","last_clean":"2024-05-07T13:59:06.094768+0000","last_became_active":"2024-05-07T13:55:52.321251+0000","last_became_peered":"2024-05-07T13:55:52.321251+0000","last_unstale":"2024-05-07T13:59:06.094768+0000","last_undegraded":"2024-05-07T13:59:06.094768+0000","last_fullsized":"2024-05-07T13:59:06.094768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:47.624596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359197+0000","last_change":"2024-05-07T13:55:54.332203+0000","last_active":"2024-05-07T13:56:35.359197+0000","last_peered":"2024-05-07T13:56:35.359197+0000","last_clean":"2024-05-07T13:56:35.359197+0000","last_became_active":"2024-05-07T13:55:54.331844+0000","last_became_peered":"2024-05-07T13:55:54.331844+0000","last_unstale":"2024-05-07T13:56:35.359197+0000","last_undegraded":"2024-05-07T13:56:35.359197+0000","last_fullsized":"2024-05-07T13:56:35.359197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:37:22.283720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":462,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.117345+0000","last_change":"2024-05-07T13:55:56.333205+0000","last_active":"2024-05-07T13:59:06.117345+0000","last_peered":"2024-05-07T13:59:06.117345+0000","last_clean":"2024-05-07T13:59:06.117345+0000","last_became_active":"2024-05-07T13:55:56.332858+0000","last_became_peered":"2024-05-07T13:55:56.332858+0000","last_unstale":"2024-05-07T13:59:06.117345+0000","last_undegraded":"2024-05-07T13:59:06.117345+0000","last_fullsized":"2024-05-07T13:59:06.117345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:19.698130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.507540+0000","last_change":"2024-05-07T13:55:58.335655+0000","last_active":"2024-05-07T13:57:58.507540+0000","last_peered":"2024-05-07T13:57:58.507540+0000","last_clean":"2024-05-07T13:57:58.507540+0000","last_became_active":"2024-05-07T13:55:58.335341+0000","last_became_peered":"2024-05-07T13:55:58.335341+0000","last_unstale":"2024-05-07T13:57:58.507540+0000","last_undegraded":"2024-05-07T13:57:58.507540+0000","last_fullsized":"2024-05-07T13:57:58.507540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:07.873806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477769+0000","last_change":"2024-05-07T13:55:50.331652+0000","last_active":"2024-05-07T13:58:59.477769+0000","last_peered":"2024-05-07T13:58:59.477769+0000","last_clean":"2024-05-07T13:58:59.477769+0000","last_became_active":"2024-05-07T13:55:50.331295+0000","last_became_peered":"2024-05-07T13:55:50.331295+0000","last_unstale":"2024-05-07T13:58:59.477769+0000","last_undegraded":"2024-05-07T13:58:59.477769+0000","last_fullsized":"2024-05-07T13:58:59.477769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:51:22.677704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357223+0000","last_change":"2024-05-07T13:55:48.352519+0000","last_active":"2024-05-07T13:56:35.357223+0000","last_peered":"2024-05-07T13:56:35.357223+0000","last_clean":"2024-05-07T13:56:35.357223+0000","last_became_active":"2024-05-07T13:55:48.351055+0000","last_became_peered":"2024-05-07T13:55:48.351055+0000","last_unstale":"2024-05-07T13:56:35.357223+0000","last_undegraded":"2024-05-07T13:56:35.357223+0000","last_fullsized":"2024-05-07T13:56:35.357223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:13:23.846967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"29'4","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.082980+0000","last_change":"2024-05-07T13:55:52.320405+0000","last_active":"2024-05-07T13:59:06.082980+0000","last_peered":"2024-05-07T13:59:06.082980+0000","last_clean":"2024-05-07T13:59:06.082980+0000","last_became_active":"2024-05-07T13:55:52.320027+0000","last_became_peered":"2024-05-07T13:55:52.320027+0000","last_unstale":"2024-05-07T13:59:06.082980+0000","last_undegraded":"2024-05-07T13:59:06.082980+0000","last_fullsized":"2024-05-07T13:59:06.082980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:36.196536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'42","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.251458+0000","last_change":"2024-05-07T13:55:54.334106+0000","last_active":"2024-05-07T13:59:06.251458+0000","last_peered":"2024-05-07T13:59:06.251458+0000","last_clean":"2024-05-07T13:59:06.251458+0000","last_became_active":"2024-05-07T13:55:54.333766+0000","last_became_peered":"2024-05-07T13:55:54.333766+0000","last_unstale":"2024-05-07T13:59:06.251458+0000","last_undegraded":"2024-05-07T13:59:06.251458+0000","last_fullsized":"2024-05-07T13:59:06.251458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:56.275417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366808+0000","last_change":"2024-05-07T13:55:56.338510+0000","last_active":"2024-05-07T13:56:35.366808+0000","last_peered":"2024-05-07T13:56:35.366808+0000","last_clean":"2024-05-07T13:56:35.366808+0000","last_became_active":"2024-05-07T13:55:56.338195+0000","last_became_peered":"2024-05-07T13:55:56.338195+0000","last_unstale":"2024-05-07T13:56:35.366808+0000","last_undegraded":"2024-05-07T13:56:35.366808+0000","last_fullsized":"2024-05-07T13:56:35.366808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:41.461582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.544535+0000","last_change":"2024-05-07T13:55:58.346374+0000","last_active":"2024-05-07T13:58:59.544535+0000","last_peered":"2024-05-07T13:58:59.544535+0000","last_clean":"2024-05-07T13:58:59.544535+0000","last_became_active":"2024-05-07T13:55:58.346040+0000","last_became_peered":"2024-05-07T13:55:58.346040+0000","last_unstale":"2024-05-07T13:58:59.544535+0000","last_undegraded":"2024-05-07T13:58:59.544535+0000","last_fullsized":"2024-05-07T13:58:59.544535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:38.039656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'16","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.143397+0000","last_change":"2024-05-07T13:56:35.374383+0000","last_active":"2024-05-07T13:58:59.143397+0000","last_peered":"2024-05-07T13:58:59.143397+0000","last_clean":"2024-05-07T13:58:59.143397+0000","last_became_active":"2024-05-07T13:56:35.369148+0000","last_became_peered":"2024-05-07T13:56:35.369148+0000","last_unstale":"2024-05-07T13:58:59.143397+0000","last_undegraded":"2024-05-07T13:58:59.143397+0000","last_fullsized":"2024-05-07T13:58:59.143397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:30.011499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359758+0000","last_change":"2024-05-07T13:55:40.043635+0000","last_active":"2024-05-07T13:56:35.359758+0000","last_peered":"2024-05-07T13:56:35.359758+0000","last_clean":"2024-05-07T13:56:35.359758+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:56:35.359758+0000","last_undegraded":"2024-05-07T13:56:35.359758+0000","last_fullsized":"2024-05-07T13:56:35.359758+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:01:05.355008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358964+0000","last_change":"2024-05-07T13:55:40.045474+0000","last_active":"2024-05-07T13:56:35.358964+0000","last_peered":"2024-05-07T13:56:35.358964+0000","last_clean":"2024-05-07T13:56:35.358964+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T13:56:35.358964+0000","last_undegraded":"2024-05-07T13:56:35.358964+0000","last_fullsized":"2024-05-07T13:56:35.358964+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:22:03.440717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.728528+0000","last_change":"2024-05-07T13:55:48.352406+0000","last_active":"2024-05-07T13:57:14.728528+0000","last_peered":"2024-05-07T13:57:14.728528+0000","last_clean":"2024-05-07T13:57:14.728528+0000","last_became_active":"2024-05-07T13:55:48.350998+0000","last_became_peered":"2024-05-07T13:55:48.350998+0000","last_unstale":"2024-05-07T13:57:14.728528+0000","last_undegraded":"2024-05-07T13:57:14.728528+0000","last_fullsized":"2024-05-07T13:57:14.728528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:52.052094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364056+0000","last_change":"2024-05-07T13:55:52.321728+0000","last_active":"2024-05-07T13:56:35.364056+0000","last_peered":"2024-05-07T13:56:35.364056+0000","last_clean":"2024-05-07T13:56:35.364056+0000","last_became_active":"2024-05-07T13:55:52.321406+0000","last_became_peered":"2024-05-07T13:55:52.321406+0000","last_unstale":"2024-05-07T13:56:35.364056+0000","last_undegraded":"2024-05-07T13:56:35.364056+0000","last_fullsized":"2024-05-07T13:56:35.364056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:35.607190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'85","reported_seq":166,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.257698+0000","last_change":"2024-05-07T13:55:54.329086+0000","last_active":"2024-05-07T13:59:06.257698+0000","last_peered":"2024-05-07T13:59:06.257698+0000","last_clean":"2024-05-07T13:59:06.257698+0000","last_became_active":"2024-05-07T13:55:54.328677+0000","last_became_peered":"2024-05-07T13:55:54.328677+0000","last_unstale":"2024-05-07T13:59:06.257698+0000","last_undegraded":"2024-05-07T13:59:06.257698+0000","last_fullsized":"2024-05-07T13:59:06.257698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:31:48.109295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359644+0000","last_change":"2024-05-07T13:55:56.335298+0000","last_active":"2024-05-07T13:56:35.359644+0000","last_peered":"2024-05-07T13:56:35.359644+0000","last_clean":"2024-05-07T13:56:35.359644+0000","last_became_active":"2024-05-07T13:55:56.335013+0000","last_became_peered":"2024-05-07T13:55:56.335013+0000","last_unstale":"2024-05-07T13:56:35.359644+0000","last_undegraded":"2024-05-07T13:56:35.359644+0000","last_fullsized":"2024-05-07T13:56:35.359644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:04.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'82","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.513260+0000","last_change":"2024-05-07T13:55:58.335516+0000","last_active":"2024-05-07T13:58:59.513260+0000","last_peered":"2024-05-07T13:58:59.513260+0000","last_clean":"2024-05-07T13:58:59.513260+0000","last_became_active":"2024-05-07T13:55:58.335220+0000","last_became_peered":"2024-05-07T13:55:58.335220+0000","last_unstale":"2024-05-07T13:58:59.513260+0000","last_undegraded":"2024-05-07T13:58:59.513260+0000","last_fullsized":"2024-05-07T13:58:59.513260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:01:58.567620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.476754+0000","last_change":"2024-05-07T13:55:50.324475+0000","last_active":"2024-05-07T13:58:59.476754+0000","last_peered":"2024-05-07T13:58:59.476754+0000","last_clean":"2024-05-07T13:58:59.476754+0000","last_became_active":"2024-05-07T13:55:50.323408+0000","last_became_peered":"2024-05-07T13:55:50.323408+0000","last_unstale":"2024-05-07T13:58:59.476754+0000","last_undegraded":"2024-05-07T13:58:59.476754+0000","last_fullsized":"2024-05-07T13:58:59.476754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:26:01.826472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356763+0000","last_change":"2024-05-07T13:55:40.043428+0000","last_active":"2024-05-07T13:56:35.356763+0000","last_peered":"2024-05-07T13:56:35.356763+0000","last_clean":"2024-05-07T13:56:35.356763+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T13:56:35.356763+0000","last_undegraded":"2024-05-07T13:56:35.356763+0000","last_fullsized":"2024-05-07T13:56:35.356763+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:34.894187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358426+0000","last_change":"2024-05-07T13:55:48.327071+0000","last_active":"2024-05-07T13:56:35.358426+0000","last_peered":"2024-05-07T13:56:35.358426+0000","last_clean":"2024-05-07T13:56:35.358426+0000","last_became_active":"2024-05-07T13:55:48.325905+0000","last_became_peered":"2024-05-07T13:55:48.325905+0000","last_unstale":"2024-05-07T13:56:35.358426+0000","last_undegraded":"2024-05-07T13:56:35.358426+0000","last_fullsized":"2024-05-07T13:56:35.358426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361487+0000","last_change":"2024-05-07T13:55:52.318581+0000","last_active":"2024-05-07T13:56:35.361487+0000","last_peered":"2024-05-07T13:56:35.361487+0000","last_clean":"2024-05-07T13:56:35.361487+0000","last_became_active":"2024-05-07T13:55:52.318221+0000","last_became_peered":"2024-05-07T13:55:52.318221+0000","last_unstale":"2024-05-07T13:56:35.361487+0000","last_undegraded":"2024-05-07T13:56:35.361487+0000","last_fullsized":"2024-05-07T13:56:35.361487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:37:46.564469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'284","reported_seq":500,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.255691+0000","last_change":"2024-05-07T13:55:54.330092+0000","last_active":"2024-05-07T13:59:06.255691+0000","last_peered":"2024-05-07T13:59:06.255691+0000","last_clean":"2024-05-07T13:59:06.255691+0000","last_became_active":"2024-05-07T13:55:54.329774+0000","last_became_peered":"2024-05-07T13:55:54.329774+0000","last_unstale":"2024-05-07T13:59:06.255691+0000","last_undegraded":"2024-05-07T13:59:06.255691+0000","last_fullsized":"2024-05-07T13:59:06.255691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:39.454749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359063+0000","last_change":"2024-05-07T13:55:56.344460+0000","last_active":"2024-05-07T13:56:35.359063+0000","last_peered":"2024-05-07T13:56:35.359063+0000","last_clean":"2024-05-07T13:56:35.359063+0000","last_became_active":"2024-05-07T13:55:56.343224+0000","last_became_peered":"2024-05-07T13:55:56.343224+0000","last_unstale":"2024-05-07T13:56:35.359063+0000","last_undegraded":"2024-05-07T13:56:35.359063+0000","last_fullsized":"2024-05-07T13:56:35.359063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:31:00.903367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.721038+0000","last_change":"2024-05-07T13:55:58.345308+0000","last_active":"2024-05-07T13:57:58.721038+0000","last_peered":"2024-05-07T13:57:58.721038+0000","last_clean":"2024-05-07T13:57:58.721038+0000","last_became_active":"2024-05-07T13:55:58.344996+0000","last_became_peered":"2024-05-07T13:55:58.344996+0000","last_unstale":"2024-05-07T13:57:58.721038+0000","last_undegraded":"2024-05-07T13:57:58.721038+0000","last_fullsized":"2024-05-07T13:57:58.721038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:26.544607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502914+0000","last_change":"2024-05-07T13:55:50.318832+0000","last_active":"2024-05-07T13:58:59.502914+0000","last_peered":"2024-05-07T13:58:59.502914+0000","last_clean":"2024-05-07T13:58:59.502914+0000","last_became_active":"2024-05-07T13:55:50.318471+0000","last_became_peered":"2024-05-07T13:55:50.318471+0000","last_unstale":"2024-05-07T13:58:59.502914+0000","last_undegraded":"2024-05-07T13:58:59.502914+0000","last_fullsized":"2024-05-07T13:58:59.502914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:26.371060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362574+0000","last_change":"2024-05-07T13:55:40.043522+0000","last_active":"2024-05-07T13:56:35.362574+0000","last_peered":"2024-05-07T13:56:35.362574+0000","last_clean":"2024-05-07T13:56:35.362574+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:56:35.362574+0000","last_undegraded":"2024-05-07T13:56:35.362574+0000","last_fullsized":"2024-05-07T13:56:35.362574+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:01:05.355008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357954+0000","last_change":"2024-05-07T13:55:48.326648+0000","last_active":"2024-05-07T13:56:35.357954+0000","last_peered":"2024-05-07T13:56:35.357954+0000","last_clean":"2024-05-07T13:56:35.357954+0000","last_became_active":"2024-05-07T13:55:48.325013+0000","last_became_peered":"2024-05-07T13:55:48.325013+0000","last_unstale":"2024-05-07T13:56:35.357954+0000","last_undegraded":"2024-05-07T13:56:35.357954+0000","last_fullsized":"2024-05-07T13:56:35.357954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.377191+0000","last_change":"2024-05-07T13:56:35.376721+0000","last_active":"2024-05-07T13:56:35.377191+0000","last_peered":"2024-05-07T13:56:35.377191+0000","last_clean":"2024-05-07T13:56:35.377191+0000","last_became_active":"2024-05-07T13:56:35.368904+0000","last_became_peered":"2024-05-07T13:56:35.368904+0000","last_unstale":"2024-05-07T13:56:35.377191+0000","last_undegraded":"2024-05-07T13:56:35.377191+0000","last_fullsized":"2024-05-07T13:56:35.377191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:48:47.495613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:57.405246+0000","last_change":"2024-05-07T13:55:54.330092+0000","last_active":"2024-05-07T13:58:57.405246+0000","last_peered":"2024-05-07T13:58:57.405246+0000","last_clean":"2024-05-07T13:58:57.405246+0000","last_became_active":"2024-05-07T13:55:54.329778+0000","last_became_peered":"2024-05-07T13:55:54.329778+0000","last_unstale":"2024-05-07T13:58:57.405246+0000","last_undegraded":"2024-05-07T13:58:57.405246+0000","last_fullsized":"2024-05-07T13:58:57.405246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:49.631798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360263+0000","last_change":"2024-05-07T13:55:56.336320+0000","last_active":"2024-05-07T13:56:35.360263+0000","last_peered":"2024-05-07T13:56:35.360263+0000","last_clean":"2024-05-07T13:56:35.360263+0000","last_became_active":"2024-05-07T13:55:56.336064+0000","last_became_peered":"2024-05-07T13:55:56.336064+0000","last_unstale":"2024-05-07T13:56:35.360263+0000","last_undegraded":"2024-05-07T13:56:35.360263+0000","last_fullsized":"2024-05-07T13:56:35.360263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:20:40.210571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.473318+0000","last_change":"2024-05-07T13:55:58.350552+0000","last_active":"2024-05-07T13:58:59.473318+0000","last_peered":"2024-05-07T13:58:59.473318+0000","last_clean":"2024-05-07T13:58:59.473318+0000","last_became_active":"2024-05-07T13:55:58.350208+0000","last_became_peered":"2024-05-07T13:55:58.350208+0000","last_unstale":"2024-05-07T13:58:59.473318+0000","last_undegraded":"2024-05-07T13:58:59.473318+0000","last_fullsized":"2024-05-07T13:58:59.473318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:40.675669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.931596+0000","last_change":"2024-05-07T13:55:50.313509+0000","last_active":"2024-05-07T13:57:14.931596+0000","last_peered":"2024-05-07T13:57:14.931596+0000","last_clean":"2024-05-07T13:57:14.931596+0000","last_became_active":"2024-05-07T13:55:50.313163+0000","last_became_peered":"2024-05-07T13:55:50.313163+0000","last_unstale":"2024-05-07T13:57:14.931596+0000","last_undegraded":"2024-05-07T13:57:14.931596+0000","last_fullsized":"2024-05-07T13:57:14.931596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:30.949901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356826+0000","last_change":"2024-05-07T13:55:40.044279+0000","last_active":"2024-05-07T13:56:35.356826+0000","last_peered":"2024-05-07T13:56:35.356826+0000","last_clean":"2024-05-07T13:56:35.356826+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T13:56:35.356826+0000","last_undegraded":"2024-05-07T13:56:35.356826+0000","last_fullsized":"2024-05-07T13:56:35.356826+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:05:53.554681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.365647+0000","last_change":"2024-05-07T13:55:48.338820+0000","last_active":"2024-05-07T13:56:35.365647+0000","last_peered":"2024-05-07T13:56:35.365647+0000","last_clean":"2024-05-07T13:56:35.365647+0000","last_became_active":"2024-05-07T13:55:48.338442+0000","last_became_peered":"2024-05-07T13:55:48.338442+0000","last_unstale":"2024-05-07T13:56:35.365647+0000","last_undegraded":"2024-05-07T13:56:35.365647+0000","last_fullsized":"2024-05-07T13:56:35.365647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:03:37.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360317+0000","last_change":"2024-05-07T13:55:52.321916+0000","last_active":"2024-05-07T13:56:35.360317+0000","last_peered":"2024-05-07T13:56:35.360317+0000","last_clean":"2024-05-07T13:56:35.360317+0000","last_became_active":"2024-05-07T13:55:52.321506+0000","last_became_peered":"2024-05-07T13:55:52.321506+0000","last_unstale":"2024-05-07T13:56:35.360317+0000","last_undegraded":"2024-05-07T13:56:35.360317+0000","last_fullsized":"2024-05-07T13:56:35.360317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:35.607190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'15","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.754593+0000","last_change":"2024-05-07T13:55:54.329113+0000","last_active":"2024-05-07T13:58:58.754593+0000","last_peered":"2024-05-07T13:58:58.754593+0000","last_clean":"2024-05-07T13:58:58.754593+0000","last_became_active":"2024-05-07T13:55:54.328763+0000","last_became_peered":"2024-05-07T13:55:54.328763+0000","last_unstale":"2024-05-07T13:58:58.754593+0000","last_undegraded":"2024-05-07T13:58:58.754593+0000","last_fullsized":"2024-05-07T13:58:58.754593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:29:04.977290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361744+0000","last_change":"2024-05-07T13:55:56.343480+0000","last_active":"2024-05-07T13:56:35.361744+0000","last_peered":"2024-05-07T13:56:35.361744+0000","last_clean":"2024-05-07T13:56:35.361744+0000","last_became_active":"2024-05-07T13:55:56.343131+0000","last_became_peered":"2024-05-07T13:55:56.343131+0000","last_unstale":"2024-05-07T13:56:35.361744+0000","last_undegraded":"2024-05-07T13:56:35.361744+0000","last_fullsized":"2024-05-07T13:56:35.361744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:50.212923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.487763+0000","last_change":"2024-05-07T13:55:58.348390+0000","last_active":"2024-05-07T13:57:58.487763+0000","last_peered":"2024-05-07T13:57:58.487763+0000","last_clean":"2024-05-07T13:57:58.487763+0000","last_became_active":"2024-05-07T13:55:58.348068+0000","last_became_peered":"2024-05-07T13:55:58.348068+0000","last_unstale":"2024-05-07T13:57:58.487763+0000","last_undegraded":"2024-05-07T13:57:58.487763+0000","last_fullsized":"2024-05-07T13:57:58.487763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:21.047817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'14","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408795+0000","last_change":"2024-05-07T13:55:50.324091+0000","last_active":"2024-05-07T13:58:59.408795+0000","last_peered":"2024-05-07T13:58:59.408795+0000","last_clean":"2024-05-07T13:58:59.408795+0000","last_became_active":"2024-05-07T13:55:50.323820+0000","last_became_peered":"2024-05-07T13:55:50.323820+0000","last_unstale":"2024-05-07T13:58:59.408795+0000","last_undegraded":"2024-05-07T13:58:59.408795+0000","last_fullsized":"2024-05-07T13:58:59.408795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367577+0000","last_change":"2024-05-07T13:55:48.338590+0000","last_active":"2024-05-07T13:56:35.367577+0000","last_peered":"2024-05-07T13:56:35.367577+0000","last_clean":"2024-05-07T13:56:35.367577+0000","last_became_active":"2024-05-07T13:55:48.338139+0000","last_became_peered":"2024-05-07T13:55:48.338139+0000","last_unstale":"2024-05-07T13:56:35.367577+0000","last_undegraded":"2024-05-07T13:56:35.367577+0000","last_fullsized":"2024-05-07T13:56:35.367577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:02.747875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359773+0000","last_change":"2024-05-07T13:55:40.043241+0000","last_active":"2024-05-07T13:56:35.359773+0000","last_peered":"2024-05-07T13:56:35.359773+0000","last_clean":"2024-05-07T13:56:35.359773+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:56:35.359773+0000","last_undegraded":"2024-05-07T13:56:35.359773+0000","last_fullsized":"2024-05-07T13:56:35.359773+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:09.446119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.675885+0000","last_change":"2024-05-07T13:55:52.321594+0000","last_active":"2024-05-07T13:58:59.675885+0000","last_peered":"2024-05-07T13:58:59.675885+0000","last_clean":"2024-05-07T13:58:59.675885+0000","last_became_active":"2024-05-07T13:55:52.321249+0000","last_became_peered":"2024-05-07T13:55:52.321249+0000","last_unstale":"2024-05-07T13:58:59.675885+0000","last_undegraded":"2024-05-07T13:58:59.675885+0000","last_fullsized":"2024-05-07T13:58:59.675885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:09.429892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'68","reported_seq":135,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.235699+0000","last_change":"2024-05-07T13:55:54.327059+0000","last_active":"2024-05-07T13:59:06.235699+0000","last_peered":"2024-05-07T13:59:06.235699+0000","last_clean":"2024-05-07T13:59:06.235699+0000","last_became_active":"2024-05-07T13:55:54.326812+0000","last_became_peered":"2024-05-07T13:55:54.326812+0000","last_unstale":"2024-05-07T13:59:06.235699+0000","last_undegraded":"2024-05-07T13:59:06.235699+0000","last_fullsized":"2024-05-07T13:59:06.235699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:43.853324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358924+0000","last_change":"2024-05-07T13:55:56.331774+0000","last_active":"2024-05-07T13:56:35.358924+0000","last_peered":"2024-05-07T13:56:35.358924+0000","last_clean":"2024-05-07T13:56:35.358924+0000","last_became_active":"2024-05-07T13:55:56.331343+0000","last_became_peered":"2024-05-07T13:55:56.331343+0000","last_unstale":"2024-05-07T13:56:35.358924+0000","last_undegraded":"2024-05-07T13:56:35.358924+0000","last_fullsized":"2024-05-07T13:56:35.358924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:51:45.860157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'11","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.663624+0000","last_change":"2024-05-07T13:55:58.347841+0000","last_active":"2024-05-07T13:57:58.663624+0000","last_peered":"2024-05-07T13:57:58.663624+0000","last_clean":"2024-05-07T13:57:58.663624+0000","last_became_active":"2024-05-07T13:55:58.347566+0000","last_became_peered":"2024-05-07T13:55:58.347566+0000","last_unstale":"2024-05-07T13:57:58.663624+0000","last_undegraded":"2024-05-07T13:57:58.663624+0000","last_fullsized":"2024-05-07T13:57:58.663624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:13:51.441059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'8","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471883+0000","last_change":"2024-05-07T13:55:50.330859+0000","last_active":"2024-05-07T13:58:59.471883+0000","last_peered":"2024-05-07T13:58:59.471883+0000","last_clean":"2024-05-07T13:58:59.471883+0000","last_became_active":"2024-05-07T13:55:50.330547+0000","last_became_peered":"2024-05-07T13:55:50.330547+0000","last_unstale":"2024-05-07T13:58:59.471883+0000","last_undegraded":"2024-05-07T13:58:59.471883+0000","last_fullsized":"2024-05-07T13:58:59.471883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:30.949901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360448+0000","last_change":"2024-05-07T13:55:48.325207+0000","last_active":"2024-05-07T13:56:35.360448+0000","last_peered":"2024-05-07T13:56:35.360448+0000","last_clean":"2024-05-07T13:56:35.360448+0000","last_became_active":"2024-05-07T13:55:48.324378+0000","last_became_peered":"2024-05-07T13:55:48.324378+0000","last_unstale":"2024-05-07T13:56:35.360448+0000","last_undegraded":"2024-05-07T13:56:35.360448+0000","last_fullsized":"2024-05-07T13:56:35.360448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:02:32.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360246+0000","last_change":"2024-05-07T13:55:40.044124+0000","last_active":"2024-05-07T13:56:35.360246+0000","last_peered":"2024-05-07T13:56:35.360246+0000","last_clean":"2024-05-07T13:56:35.360246+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T13:56:35.360246+0000","last_undegraded":"2024-05-07T13:56:35.360246+0000","last_fullsized":"2024-05-07T13:56:35.360246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:38.642853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:38.171773+0000","last_change":"2024-05-07T13:56:35.366451+0000","last_active":"2024-05-07T13:56:38.171773+0000","last_peered":"2024-05-07T13:56:38.171773+0000","last_clean":"2024-05-07T13:56:38.171773+0000","last_became_active":"2024-05-07T13:56:35.366075+0000","last_became_peered":"2024-05-07T13:56:35.366075+0000","last_unstale":"2024-05-07T13:56:38.171773+0000","last_undegraded":"2024-05-07T13:56:38.171773+0000","last_fullsized":"2024-05-07T13:56:38.171773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:13:15.026535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"27'14","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361524+0000","last_change":"2024-05-07T13:55:54.331195+0000","last_active":"2024-05-07T13:56:35.361524+0000","last_peered":"2024-05-07T13:56:35.361524+0000","last_clean":"2024-05-07T13:56:35.361524+0000","last_became_active":"2024-05-07T13:55:54.330896+0000","last_became_peered":"2024-05-07T13:55:54.330896+0000","last_unstale":"2024-05-07T13:56:35.361524+0000","last_undegraded":"2024-05-07T13:56:35.361524+0000","last_fullsized":"2024-05-07T13:56:35.361524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:44.541313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":377,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.113409+0000","last_change":"2024-05-07T13:55:56.335191+0000","last_active":"2024-05-07T13:59:06.113409+0000","last_peered":"2024-05-07T13:59:06.113409+0000","last_clean":"2024-05-07T13:59:06.113409+0000","last_became_active":"2024-05-07T13:55:56.333242+0000","last_became_peered":"2024-05-07T13:55:56.333242+0000","last_unstale":"2024-05-07T13:59:06.113409+0000","last_undegraded":"2024-05-07T13:59:06.113409+0000","last_fullsized":"2024-05-07T13:59:06.113409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:38.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.438838+0000","last_change":"2024-05-07T13:55:58.346596+0000","last_active":"2024-05-07T13:57:55.438838+0000","last_peered":"2024-05-07T13:57:55.438838+0000","last_clean":"2024-05-07T13:57:55.438838+0000","last_became_active":"2024-05-07T13:55:58.346295+0000","last_became_peered":"2024-05-07T13:55:58.346295+0000","last_unstale":"2024-05-07T13:57:55.438838+0000","last_undegraded":"2024-05-07T13:57:55.438838+0000","last_fullsized":"2024-05-07T13:57:55.438838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:45.742064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.433453+0000","last_change":"2024-05-07T13:55:50.326085+0000","last_active":"2024-05-07T13:57:55.433453+0000","last_peered":"2024-05-07T13:57:55.433453+0000","last_clean":"2024-05-07T13:57:55.433453+0000","last_became_active":"2024-05-07T13:55:50.325665+0000","last_became_peered":"2024-05-07T13:55:50.325665+0000","last_unstale":"2024-05-07T13:57:55.433453+0000","last_undegraded":"2024-05-07T13:57:55.433453+0000","last_fullsized":"2024-05-07T13:57:55.433453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:03.486728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.396425+0000","last_change":"2024-05-07T13:55:48.347535+0000","last_active":"2024-05-07T13:58:59.396425+0000","last_peered":"2024-05-07T13:58:59.396425+0000","last_clean":"2024-05-07T13:58:59.396425+0000","last_became_active":"2024-05-07T13:55:48.346645+0000","last_became_peered":"2024-05-07T13:55:48.346645+0000","last_unstale":"2024-05-07T13:58:59.396425+0000","last_undegraded":"2024-05-07T13:58:59.396425+0000","last_fullsized":"2024-05-07T13:58:59.396425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:01.162350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359789+0000","last_change":"2024-05-07T13:55:40.045556+0000","last_active":"2024-05-07T13:56:35.359789+0000","last_peered":"2024-05-07T13:56:35.359789+0000","last_clean":"2024-05-07T13:56:35.359789+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:56:35.359789+0000","last_undegraded":"2024-05-07T13:56:35.359789+0000","last_fullsized":"2024-05-07T13:56:35.359789+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:10.678478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356709+0000","last_change":"2024-05-07T13:55:52.321677+0000","last_active":"2024-05-07T13:56:35.356709+0000","last_peered":"2024-05-07T13:56:35.356709+0000","last_clean":"2024-05-07T13:56:35.356709+0000","last_became_active":"2024-05-07T13:55:52.321160+0000","last_became_peered":"2024-05-07T13:55:52.321160+0000","last_unstale":"2024-05-07T13:56:35.356709+0000","last_undegraded":"2024-05-07T13:56:35.356709+0000","last_fullsized":"2024-05-07T13:56:35.356709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:38.708646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.725372+0000","last_change":"2024-05-07T13:55:54.330229+0000","last_active":"2024-05-07T13:57:58.725372+0000","last_peered":"2024-05-07T13:57:58.725372+0000","last_clean":"2024-05-07T13:57:58.725372+0000","last_became_active":"2024-05-07T13:55:54.329885+0000","last_became_peered":"2024-05-07T13:55:54.329885+0000","last_unstale":"2024-05-07T13:57:58.725372+0000","last_undegraded":"2024-05-07T13:57:58.725372+0000","last_fullsized":"2024-05-07T13:57:58.725372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:21.319585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":392,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.118760+0000","last_change":"2024-05-07T13:55:56.334411+0000","last_active":"2024-05-07T13:59:06.118760+0000","last_peered":"2024-05-07T13:59:06.118760+0000","last_clean":"2024-05-07T13:59:06.118760+0000","last_became_active":"2024-05-07T13:55:56.334023+0000","last_became_peered":"2024-05-07T13:55:56.334023+0000","last_unstale":"2024-05-07T13:59:06.118760+0000","last_undegraded":"2024-05-07T13:59:06.118760+0000","last_fullsized":"2024-05-07T13:59:06.118760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:38.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363496+0000","last_change":"2024-05-07T13:55:58.347319+0000","last_active":"2024-05-07T13:56:35.363496+0000","last_peered":"2024-05-07T13:56:35.363496+0000","last_clean":"2024-05-07T13:56:35.363496+0000","last_became_active":"2024-05-07T13:55:58.346984+0000","last_became_peered":"2024-05-07T13:55:58.346984+0000","last_unstale":"2024-05-07T13:56:35.363496+0000","last_undegraded":"2024-05-07T13:56:35.363496+0000","last_fullsized":"2024-05-07T13:56:35.363496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:09:17.780125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363167+0000","last_change":"2024-05-07T13:55:50.327606+0000","last_active":"2024-05-07T13:56:35.363167+0000","last_peered":"2024-05-07T13:56:35.363167+0000","last_clean":"2024-05-07T13:56:35.363167+0000","last_became_active":"2024-05-07T13:55:50.327283+0000","last_became_peered":"2024-05-07T13:55:50.327283+0000","last_unstale":"2024-05-07T13:56:35.363167+0000","last_undegraded":"2024-05-07T13:56:35.363167+0000","last_fullsized":"2024-05-07T13:56:35.363167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:54.059732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364948+0000","last_change":"2024-05-07T13:55:48.337939+0000","last_active":"2024-05-07T13:56:35.364948+0000","last_peered":"2024-05-07T13:56:35.364948+0000","last_clean":"2024-05-07T13:56:35.364948+0000","last_became_active":"2024-05-07T13:55:48.337553+0000","last_became_peered":"2024-05-07T13:55:48.337553+0000","last_unstale":"2024-05-07T13:56:35.364948+0000","last_undegraded":"2024-05-07T13:56:35.364948+0000","last_fullsized":"2024-05-07T13:56:35.364948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:40:36.266302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363756+0000","last_change":"2024-05-07T13:55:40.043788+0000","last_active":"2024-05-07T13:56:35.363756+0000","last_peered":"2024-05-07T13:56:35.363756+0000","last_clean":"2024-05-07T13:56:35.363756+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T13:56:35.363756+0000","last_undegraded":"2024-05-07T13:56:35.363756+0000","last_fullsized":"2024-05-07T13:56:35.363756+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:00.337671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356449+0000","last_change":"2024-05-07T13:55:52.315544+0000","last_active":"2024-05-07T13:56:35.356449+0000","last_peered":"2024-05-07T13:56:35.356449+0000","last_clean":"2024-05-07T13:56:35.356449+0000","last_became_active":"2024-05-07T13:55:52.314793+0000","last_became_peered":"2024-05-07T13:55:52.314793+0000","last_unstale":"2024-05-07T13:56:35.356449+0000","last_undegraded":"2024-05-07T13:56:35.356449+0000","last_fullsized":"2024-05-07T13:56:35.356449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:06:46.161101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'91","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.245211+0000","last_change":"2024-05-07T13:55:54.330188+0000","last_active":"2024-05-07T13:59:06.245211+0000","last_peered":"2024-05-07T13:59:06.245211+0000","last_clean":"2024-05-07T13:59:06.245211+0000","last_became_active":"2024-05-07T13:55:54.329879+0000","last_became_peered":"2024-05-07T13:55:54.329879+0000","last_unstale":"2024-05-07T13:59:06.245211+0000","last_undegraded":"2024-05-07T13:59:06.245211+0000","last_fullsized":"2024-05-07T13:59:06.245211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:37.614392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358335+0000","last_change":"2024-05-07T13:55:56.333232+0000","last_active":"2024-05-07T13:56:35.358335+0000","last_peered":"2024-05-07T13:56:35.358335+0000","last_clean":"2024-05-07T13:56:35.358335+0000","last_became_active":"2024-05-07T13:55:56.332931+0000","last_became_peered":"2024-05-07T13:55:56.332931+0000","last_unstale":"2024-05-07T13:56:35.358335+0000","last_undegraded":"2024-05-07T13:56:35.358335+0000","last_fullsized":"2024-05-07T13:56:35.358335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:05.866559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370012+0000","last_change":"2024-05-07T13:55:58.341180+0000","last_active":"2024-05-07T13:56:35.370012+0000","last_peered":"2024-05-07T13:56:35.370012+0000","last_clean":"2024-05-07T13:56:35.370012+0000","last_became_active":"2024-05-07T13:55:58.340759+0000","last_became_peered":"2024-05-07T13:55:58.340759+0000","last_unstale":"2024-05-07T13:56:35.370012+0000","last_undegraded":"2024-05-07T13:56:35.370012+0000","last_fullsized":"2024-05-07T13:56:35.370012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:48.403945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369103+0000","last_change":"2024-05-07T13:55:58.348875+0000","last_active":"2024-05-07T13:56:35.369103+0000","last_peered":"2024-05-07T13:56:35.369103+0000","last_clean":"2024-05-07T13:56:35.369103+0000","last_became_active":"2024-05-07T13:55:58.348566+0000","last_became_peered":"2024-05-07T13:55:58.348566+0000","last_unstale":"2024-05-07T13:56:35.369103+0000","last_undegraded":"2024-05-07T13:56:35.369103+0000","last_fullsized":"2024-05-07T13:56:35.369103+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:21.705378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723807+0000","last_change":"2024-05-07T13:55:50.329912+0000","last_active":"2024-05-07T13:57:58.723807+0000","last_peered":"2024-05-07T13:57:58.723807+0000","last_clean":"2024-05-07T13:57:58.723807+0000","last_became_active":"2024-05-07T13:55:50.329615+0000","last_became_peered":"2024-05-07T13:55:50.329615+0000","last_unstale":"2024-05-07T13:57:58.723807+0000","last_undegraded":"2024-05-07T13:57:58.723807+0000","last_fullsized":"2024-05-07T13:57:58.723807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358159+0000","last_change":"2024-05-07T13:55:48.348585+0000","last_active":"2024-05-07T13:56:35.358159+0000","last_peered":"2024-05-07T13:56:35.358159+0000","last_clean":"2024-05-07T13:56:35.358159+0000","last_became_active":"2024-05-07T13:55:48.346558+0000","last_became_peered":"2024-05-07T13:55:48.346558+0000","last_unstale":"2024-05-07T13:56:35.358159+0000","last_undegraded":"2024-05-07T13:56:35.358159+0000","last_fullsized":"2024-05-07T13:56:35.358159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:46.733619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362239+0000","last_change":"2024-05-07T13:55:52.324475+0000","last_active":"2024-05-07T13:56:35.362239+0000","last_peered":"2024-05-07T13:56:35.362239+0000","last_clean":"2024-05-07T13:56:35.362239+0000","last_became_active":"2024-05-07T13:55:52.324083+0000","last_became_peered":"2024-05-07T13:55:52.324083+0000","last_unstale":"2024-05-07T13:56:35.362239+0000","last_undegraded":"2024-05-07T13:56:35.362239+0000","last_fullsized":"2024-05-07T13:56:35.362239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:22.175165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'35","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.263600+0000","last_change":"2024-05-07T13:55:54.331198+0000","last_active":"2024-05-07T13:59:06.263600+0000","last_peered":"2024-05-07T13:59:06.263600+0000","last_clean":"2024-05-07T13:59:06.263600+0000","last_became_active":"2024-05-07T13:55:54.330906+0000","last_became_peered":"2024-05-07T13:55:54.330906+0000","last_unstale":"2024-05-07T13:59:06.263600+0000","last_undegraded":"2024-05-07T13:59:06.263600+0000","last_fullsized":"2024-05-07T13:59:06.263600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:54:55.686356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358029+0000","last_change":"2024-05-07T13:55:56.348303+0000","last_active":"2024-05-07T13:56:35.358029+0000","last_peered":"2024-05-07T13:56:35.358029+0000","last_clean":"2024-05-07T13:56:35.358029+0000","last_became_active":"2024-05-07T13:55:56.346371+0000","last_became_peered":"2024-05-07T13:55:56.346371+0000","last_unstale":"2024-05-07T13:56:35.358029+0000","last_undegraded":"2024-05-07T13:56:35.358029+0000","last_fullsized":"2024-05-07T13:56:35.358029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:32:39.746591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:56.842330+0000","last_change":"2024-05-07T13:55:58.341454+0000","last_active":"2024-05-07T13:57:56.842330+0000","last_peered":"2024-05-07T13:57:56.842330+0000","last_clean":"2024-05-07T13:57:56.842330+0000","last_became_active":"2024-05-07T13:55:58.341102+0000","last_became_peered":"2024-05-07T13:55:58.341102+0000","last_unstale":"2024-05-07T13:57:56.842330+0000","last_undegraded":"2024-05-07T13:57:56.842330+0000","last_fullsized":"2024-05-07T13:57:56.842330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:24.611977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.931037+0000","last_change":"2024-05-07T13:55:50.330176+0000","last_active":"2024-05-07T13:57:14.931037+0000","last_peered":"2024-05-07T13:57:14.931037+0000","last_clean":"2024-05-07T13:57:14.931037+0000","last_became_active":"2024-05-07T13:55:50.329869+0000","last_became_peered":"2024-05-07T13:55:50.329869+0000","last_unstale":"2024-05-07T13:57:14.931037+0000","last_undegraded":"2024-05-07T13:57:14.931037+0000","last_fullsized":"2024-05-07T13:57:14.931037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:56.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.399682+0000","last_change":"2024-05-07T13:55:48.338314+0000","last_active":"2024-05-07T13:58:59.399682+0000","last_peered":"2024-05-07T13:58:59.399682+0000","last_clean":"2024-05-07T13:58:59.399682+0000","last_became_active":"2024-05-07T13:55:48.336807+0000","last_became_peered":"2024-05-07T13:55:48.336807+0000","last_unstale":"2024-05-07T13:58:59.399682+0000","last_undegraded":"2024-05-07T13:58:59.399682+0000","last_fullsized":"2024-05-07T13:58:59.399682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:40:38.650551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358047+0000","last_change":"2024-05-07T13:55:52.319258+0000","last_active":"2024-05-07T13:56:35.358047+0000","last_peered":"2024-05-07T13:56:35.358047+0000","last_clean":"2024-05-07T13:56:35.358047+0000","last_became_active":"2024-05-07T13:55:52.318534+0000","last_became_peered":"2024-05-07T13:55:52.318534+0000","last_unstale":"2024-05-07T13:56:35.358047+0000","last_undegraded":"2024-05-07T13:56:35.358047+0000","last_fullsized":"2024-05-07T13:56:35.358047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:59:17.441061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.742005+0000","last_change":"2024-05-07T13:55:54.319908+0000","last_active":"2024-05-07T13:58:58.742005+0000","last_peered":"2024-05-07T13:58:58.742005+0000","last_clean":"2024-05-07T13:58:58.742005+0000","last_became_active":"2024-05-07T13:55:54.319714+0000","last_became_peered":"2024-05-07T13:55:54.319714+0000","last_unstale":"2024-05-07T13:58:58.742005+0000","last_undegraded":"2024-05-07T13:58:58.742005+0000","last_fullsized":"2024-05-07T13:58:58.742005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:06:57.744609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359119+0000","last_change":"2024-05-07T13:55:56.334660+0000","last_active":"2024-05-07T13:56:35.359119+0000","last_peered":"2024-05-07T13:56:35.359119+0000","last_clean":"2024-05-07T13:56:35.359119+0000","last_became_active":"2024-05-07T13:55:56.334342+0000","last_became_peered":"2024-05-07T13:55:56.334342+0000","last_unstale":"2024-05-07T13:56:35.359119+0000","last_undegraded":"2024-05-07T13:56:35.359119+0000","last_fullsized":"2024-05-07T13:56:35.359119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:12.304466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"29'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.158018+0000","last_change":"2024-05-07T13:55:58.342684+0000","last_active":"2024-05-07T13:58:59.158018+0000","last_peered":"2024-05-07T13:58:59.158018+0000","last_clean":"2024-05-07T13:58:59.158018+0000","last_became_active":"2024-05-07T13:55:58.342382+0000","last_became_peered":"2024-05-07T13:55:58.342382+0000","last_unstale":"2024-05-07T13:58:59.158018+0000","last_undegraded":"2024-05-07T13:58:59.158018+0000","last_fullsized":"2024-05-07T13:58:59.158018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:58:54.112594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415635+0000","last_change":"2024-05-07T13:56:35.366216+0000","last_active":"2024-05-07T13:58:59.415635+0000","last_peered":"2024-05-07T13:58:59.415635+0000","last_clean":"2024-05-07T13:58:59.415635+0000","last_became_active":"2024-05-07T13:56:35.365890+0000","last_became_peered":"2024-05-07T13:56:35.365890+0000","last_unstale":"2024-05-07T13:58:59.415635+0000","last_undegraded":"2024-05-07T13:58:59.415635+0000","last_fullsized":"2024-05-07T13:58:59.415635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:31:44.095217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.567474+0000","last_change":"2024-05-07T13:55:48.337211+0000","last_active":"2024-05-07T13:57:58.567474+0000","last_peered":"2024-05-07T13:57:58.567474+0000","last_clean":"2024-05-07T13:57:58.567474+0000","last_became_active":"2024-05-07T13:55:48.336730+0000","last_became_peered":"2024-05-07T13:55:48.336730+0000","last_unstale":"2024-05-07T13:57:58.567474+0000","last_undegraded":"2024-05-07T13:57:58.567474+0000","last_fullsized":"2024-05-07T13:57:58.567474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.362051+0000","last_change":"2024-05-07T13:55:52.325126+0000","last_active":"2024-05-07T13:56:35.362051+0000","last_peered":"2024-05-07T13:56:35.362051+0000","last_clean":"2024-05-07T13:56:35.362051+0000","last_became_active":"2024-05-07T13:55:52.324639+0000","last_became_peered":"2024-05-07T13:55:52.324639+0000","last_unstale":"2024-05-07T13:56:35.362051+0000","last_undegraded":"2024-05-07T13:56:35.362051+0000","last_fullsized":"2024-05-07T13:56:35.362051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:43:51.986602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'44","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.229451+0000","last_change":"2024-05-07T13:55:54.331164+0000","last_active":"2024-05-07T13:59:06.229451+0000","last_peered":"2024-05-07T13:59:06.229451+0000","last_clean":"2024-05-07T13:59:06.229451+0000","last_became_active":"2024-05-07T13:55:54.330738+0000","last_became_peered":"2024-05-07T13:55:54.330738+0000","last_unstale":"2024-05-07T13:59:06.229451+0000","last_undegraded":"2024-05-07T13:59:06.229451+0000","last_fullsized":"2024-05-07T13:59:06.229451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:10.297634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361731+0000","last_change":"2024-05-07T13:55:56.333196+0000","last_active":"2024-05-07T13:56:35.361731+0000","last_peered":"2024-05-07T13:56:35.361731+0000","last_clean":"2024-05-07T13:56:35.361731+0000","last_became_active":"2024-05-07T13:55:56.332844+0000","last_became_peered":"2024-05-07T13:55:56.332844+0000","last_unstale":"2024-05-07T13:56:35.361731+0000","last_undegraded":"2024-05-07T13:56:35.361731+0000","last_fullsized":"2024-05-07T13:56:35.361731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:02:05.914379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357546+0000","last_change":"2024-05-07T13:55:58.348258+0000","last_active":"2024-05-07T13:56:35.357546+0000","last_peered":"2024-05-07T13:56:35.357546+0000","last_clean":"2024-05-07T13:56:35.357546+0000","last_became_active":"2024-05-07T13:55:58.347598+0000","last_became_peered":"2024-05-07T13:55:58.347598+0000","last_unstale":"2024-05-07T13:56:35.357546+0000","last_undegraded":"2024-05-07T13:56:35.357546+0000","last_fullsized":"2024-05-07T13:56:35.357546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:42:16.894503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'14","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723917+0000","last_change":"2024-05-07T13:55:50.326698+0000","last_active":"2024-05-07T13:57:58.723917+0000","last_peered":"2024-05-07T13:57:58.723917+0000","last_clean":"2024-05-07T13:57:58.723917+0000","last_became_active":"2024-05-07T13:55:50.326430+0000","last_became_peered":"2024-05-07T13:55:50.326430+0000","last_unstale":"2024-05-07T13:57:58.723917+0000","last_undegraded":"2024-05-07T13:57:58.723917+0000","last_fullsized":"2024-05-07T13:57:58.723917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:45.617720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366242+0000","last_change":"2024-05-07T13:55:48.332048+0000","last_active":"2024-05-07T13:56:35.366242+0000","last_peered":"2024-05-07T13:56:35.366242+0000","last_clean":"2024-05-07T13:56:35.366242+0000","last_became_active":"2024-05-07T13:55:48.331660+0000","last_became_peered":"2024-05-07T13:55:48.331660+0000","last_unstale":"2024-05-07T13:56:35.366242+0000","last_undegraded":"2024-05-07T13:56:35.366242+0000","last_fullsized":"2024-05-07T13:56:35.366242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:43.638691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356670+0000","last_change":"2024-05-07T13:55:52.320839+0000","last_active":"2024-05-07T13:56:35.356670+0000","last_peered":"2024-05-07T13:56:35.356670+0000","last_clean":"2024-05-07T13:56:35.356670+0000","last_became_active":"2024-05-07T13:55:52.320520+0000","last_became_peered":"2024-05-07T13:55:52.320520+0000","last_unstale":"2024-05-07T13:56:35.356670+0000","last_undegraded":"2024-05-07T13:56:35.356670+0000","last_fullsized":"2024-05-07T13:56:35.356670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:34.956299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'33","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.220415+0000","last_change":"2024-05-07T13:55:54.320598+0000","last_active":"2024-05-07T13:59:06.220415+0000","last_peered":"2024-05-07T13:59:06.220415+0000","last_clean":"2024-05-07T13:59:06.220415+0000","last_became_active":"2024-05-07T13:55:54.320266+0000","last_became_peered":"2024-05-07T13:55:54.320266+0000","last_unstale":"2024-05-07T13:59:06.220415+0000","last_undegraded":"2024-05-07T13:59:06.220415+0000","last_fullsized":"2024-05-07T13:59:06.220415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:11.437094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364874+0000","last_change":"2024-05-07T13:55:56.330536+0000","last_active":"2024-05-07T13:56:35.364874+0000","last_peered":"2024-05-07T13:56:35.364874+0000","last_clean":"2024-05-07T13:56:35.364874+0000","last_became_active":"2024-05-07T13:55:56.330251+0000","last_became_peered":"2024-05-07T13:55:56.330251+0000","last_unstale":"2024-05-07T13:56:35.364874+0000","last_undegraded":"2024-05-07T13:56:35.364874+0000","last_fullsized":"2024-05-07T13:56:35.364874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:02.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.141147+0000","last_change":"2024-05-07T13:55:50.323450+0000","last_active":"2024-05-07T13:58:59.141147+0000","last_peered":"2024-05-07T13:58:59.141147+0000","last_clean":"2024-05-07T13:58:59.141147+0000","last_became_active":"2024-05-07T13:55:50.323159+0000","last_became_peered":"2024-05-07T13:55:50.323159+0000","last_unstale":"2024-05-07T13:58:59.141147+0000","last_undegraded":"2024-05-07T13:58:59.141147+0000","last_fullsized":"2024-05-07T13:58:59.141147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:20.168290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356619+0000","last_change":"2024-05-07T13:55:48.352309+0000","last_active":"2024-05-07T13:56:35.356619+0000","last_peered":"2024-05-07T13:56:35.356619+0000","last_clean":"2024-05-07T13:56:35.356619+0000","last_became_active":"2024-05-07T13:55:48.350462+0000","last_became_peered":"2024-05-07T13:55:48.350462+0000","last_unstale":"2024-05-07T13:56:35.356619+0000","last_undegraded":"2024-05-07T13:56:35.356619+0000","last_fullsized":"2024-05-07T13:56:35.356619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:59.353984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359809+0000","last_change":"2024-05-07T13:55:52.321486+0000","last_active":"2024-05-07T13:56:35.359809+0000","last_peered":"2024-05-07T13:56:35.359809+0000","last_clean":"2024-05-07T13:56:35.359809+0000","last_became_active":"2024-05-07T13:55:52.321171+0000","last_became_peered":"2024-05-07T13:55:52.321171+0000","last_unstale":"2024-05-07T13:56:35.359809+0000","last_undegraded":"2024-05-07T13:56:35.359809+0000","last_fullsized":"2024-05-07T13:56:35.359809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:10.570816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'60","reported_seq":124,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.216821+0000","last_change":"2024-05-07T13:55:54.320095+0000","last_active":"2024-05-07T13:59:06.216821+0000","last_peered":"2024-05-07T13:59:06.216821+0000","last_clean":"2024-05-07T13:59:06.216821+0000","last_became_active":"2024-05-07T13:55:54.319819+0000","last_became_peered":"2024-05-07T13:55:54.319819+0000","last_unstale":"2024-05-07T13:59:06.216821+0000","last_undegraded":"2024-05-07T13:59:06.216821+0000","last_fullsized":"2024-05-07T13:59:06.216821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:00.166078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366700+0000","last_change":"2024-05-07T13:55:56.330532+0000","last_active":"2024-05-07T13:56:35.366700+0000","last_peered":"2024-05-07T13:56:35.366700+0000","last_clean":"2024-05-07T13:56:35.366700+0000","last_became_active":"2024-05-07T13:55:56.330190+0000","last_became_peered":"2024-05-07T13:55:56.330190+0000","last_unstale":"2024-05-07T13:56:35.366700+0000","last_undegraded":"2024-05-07T13:56:35.366700+0000","last_fullsized":"2024-05-07T13:56:35.366700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:46.548146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.660351+0000","last_change":"2024-05-07T13:55:58.341039+0000","last_active":"2024-05-07T13:57:58.660351+0000","last_peered":"2024-05-07T13:57:58.660351+0000","last_clean":"2024-05-07T13:57:58.660351+0000","last_became_active":"2024-05-07T13:55:58.340674+0000","last_became_peered":"2024-05-07T13:55:58.340674+0000","last_unstale":"2024-05-07T13:57:58.660351+0000","last_undegraded":"2024-05-07T13:57:58.660351+0000","last_fullsized":"2024-05-07T13:57:58.660351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:55:16.822393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408545+0000","last_change":"2024-05-07T13:55:50.318936+0000","last_active":"2024-05-07T13:58:59.408545+0000","last_peered":"2024-05-07T13:58:59.408545+0000","last_clean":"2024-05-07T13:58:59.408545+0000","last_became_active":"2024-05-07T13:55:50.318546+0000","last_became_peered":"2024-05-07T13:55:50.318546+0000","last_unstale":"2024-05-07T13:58:59.408545+0000","last_undegraded":"2024-05-07T13:58:59.408545+0000","last_fullsized":"2024-05-07T13:58:59.408545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:51.713206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361299+0000","last_change":"2024-05-07T13:55:48.332704+0000","last_active":"2024-05-07T13:56:35.361299+0000","last_peered":"2024-05-07T13:56:35.361299+0000","last_clean":"2024-05-07T13:56:35.361299+0000","last_became_active":"2024-05-07T13:55:48.331278+0000","last_became_peered":"2024-05-07T13:55:48.331278+0000","last_unstale":"2024-05-07T13:56:35.361299+0000","last_undegraded":"2024-05-07T13:56:35.361299+0000","last_fullsized":"2024-05-07T13:56:35.361299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:34:15.892537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.369459+0000","last_change":"2024-05-07T13:55:52.317997+0000","last_active":"2024-05-07T13:56:35.369459+0000","last_peered":"2024-05-07T13:56:35.369459+0000","last_clean":"2024-05-07T13:56:35.369459+0000","last_became_active":"2024-05-07T13:55:52.317564+0000","last_became_peered":"2024-05-07T13:55:52.317564+0000","last_unstale":"2024-05-07T13:56:35.369459+0000","last_undegraded":"2024-05-07T13:56:35.369459+0000","last_fullsized":"2024-05-07T13:56:35.369459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:08.119281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'40","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.223452+0000","last_change":"2024-05-07T13:55:54.330150+0000","last_active":"2024-05-07T13:59:06.223452+0000","last_peered":"2024-05-07T13:59:06.223452+0000","last_clean":"2024-05-07T13:59:06.223452+0000","last_became_active":"2024-05-07T13:55:54.329443+0000","last_became_peered":"2024-05-07T13:55:54.329443+0000","last_unstale":"2024-05-07T13:59:06.223452+0000","last_undegraded":"2024-05-07T13:59:06.223452+0000","last_fullsized":"2024-05-07T13:59:06.223452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:38:57.980890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364045+0000","last_change":"2024-05-07T13:55:56.344810+0000","last_active":"2024-05-07T13:56:35.364045+0000","last_peered":"2024-05-07T13:56:35.364045+0000","last_clean":"2024-05-07T13:56:35.364045+0000","last_became_active":"2024-05-07T13:55:56.344470+0000","last_became_peered":"2024-05-07T13:55:56.344470+0000","last_unstale":"2024-05-07T13:56:35.364045+0000","last_undegraded":"2024-05-07T13:56:35.364045+0000","last_fullsized":"2024-05-07T13:56:35.364045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:05.866559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.821748+0000","last_change":"2024-05-07T13:55:58.351086+0000","last_active":"2024-05-07T13:58:58.821748+0000","last_peered":"2024-05-07T13:58:58.821748+0000","last_clean":"2024-05-07T13:58:58.821748+0000","last_became_active":"2024-05-07T13:55:58.350796+0000","last_became_peered":"2024-05-07T13:55:58.350796+0000","last_unstale":"2024-05-07T13:58:58.821748+0000","last_undegraded":"2024-05-07T13:58:58.821748+0000","last_fullsized":"2024-05-07T13:58:58.821748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:13:08.107265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502779+0000","last_change":"2024-05-07T13:55:50.327981+0000","last_active":"2024-05-07T13:58:59.502779+0000","last_peered":"2024-05-07T13:58:59.502779+0000","last_clean":"2024-05-07T13:58:59.502779+0000","last_became_active":"2024-05-07T13:55:50.326424+0000","last_became_peered":"2024-05-07T13:55:50.326424+0000","last_unstale":"2024-05-07T13:58:59.502779+0000","last_undegraded":"2024-05-07T13:58:59.502779+0000","last_fullsized":"2024-05-07T13:58:59.502779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:52.261340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.208955+0000","last_change":"2024-05-07T13:55:48.342464+0000","last_active":"2024-05-07T13:59:06.208955+0000","last_peered":"2024-05-07T13:59:06.208955+0000","last_clean":"2024-05-07T13:59:06.208955+0000","last_became_active":"2024-05-07T13:55:48.342072+0000","last_became_peered":"2024-05-07T13:55:48.342072+0000","last_unstale":"2024-05-07T13:59:06.208955+0000","last_undegraded":"2024-05-07T13:59:06.208955+0000","last_fullsized":"2024-05-07T13:59:06.208955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:50.599133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367888+0000","last_change":"2024-05-07T13:55:52.318946+0000","last_active":"2024-05-07T13:56:35.367888+0000","last_peered":"2024-05-07T13:56:35.367888+0000","last_clean":"2024-05-07T13:56:35.367888+0000","last_became_active":"2024-05-07T13:55:52.318605+0000","last_became_peered":"2024-05-07T13:55:52.318605+0000","last_unstale":"2024-05-07T13:56:35.367888+0000","last_undegraded":"2024-05-07T13:56:35.367888+0000","last_fullsized":"2024-05-07T13:56:35.367888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:09.398107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'35","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.166029+0000","last_change":"2024-05-07T13:55:54.326840+0000","last_active":"2024-05-07T13:59:06.166029+0000","last_peered":"2024-05-07T13:59:06.166029+0000","last_clean":"2024-05-07T13:59:06.166029+0000","last_became_active":"2024-05-07T13:55:54.326599+0000","last_became_peered":"2024-05-07T13:55:54.326599+0000","last_unstale":"2024-05-07T13:59:06.166029+0000","last_undegraded":"2024-05-07T13:59:06.166029+0000","last_fullsized":"2024-05-07T13:59:06.166029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:39:44.541313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359346+0000","last_change":"2024-05-07T13:55:56.334669+0000","last_active":"2024-05-07T13:56:35.359346+0000","last_peered":"2024-05-07T13:56:35.359346+0000","last_clean":"2024-05-07T13:56:35.359346+0000","last_became_active":"2024-05-07T13:55:56.334226+0000","last_became_peered":"2024-05-07T13:55:56.334226+0000","last_unstale":"2024-05-07T13:56:35.359346+0000","last_undegraded":"2024-05-07T13:56:35.359346+0000","last_fullsized":"2024-05-07T13:56:35.359346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:59:21.455096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.719529+0000","last_change":"2024-05-07T13:55:58.352585+0000","last_active":"2024-05-07T13:57:58.719529+0000","last_peered":"2024-05-07T13:57:58.719529+0000","last_clean":"2024-05-07T13:57:58.719529+0000","last_became_active":"2024-05-07T13:55:58.352263+0000","last_became_peered":"2024-05-07T13:55:58.352263+0000","last_unstale":"2024-05-07T13:57:58.719529+0000","last_undegraded":"2024-05-07T13:57:58.719529+0000","last_fullsized":"2024-05-07T13:57:58.719529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:11:22.158209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361243+0000","last_change":"2024-05-07T13:55:50.313466+0000","last_active":"2024-05-07T13:56:35.361243+0000","last_peered":"2024-05-07T13:56:35.361243+0000","last_clean":"2024-05-07T13:56:35.361243+0000","last_became_active":"2024-05-07T13:55:50.312852+0000","last_became_peered":"2024-05-07T13:55:50.312852+0000","last_unstale":"2024-05-07T13:56:35.361243+0000","last_undegraded":"2024-05-07T13:56:35.361243+0000","last_fullsized":"2024-05-07T13:56:35.361243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:10:37.723460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358505+0000","last_change":"2024-05-07T13:55:48.351068+0000","last_active":"2024-05-07T13:56:35.358505+0000","last_peered":"2024-05-07T13:56:35.358505+0000","last_clean":"2024-05-07T13:56:35.358505+0000","last_became_active":"2024-05-07T13:55:48.348476+0000","last_became_peered":"2024-05-07T13:55:48.348476+0000","last_unstale":"2024-05-07T13:56:35.358505+0000","last_undegraded":"2024-05-07T13:56:35.358505+0000","last_fullsized":"2024-05-07T13:56:35.358505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:24.363423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364249+0000","last_change":"2024-05-07T13:55:52.323853+0000","last_active":"2024-05-07T13:56:35.364249+0000","last_peered":"2024-05-07T13:56:35.364249+0000","last_clean":"2024-05-07T13:56:35.364249+0000","last_became_active":"2024-05-07T13:55:52.322431+0000","last_became_peered":"2024-05-07T13:55:52.322431+0000","last_unstale":"2024-05-07T13:56:35.364249+0000","last_undegraded":"2024-05-07T13:56:35.364249+0000","last_fullsized":"2024-05-07T13:56:35.364249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:10.570816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361154+0000","last_change":"2024-05-07T13:55:54.329901+0000","last_active":"2024-05-07T13:56:35.361154+0000","last_peered":"2024-05-07T13:56:35.361154+0000","last_clean":"2024-05-07T13:56:35.361154+0000","last_became_active":"2024-05-07T13:55:54.329539+0000","last_became_peered":"2024-05-07T13:55:54.329539+0000","last_unstale":"2024-05-07T13:56:35.361154+0000","last_undegraded":"2024-05-07T13:56:35.361154+0000","last_fullsized":"2024-05-07T13:56:35.361154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:26:09.693773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":409,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.111860+0000","last_change":"2024-05-07T13:55:56.338533+0000","last_active":"2024-05-07T13:59:06.111860+0000","last_peered":"2024-05-07T13:59:06.111860+0000","last_clean":"2024-05-07T13:59:06.111860+0000","last_became_active":"2024-05-07T13:55:56.338021+0000","last_became_peered":"2024-05-07T13:55:56.338021+0000","last_unstale":"2024-05-07T13:59:06.111860+0000","last_undegraded":"2024-05-07T13:59:06.111860+0000","last_fullsized":"2024-05-07T13:59:06.111860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:01:20.272404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356081+0000","last_change":"2024-05-07T13:55:58.351904+0000","last_active":"2024-05-07T13:56:35.356081+0000","last_peered":"2024-05-07T13:56:35.356081+0000","last_clean":"2024-05-07T13:56:35.356081+0000","last_became_active":"2024-05-07T13:55:58.351616+0000","last_became_peered":"2024-05-07T13:55:58.351616+0000","last_unstale":"2024-05-07T13:56:35.356081+0000","last_undegraded":"2024-05-07T13:56:35.356081+0000","last_fullsized":"2024-05-07T13:56:35.356081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:06:22.090983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.185290+0000","last_change":"2024-05-07T13:55:50.313284+0000","last_active":"2024-05-07T13:58:23.185290+0000","last_peered":"2024-05-07T13:58:23.185290+0000","last_clean":"2024-05-07T13:58:23.185290+0000","last_became_active":"2024-05-07T13:55:50.313016+0000","last_became_peered":"2024-05-07T13:55:50.313016+0000","last_unstale":"2024-05-07T13:58:23.185290+0000","last_undegraded":"2024-05-07T13:58:23.185290+0000","last_fullsized":"2024-05-07T13:58:23.185290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:33:15.469036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363748+0000","last_change":"2024-05-07T13:55:48.340087+0000","last_active":"2024-05-07T13:56:35.363748+0000","last_peered":"2024-05-07T13:56:35.363748+0000","last_clean":"2024-05-07T13:56:35.363748+0000","last_became_active":"2024-05-07T13:55:48.339639+0000","last_became_peered":"2024-05-07T13:55:48.339639+0000","last_unstale":"2024-05-07T13:56:35.363748+0000","last_undegraded":"2024-05-07T13:56:35.363748+0000","last_fullsized":"2024-05-07T13:56:35.363748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361140+0000","last_change":"2024-05-07T13:55:52.324874+0000","last_active":"2024-05-07T13:56:35.361140+0000","last_peered":"2024-05-07T13:56:35.361140+0000","last_clean":"2024-05-07T13:56:35.361140+0000","last_became_active":"2024-05-07T13:55:52.324567+0000","last_became_peered":"2024-05-07T13:55:52.324567+0000","last_unstale":"2024-05-07T13:56:35.361140+0000","last_undegraded":"2024-05-07T13:56:35.361140+0000","last_fullsized":"2024-05-07T13:56:35.361140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:01.502846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'39","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.187843+0000","last_change":"2024-05-07T13:55:54.329601+0000","last_active":"2024-05-07T13:59:06.187843+0000","last_peered":"2024-05-07T13:59:06.187843+0000","last_clean":"2024-05-07T13:59:06.187843+0000","last_became_active":"2024-05-07T13:55:54.329220+0000","last_became_peered":"2024-05-07T13:55:54.329220+0000","last_unstale":"2024-05-07T13:59:06.187843+0000","last_undegraded":"2024-05-07T13:59:06.187843+0000","last_fullsized":"2024-05-07T13:59:06.187843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:00.166078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358098+0000","last_change":"2024-05-07T13:55:56.333675+0000","last_active":"2024-05-07T13:56:35.358098+0000","last_peered":"2024-05-07T13:56:35.358098+0000","last_clean":"2024-05-07T13:56:35.358098+0000","last_became_active":"2024-05-07T13:55:56.333373+0000","last_became_peered":"2024-05-07T13:55:56.333373+0000","last_unstale":"2024-05-07T13:56:35.358098+0000","last_undegraded":"2024-05-07T13:56:35.358098+0000","last_fullsized":"2024-05-07T13:56:35.358098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:19.698130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366747+0000","last_change":"2024-05-07T13:55:58.347910+0000","last_active":"2024-05-07T13:56:35.366747+0000","last_peered":"2024-05-07T13:56:35.366747+0000","last_clean":"2024-05-07T13:56:35.366747+0000","last_became_active":"2024-05-07T13:55:58.347327+0000","last_became_peered":"2024-05-07T13:55:58.347327+0000","last_unstale":"2024-05-07T13:56:35.366747+0000","last_undegraded":"2024-05-07T13:56:35.366747+0000","last_fullsized":"2024-05-07T13:56:35.366747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:18.476650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359524+0000","last_change":"2024-05-07T13:55:50.311670+0000","last_active":"2024-05-07T13:56:35.359524+0000","last_peered":"2024-05-07T13:56:35.359524+0000","last_clean":"2024-05-07T13:56:35.359524+0000","last_became_active":"2024-05-07T13:55:50.311340+0000","last_became_peered":"2024-05-07T13:55:50.311340+0000","last_unstale":"2024-05-07T13:56:35.359524+0000","last_undegraded":"2024-05-07T13:56:35.359524+0000","last_fullsized":"2024-05-07T13:56:35.359524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:28:45.426204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.360374+0000","last_change":"2024-05-07T13:55:48.351060+0000","last_active":"2024-05-07T13:56:35.360374+0000","last_peered":"2024-05-07T13:56:35.360374+0000","last_clean":"2024-05-07T13:56:35.360374+0000","last_became_active":"2024-05-07T13:55:48.349589+0000","last_became_peered":"2024-05-07T13:55:48.349589+0000","last_unstale":"2024-05-07T13:56:35.360374+0000","last_undegraded":"2024-05-07T13:56:35.360374+0000","last_fullsized":"2024-05-07T13:56:35.360374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:54:44.852941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366095+0000","last_change":"2024-05-07T13:55:52.323978+0000","last_active":"2024-05-07T13:56:35.366095+0000","last_peered":"2024-05-07T13:56:35.366095+0000","last_clean":"2024-05-07T13:56:35.366095+0000","last_became_active":"2024-05-07T13:55:52.323548+0000","last_became_peered":"2024-05-07T13:55:52.323548+0000","last_unstale":"2024-05-07T13:56:35.366095+0000","last_undegraded":"2024-05-07T13:56:35.366095+0000","last_fullsized":"2024-05-07T13:56:35.366095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:51:24.684579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'33","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.191118+0000","last_change":"2024-05-07T13:55:54.327074+0000","last_active":"2024-05-07T13:59:06.191118+0000","last_peered":"2024-05-07T13:59:06.191118+0000","last_clean":"2024-05-07T13:59:06.191118+0000","last_became_active":"2024-05-07T13:55:54.326844+0000","last_became_peered":"2024-05-07T13:55:54.326844+0000","last_unstale":"2024-05-07T13:59:06.191118+0000","last_undegraded":"2024-05-07T13:59:06.191118+0000","last_fullsized":"2024-05-07T13:59:06.191118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:07.500805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.356419+0000","last_change":"2024-05-07T13:55:56.345203+0000","last_active":"2024-05-07T13:56:35.356419+0000","last_peered":"2024-05-07T13:56:35.356419+0000","last_clean":"2024-05-07T13:56:35.356419+0000","last_became_active":"2024-05-07T13:55:56.344885+0000","last_became_peered":"2024-05-07T13:55:56.344885+0000","last_unstale":"2024-05-07T13:56:35.356419+0000","last_undegraded":"2024-05-07T13:56:35.356419+0000","last_fullsized":"2024-05-07T13:56:35.356419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:23.344207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361365+0000","last_change":"2024-05-07T13:55:58.348158+0000","last_active":"2024-05-07T13:56:35.361365+0000","last_peered":"2024-05-07T13:56:35.361365+0000","last_clean":"2024-05-07T13:56:35.361365+0000","last_became_active":"2024-05-07T13:55:58.347850+0000","last_became_peered":"2024-05-07T13:55:58.347850+0000","last_unstale":"2024-05-07T13:56:35.361365+0000","last_undegraded":"2024-05-07T13:56:35.361365+0000","last_fullsized":"2024-05-07T13:56:35.361365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:53.578201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'20","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.502897+0000","last_change":"2024-05-07T13:55:50.325227+0000","last_active":"2024-05-07T13:58:59.502897+0000","last_peered":"2024-05-07T13:58:59.502897+0000","last_clean":"2024-05-07T13:58:59.502897+0000","last_became_active":"2024-05-07T13:55:50.324745+0000","last_became_peered":"2024-05-07T13:55:50.324745+0000","last_unstale":"2024-05-07T13:58:59.502897+0000","last_undegraded":"2024-05-07T13:58:59.502897+0000","last_fullsized":"2024-05-07T13:58:59.502897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:41:33.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.920397+0000","last_change":"2024-05-07T13:55:48.324008+0000","last_active":"2024-05-07T13:57:14.920397+0000","last_peered":"2024-05-07T13:57:14.920397+0000","last_clean":"2024-05-07T13:57:14.920397+0000","last_became_active":"2024-05-07T13:55:48.323125+0000","last_became_peered":"2024-05-07T13:55:48.323125+0000","last_unstale":"2024-05-07T13:57:14.920397+0000","last_undegraded":"2024-05-07T13:57:14.920397+0000","last_fullsized":"2024-05-07T13:57:14.920397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:00:13.644367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359668+0000","last_change":"2024-05-07T13:55:52.322334+0000","last_active":"2024-05-07T13:56:35.359668+0000","last_peered":"2024-05-07T13:56:35.359668+0000","last_clean":"2024-05-07T13:56:35.359668+0000","last_became_active":"2024-05-07T13:55:52.322012+0000","last_became_peered":"2024-05-07T13:55:52.322012+0000","last_unstale":"2024-05-07T13:56:35.359668+0000","last_undegraded":"2024-05-07T13:56:35.359668+0000","last_fullsized":"2024-05-07T13:56:35.359668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:26:51.701961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.270036+0000","last_change":"2024-05-07T13:55:54.327483+0000","last_active":"2024-05-07T13:59:06.270036+0000","last_peered":"2024-05-07T13:59:06.270036+0000","last_clean":"2024-05-07T13:59:06.270036+0000","last_became_active":"2024-05-07T13:55:54.326758+0000","last_became_peered":"2024-05-07T13:55:54.326758+0000","last_unstale":"2024-05-07T13:59:06.270036+0000","last_undegraded":"2024-05-07T13:59:06.270036+0000","last_fullsized":"2024-05-07T13:59:06.270036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:13:47.426980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357488+0000","last_change":"2024-05-07T13:55:56.346233+0000","last_active":"2024-05-07T13:56:35.357488+0000","last_peered":"2024-05-07T13:56:35.357488+0000","last_clean":"2024-05-07T13:56:35.357488+0000","last_became_active":"2024-05-07T13:55:56.345933+0000","last_became_peered":"2024-05-07T13:55:56.345933+0000","last_unstale":"2024-05-07T13:56:35.357488+0000","last_undegraded":"2024-05-07T13:56:35.357488+0000","last_fullsized":"2024-05-07T13:56:35.357488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:38:24.160530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:57.172834+0000","last_change":"2024-05-07T13:55:58.349147+0000","last_active":"2024-05-07T13:57:57.172834+0000","last_peered":"2024-05-07T13:57:57.172834+0000","last_clean":"2024-05-07T13:57:57.172834+0000","last_became_active":"2024-05-07T13:55:58.348763+0000","last_became_peered":"2024-05-07T13:55:58.348763+0000","last_unstale":"2024-05-07T13:57:57.172834+0000","last_undegraded":"2024-05-07T13:57:57.172834+0000","last_fullsized":"2024-05-07T13:57:57.172834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:21:37.840451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408575+0000","last_change":"2024-05-07T13:55:50.313977+0000","last_active":"2024-05-07T13:58:59.408575+0000","last_peered":"2024-05-07T13:58:59.408575+0000","last_clean":"2024-05-07T13:58:59.408575+0000","last_became_active":"2024-05-07T13:55:50.312605+0000","last_became_peered":"2024-05-07T13:55:50.312605+0000","last_unstale":"2024-05-07T13:58:59.408575+0000","last_undegraded":"2024-05-07T13:58:59.408575+0000","last_fullsized":"2024-05-07T13:58:59.408575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:54:46.860579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.366631+0000","last_change":"2024-05-07T13:55:48.333628+0000","last_active":"2024-05-07T13:56:35.366631+0000","last_peered":"2024-05-07T13:56:35.366631+0000","last_clean":"2024-05-07T13:56:35.366631+0000","last_became_active":"2024-05-07T13:55:48.333254+0000","last_became_peered":"2024-05-07T13:55:48.333254+0000","last_unstale":"2024-05-07T13:56:35.366631+0000","last_undegraded":"2024-05-07T13:56:35.366631+0000","last_fullsized":"2024-05-07T13:56:35.366631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.781719+0000","last_change":"2024-05-07T13:55:52.322300+0000","last_active":"2024-05-07T13:57:55.781719+0000","last_peered":"2024-05-07T13:57:55.781719+0000","last_clean":"2024-05-07T13:57:55.781719+0000","last_became_active":"2024-05-07T13:55:52.321982+0000","last_became_peered":"2024-05-07T13:55:52.321982+0000","last_unstale":"2024-05-07T13:57:55.781719+0000","last_undegraded":"2024-05-07T13:57:55.781719+0000","last_fullsized":"2024-05-07T13:57:55.781719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:07:58.452077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.169599+0000","last_change":"2024-05-07T13:55:54.327217+0000","last_active":"2024-05-07T13:59:06.169599+0000","last_peered":"2024-05-07T13:59:06.169599+0000","last_clean":"2024-05-07T13:59:06.169599+0000","last_became_active":"2024-05-07T13:55:54.326895+0000","last_became_peered":"2024-05-07T13:55:54.326895+0000","last_unstale":"2024-05-07T13:59:06.169599+0000","last_undegraded":"2024-05-07T13:59:06.169599+0000","last_fullsized":"2024-05-07T13:59:06.169599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:20:31.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359452+0000","last_change":"2024-05-07T13:55:56.343265+0000","last_active":"2024-05-07T13:56:35.359452+0000","last_peered":"2024-05-07T13:56:35.359452+0000","last_clean":"2024-05-07T13:56:35.359452+0000","last_became_active":"2024-05-07T13:55:56.343002+0000","last_became_peered":"2024-05-07T13:55:56.343002+0000","last_unstale":"2024-05-07T13:56:35.359452+0000","last_undegraded":"2024-05-07T13:56:35.359452+0000","last_fullsized":"2024-05-07T13:56:35.359452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:12:46.396698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.593707+0000","last_change":"2024-05-07T13:55:58.348783+0000","last_active":"2024-05-07T13:58:59.593707+0000","last_peered":"2024-05-07T13:58:59.593707+0000","last_clean":"2024-05-07T13:58:59.593707+0000","last_became_active":"2024-05-07T13:55:58.347820+0000","last_became_peered":"2024-05-07T13:55:58.347820+0000","last_unstale":"2024-05-07T13:58:59.593707+0000","last_undegraded":"2024-05-07T13:58:59.593707+0000","last_fullsized":"2024-05-07T13:58:59.593707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:54.677953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471805+0000","last_change":"2024-05-07T13:55:50.330476+0000","last_active":"2024-05-07T13:58:59.471805+0000","last_peered":"2024-05-07T13:58:59.471805+0000","last_clean":"2024-05-07T13:58:59.471805+0000","last_became_active":"2024-05-07T13:55:50.330166+0000","last_became_peered":"2024-05-07T13:55:50.330166+0000","last_unstale":"2024-05-07T13:58:59.471805+0000","last_undegraded":"2024-05-07T13:58:59.471805+0000","last_fullsized":"2024-05-07T13:58:59.471805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:17:53.138578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358590+0000","last_change":"2024-05-07T13:55:48.339261+0000","last_active":"2024-05-07T13:56:35.358590+0000","last_peered":"2024-05-07T13:56:35.358590+0000","last_clean":"2024-05-07T13:56:35.358590+0000","last_became_active":"2024-05-07T13:55:48.338874+0000","last_became_peered":"2024-05-07T13:55:48.338874+0000","last_unstale":"2024-05-07T13:56:35.358590+0000","last_undegraded":"2024-05-07T13:56:35.358590+0000","last_fullsized":"2024-05-07T13:56:35.358590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.142958+0000","last_change":"2024-05-07T13:55:50.311630+0000","last_active":"2024-05-07T13:58:59.142958+0000","last_peered":"2024-05-07T13:58:59.142958+0000","last_clean":"2024-05-07T13:58:59.142958+0000","last_became_active":"2024-05-07T13:55:50.311324+0000","last_became_peered":"2024-05-07T13:55:50.311324+0000","last_unstale":"2024-05-07T13:58:59.142958+0000","last_undegraded":"2024-05-07T13:58:59.142958+0000","last_fullsized":"2024-05-07T13:58:59.142958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:52.088546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358534+0000","last_change":"2024-05-07T13:55:48.327068+0000","last_active":"2024-05-07T13:56:35.358534+0000","last_peered":"2024-05-07T13:56:35.358534+0000","last_clean":"2024-05-07T13:56:35.358534+0000","last_became_active":"2024-05-07T13:55:48.325561+0000","last_became_peered":"2024-05-07T13:55:48.325561+0000","last_unstale":"2024-05-07T13:56:35.358534+0000","last_undegraded":"2024-05-07T13:56:35.358534+0000","last_fullsized":"2024-05-07T13:56:35.358534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:10.485172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180888+0000","last_change":"2024-05-07T13:55:50.326752+0000","last_active":"2024-05-07T13:58:03.180888+0000","last_peered":"2024-05-07T13:58:03.180888+0000","last_clean":"2024-05-07T13:58:03.180888+0000","last_became_active":"2024-05-07T13:55:50.326322+0000","last_became_peered":"2024-05-07T13:55:50.326322+0000","last_unstale":"2024-05-07T13:58:03.180888+0000","last_undegraded":"2024-05-07T13:58:03.180888+0000","last_fullsized":"2024-05-07T13:58:03.180888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:07:36.575334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357230+0000","last_change":"2024-05-07T13:55:48.352058+0000","last_active":"2024-05-07T13:56:35.357230+0000","last_peered":"2024-05-07T13:56:35.357230+0000","last_clean":"2024-05-07T13:56:35.357230+0000","last_became_active":"2024-05-07T13:55:48.350385+0000","last_became_peered":"2024-05-07T13:55:48.350385+0000","last_unstale":"2024-05-07T13:56:35.357230+0000","last_undegraded":"2024-05-07T13:56:35.357230+0000","last_fullsized":"2024-05-07T13:56:35.357230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:17:38.955925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.178821+0000","last_change":"2024-05-07T13:55:50.313167+0000","last_active":"2024-05-07T13:58:03.178821+0000","last_peered":"2024-05-07T13:58:03.178821+0000","last_clean":"2024-05-07T13:58:03.178821+0000","last_became_active":"2024-05-07T13:55:50.312703+0000","last_became_peered":"2024-05-07T13:55:50.312703+0000","last_unstale":"2024-05-07T13:58:03.178821+0000","last_undegraded":"2024-05-07T13:58:03.178821+0000","last_fullsized":"2024-05-07T13:58:03.178821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:48:03.169988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.043184+0000","last_change":"2024-05-07T13:55:48.325914+0000","last_active":"2024-05-07T13:58:59.043184+0000","last_peered":"2024-05-07T13:58:59.043184+0000","last_clean":"2024-05-07T13:58:59.043184+0000","last_became_active":"2024-05-07T13:55:48.323979+0000","last_became_peered":"2024-05-07T13:55:48.323979+0000","last_unstale":"2024-05-07T13:58:59.043184+0000","last_undegraded":"2024-05-07T13:58:59.043184+0000","last_fullsized":"2024-05-07T13:58:59.043184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:07:27.359915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.472146+0000","last_change":"2024-05-07T13:55:50.331631+0000","last_active":"2024-05-07T13:58:59.472146+0000","last_peered":"2024-05-07T13:58:59.472146+0000","last_clean":"2024-05-07T13:58:59.472146+0000","last_became_active":"2024-05-07T13:55:50.331311+0000","last_became_peered":"2024-05-07T13:55:50.331311+0000","last_unstale":"2024-05-07T13:58:59.472146+0000","last_undegraded":"2024-05-07T13:58:59.472146+0000","last_fullsized":"2024-05-07T13:58:59.472146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.089065+0000","last_change":"2024-05-07T13:55:48.326606+0000","last_active":"2024-05-07T13:58:59.089065+0000","last_peered":"2024-05-07T13:58:59.089065+0000","last_clean":"2024-05-07T13:58:59.089065+0000","last_became_active":"2024-05-07T13:55:48.325858+0000","last_became_peered":"2024-05-07T13:55:48.325858+0000","last_unstale":"2024-05-07T13:58:59.089065+0000","last_undegraded":"2024-05-07T13:58:59.089065+0000","last_fullsized":"2024-05-07T13:58:59.089065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:24:43.039363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.717865+0000","last_change":"2024-05-07T13:55:50.324360+0000","last_active":"2024-05-07T13:57:58.717865+0000","last_peered":"2024-05-07T13:57:58.717865+0000","last_clean":"2024-05-07T13:57:58.717865+0000","last_became_active":"2024-05-07T13:55:50.323573+0000","last_became_peered":"2024-05-07T13:55:50.323573+0000","last_unstale":"2024-05-07T13:57:58.717865+0000","last_undegraded":"2024-05-07T13:57:58.717865+0000","last_fullsized":"2024-05-07T13:57:58.717865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:57:18.448833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.364364+0000","last_change":"2024-05-07T13:55:48.334670+0000","last_active":"2024-05-07T13:56:35.364364+0000","last_peered":"2024-05-07T13:56:35.364364+0000","last_clean":"2024-05-07T13:56:35.364364+0000","last_became_active":"2024-05-07T13:55:48.334268+0000","last_became_peered":"2024-05-07T13:55:48.334268+0000","last_unstale":"2024-05-07T13:56:35.364364+0000","last_undegraded":"2024-05-07T13:56:35.364364+0000","last_fullsized":"2024-05-07T13:56:35.364364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.471690+0000","last_change":"2024-05-07T13:55:50.320633+0000","last_active":"2024-05-07T13:58:59.471690+0000","last_peered":"2024-05-07T13:58:59.471690+0000","last_clean":"2024-05-07T13:58:59.471690+0000","last_became_active":"2024-05-07T13:55:50.320242+0000","last_became_peered":"2024-05-07T13:55:50.320242+0000","last_unstale":"2024-05-07T13:58:59.471690+0000","last_undegraded":"2024-05-07T13:58:59.471690+0000","last_fullsized":"2024-05-07T13:58:59.471690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:05.135442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.010782+0000","last_change":"2024-05-07T13:55:48.341172+0000","last_active":"2024-05-07T13:58:59.010782+0000","last_peered":"2024-05-07T13:58:59.010782+0000","last_clean":"2024-05-07T13:58:59.010782+0000","last_became_active":"2024-05-07T13:55:48.340718+0000","last_became_peered":"2024-05-07T13:55:48.340718+0000","last_unstale":"2024-05-07T13:58:59.010782+0000","last_undegraded":"2024-05-07T13:58:59.010782+0000","last_fullsized":"2024-05-07T13:58:59.010782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:05.893884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'11","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149433+0000","last_change":"2024-05-07T13:55:50.320724+0000","last_active":"2024-05-07T13:58:59.149433+0000","last_peered":"2024-05-07T13:58:59.149433+0000","last_clean":"2024-05-07T13:58:59.149433+0000","last_became_active":"2024-05-07T13:55:50.320430+0000","last_became_peered":"2024-05-07T13:55:50.320430+0000","last_unstale":"2024-05-07T13:58:59.149433+0000","last_undegraded":"2024-05-07T13:58:59.149433+0000","last_fullsized":"2024-05-07T13:58:59.149433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:25:44.298994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361383+0000","last_change":"2024-05-07T13:55:48.324349+0000","last_active":"2024-05-07T13:56:35.361383+0000","last_peered":"2024-05-07T13:56:35.361383+0000","last_clean":"2024-05-07T13:56:35.361383+0000","last_became_active":"2024-05-07T13:55:48.323524+0000","last_became_peered":"2024-05-07T13:55:48.323524+0000","last_unstale":"2024-05-07T13:56:35.361383+0000","last_undegraded":"2024-05-07T13:56:35.361383+0000","last_fullsized":"2024-05-07T13:56:35.361383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:02.962105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.367054+0000","last_change":"2024-05-07T13:55:50.313308+0000","last_active":"2024-05-07T13:56:35.367054+0000","last_peered":"2024-05-07T13:56:35.367054+0000","last_clean":"2024-05-07T13:56:35.367054+0000","last_became_active":"2024-05-07T13:55:50.313012+0000","last_became_peered":"2024-05-07T13:55:50.313012+0000","last_unstale":"2024-05-07T13:56:35.367054+0000","last_undegraded":"2024-05-07T13:56:35.367054+0000","last_fullsized":"2024-05-07T13:56:35.367054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:18.182290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.430794+0000","last_change":"2024-05-07T13:55:48.353515+0000","last_active":"2024-05-07T13:57:55.430794+0000","last_peered":"2024-05-07T13:57:55.430794+0000","last_clean":"2024-05-07T13:57:55.430794+0000","last_became_active":"2024-05-07T13:55:48.351882+0000","last_became_peered":"2024-05-07T13:55:48.351882+0000","last_unstale":"2024-05-07T13:57:55.430794+0000","last_undegraded":"2024-05-07T13:57:55.430794+0000","last_fullsized":"2024-05-07T13:57:55.430794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:34.947652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408508+0000","last_change":"2024-05-07T13:55:50.326172+0000","last_active":"2024-05-07T13:58:59.408508+0000","last_peered":"2024-05-07T13:58:59.408508+0000","last_clean":"2024-05-07T13:58:59.408508+0000","last_became_active":"2024-05-07T13:55:50.325807+0000","last_became_peered":"2024-05-07T13:55:50.325807+0000","last_unstale":"2024-05-07T13:58:59.408508+0000","last_undegraded":"2024-05-07T13:58:59.408508+0000","last_fullsized":"2024-05-07T13:58:59.408508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:08.013460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.358738+0000","last_change":"2024-05-07T13:55:48.326746+0000","last_active":"2024-05-07T13:56:35.358738+0000","last_peered":"2024-05-07T13:56:35.358738+0000","last_clean":"2024-05-07T13:56:35.358738+0000","last_became_active":"2024-05-07T13:55:48.324919+0000","last_became_peered":"2024-05-07T13:55:48.324919+0000","last_unstale":"2024-05-07T13:56:35.358738+0000","last_undegraded":"2024-05-07T13:56:35.358738+0000","last_fullsized":"2024-05-07T13:56:35.358738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:45.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723663+0000","last_change":"2024-05-07T13:55:50.326002+0000","last_active":"2024-05-07T13:57:58.723663+0000","last_peered":"2024-05-07T13:57:58.723663+0000","last_clean":"2024-05-07T13:57:58.723663+0000","last_became_active":"2024-05-07T13:55:50.325620+0000","last_became_peered":"2024-05-07T13:55:50.325620+0000","last_unstale":"2024-05-07T13:57:58.723663+0000","last_undegraded":"2024-05-07T13:57:58.723663+0000","last_fullsized":"2024-05-07T13:57:58.723663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:56.333264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.079798+0000","last_change":"2024-05-07T13:55:48.342921+0000","last_active":"2024-05-07T13:58:59.079798+0000","last_peered":"2024-05-07T13:58:59.079798+0000","last_clean":"2024-05-07T13:58:59.079798+0000","last_became_active":"2024-05-07T13:55:48.342508+0000","last_became_peered":"2024-05-07T13:55:48.342508+0000","last_unstale":"2024-05-07T13:58:59.079798+0000","last_undegraded":"2024-05-07T13:58:59.079798+0000","last_fullsized":"2024-05-07T13:58:59.079798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:02.747875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.246679+0000","last_change":"2024-05-07T13:55:50.321908+0000","last_active":"2024-05-07T13:58:59.246679+0000","last_peered":"2024-05-07T13:58:59.246679+0000","last_clean":"2024-05-07T13:58:59.246679+0000","last_became_active":"2024-05-07T13:55:50.321606+0000","last_became_peered":"2024-05-07T13:55:50.321606+0000","last_unstale":"2024-05-07T13:58:59.246679+0000","last_undegraded":"2024-05-07T13:58:59.246679+0000","last_fullsized":"2024-05-07T13:58:59.246679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:43:26.371060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.361244+0000","last_change":"2024-05-07T13:55:48.332694+0000","last_active":"2024-05-07T13:56:35.361244+0000","last_peered":"2024-05-07T13:56:35.361244+0000","last_clean":"2024-05-07T13:56:35.361244+0000","last_became_active":"2024-05-07T13:55:48.332247+0000","last_became_peered":"2024-05-07T13:55:48.332247+0000","last_unstale":"2024-05-07T13:56:35.361244+0000","last_undegraded":"2024-05-07T13:56:35.361244+0000","last_fullsized":"2024-05-07T13:56:35.361244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:01.662533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408527+0000","last_change":"2024-05-07T13:55:50.329959+0000","last_active":"2024-05-07T13:58:59.408527+0000","last_peered":"2024-05-07T13:58:59.408527+0000","last_clean":"2024-05-07T13:58:59.408527+0000","last_became_active":"2024-05-07T13:55:50.329434+0000","last_became_peered":"2024-05-07T13:55:50.329434+0000","last_unstale":"2024-05-07T13:58:59.408527+0000","last_undegraded":"2024-05-07T13:58:59.408527+0000","last_fullsized":"2024-05-07T13:58:59.408527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:25:48.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.498000+0000","last_change":"2024-05-07T13:55:48.348177+0000","last_active":"2024-05-07T13:58:59.498000+0000","last_peered":"2024-05-07T13:58:59.498000+0000","last_clean":"2024-05-07T13:58:59.498000+0000","last_became_active":"2024-05-07T13:55:48.345844+0000","last_became_peered":"2024-05-07T13:55:48.345844+0000","last_unstale":"2024-05-07T13:58:59.498000+0000","last_undegraded":"2024-05-07T13:58:59.498000+0000","last_fullsized":"2024-05-07T13:58:59.498000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:03.127804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.363106+0000","last_change":"2024-05-07T13:55:50.313698+0000","last_active":"2024-05-07T13:56:35.363106+0000","last_peered":"2024-05-07T13:56:35.363106+0000","last_clean":"2024-05-07T13:56:35.363106+0000","last_became_active":"2024-05-07T13:55:50.313049+0000","last_became_peered":"2024-05-07T13:55:50.313049+0000","last_unstale":"2024-05-07T13:56:35.363106+0000","last_undegraded":"2024-05-07T13:56:35.363106+0000","last_fullsized":"2024-05-07T13:56:35.363106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:43:49.979727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.121947+0000","last_change":"2024-05-07T13:55:48.349780+0000","last_active":"2024-05-07T13:58:59.121947+0000","last_peered":"2024-05-07T13:58:59.121947+0000","last_clean":"2024-05-07T13:58:59.121947+0000","last_became_active":"2024-05-07T13:55:48.346691+0000","last_became_peered":"2024-05-07T13:55:48.346691+0000","last_unstale":"2024-05-07T13:58:59.121947+0000","last_undegraded":"2024-05-07T13:58:59.121947+0000","last_fullsized":"2024-05-07T13:58:59.121947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:47.664009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'10","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:14.739245+0000","last_change":"2024-05-07T13:55:50.323717+0000","last_active":"2024-05-07T13:57:14.739245+0000","last_peered":"2024-05-07T13:57:14.739245+0000","last_clean":"2024-05-07T13:57:14.739245+0000","last_became_active":"2024-05-07T13:55:50.322543+0000","last_became_peered":"2024-05-07T13:55:50.322543+0000","last_unstale":"2024-05-07T13:57:14.739245+0000","last_undegraded":"2024-05-07T13:57:14.739245+0000","last_fullsized":"2024-05-07T13:57:14.739245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:12:56.152000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.370285+0000","last_change":"2024-05-07T13:55:48.340889+0000","last_active":"2024-05-07T13:56:35.370285+0000","last_peered":"2024-05-07T13:56:35.370285+0000","last_clean":"2024-05-07T13:56:35.370285+0000","last_became_active":"2024-05-07T13:55:48.339909+0000","last_became_peered":"2024-05-07T13:55:48.339909+0000","last_unstale":"2024-05-07T13:56:35.370285+0000","last_undegraded":"2024-05-07T13:56:35.370285+0000","last_fullsized":"2024-05-07T13:56:35.370285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408516+0000","last_change":"2024-05-07T13:55:50.323280+0000","last_active":"2024-05-07T13:58:59.408516+0000","last_peered":"2024-05-07T13:58:59.408516+0000","last_clean":"2024-05-07T13:58:59.408516+0000","last_became_active":"2024-05-07T13:55:50.322967+0000","last_became_peered":"2024-05-07T13:55:50.322967+0000","last_unstale":"2024-05-07T13:58:59.408516+0000","last_undegraded":"2024-05-07T13:58:59.408516+0000","last_fullsized":"2024-05-07T13:58:59.408516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:51.713206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.102826+0000","last_change":"2024-05-07T13:55:48.347208+0000","last_active":"2024-05-07T13:58:59.102826+0000","last_peered":"2024-05-07T13:58:59.102826+0000","last_clean":"2024-05-07T13:58:59.102826+0000","last_became_active":"2024-05-07T13:55:48.346724+0000","last_became_peered":"2024-05-07T13:55:48.346724+0000","last_unstale":"2024-05-07T13:58:59.102826+0000","last_undegraded":"2024-05-07T13:58:59.102826+0000","last_fullsized":"2024-05-07T13:58:59.102826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:03.378851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.357777+0000","last_change":"2024-05-07T13:55:48.351645+0000","last_active":"2024-05-07T13:56:35.357777+0000","last_peered":"2024-05-07T13:56:35.357777+0000","last_clean":"2024-05-07T13:56:35.357777+0000","last_became_active":"2024-05-07T13:55:48.349852+0000","last_became_peered":"2024-05-07T13:55:48.349852+0000","last_unstale":"2024-05-07T13:56:35.357777+0000","last_undegraded":"2024-05-07T13:56:35.357777+0000","last_fullsized":"2024-05-07T13:56:35.357777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:37:41.603367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.408432+0000","last_change":"2024-05-07T13:55:50.319944+0000","last_active":"2024-05-07T13:58:59.408432+0000","last_peered":"2024-05-07T13:58:59.408432+0000","last_clean":"2024-05-07T13:58:59.408432+0000","last_became_active":"2024-05-07T13:55:50.319033+0000","last_became_peered":"2024-05-07T13:55:50.319033+0000","last_unstale":"2024-05-07T13:58:59.408432+0000","last_undegraded":"2024-05-07T13:58:59.408432+0000","last_fullsized":"2024-05-07T13:58:59.408432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.446915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:56:35.359001+0000","last_change":"2024-05-07T13:55:48.326709+0000","last_active":"2024-05-07T13:56:35.359001+0000","last_peered":"2024-05-07T13:56:35.359001+0000","last_clean":"2024-05-07T13:56:35.359001+0000","last_became_active":"2024-05-07T13:55:48.324081+0000","last_became_peered":"2024-05-07T13:55:48.324081+0000","last_unstale":"2024-05-07T13:56:35.359001+0000","last_undegraded":"2024-05-07T13:56:35.359001+0000","last_fullsized":"2024-05-07T13:56:35.359001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:58.469039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723822+0000","last_change":"2024-05-07T13:55:50.330143+0000","last_active":"2024-05-07T13:57:58.723822+0000","last_peered":"2024-05-07T13:57:58.723822+0000","last_clean":"2024-05-07T13:57:58.723822+0000","last_became_active":"2024-05-07T13:55:50.329848+0000","last_became_peered":"2024-05-07T13:55:50.329848+0000","last_unstale":"2024-05-07T13:57:58.723822+0000","last_undegraded":"2024-05-07T13:57:58.723822+0000","last_fullsized":"2024-05-07T13:57:58.723822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:07.391231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1375,"ondisk_log_size":1375,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44088,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327752,"statfs":{"total":96636764160,"available":96591618048,"internally_reserved":0,"allocated":442368,"data_stored":136605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":970752,"data_stored":724702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":157,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":995328,"data_stored":724122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":134585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T13:59:10.854 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.854 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.854 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.855 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.855 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.855 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.855 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.855 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.855 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.855 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.855 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.855 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.856 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.856 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.856 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.856 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.856 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.856 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.856 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.856 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.856 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.857 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.857 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.857 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.857 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.857 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.857 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.857 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.857 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.857 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.858 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.858 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.858 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.858 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.859 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.859 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.859 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.859 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.859 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.860 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.860 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.860 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.860 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.860 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.860 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.860 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.860 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.861 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.861 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.861 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.861 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.861 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.861 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.861 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.861 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.861 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.862 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.862 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.862 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.862 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.862 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.862 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.862 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.862 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.863 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.863 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.863 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.863 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.863 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.863 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.863 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.863 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.864 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.864 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.864 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.864 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.864 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.864 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.864 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.864 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.865 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.865 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.865 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.865 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.865 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.865 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.865 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.866 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.866 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.866 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.866 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.866 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.866 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.867 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.867 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.867 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.867 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.867 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.867 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.867 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.868 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.868 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.868 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.868 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.868 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.868 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.868 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.869 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.869 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.869 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.869 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.869 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.869 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.869 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.870 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.870 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.870 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.870 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.870 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.870 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.870 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.871 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.871 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.871 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.871 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.871 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.871 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.871 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.872 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.872 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.872 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.872 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.872 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.872 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.872 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.873 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.873 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.873 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.873 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.873 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.873 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.873 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.873 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.873 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.874 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.874 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.874 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.874 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.874 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.874 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.874 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.874 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.874 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.875 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.875 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.875 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.875 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.875 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.875 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.875 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.875 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.875 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.876 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.876 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.876 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.876 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.876 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.876 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.876 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.876 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.877 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.877 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.877 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.877 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.877 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.877 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.877 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.877 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.877 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.878 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.878 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.878 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.878 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.878 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.878 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.878 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.878 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.878 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.879 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.879 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.879 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.879 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.879 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.879 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.879 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.879 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.879 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.880 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.880 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.880 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.880 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.880 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.880 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.880 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.880 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.880 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.881 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.881 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.881 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.881 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.881 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.881 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.881 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.881 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.881 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.882 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.882 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.882 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.882 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.882 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.882 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.882 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.882 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.882 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.883 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.883 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.883 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.883 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.883 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.883 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.883 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.883 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.883 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.884 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.884 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.884 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.884 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.884 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.884 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.884 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.884 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.885 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.886 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.886 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.886 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.886 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.886 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.886 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.886 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.886 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.886 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.887 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.887 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.887 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.887 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.887 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:10.887 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T13:59:11.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-07T13:59:30.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T13:59:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.017+0000 7f429829a640 1 Processor -- start 2024-05-07T13:59:31.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.017+0000 7f429829a640 1 -- start start 2024-05-07T13:59:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.018+0000 7f429829a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f429012c5b0 0x7f429012c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.018+0000 7f429829a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4290113dd0 con 0x7f429012ced0 2024-05-07T13:59:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.018+0000 7f429829a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f4290072290 con 0x7f429012c5b0 2024-05-07T13:59:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.018+0000 7f4296036640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f429012c5b0 0x7f429012c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.018+0000 7f4295835640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f429012ced0 0x7f429006e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59034/0 (socket says 172.21.15.22:59034) 2024-05-07T13:59:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.018+0000 7f4295835640 1 -- 172.21.15.22:0/3166756597 learned_addr learned my addr 172.21.15.22:0/3166756597 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.019+0000 7f4296036640 1 -- 172.21.15.22:0/3166756597 >> v1:172.21.15.22:6789/0 conn(0x7f429012ced0 legacy=0x7f429006e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.019+0000 7f4295034640 1 -- 172.21.15.22:0/3166756597 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1904141812 0 0) 0x7f4290113dd0 con 0x7f429012ced0 2024-05-07T13:59:31.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.019+0000 7f4296036640 1 -- 172.21.15.22:0/3166756597 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429012c390 con 0x7f429012c5b0 2024-05-07T13:59:31.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.019+0000 7f4296036640 1 --2- 172.21.15.22:0/3166756597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 0x7f429012c990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f428c009720 tx=0x7f428c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ac72d5ee9f16e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f4295034640 1 -- 172.21.15.22:0/3166756597 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c0316d0 con 0x7f429012c5b0 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f4295034640 1 -- 172.21.15.22:0/3166756597 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428c037070 con 0x7f429012c5b0 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f4295034640 1 -- 172.21.15.22:0/3166756597 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c0319c0 con 0x7f429012c5b0 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f429829a640 1 -- 172.21.15.22:0/3166756597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 msgr2=0x7f429012c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f429829a640 1 --2- 172.21.15.22:0/3166756597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 0x7f429012c990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f428c009720 tx=0x7f428c02b840 comp rx=0 tx=0).stop 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f429829a640 1 -- 172.21.15.22:0/3166756597 shutdown_connections 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f429829a640 1 --2- 172.21.15.22:0/3166756597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 0x7f429012c990 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f429829a640 1 -- 172.21.15.22:0/3166756597 >> 172.21.15.22:0/3166756597 conn(0x7f4290099380 msgr2=0x7f4290099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f429829a640 1 -- 172.21.15.22:0/3166756597 shutdown_connections 2024-05-07T13:59:31.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.020+0000 7f429829a640 1 -- 172.21.15.22:0/3166756597 wait complete. 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.021+0000 7f429829a640 1 Processor -- start 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.021+0000 7f429829a640 1 -- start start 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f429829a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 0x7f42901c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f429829a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4290113b10 con 0x7f429012c5b0 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f4296036640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 0x7f42901c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f4296036640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 0x7f42901c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37388/0 (socket says 172.21.15.22:37388) 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f4296036640 1 -- 172.21.15.22:0/464235058 learned_addr learned my addr 172.21.15.22:0/464235058 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f4296036640 1 -- 172.21.15.22:0/464235058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429011acc0 con 0x7f429012c5b0 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f4296036640 1 --2- 172.21.15.22:0/464235058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 0x7f42901c33d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f428c009720 tx=0x7f428c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f4286ffd640 1 -- 172.21.15.22:0/464235058 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c032770 con 0x7f429012c5b0 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f4286ffd640 1 -- 172.21.15.22:0/464235058 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428c032910 con 0x7f429012c5b0 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f4286ffd640 1 -- 172.21.15.22:0/464235058 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c032bf0 con 0x7f429012c5b0 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429011b490 con 0x7f429012c5b0 2024-05-07T13:59:31.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.022+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42901c3910 con 0x7f429012c5b0 2024-05-07T13:59:31.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.023+0000 7f4286ffd640 1 -- 172.21.15.22:0/464235058 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f428c04d3f0 con 0x7f429012c5b0 2024-05-07T13:59:31.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.023+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f429011c3f0 con 0x7f429012c5b0 2024-05-07T13:59:31.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.023+0000 7f4286ffd640 1 --2- 172.21.15.22:0/464235058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4274038060 0x7f427403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:31.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.024+0000 7f4286ffd640 1 -- 172.21.15.22:0/464235058 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f428c02f050 con 0x7f429012c5b0 2024-05-07T13:59:31.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.024+0000 7f4295835640 1 --2- 172.21.15.22:0/464235058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4274038060 0x7f427403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:31.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.024+0000 7f4295835640 1 --2- 172.21.15.22:0/464235058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4274038060 0x7f427403a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4280000c00 tx=0x7f4280007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:31.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.028+0000 7f4286ffd640 1 -- 172.21.15.22:0/464235058 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f428c040070 con 0x7f429012c5b0 2024-05-07T13:59:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.210+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4290062e90 con 0x7f4274038060 2024-05-07T13:59:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.226+0000 7f4286ffd640 1 -- 172.21.15.22:0/464235058 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658950 (secure 0 0 0) 0x7f4290062e90 con 0x7f4274038060 2024-05-07T13:59:31.220 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:59:31.226 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T13:59:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.230+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4274038060 msgr2=0x7f427403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.230+0000 7f429829a640 1 --2- 172.21.15.22:0/464235058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4274038060 0x7f427403a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4280000c00 tx=0x7f4280007970 comp rx=0 tx=0).stop 2024-05-07T13:59:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.230+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 msgr2=0x7f42901c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.230+0000 7f429829a640 1 --2- 172.21.15.22:0/464235058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 0x7f42901c33d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f428c009720 tx=0x7f428c0046c0 comp rx=0 tx=0).stop 2024-05-07T13:59:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.230+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 shutdown_connections 2024-05-07T13:59:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.230+0000 7f429829a640 1 --2- 172.21.15.22:0/464235058 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f4274038060 0x7f427403a520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.230+0000 7f429829a640 1 --2- 172.21.15.22:0/464235058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f429012c5b0 0x7f42901c33d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:31.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.230+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 >> 172.21.15.22:0/464235058 conn(0x7f4290099380 msgr2=0x7f429009b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:31.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.230+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 shutdown_connections 2024-05-07T13:59:31.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:31.231+0000 7f429829a640 1 -- 172.21.15.22:0/464235058 wait complete. 2024-05-07T13:59:31.229 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-05-07T13:59:30.170929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5119,"num_read_kb":4700,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4725,"ondisk_log_size":4725,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":127448,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":124665,"kb_avail":377359912,"statfs":{"total":386547056640,"available":386416549888,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":127657750},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003055"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.181540+0000","last_change":"2024-05-07T13:55:48.336201+0000","last_active":"2024-05-07T13:57:53.181540+0000","last_peered":"2024-05-07T13:57:53.181540+0000","last_clean":"2024-05-07T13:57:53.181540+0000","last_became_active":"2024-05-07T13:55:48.335740+0000","last_became_peered":"2024-05-07T13:55:48.335740+0000","last_unstale":"2024-05-07T13:57:53.181540+0000","last_undegraded":"2024-05-07T13:57:53.181540+0000","last_fullsized":"2024-05-07T13:57:53.181540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'13","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.592541+0000","last_change":"2024-05-07T13:55:50.316599+0000","last_active":"2024-05-07T13:58:59.592541+0000","last_peered":"2024-05-07T13:58:59.592541+0000","last_clean":"2024-05-07T13:58:59.592541+0000","last_became_active":"2024-05-07T13:55:50.316253+0000","last_became_peered":"2024-05-07T13:55:50.316253+0000","last_unstale":"2024-05-07T13:58:59.592541+0000","last_undegraded":"2024-05-07T13:58:59.592541+0000","last_fullsized":"2024-05-07T13:58:59.592541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.392972+0000","last_change":"2024-05-07T13:55:48.324242+0000","last_active":"2024-05-07T13:58:59.392972+0000","last_peered":"2024-05-07T13:58:59.392972+0000","last_clean":"2024-05-07T13:58:59.392972+0000","last_became_active":"2024-05-07T13:55:48.323151+0000","last_became_peered":"2024-05-07T13:55:48.323151+0000","last_unstale":"2024-05-07T13:58:59.392972+0000","last_undegraded":"2024-05-07T13:58:59.392972+0000","last_fullsized":"2024-05-07T13:58:59.392972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184151+0000","last_change":"2024-05-07T13:55:50.322812+0000","last_active":"2024-05-07T13:58:23.184151+0000","last_peered":"2024-05-07T13:58:23.184151+0000","last_clean":"2024-05-07T13:58:23.184151+0000","last_became_active":"2024-05-07T13:55:50.322066+0000","last_became_peered":"2024-05-07T13:55:50.322066+0000","last_unstale":"2024-05-07T13:58:23.184151+0000","last_undegraded":"2024-05-07T13:58:23.184151+0000","last_fullsized":"2024-05-07T13:58:23.184151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179448+0000","last_change":"2024-05-07T13:55:48.350450+0000","last_active":"2024-05-07T13:57:53.179448+0000","last_peered":"2024-05-07T13:57:53.179448+0000","last_clean":"2024-05-07T13:57:53.179448+0000","last_became_active":"2024-05-07T13:55:48.347661+0000","last_became_peered":"2024-05-07T13:55:48.347661+0000","last_unstale":"2024-05-07T13:57:53.179448+0000","last_undegraded":"2024-05-07T13:57:53.179448+0000","last_fullsized":"2024-05-07T13:57:53.179448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184195+0000","last_change":"2024-05-07T13:55:50.322032+0000","last_active":"2024-05-07T13:58:23.184195+0000","last_peered":"2024-05-07T13:58:23.184195+0000","last_clean":"2024-05-07T13:58:23.184195+0000","last_became_active":"2024-05-07T13:55:50.321598+0000","last_became_peered":"2024-05-07T13:55:50.321598+0000","last_unstale":"2024-05-07T13:58:23.184195+0000","last_undegraded":"2024-05-07T13:58:23.184195+0000","last_fullsized":"2024-05-07T13:58:23.184195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.699865+0000","last_change":"2024-05-07T13:55:48.337861+0000","last_active":"2024-05-07T13:57:58.699865+0000","last_peered":"2024-05-07T13:57:58.699865+0000","last_clean":"2024-05-07T13:57:58.699865+0000","last_became_active":"2024-05-07T13:55:48.337418+0000","last_became_peered":"2024-05-07T13:55:48.337418+0000","last_unstale":"2024-05-07T13:57:58.699865+0000","last_undegraded":"2024-05-07T13:57:58.699865+0000","last_fullsized":"2024-05-07T13:57:58.699865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:08.190604+0000","last_change":"2024-05-07T13:56:35.367287+0000","last_active":"2024-05-07T13:59:08.190604+0000","last_peered":"2024-05-07T13:59:08.190604+0000","last_clean":"2024-05-07T13:59:08.190604+0000","last_became_active":"2024-05-07T13:56:35.366947+0000","last_became_peered":"2024-05-07T13:56:35.366947+0000","last_unstale":"2024-05-07T13:59:08.190604+0000","last_undegraded":"2024-05-07T13:59:08.190604+0000","last_fullsized":"2024-05-07T13:59:08.190604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183398+0000","last_change":"2024-05-07T13:55:48.349880+0000","last_active":"2024-05-07T13:58:18.183398+0000","last_peered":"2024-05-07T13:58:18.183398+0000","last_clean":"2024-05-07T13:58:18.183398+0000","last_became_active":"2024-05-07T13:55:48.347714+0000","last_became_peered":"2024-05-07T13:55:48.347714+0000","last_unstale":"2024-05-07T13:58:18.183398+0000","last_undegraded":"2024-05-07T13:58:18.183398+0000","last_fullsized":"2024-05-07T13:58:18.183398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'8","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179065+0000","last_change":"2024-05-07T13:55:50.314953+0000","last_active":"2024-05-07T13:57:53.179065+0000","last_peered":"2024-05-07T13:57:53.179065+0000","last_clean":"2024-05-07T13:57:53.179065+0000","last_became_active":"2024-05-07T13:55:50.314660+0000","last_became_peered":"2024-05-07T13:55:50.314660+0000","last_unstale":"2024-05-07T13:57:53.179065+0000","last_undegraded":"2024-05-07T13:57:53.179065+0000","last_fullsized":"2024-05-07T13:57:53.179065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.184692+0000","last_change":"2024-05-07T13:55:48.338607+0000","last_active":"2024-05-07T13:58:18.184692+0000","last_peered":"2024-05-07T13:58:18.184692+0000","last_clean":"2024-05-07T13:58:18.184692+0000","last_became_active":"2024-05-07T13:55:48.337256+0000","last_became_peered":"2024-05-07T13:55:48.337256+0000","last_unstale":"2024-05-07T13:58:18.184692+0000","last_undegraded":"2024-05-07T13:58:18.184692+0000","last_fullsized":"2024-05-07T13:58:18.184692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.510758+0000","last_change":"2024-05-07T13:55:50.322605+0000","last_active":"2024-05-07T13:58:59.510758+0000","last_peered":"2024-05-07T13:58:59.510758+0000","last_clean":"2024-05-07T13:58:59.510758+0000","last_became_active":"2024-05-07T13:55:50.322204+0000","last_became_peered":"2024-05-07T13:55:50.322204+0000","last_unstale":"2024-05-07T13:58:59.510758+0000","last_undegraded":"2024-05-07T13:58:59.510758+0000","last_fullsized":"2024-05-07T13:58:59.510758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183291+0000","last_change":"2024-05-07T13:55:48.348111+0000","last_active":"2024-05-07T13:58:18.183291+0000","last_peered":"2024-05-07T13:58:18.183291+0000","last_clean":"2024-05-07T13:58:18.183291+0000","last_became_active":"2024-05-07T13:55:48.347006+0000","last_became_peered":"2024-05-07T13:55:48.347006+0000","last_unstale":"2024-05-07T13:58:18.183291+0000","last_undegraded":"2024-05-07T13:58:18.183291+0000","last_fullsized":"2024-05-07T13:58:18.183291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.182208+0000","last_change":"2024-05-07T13:55:50.313130+0000","last_active":"2024-05-07T13:57:58.182208+0000","last_peered":"2024-05-07T13:57:58.182208+0000","last_clean":"2024-05-07T13:57:58.182208+0000","last_became_active":"2024-05-07T13:55:50.312835+0000","last_became_peered":"2024-05-07T13:55:50.312835+0000","last_unstale":"2024-05-07T13:57:58.182208+0000","last_undegraded":"2024-05-07T13:57:58.182208+0000","last_fullsized":"2024-05-07T13:57:58.182208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.181090+0000","last_change":"2024-05-07T13:55:48.325646+0000","last_active":"2024-05-07T13:58:18.181090+0000","last_peered":"2024-05-07T13:58:18.181090+0000","last_clean":"2024-05-07T13:58:18.181090+0000","last_became_active":"2024-05-07T13:55:48.323612+0000","last_became_peered":"2024-05-07T13:55:48.323612+0000","last_unstale":"2024-05-07T13:58:18.181090+0000","last_undegraded":"2024-05-07T13:58:18.181090+0000","last_fullsized":"2024-05-07T13:58:18.181090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149511+0000","last_change":"2024-05-07T13:55:50.325361+0000","last_active":"2024-05-07T13:58:59.149511+0000","last_peered":"2024-05-07T13:58:59.149511+0000","last_clean":"2024-05-07T13:58:59.149511+0000","last_became_active":"2024-05-07T13:55:50.325055+0000","last_became_peered":"2024-05-07T13:55:50.325055+0000","last_unstale":"2024-05-07T13:58:59.149511+0000","last_undegraded":"2024-05-07T13:58:59.149511+0000","last_fullsized":"2024-05-07T13:58:59.149511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'22","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509642+0000","last_change":"2024-05-07T13:55:50.321695+0000","last_active":"2024-05-07T13:58:59.509642+0000","last_peered":"2024-05-07T13:58:59.509642+0000","last_clean":"2024-05-07T13:58:59.509642+0000","last_became_active":"2024-05-07T13:55:50.321385+0000","last_became_peered":"2024-05-07T13:55:50.321385+0000","last_unstale":"2024-05-07T13:58:59.509642+0000","last_undegraded":"2024-05-07T13:58:59.509642+0000","last_fullsized":"2024-05-07T13:58:59.509642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182043+0000","last_change":"2024-05-07T13:55:48.335649+0000","last_active":"2024-05-07T13:58:13.182043+0000","last_peered":"2024-05-07T13:58:13.182043+0000","last_clean":"2024-05-07T13:58:13.182043+0000","last_became_active":"2024-05-07T13:55:48.335213+0000","last_became_peered":"2024-05-07T13:55:48.335213+0000","last_unstale":"2024-05-07T13:58:13.182043+0000","last_undegraded":"2024-05-07T13:58:13.182043+0000","last_fullsized":"2024-05-07T13:58:13.182043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'15","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.592216+0000","last_change":"2024-05-07T13:55:50.313758+0000","last_active":"2024-05-07T13:58:59.592216+0000","last_peered":"2024-05-07T13:58:59.592216+0000","last_clean":"2024-05-07T13:58:59.592216+0000","last_became_active":"2024-05-07T13:55:50.313457+0000","last_became_peered":"2024-05-07T13:55:50.313457+0000","last_unstale":"2024-05-07T13:58:59.592216+0000","last_undegraded":"2024-05-07T13:58:59.592216+0000","last_fullsized":"2024-05-07T13:58:59.592216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.184119+0000","last_change":"2024-05-07T13:55:48.341129+0000","last_active":"2024-05-07T13:58:13.184119+0000","last_peered":"2024-05-07T13:58:13.184119+0000","last_clean":"2024-05-07T13:58:13.184119+0000","last_became_active":"2024-05-07T13:55:48.340516+0000","last_became_peered":"2024-05-07T13:55:48.340516+0000","last_unstale":"2024-05-07T13:58:13.184119+0000","last_undegraded":"2024-05-07T13:58:13.184119+0000","last_fullsized":"2024-05-07T13:58:13.184119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'12","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.510619+0000","last_change":"2024-05-07T13:55:50.313924+0000","last_active":"2024-05-07T13:58:59.510619+0000","last_peered":"2024-05-07T13:58:59.510619+0000","last_clean":"2024-05-07T13:58:59.510619+0000","last_became_active":"2024-05-07T13:55:50.313442+0000","last_became_peered":"2024-05-07T13:55:50.313442+0000","last_unstale":"2024-05-07T13:58:59.510619+0000","last_undegraded":"2024-05-07T13:58:59.510619+0000","last_fullsized":"2024-05-07T13:58:59.510619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181951+0000","last_change":"2024-05-07T13:55:48.339008+0000","last_active":"2024-05-07T13:58:13.181951+0000","last_peered":"2024-05-07T13:58:13.181951+0000","last_clean":"2024-05-07T13:58:13.181951+0000","last_became_active":"2024-05-07T13:55:48.338589+0000","last_became_peered":"2024-05-07T13:55:48.338589+0000","last_unstale":"2024-05-07T13:58:13.181951+0000","last_undegraded":"2024-05-07T13:58:13.181951+0000","last_fullsized":"2024-05-07T13:58:13.181951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'7","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.592566+0000","last_change":"2024-05-07T13:55:50.328784+0000","last_active":"2024-05-07T13:58:59.592566+0000","last_peered":"2024-05-07T13:58:59.592566+0000","last_clean":"2024-05-07T13:58:59.592566+0000","last_became_active":"2024-05-07T13:55:50.328471+0000","last_became_peered":"2024-05-07T13:55:50.328471+0000","last_unstale":"2024-05-07T13:58:59.592566+0000","last_undegraded":"2024-05-07T13:58:59.592566+0000","last_fullsized":"2024-05-07T13:58:59.592566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181894+0000","last_change":"2024-05-07T13:55:48.340701+0000","last_active":"2024-05-07T13:58:13.181894+0000","last_peered":"2024-05-07T13:58:13.181894+0000","last_clean":"2024-05-07T13:58:13.181894+0000","last_became_active":"2024-05-07T13:55:48.340284+0000","last_became_peered":"2024-05-07T13:55:48.340284+0000","last_unstale":"2024-05-07T13:58:13.181894+0000","last_undegraded":"2024-05-07T13:58:13.181894+0000","last_fullsized":"2024-05-07T13:58:13.181894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.510309+0000","last_change":"2024-05-07T13:55:50.322836+0000","last_active":"2024-05-07T13:58:59.510309+0000","last_peered":"2024-05-07T13:58:59.510309+0000","last_clean":"2024-05-07T13:58:59.510309+0000","last_became_active":"2024-05-07T13:55:50.322513+0000","last_became_peered":"2024-05-07T13:55:50.322513+0000","last_unstale":"2024-05-07T13:58:59.510309+0000","last_undegraded":"2024-05-07T13:58:59.510309+0000","last_fullsized":"2024-05-07T13:58:59.510309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.180443+0000","last_change":"2024-05-07T13:55:48.326455+0000","last_active":"2024-05-07T13:58:13.180443+0000","last_peered":"2024-05-07T13:58:13.180443+0000","last_clean":"2024-05-07T13:58:13.180443+0000","last_became_active":"2024-05-07T13:55:48.325321+0000","last_became_peered":"2024-05-07T13:55:48.325321+0000","last_unstale":"2024-05-07T13:58:13.180443+0000","last_undegraded":"2024-05-07T13:58:13.180443+0000","last_fullsized":"2024-05-07T13:58:13.180443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477144+0000","last_change":"2024-05-07T13:55:50.322751+0000","last_active":"2024-05-07T13:58:59.477144+0000","last_peered":"2024-05-07T13:58:59.477144+0000","last_clean":"2024-05-07T13:58:59.477144+0000","last_became_active":"2024-05-07T13:55:50.322476+0000","last_became_peered":"2024-05-07T13:55:50.322476+0000","last_unstale":"2024-05-07T13:58:59.477144+0000","last_undegraded":"2024-05-07T13:58:59.477144+0000","last_fullsized":"2024-05-07T13:58:59.477144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181627+0000","last_change":"2024-05-07T13:55:48.351155+0000","last_active":"2024-05-07T13:58:08.181627+0000","last_peered":"2024-05-07T13:58:08.181627+0000","last_clean":"2024-05-07T13:58:08.181627+0000","last_became_active":"2024-05-07T13:55:48.348714+0000","last_became_peered":"2024-05-07T13:55:48.348714+0000","last_unstale":"2024-05-07T13:58:08.181627+0000","last_undegraded":"2024-05-07T13:58:08.181627+0000","last_fullsized":"2024-05-07T13:58:08.181627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'37","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.519599+0000","last_change":"2024-05-07T13:55:58.348302+0000","last_active":"2024-05-07T13:58:59.519599+0000","last_peered":"2024-05-07T13:58:59.519599+0000","last_clean":"2024-05-07T13:58:59.519599+0000","last_became_active":"2024-05-07T13:55:58.347993+0000","last_became_peered":"2024-05-07T13:55:58.347993+0000","last_unstale":"2024-05-07T13:58:59.519599+0000","last_undegraded":"2024-05-07T13:58:59.519599+0000","last_fullsized":"2024-05-07T13:58:59.519599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182499+0000","last_change":"2024-05-07T13:55:50.323646+0000","last_active":"2024-05-07T13:58:13.182499+0000","last_peered":"2024-05-07T13:58:13.182499+0000","last_clean":"2024-05-07T13:58:13.182499+0000","last_became_active":"2024-05-07T13:55:50.323355+0000","last_became_peered":"2024-05-07T13:55:50.323355+0000","last_unstale":"2024-05-07T13:58:13.182499+0000","last_undegraded":"2024-05-07T13:58:13.182499+0000","last_fullsized":"2024-05-07T13:58:13.182499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.406190+0000","last_change":"2024-05-07T13:55:48.352275+0000","last_active":"2024-05-07T13:58:59.406190+0000","last_peered":"2024-05-07T13:58:59.406190+0000","last_clean":"2024-05-07T13:58:59.406190+0000","last_became_active":"2024-05-07T13:55:48.350161+0000","last_became_peered":"2024-05-07T13:55:48.350161+0000","last_unstale":"2024-05-07T13:58:59.406190+0000","last_undegraded":"2024-05-07T13:58:59.406190+0000","last_fullsized":"2024-05-07T13:58:59.406190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.845677+0000","last_change":"2024-05-07T13:59:13.845708+0000","last_active":"2024-05-07T13:59:13.845677+0000","last_peered":"2024-05-07T13:59:13.845677+0000","last_clean":"2024-05-07T13:59:13.845677+0000","last_became_active":"2024-05-07T13:55:52.318966+0000","last_became_peered":"2024-05-07T13:55:52.318966+0000","last_unstale":"2024-05-07T13:59:13.845677+0000","last_undegraded":"2024-05-07T13:59:13.845677+0000","last_fullsized":"2024-05-07T13:59:13.845677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.845587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:14.171712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.249065+0000","last_change":"2024-05-07T13:55:54.332167+0000","last_active":"2024-05-07T13:59:06.249065+0000","last_peered":"2024-05-07T13:59:06.249065+0000","last_clean":"2024-05-07T13:59:06.249065+0000","last_became_active":"2024-05-07T13:55:54.331835+0000","last_became_peered":"2024-05-07T13:55:54.331835+0000","last_unstale":"2024-05-07T13:59:06.249065+0000","last_undegraded":"2024-05-07T13:59:06.249065+0000","last_fullsized":"2024-05-07T13:59:06.249065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.049143+0000","last_change":"2024-05-07T13:59:23.049169+0000","last_active":"2024-05-07T13:59:23.049143+0000","last_peered":"2024-05-07T13:59:23.049143+0000","last_clean":"2024-05-07T13:59:23.049143+0000","last_became_active":"2024-05-07T13:55:56.338638+0000","last_became_peered":"2024-05-07T13:55:56.338638+0000","last_unstale":"2024-05-07T13:59:23.049143+0000","last_undegraded":"2024-05-07T13:59:23.049143+0000","last_fullsized":"2024-05-07T13:59:23.049143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.049049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:44:20.135960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'13","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.183386+0000","last_change":"2024-05-07T13:55:58.348663+0000","last_active":"2024-05-07T13:58:23.183386+0000","last_peered":"2024-05-07T13:58:23.183386+0000","last_clean":"2024-05-07T13:58:23.183386+0000","last_became_active":"2024-05-07T13:55:58.348341+0000","last_became_peered":"2024-05-07T13:55:58.348341+0000","last_unstale":"2024-05-07T13:58:23.183386+0000","last_undegraded":"2024-05-07T13:58:23.183386+0000","last_fullsized":"2024-05-07T13:58:23.183386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183499+0000","last_change":"2024-05-07T13:55:50.325607+0000","last_active":"2024-05-07T13:58:18.183499+0000","last_peered":"2024-05-07T13:58:18.183499+0000","last_clean":"2024-05-07T13:58:18.183499+0000","last_became_active":"2024-05-07T13:55:50.325201+0000","last_became_peered":"2024-05-07T13:55:50.325201+0000","last_unstale":"2024-05-07T13:58:18.183499+0000","last_undegraded":"2024-05-07T13:58:18.183499+0000","last_fullsized":"2024-05-07T13:58:18.183499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.183380+0000","last_change":"2024-05-07T13:55:48.339081+0000","last_active":"2024-05-07T13:58:08.183380+0000","last_peered":"2024-05-07T13:58:08.183380+0000","last_clean":"2024-05-07T13:58:08.183380+0000","last_became_active":"2024-05-07T13:55:48.338704+0000","last_became_peered":"2024-05-07T13:55:48.338704+0000","last_unstale":"2024-05-07T13:58:08.183380+0000","last_undegraded":"2024-05-07T13:58:08.183380+0000","last_fullsized":"2024-05-07T13:58:08.183380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.188527+0000","last_change":"2024-05-07T13:56:35.362029+0000","last_active":"2024-05-07T13:58:58.188527+0000","last_peered":"2024-05-07T13:58:58.188527+0000","last_clean":"2024-05-07T13:58:58.188527+0000","last_became_active":"2024-05-07T13:56:35.361623+0000","last_became_peered":"2024-05-07T13:56:35.361623+0000","last_unstale":"2024-05-07T13:58:58.188527+0000","last_undegraded":"2024-05-07T13:58:58.188527+0000","last_fullsized":"2024-05-07T13:58:58.188527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.125797+0000","last_change":"2024-05-07T13:59:12.125828+0000","last_active":"2024-05-07T13:59:12.125797+0000","last_peered":"2024-05-07T13:59:12.125797+0000","last_clean":"2024-05-07T13:59:12.125797+0000","last_became_active":"2024-05-07T13:55:54.333402+0000","last_became_peered":"2024-05-07T13:55:54.333402+0000","last_unstale":"2024-05-07T13:59:12.125797+0000","last_undegraded":"2024-05-07T13:59:12.125797+0000","last_fullsized":"2024-05-07T13:59:12.125797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.125709+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:10.791591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.010782+0000","last_change":"2024-05-07T13:59:19.010859+0000","last_active":"2024-05-07T13:59:19.010782+0000","last_peered":"2024-05-07T13:59:19.010782+0000","last_clean":"2024-05-07T13:59:19.010782+0000","last_became_active":"2024-05-07T13:55:56.335463+0000","last_became_peered":"2024-05-07T13:55:56.335463+0000","last_unstale":"2024-05-07T13:59:19.010782+0000","last_undegraded":"2024-05-07T13:59:19.010782+0000","last_fullsized":"2024-05-07T13:59:19.010782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.010674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:27.103094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:28.182615+0000","last_change":"2024-05-07T13:55:58.341190+0000","last_active":"2024-05-07T13:58:28.182615+0000","last_peered":"2024-05-07T13:58:28.182615+0000","last_clean":"2024-05-07T13:58:28.182615+0000","last_became_active":"2024-05-07T13:55:58.340688+0000","last_became_peered":"2024-05-07T13:55:58.340688+0000","last_unstale":"2024-05-07T13:58:28.182615+0000","last_undegraded":"2024-05-07T13:58:28.182615+0000","last_fullsized":"2024-05-07T13:58:28.182615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.510309+0000","last_change":"2024-05-07T13:55:50.324646+0000","last_active":"2024-05-07T13:58:59.510309+0000","last_peered":"2024-05-07T13:58:59.510309+0000","last_clean":"2024-05-07T13:58:59.510309+0000","last_became_active":"2024-05-07T13:55:50.323775+0000","last_became_peered":"2024-05-07T13:55:50.323775+0000","last_unstale":"2024-05-07T13:58:59.510309+0000","last_undegraded":"2024-05-07T13:58:59.510309+0000","last_fullsized":"2024-05-07T13:58:59.510309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.395932+0000","last_change":"2024-05-07T13:55:48.350102+0000","last_active":"2024-05-07T13:58:59.395932+0000","last_peered":"2024-05-07T13:58:59.395932+0000","last_clean":"2024-05-07T13:58:59.395932+0000","last_became_active":"2024-05-07T13:55:48.349636+0000","last_became_peered":"2024-05-07T13:55:48.349636+0000","last_unstale":"2024-05-07T13:58:59.395932+0000","last_undegraded":"2024-05-07T13:58:59.395932+0000","last_fullsized":"2024-05-07T13:58:59.395932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:03.190026+0000","last_change":"2024-05-07T13:56:35.370451+0000","last_active":"2024-05-07T13:59:03.190026+0000","last_peered":"2024-05-07T13:59:03.190026+0000","last_clean":"2024-05-07T13:59:03.190026+0000","last_became_active":"2024-05-07T13:56:35.370109+0000","last_became_peered":"2024-05-07T13:56:35.370109+0000","last_unstale":"2024-05-07T13:59:03.190026+0000","last_undegraded":"2024-05-07T13:59:03.190026+0000","last_fullsized":"2024-05-07T13:59:03.190026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.187173+0000","last_change":"2024-05-07T13:59:22.187264+0000","last_active":"2024-05-07T13:59:22.187173+0000","last_peered":"2024-05-07T13:59:22.187173+0000","last_clean":"2024-05-07T13:59:22.187173+0000","last_became_active":"2024-05-07T13:55:54.327178+0000","last_became_peered":"2024-05-07T13:55:54.327178+0000","last_unstale":"2024-05-07T13:59:22.187173+0000","last_undegraded":"2024-05-07T13:59:22.187173+0000","last_fullsized":"2024-05-07T13:59:22.187173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.187065+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:32.587195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":394,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.276325+0000","last_change":"2024-05-07T13:55:56.347848+0000","last_active":"2024-05-07T13:59:06.276325+0000","last_peered":"2024-05-07T13:59:06.276325+0000","last_clean":"2024-05-07T13:59:06.276325+0000","last_became_active":"2024-05-07T13:55:56.345712+0000","last_became_peered":"2024-05-07T13:55:56.345712+0000","last_unstale":"2024-05-07T13:59:06.276325+0000","last_undegraded":"2024-05-07T13:59:06.276325+0000","last_fullsized":"2024-05-07T13:59:06.276325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.162805+0000","last_change":"2024-05-07T13:59:28.162826+0000","last_active":"2024-05-07T13:59:28.162805+0000","last_peered":"2024-05-07T13:59:28.162805+0000","last_clean":"2024-05-07T13:59:28.162805+0000","last_became_active":"2024-05-07T13:55:58.339825+0000","last_became_peered":"2024-05-07T13:55:58.339825+0000","last_unstale":"2024-05-07T13:59:28.162805+0000","last_undegraded":"2024-05-07T13:59:28.162805+0000","last_fullsized":"2024-05-07T13:59:28.162805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.162716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:49.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.181251+0000","last_change":"2024-05-07T13:55:50.319097+0000","last_active":"2024-05-07T13:58:18.181251+0000","last_peered":"2024-05-07T13:58:18.181251+0000","last_clean":"2024-05-07T13:58:18.181251+0000","last_became_active":"2024-05-07T13:55:50.318502+0000","last_became_peered":"2024-05-07T13:55:50.318502+0000","last_unstale":"2024-05-07T13:58:18.181251+0000","last_undegraded":"2024-05-07T13:58:18.181251+0000","last_fullsized":"2024-05-07T13:58:18.181251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181081+0000","last_change":"2024-05-07T13:55:48.345523+0000","last_active":"2024-05-07T13:58:08.181081+0000","last_peered":"2024-05-07T13:58:08.181081+0000","last_clean":"2024-05-07T13:58:08.181081+0000","last_became_active":"2024-05-07T13:55:48.345080+0000","last_became_peered":"2024-05-07T13:55:48.345080+0000","last_unstale":"2024-05-07T13:58:08.181081+0000","last_undegraded":"2024-05-07T13:58:08.181081+0000","last_fullsized":"2024-05-07T13:58:08.181081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.860466+0000","last_change":"2024-05-07T13:59:18.860501+0000","last_active":"2024-05-07T13:59:18.860466+0000","last_peered":"2024-05-07T13:59:18.860466+0000","last_clean":"2024-05-07T13:59:18.860466+0000","last_became_active":"2024-05-07T13:55:52.318178+0000","last_became_peered":"2024-05-07T13:55:52.318178+0000","last_unstale":"2024-05-07T13:59:18.860466+0000","last_undegraded":"2024-05-07T13:59:18.860466+0000","last_fullsized":"2024-05-07T13:59:18.860466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.860344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:31:08.364202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.065120+0000","last_change":"2024-05-07T13:59:17.065153+0000","last_active":"2024-05-07T13:59:17.065120+0000","last_peered":"2024-05-07T13:59:17.065120+0000","last_clean":"2024-05-07T13:59:17.065120+0000","last_became_active":"2024-05-07T13:55:54.330662+0000","last_became_peered":"2024-05-07T13:55:54.330662+0000","last_unstale":"2024-05-07T13:59:17.065120+0000","last_undegraded":"2024-05-07T13:59:17.065120+0000","last_fullsized":"2024-05-07T13:59:17.065120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.065035+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:20.830603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.894290+0000","last_change":"2024-05-07T13:59:10.894332+0000","last_active":"2024-05-07T13:59:10.894290+0000","last_peered":"2024-05-07T13:59:10.894290+0000","last_clean":"2024-05-07T13:59:10.894290+0000","last_became_active":"2024-05-07T13:55:56.334111+0000","last_became_peered":"2024-05-07T13:55:56.334111+0000","last_unstale":"2024-05-07T13:59:10.894290+0000","last_undegraded":"2024-05-07T13:59:10.894290+0000","last_fullsized":"2024-05-07T13:59:10.894290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.894211+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:00.735952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'11","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.031877+0000","last_change":"2024-05-07T13:59:27.031904+0000","last_active":"2024-05-07T13:59:27.031877+0000","last_peered":"2024-05-07T13:59:27.031877+0000","last_clean":"2024-05-07T13:59:27.031877+0000","last_became_active":"2024-05-07T13:55:50.324820+0000","last_became_peered":"2024-05-07T13:55:50.324820+0000","last_unstale":"2024-05-07T13:59:27.031877+0000","last_undegraded":"2024-05-07T13:59:27.031877+0000","last_fullsized":"2024-05-07T13:59:27.031877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.031775+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:22.190354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182839+0000","last_change":"2024-05-07T13:55:48.335906+0000","last_active":"2024-05-07T13:58:03.182839+0000","last_peered":"2024-05-07T13:58:03.182839+0000","last_clean":"2024-05-07T13:58:03.182839+0000","last_became_active":"2024-05-07T13:55:48.335443+0000","last_became_peered":"2024-05-07T13:55:48.335443+0000","last_unstale":"2024-05-07T13:58:03.182839+0000","last_undegraded":"2024-05-07T13:58:03.182839+0000","last_fullsized":"2024-05-07T13:58:03.182839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.073468+0000","last_change":"2024-05-07T13:59:24.073496+0000","last_active":"2024-05-07T13:59:24.073468+0000","last_peered":"2024-05-07T13:59:24.073468+0000","last_clean":"2024-05-07T13:59:24.073468+0000","last_became_active":"2024-05-07T13:55:52.322188+0000","last_became_peered":"2024-05-07T13:55:52.322188+0000","last_unstale":"2024-05-07T13:59:24.073468+0000","last_undegraded":"2024-05-07T13:59:24.073468+0000","last_fullsized":"2024-05-07T13:59:24.073468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.073340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:13.708665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.081851+0000","last_change":"2024-05-07T13:59:18.081901+0000","last_active":"2024-05-07T13:59:18.081851+0000","last_peered":"2024-05-07T13:59:18.081851+0000","last_clean":"2024-05-07T13:59:18.081851+0000","last_became_active":"2024-05-07T13:55:54.330401+0000","last_became_peered":"2024-05-07T13:55:54.330401+0000","last_unstale":"2024-05-07T13:59:18.081851+0000","last_undegraded":"2024-05-07T13:59:18.081851+0000","last_fullsized":"2024-05-07T13:59:18.081851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.081750+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:16:16.381571+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.945644+0000","last_change":"2024-05-07T13:59:13.945668+0000","last_active":"2024-05-07T13:59:13.945644+0000","last_peered":"2024-05-07T13:59:13.945644+0000","last_clean":"2024-05-07T13:59:13.945644+0000","last_became_active":"2024-05-07T13:55:56.334368+0000","last_became_peered":"2024-05-07T13:55:56.334368+0000","last_unstale":"2024-05-07T13:59:13.945644+0000","last_undegraded":"2024-05-07T13:59:13.945644+0000","last_fullsized":"2024-05-07T13:59:13.945644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.945550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:11.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182753+0000","last_change":"2024-05-07T13:55:58.346747+0000","last_active":"2024-05-07T13:58:03.182753+0000","last_peered":"2024-05-07T13:58:03.182753+0000","last_clean":"2024-05-07T13:58:03.182753+0000","last_became_active":"2024-05-07T13:55:58.346457+0000","last_became_peered":"2024-05-07T13:55:58.346457+0000","last_unstale":"2024-05-07T13:58:03.182753+0000","last_undegraded":"2024-05-07T13:58:03.182753+0000","last_fullsized":"2024-05-07T13:58:03.182753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180359+0000","last_change":"2024-05-07T13:55:50.312874+0000","last_active":"2024-05-07T13:58:03.180359+0000","last_peered":"2024-05-07T13:58:03.180359+0000","last_clean":"2024-05-07T13:58:03.180359+0000","last_became_active":"2024-05-07T13:55:50.312564+0000","last_became_peered":"2024-05-07T13:55:50.312564+0000","last_unstale":"2024-05-07T13:58:03.180359+0000","last_undegraded":"2024-05-07T13:58:03.180359+0000","last_fullsized":"2024-05-07T13:58:03.180359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182806+0000","last_change":"2024-05-07T13:55:48.336211+0000","last_active":"2024-05-07T13:58:03.182806+0000","last_peered":"2024-05-07T13:58:03.182806+0000","last_clean":"2024-05-07T13:58:03.182806+0000","last_became_active":"2024-05-07T13:55:48.335791+0000","last_became_peered":"2024-05-07T13:55:48.335791+0000","last_unstale":"2024-05-07T13:58:03.182806+0000","last_undegraded":"2024-05-07T13:58:03.182806+0000","last_fullsized":"2024-05-07T13:58:03.182806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.088740+0000","last_change":"2024-05-07T13:59:27.088805+0000","last_active":"2024-05-07T13:59:27.088740+0000","last_peered":"2024-05-07T13:59:27.088740+0000","last_clean":"2024-05-07T13:59:27.088740+0000","last_became_active":"2024-05-07T13:55:52.325676+0000","last_became_peered":"2024-05-07T13:55:52.325676+0000","last_unstale":"2024-05-07T13:59:27.088740+0000","last_undegraded":"2024-05-07T13:59:27.088740+0000","last_fullsized":"2024-05-07T13:59:27.088740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.088632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:08.861590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'36","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.195171+0000","last_change":"2024-05-07T13:55:54.332289+0000","last_active":"2024-05-07T13:59:06.195171+0000","last_peered":"2024-05-07T13:59:06.195171+0000","last_clean":"2024-05-07T13:59:06.195171+0000","last_became_active":"2024-05-07T13:55:54.331979+0000","last_became_peered":"2024-05-07T13:55:54.331979+0000","last_unstale":"2024-05-07T13:59:06.195171+0000","last_undegraded":"2024-05-07T13:59:06.195171+0000","last_fullsized":"2024-05-07T13:59:06.195171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.927280+0000","last_change":"2024-05-07T13:59:12.927307+0000","last_active":"2024-05-07T13:59:12.927280+0000","last_peered":"2024-05-07T13:59:12.927280+0000","last_clean":"2024-05-07T13:59:12.927280+0000","last_became_active":"2024-05-07T13:55:56.333357+0000","last_became_peered":"2024-05-07T13:55:56.333357+0000","last_unstale":"2024-05-07T13:59:12.927280+0000","last_undegraded":"2024-05-07T13:59:12.927280+0000","last_fullsized":"2024-05-07T13:59:12.927280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.927183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:18.128049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180508+0000","last_change":"2024-05-07T13:55:58.345252+0000","last_active":"2024-05-07T13:58:03.180508+0000","last_peered":"2024-05-07T13:58:03.180508+0000","last_clean":"2024-05-07T13:58:03.180508+0000","last_became_active":"2024-05-07T13:55:58.344955+0000","last_became_peered":"2024-05-07T13:55:58.344955+0000","last_unstale":"2024-05-07T13:58:03.180508+0000","last_undegraded":"2024-05-07T13:58:03.180508+0000","last_fullsized":"2024-05-07T13:58:03.180508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.252564+0000","last_change":"2024-05-07T13:55:50.327717+0000","last_active":"2024-05-07T13:58:59.252564+0000","last_peered":"2024-05-07T13:58:59.252564+0000","last_clean":"2024-05-07T13:58:59.252564+0000","last_became_active":"2024-05-07T13:55:50.327059+0000","last_became_peered":"2024-05-07T13:55:50.327059+0000","last_unstale":"2024-05-07T13:58:59.252564+0000","last_undegraded":"2024-05-07T13:58:59.252564+0000","last_fullsized":"2024-05-07T13:58:59.252564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180915+0000","last_change":"2024-05-07T13:55:48.350939+0000","last_active":"2024-05-07T13:58:03.180915+0000","last_peered":"2024-05-07T13:58:03.180915+0000","last_clean":"2024-05-07T13:58:03.180915+0000","last_became_active":"2024-05-07T13:55:48.350442+0000","last_became_peered":"2024-05-07T13:55:48.350442+0000","last_unstale":"2024-05-07T13:58:03.180915+0000","last_undegraded":"2024-05-07T13:58:03.180915+0000","last_fullsized":"2024-05-07T13:58:03.180915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.179668+0000","last_change":"2024-05-07T13:55:52.321998+0000","last_active":"2024-05-07T13:58:08.179668+0000","last_peered":"2024-05-07T13:58:08.179668+0000","last_clean":"2024-05-07T13:58:08.179668+0000","last_became_active":"2024-05-07T13:55:52.321674+0000","last_became_peered":"2024-05-07T13:55:52.321674+0000","last_unstale":"2024-05-07T13:58:08.179668+0000","last_undegraded":"2024-05-07T13:58:08.179668+0000","last_fullsized":"2024-05-07T13:58:08.179668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.831229+0000","last_change":"2024-05-07T13:59:14.831318+0000","last_active":"2024-05-07T13:59:14.831229+0000","last_peered":"2024-05-07T13:59:14.831229+0000","last_clean":"2024-05-07T13:59:14.831229+0000","last_became_active":"2024-05-07T13:55:54.325336+0000","last_became_peered":"2024-05-07T13:55:54.325336+0000","last_unstale":"2024-05-07T13:59:14.831229+0000","last_undegraded":"2024-05-07T13:59:14.831229+0000","last_fullsized":"2024-05-07T13:59:14.831229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.831128+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:26:59.956651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.962074+0000","last_change":"2024-05-07T13:59:17.962101+0000","last_active":"2024-05-07T13:59:17.962074+0000","last_peered":"2024-05-07T13:59:17.962074+0000","last_clean":"2024-05-07T13:59:17.962074+0000","last_became_active":"2024-05-07T13:55:56.334895+0000","last_became_peered":"2024-05-07T13:55:56.334895+0000","last_unstale":"2024-05-07T13:59:17.962074+0000","last_undegraded":"2024-05-07T13:59:17.962074+0000","last_fullsized":"2024-05-07T13:59:17.962074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.961985+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:39.314908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.179732+0000","last_change":"2024-05-07T13:55:58.341127+0000","last_active":"2024-05-07T13:58:08.179732+0000","last_peered":"2024-05-07T13:58:08.179732+0000","last_clean":"2024-05-07T13:58:08.179732+0000","last_became_active":"2024-05-07T13:55:58.340764+0000","last_became_peered":"2024-05-07T13:55:58.340764+0000","last_unstale":"2024-05-07T13:58:08.179732+0000","last_undegraded":"2024-05-07T13:58:08.179732+0000","last_fullsized":"2024-05-07T13:58:08.179732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'10","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.592005+0000","last_change":"2024-05-07T13:55:50.313309+0000","last_active":"2024-05-07T13:58:59.592005+0000","last_peered":"2024-05-07T13:58:59.592005+0000","last_clean":"2024-05-07T13:58:59.592005+0000","last_became_active":"2024-05-07T13:55:50.312649+0000","last_became_peered":"2024-05-07T13:55:50.312649+0000","last_unstale":"2024-05-07T13:58:59.592005+0000","last_undegraded":"2024-05-07T13:58:59.592005+0000","last_fullsized":"2024-05-07T13:58:59.592005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180844+0000","last_change":"2024-05-07T13:55:48.347430+0000","last_active":"2024-05-07T13:58:03.180844+0000","last_peered":"2024-05-07T13:58:03.180844+0000","last_clean":"2024-05-07T13:58:03.180844+0000","last_became_active":"2024-05-07T13:55:48.346027+0000","last_became_peered":"2024-05-07T13:55:48.346027+0000","last_unstale":"2024-05-07T13:58:03.180844+0000","last_undegraded":"2024-05-07T13:58:03.180844+0000","last_fullsized":"2024-05-07T13:58:03.180844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.054825+0000","last_change":"2024-05-07T13:59:28.054894+0000","last_active":"2024-05-07T13:59:28.054825+0000","last_peered":"2024-05-07T13:59:28.054825+0000","last_clean":"2024-05-07T13:59:28.054825+0000","last_became_active":"2024-05-07T13:55:52.325427+0000","last_became_peered":"2024-05-07T13:55:52.325427+0000","last_unstale":"2024-05-07T13:59:28.054825+0000","last_undegraded":"2024-05-07T13:59:28.054825+0000","last_fullsized":"2024-05-07T13:59:28.054825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.054722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:47.334525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'60","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.203901+0000","last_change":"2024-05-07T13:55:54.334756+0000","last_active":"2024-05-07T13:59:06.203901+0000","last_peered":"2024-05-07T13:59:06.203901+0000","last_clean":"2024-05-07T13:59:06.203901+0000","last_became_active":"2024-05-07T13:55:54.334315+0000","last_became_peered":"2024-05-07T13:55:54.334315+0000","last_unstale":"2024-05-07T13:59:06.203901+0000","last_undegraded":"2024-05-07T13:59:06.203901+0000","last_fullsized":"2024-05-07T13:59:06.203901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.917795+0000","last_change":"2024-05-07T13:59:16.917820+0000","last_active":"2024-05-07T13:59:16.917795+0000","last_peered":"2024-05-07T13:59:16.917795+0000","last_clean":"2024-05-07T13:59:16.917795+0000","last_became_active":"2024-05-07T13:55:56.330355+0000","last_became_peered":"2024-05-07T13:55:56.330355+0000","last_unstale":"2024-05-07T13:59:16.917795+0000","last_undegraded":"2024-05-07T13:59:16.917795+0000","last_fullsized":"2024-05-07T13:59:16.917795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.917702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:29.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'18","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.652222+0000","last_change":"2024-05-07T13:55:58.337164+0000","last_active":"2024-05-07T13:58:59.652222+0000","last_peered":"2024-05-07T13:58:59.652222+0000","last_clean":"2024-05-07T13:58:59.652222+0000","last_became_active":"2024-05-07T13:55:58.336692+0000","last_became_peered":"2024-05-07T13:55:58.336692+0000","last_unstale":"2024-05-07T13:58:59.652222+0000","last_undegraded":"2024-05-07T13:58:59.652222+0000","last_fullsized":"2024-05-07T13:58:59.652222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149744+0000","last_change":"2024-05-07T13:55:50.323082+0000","last_active":"2024-05-07T13:58:59.149744+0000","last_peered":"2024-05-07T13:58:59.149744+0000","last_clean":"2024-05-07T13:58:59.149744+0000","last_became_active":"2024-05-07T13:55:50.322764+0000","last_became_peered":"2024-05-07T13:55:50.322764+0000","last_unstale":"2024-05-07T13:58:59.149744+0000","last_undegraded":"2024-05-07T13:58:59.149744+0000","last_fullsized":"2024-05-07T13:58:59.149744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.208997+0000","last_change":"2024-05-07T13:55:48.325995+0000","last_active":"2024-05-07T13:59:06.208997+0000","last_peered":"2024-05-07T13:59:06.208997+0000","last_clean":"2024-05-07T13:59:06.208997+0000","last_became_active":"2024-05-07T13:55:48.325075+0000","last_became_peered":"2024-05-07T13:55:48.325075+0000","last_unstale":"2024-05-07T13:59:06.208997+0000","last_undegraded":"2024-05-07T13:59:06.208997+0000","last_fullsized":"2024-05-07T13:59:06.208997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.183445+0000","last_change":"2024-05-07T13:55:52.322042+0000","last_active":"2024-05-07T13:58:08.183445+0000","last_peered":"2024-05-07T13:58:08.183445+0000","last_clean":"2024-05-07T13:58:08.183445+0000","last_became_active":"2024-05-07T13:55:52.321730+0000","last_became_peered":"2024-05-07T13:55:52.321730+0000","last_unstale":"2024-05-07T13:58:08.183445+0000","last_undegraded":"2024-05-07T13:58:08.183445+0000","last_fullsized":"2024-05-07T13:58:08.183445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'41","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.091355+0000","last_change":"2024-05-07T13:59:17.091397+0000","last_active":"2024-05-07T13:59:17.091355+0000","last_peered":"2024-05-07T13:59:17.091355+0000","last_clean":"2024-05-07T13:59:17.091355+0000","last_became_active":"2024-05-07T13:55:54.324530+0000","last_became_peered":"2024-05-07T13:55:54.324530+0000","last_unstale":"2024-05-07T13:59:17.091355+0000","last_undegraded":"2024-05-07T13:59:17.091355+0000","last_fullsized":"2024-05-07T13:59:17.091355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.091253+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:22.292118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182620+0000","last_change":"2024-05-07T13:55:56.344241+0000","last_active":"2024-05-07T13:58:13.182620+0000","last_peered":"2024-05-07T13:58:13.182620+0000","last_clean":"2024-05-07T13:58:13.182620+0000","last_became_active":"2024-05-07T13:55:56.343900+0000","last_became_peered":"2024-05-07T13:55:56.343900+0000","last_unstale":"2024-05-07T13:58:13.182620+0000","last_undegraded":"2024-05-07T13:58:13.182620+0000","last_fullsized":"2024-05-07T13:58:13.182620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.595430+0000","last_change":"2024-05-07T13:55:58.352050+0000","last_active":"2024-05-07T13:58:59.595430+0000","last_peered":"2024-05-07T13:58:59.595430+0000","last_clean":"2024-05-07T13:58:59.595430+0000","last_became_active":"2024-05-07T13:55:58.351724+0000","last_became_peered":"2024-05-07T13:55:58.351724+0000","last_unstale":"2024-05-07T13:58:59.595430+0000","last_undegraded":"2024-05-07T13:58:59.595430+0000","last_fullsized":"2024-05-07T13:58:59.595430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.842728+0000","last_change":"2024-05-07T13:59:21.842752+0000","last_active":"2024-05-07T13:59:21.842728+0000","last_peered":"2024-05-07T13:59:21.842728+0000","last_clean":"2024-05-07T13:59:21.842728+0000","last_became_active":"2024-05-07T13:55:50.326050+0000","last_became_peered":"2024-05-07T13:55:50.326050+0000","last_unstale":"2024-05-07T13:59:21.842728+0000","last_undegraded":"2024-05-07T13:59:21.842728+0000","last_fullsized":"2024-05-07T13:59:21.842728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.842623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:38.606939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.180108+0000","last_change":"2024-05-07T13:55:48.352032+0000","last_active":"2024-05-07T13:57:58.180108+0000","last_peered":"2024-05-07T13:57:58.180108+0000","last_clean":"2024-05-07T13:57:58.180108+0000","last_became_active":"2024-05-07T13:55:48.350335+0000","last_became_peered":"2024-05-07T13:55:48.350335+0000","last_unstale":"2024-05-07T13:57:58.180108+0000","last_undegraded":"2024-05-07T13:57:58.180108+0000","last_fullsized":"2024-05-07T13:57:58.180108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"20'1","reported_seq":221,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.108292+0000","last_change":"2024-05-07T13:55:52.322369+0000","last_active":"2024-05-07T13:59:06.108292+0000","last_peered":"2024-05-07T13:59:06.108292+0000","last_clean":"2024-05-07T13:59:06.108292+0000","last_became_active":"2024-05-07T13:55:52.322006+0000","last_became_peered":"2024-05-07T13:55:52.322006+0000","last_unstale":"2024-05-07T13:59:06.108292+0000","last_undegraded":"2024-05-07T13:59:06.108292+0000","last_fullsized":"2024-05-07T13:59:06.108292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.102576+0000","last_change":"2024-05-07T13:59:25.102617+0000","last_active":"2024-05-07T13:59:25.102576+0000","last_peered":"2024-05-07T13:59:25.102576+0000","last_clean":"2024-05-07T13:59:25.102576+0000","last_became_active":"2024-05-07T13:55:54.319812+0000","last_became_peered":"2024-05-07T13:55:54.319812+0000","last_unstale":"2024-05-07T13:59:25.102576+0000","last_undegraded":"2024-05-07T13:59:25.102576+0000","last_fullsized":"2024-05-07T13:59:25.102576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.102469+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:25.507214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.102076+0000","last_change":"2024-05-07T13:59:11.102102+0000","last_active":"2024-05-07T13:59:11.102076+0000","last_peered":"2024-05-07T13:59:11.102076+0000","last_clean":"2024-05-07T13:59:11.102076+0000","last_became_active":"2024-05-07T13:55:56.331966+0000","last_became_peered":"2024-05-07T13:55:56.331966+0000","last_unstale":"2024-05-07T13:59:11.102076+0000","last_undegraded":"2024-05-07T13:59:11.102076+0000","last_fullsized":"2024-05-07T13:59:11.102076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.101988+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:35.873097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'20","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.597624+0000","last_change":"2024-05-07T13:55:58.340997+0000","last_active":"2024-05-07T13:58:59.597624+0000","last_peered":"2024-05-07T13:58:59.597624+0000","last_clean":"2024-05-07T13:58:59.597624+0000","last_became_active":"2024-05-07T13:55:58.340608+0000","last_became_peered":"2024-05-07T13:55:58.340608+0000","last_unstale":"2024-05-07T13:58:59.597624+0000","last_undegraded":"2024-05-07T13:58:59.597624+0000","last_fullsized":"2024-05-07T13:58:59.597624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.252513+0000","last_change":"2024-05-07T13:55:50.322925+0000","last_active":"2024-05-07T13:58:59.252513+0000","last_peered":"2024-05-07T13:58:59.252513+0000","last_clean":"2024-05-07T13:58:59.252513+0000","last_became_active":"2024-05-07T13:55:50.322650+0000","last_became_peered":"2024-05-07T13:55:50.322650+0000","last_unstale":"2024-05-07T13:58:59.252513+0000","last_undegraded":"2024-05-07T13:58:59.252513+0000","last_fullsized":"2024-05-07T13:58:59.252513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.180087+0000","last_change":"2024-05-07T13:55:48.349364+0000","last_active":"2024-05-07T13:57:58.180087+0000","last_peered":"2024-05-07T13:57:58.180087+0000","last_clean":"2024-05-07T13:57:58.180087+0000","last_became_active":"2024-05-07T13:55:48.347434+0000","last_became_peered":"2024-05-07T13:55:48.347434+0000","last_unstale":"2024-05-07T13:57:58.180087+0000","last_undegraded":"2024-05-07T13:57:58.180087+0000","last_fullsized":"2024-05-07T13:57:58.180087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":428,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.028806+0000","last_change":"2024-05-07T13:59:25.028855+0000","last_active":"2024-05-07T13:59:25.028806+0000","last_peered":"2024-05-07T13:59:25.028806+0000","last_clean":"2024-05-07T13:59:25.028806+0000","last_became_active":"2024-05-07T13:55:52.321251+0000","last_became_peered":"2024-05-07T13:55:52.321251+0000","last_unstale":"2024-05-07T13:59:25.028806+0000","last_undegraded":"2024-05-07T13:59:25.028806+0000","last_fullsized":"2024-05-07T13:59:25.028806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.028700+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:12.963826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182519+0000","last_change":"2024-05-07T13:55:54.332203+0000","last_active":"2024-05-07T13:58:13.182519+0000","last_peered":"2024-05-07T13:58:13.182519+0000","last_clean":"2024-05-07T13:58:13.182519+0000","last_became_active":"2024-05-07T13:55:54.331844+0000","last_became_peered":"2024-05-07T13:55:54.331844+0000","last_unstale":"2024-05-07T13:58:13.182519+0000","last_undegraded":"2024-05-07T13:58:13.182519+0000","last_fullsized":"2024-05-07T13:58:13.182519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.078501+0000","last_change":"2024-05-07T13:59:15.078526+0000","last_active":"2024-05-07T13:59:15.078501+0000","last_peered":"2024-05-07T13:59:15.078501+0000","last_clean":"2024-05-07T13:59:15.078501+0000","last_became_active":"2024-05-07T13:55:56.332858+0000","last_became_peered":"2024-05-07T13:55:56.332858+0000","last_unstale":"2024-05-07T13:59:15.078501+0000","last_undegraded":"2024-05-07T13:59:15.078501+0000","last_fullsized":"2024-05-07T13:59:15.078501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078412+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:04.920152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.107453+0000","last_change":"2024-05-07T13:59:24.107497+0000","last_active":"2024-05-07T13:59:24.107453+0000","last_peered":"2024-05-07T13:59:24.107453+0000","last_clean":"2024-05-07T13:59:24.107453+0000","last_became_active":"2024-05-07T13:55:58.335341+0000","last_became_peered":"2024-05-07T13:55:58.335341+0000","last_unstale":"2024-05-07T13:59:24.107453+0000","last_undegraded":"2024-05-07T13:59:24.107453+0000","last_fullsized":"2024-05-07T13:59:24.107453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.107327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:21.412357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.592588+0000","last_change":"2024-05-07T13:55:50.331652+0000","last_active":"2024-05-07T13:58:59.592588+0000","last_peered":"2024-05-07T13:58:59.592588+0000","last_clean":"2024-05-07T13:58:59.592588+0000","last_became_active":"2024-05-07T13:55:50.331295+0000","last_became_peered":"2024-05-07T13:55:50.331295+0000","last_unstale":"2024-05-07T13:58:59.592588+0000","last_undegraded":"2024-05-07T13:58:59.592588+0000","last_fullsized":"2024-05-07T13:58:59.592588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.180049+0000","last_change":"2024-05-07T13:55:48.352519+0000","last_active":"2024-05-07T13:57:58.180049+0000","last_peered":"2024-05-07T13:57:58.180049+0000","last_clean":"2024-05-07T13:57:58.180049+0000","last_became_active":"2024-05-07T13:55:48.351055+0000","last_became_peered":"2024-05-07T13:55:48.351055+0000","last_unstale":"2024-05-07T13:57:58.180049+0000","last_undegraded":"2024-05-07T13:57:58.180049+0000","last_fullsized":"2024-05-07T13:57:58.180049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"29'5","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.888798+0000","last_change":"2024-05-07T13:59:11.888832+0000","last_active":"2024-05-07T13:59:11.888798+0000","last_peered":"2024-05-07T13:59:11.888798+0000","last_clean":"2024-05-07T13:59:11.888798+0000","last_became_active":"2024-05-07T13:55:52.320027+0000","last_became_peered":"2024-05-07T13:55:52.320027+0000","last_unstale":"2024-05-07T13:59:11.888798+0000","last_undegraded":"2024-05-07T13:59:11.888798+0000","last_fullsized":"2024-05-07T13:59:11.888798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.888710+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:38:54.237300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'49","reported_seq":108,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.067236+0000","last_change":"2024-05-07T13:59:10.067275+0000","last_active":"2024-05-07T13:59:10.067236+0000","last_peered":"2024-05-07T13:59:10.067236+0000","last_clean":"2024-05-07T13:59:10.067236+0000","last_became_active":"2024-05-07T13:55:54.333766+0000","last_became_peered":"2024-05-07T13:55:54.333766+0000","last_unstale":"2024-05-07T13:59:10.067236+0000","last_undegraded":"2024-05-07T13:59:10.067236+0000","last_fullsized":"2024-05-07T13:59:10.067236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.067149+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:19.058798+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.069510+0000","last_change":"2024-05-07T13:59:12.069535+0000","last_active":"2024-05-07T13:59:12.069510+0000","last_peered":"2024-05-07T13:59:12.069510+0000","last_clean":"2024-05-07T13:59:12.069510+0000","last_became_active":"2024-05-07T13:55:56.338195+0000","last_became_peered":"2024-05-07T13:55:56.338195+0000","last_unstale":"2024-05-07T13:59:12.069510+0000","last_undegraded":"2024-05-07T13:59:12.069510+0000","last_fullsized":"2024-05-07T13:59:12.069510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.069419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:19:55.425213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.650464+0000","last_change":"2024-05-07T13:55:58.346374+0000","last_active":"2024-05-07T13:58:59.650464+0000","last_peered":"2024-05-07T13:58:59.650464+0000","last_clean":"2024-05-07T13:58:59.650464+0000","last_became_active":"2024-05-07T13:55:58.346040+0000","last_became_peered":"2024-05-07T13:55:58.346040+0000","last_unstale":"2024-05-07T13:58:59.650464+0000","last_undegraded":"2024-05-07T13:58:59.650464+0000","last_fullsized":"2024-05-07T13:58:59.650464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149919+0000","last_change":"2024-05-07T13:56:35.374383+0000","last_active":"2024-05-07T13:58:59.149919+0000","last_peered":"2024-05-07T13:58:59.149919+0000","last_clean":"2024-05-07T13:58:59.149919+0000","last_became_active":"2024-05-07T13:56:35.369148+0000","last_became_peered":"2024-05-07T13:56:35.369148+0000","last_unstale":"2024-05-07T13:58:59.149919+0000","last_undegraded":"2024-05-07T13:58:59.149919+0000","last_fullsized":"2024-05-07T13:58:59.149919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:43.177335+0000","last_change":"2024-05-07T13:55:40.043635+0000","last_active":"2024-05-07T13:57:43.177335+0000","last_peered":"2024-05-07T13:57:43.177335+0000","last_clean":"2024-05-07T13:57:43.177335+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:57:43.177335+0000","last_undegraded":"2024-05-07T13:57:43.177335+0000","last_fullsized":"2024-05-07T13:57:43.177335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.178510+0000","last_change":"2024-05-07T13:55:40.045474+0000","last_active":"2024-05-07T13:57:48.178510+0000","last_peered":"2024-05-07T13:57:48.178510+0000","last_clean":"2024-05-07T13:57:48.178510+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T13:57:48.178510+0000","last_undegraded":"2024-05-07T13:57:48.178510+0000","last_fullsized":"2024-05-07T13:57:48.178510+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179367+0000","last_change":"2024-05-07T13:55:48.352406+0000","last_active":"2024-05-07T13:57:53.179367+0000","last_peered":"2024-05-07T13:57:53.179367+0000","last_clean":"2024-05-07T13:57:53.179367+0000","last_became_active":"2024-05-07T13:55:48.350998+0000","last_became_peered":"2024-05-07T13:55:48.350998+0000","last_unstale":"2024-05-07T13:57:53.179367+0000","last_undegraded":"2024-05-07T13:57:53.179367+0000","last_fullsized":"2024-05-07T13:57:53.179367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.053544+0000","last_change":"2024-05-07T13:59:28.053567+0000","last_active":"2024-05-07T13:59:28.053544+0000","last_peered":"2024-05-07T13:59:28.053544+0000","last_clean":"2024-05-07T13:59:28.053544+0000","last_became_active":"2024-05-07T13:55:52.321406+0000","last_became_peered":"2024-05-07T13:55:52.321406+0000","last_unstale":"2024-05-07T13:59:28.053544+0000","last_undegraded":"2024-05-07T13:59:28.053544+0000","last_fullsized":"2024-05-07T13:59:28.053544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.053456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:40.818094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.891563+0000","last_change":"2024-05-07T13:59:22.891601+0000","last_active":"2024-05-07T13:59:22.891563+0000","last_peered":"2024-05-07T13:59:22.891563+0000","last_clean":"2024-05-07T13:59:22.891563+0000","last_became_active":"2024-05-07T13:55:54.328677+0000","last_became_peered":"2024-05-07T13:55:54.328677+0000","last_unstale":"2024-05-07T13:59:22.891563+0000","last_undegraded":"2024-05-07T13:59:22.891563+0000","last_fullsized":"2024-05-07T13:59:22.891563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.891465+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:38.858949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.993083+0000","last_change":"2024-05-07T13:59:21.993105+0000","last_active":"2024-05-07T13:59:21.993083+0000","last_peered":"2024-05-07T13:59:21.993083+0000","last_clean":"2024-05-07T13:59:21.993083+0000","last_became_active":"2024-05-07T13:55:56.335013+0000","last_became_peered":"2024-05-07T13:55:56.335013+0000","last_unstale":"2024-05-07T13:59:21.993083+0000","last_undegraded":"2024-05-07T13:59:21.993083+0000","last_fullsized":"2024-05-07T13:59:21.993083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.992994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:07:21.511355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'82","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.141155+0000","last_change":"2024-05-07T13:59:20.141198+0000","last_active":"2024-05-07T13:59:20.141155+0000","last_peered":"2024-05-07T13:59:20.141155+0000","last_clean":"2024-05-07T13:59:20.141155+0000","last_became_active":"2024-05-07T13:55:58.335220+0000","last_became_peered":"2024-05-07T13:55:58.335220+0000","last_unstale":"2024-05-07T13:59:20.141155+0000","last_undegraded":"2024-05-07T13:59:20.141155+0000","last_fullsized":"2024-05-07T13:59:20.141155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.141061+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:19.754291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.476899+0000","last_change":"2024-05-07T13:55:50.324475+0000","last_active":"2024-05-07T13:58:59.476899+0000","last_peered":"2024-05-07T13:58:59.476899+0000","last_clean":"2024-05-07T13:58:59.476899+0000","last_became_active":"2024-05-07T13:55:50.323408+0000","last_became_peered":"2024-05-07T13:55:50.323408+0000","last_unstale":"2024-05-07T13:58:59.476899+0000","last_undegraded":"2024-05-07T13:58:59.476899+0000","last_fullsized":"2024-05-07T13:58:59.476899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:43.177646+0000","last_change":"2024-05-07T13:55:40.043428+0000","last_active":"2024-05-07T13:57:43.177646+0000","last_peered":"2024-05-07T13:57:43.177646+0000","last_clean":"2024-05-07T13:57:43.177646+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T13:57:43.177646+0000","last_undegraded":"2024-05-07T13:57:43.177646+0000","last_fullsized":"2024-05-07T13:57:43.177646+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.177479+0000","last_change":"2024-05-07T13:55:48.327071+0000","last_active":"2024-05-07T13:57:53.177479+0000","last_peered":"2024-05-07T13:57:53.177479+0000","last_clean":"2024-05-07T13:57:53.177479+0000","last_became_active":"2024-05-07T13:55:48.325905+0000","last_became_peered":"2024-05-07T13:55:48.325905+0000","last_unstale":"2024-05-07T13:57:53.177479+0000","last_undegraded":"2024-05-07T13:57:53.177479+0000","last_fullsized":"2024-05-07T13:57:53.177479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.859897+0000","last_change":"2024-05-07T13:59:17.859922+0000","last_active":"2024-05-07T13:59:17.859897+0000","last_peered":"2024-05-07T13:59:17.859897+0000","last_clean":"2024-05-07T13:59:17.859897+0000","last_became_active":"2024-05-07T13:55:52.318221+0000","last_became_peered":"2024-05-07T13:55:52.318221+0000","last_unstale":"2024-05-07T13:59:17.859897+0000","last_undegraded":"2024-05-07T13:59:17.859897+0000","last_fullsized":"2024-05-07T13:59:17.859897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.859806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:59.896313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.121926+0000","last_change":"2024-05-07T13:59:14.121985+0000","last_active":"2024-05-07T13:59:14.121926+0000","last_peered":"2024-05-07T13:59:14.121926+0000","last_clean":"2024-05-07T13:59:14.121926+0000","last_became_active":"2024-05-07T13:55:54.329774+0000","last_became_peered":"2024-05-07T13:55:54.329774+0000","last_unstale":"2024-05-07T13:59:14.121926+0000","last_undegraded":"2024-05-07T13:59:14.121926+0000","last_fullsized":"2024-05-07T13:59:14.121926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.121829+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:13.735059+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180873+0000","last_change":"2024-05-07T13:55:56.344460+0000","last_active":"2024-05-07T13:58:03.180873+0000","last_peered":"2024-05-07T13:58:03.180873+0000","last_clean":"2024-05-07T13:58:03.180873+0000","last_became_active":"2024-05-07T13:55:56.343224+0000","last_became_peered":"2024-05-07T13:55:56.343224+0000","last_unstale":"2024-05-07T13:58:03.180873+0000","last_undegraded":"2024-05-07T13:58:03.180873+0000","last_fullsized":"2024-05-07T13:58:03.180873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181120+0000","last_change":"2024-05-07T13:55:58.345308+0000","last_active":"2024-05-07T13:58:08.181120+0000","last_peered":"2024-05-07T13:58:08.181120+0000","last_clean":"2024-05-07T13:58:08.181120+0000","last_became_active":"2024-05-07T13:55:58.344996+0000","last_became_peered":"2024-05-07T13:55:58.344996+0000","last_unstale":"2024-05-07T13:58:08.181120+0000","last_undegraded":"2024-05-07T13:58:08.181120+0000","last_fullsized":"2024-05-07T13:58:08.181120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509889+0000","last_change":"2024-05-07T13:55:50.318832+0000","last_active":"2024-05-07T13:58:59.509889+0000","last_peered":"2024-05-07T13:58:59.509889+0000","last_clean":"2024-05-07T13:58:59.509889+0000","last_became_active":"2024-05-07T13:55:50.318471+0000","last_became_peered":"2024-05-07T13:55:50.318471+0000","last_unstale":"2024-05-07T13:58:59.509889+0000","last_undegraded":"2024-05-07T13:58:59.509889+0000","last_fullsized":"2024-05-07T13:58:59.509889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:43.180229+0000","last_change":"2024-05-07T13:55:40.043522+0000","last_active":"2024-05-07T13:57:43.180229+0000","last_peered":"2024-05-07T13:57:43.180229+0000","last_clean":"2024-05-07T13:57:43.180229+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:57:43.180229+0000","last_undegraded":"2024-05-07T13:57:43.180229+0000","last_fullsized":"2024-05-07T13:57:43.180229+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.176776+0000","last_change":"2024-05-07T13:55:48.326648+0000","last_active":"2024-05-07T13:57:48.176776+0000","last_peered":"2024-05-07T13:57:48.176776+0000","last_clean":"2024-05-07T13:57:48.176776+0000","last_became_active":"2024-05-07T13:55:48.325013+0000","last_became_peered":"2024-05-07T13:55:48.325013+0000","last_unstale":"2024-05-07T13:57:48.176776+0000","last_undegraded":"2024-05-07T13:57:48.176776+0000","last_fullsized":"2024-05-07T13:57:48.176776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182795+0000","last_change":"2024-05-07T13:56:35.376721+0000","last_active":"2024-05-07T13:58:03.182795+0000","last_peered":"2024-05-07T13:58:03.182795+0000","last_clean":"2024-05-07T13:58:03.182795+0000","last_became_active":"2024-05-07T13:56:35.368904+0000","last_became_peered":"2024-05-07T13:56:35.368904+0000","last_unstale":"2024-05-07T13:58:03.182795+0000","last_undegraded":"2024-05-07T13:58:03.182795+0000","last_fullsized":"2024-05-07T13:58:03.182795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.147287+0000","last_change":"2024-05-07T13:59:21.147329+0000","last_active":"2024-05-07T13:59:21.147287+0000","last_peered":"2024-05-07T13:59:21.147287+0000","last_clean":"2024-05-07T13:59:21.147287+0000","last_became_active":"2024-05-07T13:55:54.329778+0000","last_became_peered":"2024-05-07T13:55:54.329778+0000","last_unstale":"2024-05-07T13:59:21.147287+0000","last_undegraded":"2024-05-07T13:59:21.147287+0000","last_fullsized":"2024-05-07T13:59:21.147287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.147200+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:14:48.234250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.061769+0000","last_change":"2024-05-07T13:59:26.061795+0000","last_active":"2024-05-07T13:59:26.061769+0000","last_peered":"2024-05-07T13:59:26.061769+0000","last_clean":"2024-05-07T13:59:26.061769+0000","last_became_active":"2024-05-07T13:55:56.336064+0000","last_became_peered":"2024-05-07T13:55:56.336064+0000","last_unstale":"2024-05-07T13:59:26.061769+0000","last_undegraded":"2024-05-07T13:59:26.061769+0000","last_fullsized":"2024-05-07T13:59:26.061769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.061660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:02.633772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.479098+0000","last_change":"2024-05-07T13:55:58.350552+0000","last_active":"2024-05-07T13:58:59.479098+0000","last_peered":"2024-05-07T13:58:59.479098+0000","last_clean":"2024-05-07T13:58:59.479098+0000","last_became_active":"2024-05-07T13:55:58.350208+0000","last_became_peered":"2024-05-07T13:55:58.350208+0000","last_unstale":"2024-05-07T13:58:59.479098+0000","last_undegraded":"2024-05-07T13:58:59.479098+0000","last_fullsized":"2024-05-07T13:58:59.479098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'8","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178162+0000","last_change":"2024-05-07T13:55:50.313509+0000","last_active":"2024-05-07T13:57:58.178162+0000","last_peered":"2024-05-07T13:57:58.178162+0000","last_clean":"2024-05-07T13:57:58.178162+0000","last_became_active":"2024-05-07T13:55:50.313163+0000","last_became_peered":"2024-05-07T13:55:50.313163+0000","last_unstale":"2024-05-07T13:57:58.178162+0000","last_undegraded":"2024-05-07T13:57:58.178162+0000","last_fullsized":"2024-05-07T13:57:58.178162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.178453+0000","last_change":"2024-05-07T13:55:40.044279+0000","last_active":"2024-05-07T13:57:48.178453+0000","last_peered":"2024-05-07T13:57:48.178453+0000","last_clean":"2024-05-07T13:57:48.178453+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T13:57:48.178453+0000","last_undegraded":"2024-05-07T13:57:48.178453+0000","last_fullsized":"2024-05-07T13:57:48.178453+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.181466+0000","last_change":"2024-05-07T13:55:48.338820+0000","last_active":"2024-05-07T13:57:53.181466+0000","last_peered":"2024-05-07T13:57:53.181466+0000","last_clean":"2024-05-07T13:57:53.181466+0000","last_became_active":"2024-05-07T13:55:48.338442+0000","last_became_peered":"2024-05-07T13:55:48.338442+0000","last_unstale":"2024-05-07T13:57:53.181466+0000","last_undegraded":"2024-05-07T13:57:53.181466+0000","last_fullsized":"2024-05-07T13:57:53.181466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178172+0000","last_change":"2024-05-07T13:55:52.321916+0000","last_active":"2024-05-07T13:57:58.178172+0000","last_peered":"2024-05-07T13:57:58.178172+0000","last_clean":"2024-05-07T13:57:58.178172+0000","last_became_active":"2024-05-07T13:55:52.321506+0000","last_became_peered":"2024-05-07T13:55:52.321506+0000","last_unstale":"2024-05-07T13:57:58.178172+0000","last_undegraded":"2024-05-07T13:57:58.178172+0000","last_fullsized":"2024-05-07T13:57:58.178172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.983795+0000","last_change":"2024-05-07T13:59:24.983843+0000","last_active":"2024-05-07T13:59:24.983795+0000","last_peered":"2024-05-07T13:59:24.983795+0000","last_clean":"2024-05-07T13:59:24.983795+0000","last_became_active":"2024-05-07T13:55:54.328763+0000","last_became_peered":"2024-05-07T13:55:54.328763+0000","last_unstale":"2024-05-07T13:59:24.983795+0000","last_undegraded":"2024-05-07T13:59:24.983795+0000","last_fullsized":"2024-05-07T13:59:24.983795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.983703+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:59.173853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181758+0000","last_change":"2024-05-07T13:55:56.343480+0000","last_active":"2024-05-07T13:58:08.181758+0000","last_peered":"2024-05-07T13:58:08.181758+0000","last_clean":"2024-05-07T13:58:08.181758+0000","last_became_active":"2024-05-07T13:55:56.343131+0000","last_became_peered":"2024-05-07T13:55:56.343131+0000","last_unstale":"2024-05-07T13:58:08.181758+0000","last_undegraded":"2024-05-07T13:58:08.181758+0000","last_fullsized":"2024-05-07T13:58:08.181758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181055+0000","last_change":"2024-05-07T13:55:58.348390+0000","last_active":"2024-05-07T13:58:08.181055+0000","last_peered":"2024-05-07T13:58:08.181055+0000","last_clean":"2024-05-07T13:58:08.181055+0000","last_became_active":"2024-05-07T13:55:58.348068+0000","last_became_peered":"2024-05-07T13:55:58.348068+0000","last_unstale":"2024-05-07T13:58:08.181055+0000","last_undegraded":"2024-05-07T13:58:08.181055+0000","last_fullsized":"2024-05-07T13:58:08.181055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'14","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415511+0000","last_change":"2024-05-07T13:55:50.324091+0000","last_active":"2024-05-07T13:58:59.415511+0000","last_peered":"2024-05-07T13:58:59.415511+0000","last_clean":"2024-05-07T13:58:59.415511+0000","last_became_active":"2024-05-07T13:55:50.323820+0000","last_became_peered":"2024-05-07T13:55:50.323820+0000","last_unstale":"2024-05-07T13:58:59.415511+0000","last_undegraded":"2024-05-07T13:58:59.415511+0000","last_fullsized":"2024-05-07T13:58:59.415511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.181498+0000","last_change":"2024-05-07T13:55:48.338590+0000","last_active":"2024-05-07T13:57:53.181498+0000","last_peered":"2024-05-07T13:57:53.181498+0000","last_clean":"2024-05-07T13:57:53.181498+0000","last_became_active":"2024-05-07T13:55:48.338139+0000","last_became_peered":"2024-05-07T13:55:48.338139+0000","last_unstale":"2024-05-07T13:57:53.181498+0000","last_undegraded":"2024-05-07T13:57:53.181498+0000","last_fullsized":"2024-05-07T13:57:53.181498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.176847+0000","last_change":"2024-05-07T13:55:40.043241+0000","last_active":"2024-05-07T13:57:48.176847+0000","last_peered":"2024-05-07T13:57:48.176847+0000","last_clean":"2024-05-07T13:57:48.176847+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:57:48.176847+0000","last_undegraded":"2024-05-07T13:57:48.176847+0000","last_fullsized":"2024-05-07T13:57:48.176847+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.108838+0000","last_change":"2024-05-07T13:55:52.321594+0000","last_active":"2024-05-07T13:59:06.108838+0000","last_peered":"2024-05-07T13:59:06.108838+0000","last_clean":"2024-05-07T13:59:06.108838+0000","last_became_active":"2024-05-07T13:55:52.321249+0000","last_became_peered":"2024-05-07T13:55:52.321249+0000","last_unstale":"2024-05-07T13:59:06.108838+0000","last_undegraded":"2024-05-07T13:59:06.108838+0000","last_fullsized":"2024-05-07T13:59:06.108838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'74","reported_seq":150,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.980017+0000","last_change":"2024-05-07T13:59:20.980067+0000","last_active":"2024-05-07T13:59:20.980017+0000","last_peered":"2024-05-07T13:59:20.980017+0000","last_clean":"2024-05-07T13:59:20.980017+0000","last_became_active":"2024-05-07T13:55:54.326812+0000","last_became_peered":"2024-05-07T13:55:54.326812+0000","last_unstale":"2024-05-07T13:59:20.980017+0000","last_undegraded":"2024-05-07T13:59:20.980017+0000","last_fullsized":"2024-05-07T13:59:20.980017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.979917+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:21.832415+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.116227+0000","last_change":"2024-05-07T13:59:13.116256+0000","last_active":"2024-05-07T13:59:13.116227+0000","last_peered":"2024-05-07T13:59:13.116227+0000","last_clean":"2024-05-07T13:59:13.116227+0000","last_became_active":"2024-05-07T13:55:56.331343+0000","last_became_peered":"2024-05-07T13:55:56.331343+0000","last_unstale":"2024-05-07T13:59:13.116227+0000","last_undegraded":"2024-05-07T13:59:13.116227+0000","last_fullsized":"2024-05-07T13:59:13.116227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.116129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:37.954463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'11","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.180491+0000","last_change":"2024-05-07T13:55:58.347841+0000","last_active":"2024-05-07T13:58:13.180491+0000","last_peered":"2024-05-07T13:58:13.180491+0000","last_clean":"2024-05-07T13:58:13.180491+0000","last_became_active":"2024-05-07T13:55:58.347566+0000","last_became_peered":"2024-05-07T13:55:58.347566+0000","last_unstale":"2024-05-07T13:58:13.180491+0000","last_undegraded":"2024-05-07T13:58:13.180491+0000","last_fullsized":"2024-05-07T13:58:13.180491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477404+0000","last_change":"2024-05-07T13:55:50.330859+0000","last_active":"2024-05-07T13:58:59.477404+0000","last_peered":"2024-05-07T13:58:59.477404+0000","last_clean":"2024-05-07T13:58:59.477404+0000","last_became_active":"2024-05-07T13:55:50.330547+0000","last_became_peered":"2024-05-07T13:55:50.330547+0000","last_unstale":"2024-05-07T13:58:59.477404+0000","last_undegraded":"2024-05-07T13:58:59.477404+0000","last_fullsized":"2024-05-07T13:58:59.477404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.177543+0000","last_change":"2024-05-07T13:55:48.325207+0000","last_active":"2024-05-07T13:57:53.177543+0000","last_peered":"2024-05-07T13:57:53.177543+0000","last_clean":"2024-05-07T13:57:53.177543+0000","last_became_active":"2024-05-07T13:55:48.324378+0000","last_became_peered":"2024-05-07T13:55:48.324378+0000","last_unstale":"2024-05-07T13:57:53.177543+0000","last_undegraded":"2024-05-07T13:57:53.177543+0000","last_fullsized":"2024-05-07T13:57:53.177543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.178555+0000","last_change":"2024-05-07T13:55:40.044124+0000","last_active":"2024-05-07T13:57:48.178555+0000","last_peered":"2024-05-07T13:57:48.178555+0000","last_clean":"2024-05-07T13:57:48.178555+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T13:57:48.178555+0000","last_undegraded":"2024-05-07T13:57:48.178555+0000","last_fullsized":"2024-05-07T13:57:48.178555+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:43.187640+0000","last_change":"2024-05-07T13:56:35.366451+0000","last_active":"2024-05-07T13:58:43.187640+0000","last_peered":"2024-05-07T13:58:43.187640+0000","last_clean":"2024-05-07T13:58:43.187640+0000","last_became_active":"2024-05-07T13:56:35.366075+0000","last_became_peered":"2024-05-07T13:56:35.366075+0000","last_unstale":"2024-05-07T13:58:43.187640+0000","last_undegraded":"2024-05-07T13:58:43.187640+0000","last_fullsized":"2024-05-07T13:58:43.187640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"29'21","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.152337+0000","last_change":"2024-05-07T13:59:13.152407+0000","last_active":"2024-05-07T13:59:13.152337+0000","last_peered":"2024-05-07T13:59:13.152337+0000","last_clean":"2024-05-07T13:59:13.152337+0000","last_became_active":"2024-05-07T13:55:54.330896+0000","last_became_peered":"2024-05-07T13:55:54.330896+0000","last_unstale":"2024-05-07T13:59:13.152337+0000","last_undegraded":"2024-05-07T13:59:13.152337+0000","last_fullsized":"2024-05-07T13:59:13.152337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.152223+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.463262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":386,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.085631+0000","last_change":"2024-05-07T13:59:27.085692+0000","last_active":"2024-05-07T13:59:27.085631+0000","last_peered":"2024-05-07T13:59:27.085631+0000","last_clean":"2024-05-07T13:59:27.085631+0000","last_became_active":"2024-05-07T13:55:56.333242+0000","last_became_peered":"2024-05-07T13:55:56.333242+0000","last_unstale":"2024-05-07T13:59:27.085631+0000","last_undegraded":"2024-05-07T13:59:27.085631+0000","last_fullsized":"2024-05-07T13:59:27.085631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.085530+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:23.784119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182607+0000","last_change":"2024-05-07T13:55:58.346596+0000","last_active":"2024-05-07T13:58:13.182607+0000","last_peered":"2024-05-07T13:58:13.182607+0000","last_clean":"2024-05-07T13:58:13.182607+0000","last_became_active":"2024-05-07T13:55:58.346295+0000","last_became_peered":"2024-05-07T13:55:58.346295+0000","last_unstale":"2024-05-07T13:58:13.182607+0000","last_undegraded":"2024-05-07T13:58:13.182607+0000","last_fullsized":"2024-05-07T13:58:13.182607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:55.442065+0000","last_change":"2024-05-07T13:55:50.326085+0000","last_active":"2024-05-07T13:57:55.442065+0000","last_peered":"2024-05-07T13:57:55.442065+0000","last_clean":"2024-05-07T13:57:55.442065+0000","last_became_active":"2024-05-07T13:55:50.325665+0000","last_became_peered":"2024-05-07T13:55:50.325665+0000","last_unstale":"2024-05-07T13:57:55.442065+0000","last_undegraded":"2024-05-07T13:57:55.442065+0000","last_fullsized":"2024-05-07T13:57:55.442065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.399241+0000","last_change":"2024-05-07T13:55:48.347535+0000","last_active":"2024-05-07T13:58:59.399241+0000","last_peered":"2024-05-07T13:58:59.399241+0000","last_clean":"2024-05-07T13:58:59.399241+0000","last_became_active":"2024-05-07T13:55:48.346645+0000","last_became_peered":"2024-05-07T13:55:48.346645+0000","last_unstale":"2024-05-07T13:58:59.399241+0000","last_undegraded":"2024-05-07T13:58:59.399241+0000","last_fullsized":"2024-05-07T13:58:59.399241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.176884+0000","last_change":"2024-05-07T13:55:40.045556+0000","last_active":"2024-05-07T13:57:48.176884+0000","last_peered":"2024-05-07T13:57:48.176884+0000","last_clean":"2024-05-07T13:57:48.176884+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:57:48.176884+0000","last_undegraded":"2024-05-07T13:57:48.176884+0000","last_fullsized":"2024-05-07T13:57:48.176884+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.841962+0000","last_change":"2024-05-07T13:59:12.842021+0000","last_active":"2024-05-07T13:59:12.841962+0000","last_peered":"2024-05-07T13:59:12.841962+0000","last_clean":"2024-05-07T13:59:12.841962+0000","last_became_active":"2024-05-07T13:55:52.321160+0000","last_became_peered":"2024-05-07T13:55:52.321160+0000","last_unstale":"2024-05-07T13:59:12.841962+0000","last_undegraded":"2024-05-07T13:59:12.841962+0000","last_fullsized":"2024-05-07T13:59:12.841962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.841853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:34.497713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180805+0000","last_change":"2024-05-07T13:55:54.330229+0000","last_active":"2024-05-07T13:58:03.180805+0000","last_peered":"2024-05-07T13:58:03.180805+0000","last_clean":"2024-05-07T13:58:03.180805+0000","last_became_active":"2024-05-07T13:55:54.329885+0000","last_became_peered":"2024-05-07T13:55:54.329885+0000","last_unstale":"2024-05-07T13:58:03.180805+0000","last_undegraded":"2024-05-07T13:58:03.180805+0000","last_fullsized":"2024-05-07T13:58:03.180805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.906520+0000","last_change":"2024-05-07T13:59:11.906548+0000","last_active":"2024-05-07T13:59:11.906520+0000","last_peered":"2024-05-07T13:59:11.906520+0000","last_clean":"2024-05-07T13:59:11.906520+0000","last_became_active":"2024-05-07T13:55:56.334023+0000","last_became_peered":"2024-05-07T13:55:56.334023+0000","last_unstale":"2024-05-07T13:59:11.906520+0000","last_undegraded":"2024-05-07T13:59:11.906520+0000","last_fullsized":"2024-05-07T13:59:11.906520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.906422+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:49:19.117395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181875+0000","last_change":"2024-05-07T13:55:58.347319+0000","last_active":"2024-05-07T13:58:13.181875+0000","last_peered":"2024-05-07T13:58:13.181875+0000","last_clean":"2024-05-07T13:58:13.181875+0000","last_became_active":"2024-05-07T13:55:58.346984+0000","last_became_peered":"2024-05-07T13:55:58.346984+0000","last_unstale":"2024-05-07T13:58:13.181875+0000","last_undegraded":"2024-05-07T13:58:13.181875+0000","last_fullsized":"2024-05-07T13:58:13.181875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.182059+0000","last_change":"2024-05-07T13:55:50.327606+0000","last_active":"2024-05-07T13:57:58.182059+0000","last_peered":"2024-05-07T13:57:58.182059+0000","last_clean":"2024-05-07T13:57:58.182059+0000","last_became_active":"2024-05-07T13:55:50.327283+0000","last_became_peered":"2024-05-07T13:55:50.327283+0000","last_unstale":"2024-05-07T13:57:58.182059+0000","last_undegraded":"2024-05-07T13:57:58.182059+0000","last_fullsized":"2024-05-07T13:57:58.182059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.179739+0000","last_change":"2024-05-07T13:55:48.337939+0000","last_active":"2024-05-07T13:57:58.179739+0000","last_peered":"2024-05-07T13:57:58.179739+0000","last_clean":"2024-05-07T13:57:58.179739+0000","last_became_active":"2024-05-07T13:55:48.337553+0000","last_became_peered":"2024-05-07T13:55:48.337553+0000","last_unstale":"2024-05-07T13:57:58.179739+0000","last_undegraded":"2024-05-07T13:57:58.179739+0000","last_fullsized":"2024-05-07T13:57:58.179739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179501+0000","last_change":"2024-05-07T13:55:40.043788+0000","last_active":"2024-05-07T13:57:53.179501+0000","last_peered":"2024-05-07T13:57:53.179501+0000","last_clean":"2024-05-07T13:57:53.179501+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T13:57:53.179501+0000","last_undegraded":"2024-05-07T13:57:53.179501+0000","last_fullsized":"2024-05-07T13:57:53.179501+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.844855+0000","last_change":"2024-05-07T13:59:19.844877+0000","last_active":"2024-05-07T13:59:19.844855+0000","last_peered":"2024-05-07T13:59:19.844855+0000","last_clean":"2024-05-07T13:59:19.844855+0000","last_became_active":"2024-05-07T13:55:52.314793+0000","last_became_peered":"2024-05-07T13:55:52.314793+0000","last_unstale":"2024-05-07T13:59:19.844855+0000","last_undegraded":"2024-05-07T13:59:19.844855+0000","last_fullsized":"2024-05-07T13:59:19.844855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.844768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:57:45.920718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.116000+0000","last_change":"2024-05-07T13:59:19.116043+0000","last_active":"2024-05-07T13:59:19.116000+0000","last_peered":"2024-05-07T13:59:19.116000+0000","last_clean":"2024-05-07T13:59:19.116000+0000","last_became_active":"2024-05-07T13:55:54.329879+0000","last_became_peered":"2024-05-07T13:55:54.329879+0000","last_unstale":"2024-05-07T13:59:19.116000+0000","last_undegraded":"2024-05-07T13:59:19.116000+0000","last_fullsized":"2024-05-07T13:59:19.116000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.115906+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:13.426945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.963155+0000","last_change":"2024-05-07T13:59:15.963178+0000","last_active":"2024-05-07T13:59:15.963155+0000","last_peered":"2024-05-07T13:59:15.963155+0000","last_clean":"2024-05-07T13:59:15.963155+0000","last_became_active":"2024-05-07T13:55:56.332931+0000","last_became_peered":"2024-05-07T13:55:56.332931+0000","last_unstale":"2024-05-07T13:59:15.963155+0000","last_undegraded":"2024-05-07T13:59:15.963155+0000","last_fullsized":"2024-05-07T13:59:15.963155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.963044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:35.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.184078+0000","last_change":"2024-05-07T13:55:58.341180+0000","last_active":"2024-05-07T13:58:13.184078+0000","last_peered":"2024-05-07T13:58:13.184078+0000","last_clean":"2024-05-07T13:58:13.184078+0000","last_became_active":"2024-05-07T13:55:58.340759+0000","last_became_peered":"2024-05-07T13:55:58.340759+0000","last_unstale":"2024-05-07T13:58:13.184078+0000","last_undegraded":"2024-05-07T13:58:13.184078+0000","last_fullsized":"2024-05-07T13:58:13.184078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182828+0000","last_change":"2024-05-07T13:55:58.348875+0000","last_active":"2024-05-07T13:58:03.182828+0000","last_peered":"2024-05-07T13:58:03.182828+0000","last_clean":"2024-05-07T13:58:03.182828+0000","last_became_active":"2024-05-07T13:55:58.348566+0000","last_became_peered":"2024-05-07T13:55:58.348566+0000","last_unstale":"2024-05-07T13:58:03.182828+0000","last_undegraded":"2024-05-07T13:58:03.182828+0000","last_fullsized":"2024-05-07T13:58:03.182828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.184014+0000","last_change":"2024-05-07T13:55:50.329912+0000","last_active":"2024-05-07T13:58:13.184014+0000","last_peered":"2024-05-07T13:58:13.184014+0000","last_clean":"2024-05-07T13:58:13.184014+0000","last_became_active":"2024-05-07T13:55:50.329615+0000","last_became_peered":"2024-05-07T13:55:50.329615+0000","last_unstale":"2024-05-07T13:58:13.184014+0000","last_undegraded":"2024-05-07T13:58:13.184014+0000","last_fullsized":"2024-05-07T13:58:13.184014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181674+0000","last_change":"2024-05-07T13:55:48.348585+0000","last_active":"2024-05-07T13:58:08.181674+0000","last_peered":"2024-05-07T13:58:08.181674+0000","last_clean":"2024-05-07T13:58:08.181674+0000","last_became_active":"2024-05-07T13:55:48.346558+0000","last_became_peered":"2024-05-07T13:55:48.346558+0000","last_unstale":"2024-05-07T13:58:08.181674+0000","last_undegraded":"2024-05-07T13:58:08.181674+0000","last_fullsized":"2024-05-07T13:58:08.181674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.052177+0000","last_change":"2024-05-07T13:59:20.052199+0000","last_active":"2024-05-07T13:59:20.052177+0000","last_peered":"2024-05-07T13:59:20.052177+0000","last_clean":"2024-05-07T13:59:20.052177+0000","last_became_active":"2024-05-07T13:55:52.324083+0000","last_became_peered":"2024-05-07T13:55:52.324083+0000","last_unstale":"2024-05-07T13:59:20.052177+0000","last_undegraded":"2024-05-07T13:59:20.052177+0000","last_fullsized":"2024-05-07T13:59:20.052177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.052084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:52.982817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'35","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.264520+0000","last_change":"2024-05-07T13:55:54.331198+0000","last_active":"2024-05-07T13:59:06.264520+0000","last_peered":"2024-05-07T13:59:06.264520+0000","last_clean":"2024-05-07T13:59:06.264520+0000","last_became_active":"2024-05-07T13:55:54.330906+0000","last_became_peered":"2024-05-07T13:55:54.330906+0000","last_unstale":"2024-05-07T13:59:06.264520+0000","last_undegraded":"2024-05-07T13:59:06.264520+0000","last_fullsized":"2024-05-07T13:59:06.264520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183211+0000","last_change":"2024-05-07T13:55:56.348303+0000","last_active":"2024-05-07T13:58:18.183211+0000","last_peered":"2024-05-07T13:58:18.183211+0000","last_clean":"2024-05-07T13:58:18.183211+0000","last_became_active":"2024-05-07T13:55:56.346371+0000","last_became_peered":"2024-05-07T13:55:56.346371+0000","last_unstale":"2024-05-07T13:58:18.183211+0000","last_undegraded":"2024-05-07T13:58:18.183211+0000","last_fullsized":"2024-05-07T13:58:18.183211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178185+0000","last_change":"2024-05-07T13:55:58.341454+0000","last_active":"2024-05-07T13:57:58.178185+0000","last_peered":"2024-05-07T13:57:58.178185+0000","last_clean":"2024-05-07T13:57:58.178185+0000","last_became_active":"2024-05-07T13:55:58.341102+0000","last_became_peered":"2024-05-07T13:55:58.341102+0000","last_unstale":"2024-05-07T13:57:58.178185+0000","last_undegraded":"2024-05-07T13:57:58.178185+0000","last_fullsized":"2024-05-07T13:57:58.178185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181837+0000","last_change":"2024-05-07T13:55:50.330176+0000","last_active":"2024-05-07T13:58:13.181837+0000","last_peered":"2024-05-07T13:58:13.181837+0000","last_clean":"2024-05-07T13:58:13.181837+0000","last_became_active":"2024-05-07T13:55:50.329869+0000","last_became_peered":"2024-05-07T13:55:50.329869+0000","last_unstale":"2024-05-07T13:58:13.181837+0000","last_undegraded":"2024-05-07T13:58:13.181837+0000","last_fullsized":"2024-05-07T13:58:13.181837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.402894+0000","last_change":"2024-05-07T13:55:48.338314+0000","last_active":"2024-05-07T13:58:59.402894+0000","last_peered":"2024-05-07T13:58:59.402894+0000","last_clean":"2024-05-07T13:58:59.402894+0000","last_became_active":"2024-05-07T13:55:48.336807+0000","last_became_peered":"2024-05-07T13:55:48.336807+0000","last_unstale":"2024-05-07T13:58:59.402894+0000","last_undegraded":"2024-05-07T13:58:59.402894+0000","last_fullsized":"2024-05-07T13:58:59.402894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.827428+0000","last_change":"2024-05-07T13:59:15.827453+0000","last_active":"2024-05-07T13:59:15.827428+0000","last_peered":"2024-05-07T13:59:15.827428+0000","last_clean":"2024-05-07T13:59:15.827428+0000","last_became_active":"2024-05-07T13:55:52.318534+0000","last_became_peered":"2024-05-07T13:55:52.318534+0000","last_unstale":"2024-05-07T13:59:15.827428+0000","last_undegraded":"2024-05-07T13:59:15.827428+0000","last_fullsized":"2024-05-07T13:59:15.827428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.827322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:35.422572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.031728+0000","last_change":"2024-05-07T13:59:25.031770+0000","last_active":"2024-05-07T13:59:25.031728+0000","last_peered":"2024-05-07T13:59:25.031728+0000","last_clean":"2024-05-07T13:59:25.031728+0000","last_became_active":"2024-05-07T13:55:54.319714+0000","last_became_peered":"2024-05-07T13:55:54.319714+0000","last_unstale":"2024-05-07T13:59:25.031728+0000","last_undegraded":"2024-05-07T13:59:25.031728+0000","last_fullsized":"2024-05-07T13:59:25.031728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.031629+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:37.796266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.110151+0000","last_change":"2024-05-07T13:59:10.110217+0000","last_active":"2024-05-07T13:59:10.110151+0000","last_peered":"2024-05-07T13:59:10.110151+0000","last_clean":"2024-05-07T13:59:10.110151+0000","last_became_active":"2024-05-07T13:55:56.334342+0000","last_became_peered":"2024-05-07T13:55:56.334342+0000","last_unstale":"2024-05-07T13:59:10.110151+0000","last_undegraded":"2024-05-07T13:59:10.110151+0000","last_fullsized":"2024-05-07T13:59:10.110151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.110045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:09.225940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.412717+0000","last_change":"2024-05-07T13:55:58.342684+0000","last_active":"2024-05-07T13:58:59.412717+0000","last_peered":"2024-05-07T13:58:59.412717+0000","last_clean":"2024-05-07T13:58:59.412717+0000","last_became_active":"2024-05-07T13:55:58.342382+0000","last_became_peered":"2024-05-07T13:55:58.342382+0000","last_unstale":"2024-05-07T13:58:59.412717+0000","last_undegraded":"2024-05-07T13:58:59.412717+0000","last_fullsized":"2024-05-07T13:58:59.412717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415718+0000","last_change":"2024-05-07T13:56:35.366216+0000","last_active":"2024-05-07T13:58:59.415718+0000","last_peered":"2024-05-07T13:58:59.415718+0000","last_clean":"2024-05-07T13:58:59.415718+0000","last_became_active":"2024-05-07T13:56:35.365890+0000","last_became_peered":"2024-05-07T13:56:35.365890+0000","last_unstale":"2024-05-07T13:58:59.415718+0000","last_undegraded":"2024-05-07T13:58:59.415718+0000","last_fullsized":"2024-05-07T13:58:59.415718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.184102+0000","last_change":"2024-05-07T13:55:48.337211+0000","last_active":"2024-05-07T13:58:13.184102+0000","last_peered":"2024-05-07T13:58:13.184102+0000","last_clean":"2024-05-07T13:58:13.184102+0000","last_became_active":"2024-05-07T13:55:48.336730+0000","last_became_peered":"2024-05-07T13:55:48.336730+0000","last_unstale":"2024-05-07T13:58:13.184102+0000","last_undegraded":"2024-05-07T13:58:13.184102+0000","last_fullsized":"2024-05-07T13:58:13.184102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.138495+0000","last_change":"2024-05-07T13:59:26.138549+0000","last_active":"2024-05-07T13:59:26.138495+0000","last_peered":"2024-05-07T13:59:26.138495+0000","last_clean":"2024-05-07T13:59:26.138495+0000","last_became_active":"2024-05-07T13:55:52.324639+0000","last_became_peered":"2024-05-07T13:55:52.324639+0000","last_unstale":"2024-05-07T13:59:26.138495+0000","last_undegraded":"2024-05-07T13:59:26.138495+0000","last_fullsized":"2024-05-07T13:59:26.138495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.138376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:46.117728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'48","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.012636+0000","last_change":"2024-05-07T13:59:19.012678+0000","last_active":"2024-05-07T13:59:19.012636+0000","last_peered":"2024-05-07T13:59:19.012636+0000","last_clean":"2024-05-07T13:59:19.012636+0000","last_became_active":"2024-05-07T13:55:54.330738+0000","last_became_peered":"2024-05-07T13:55:54.330738+0000","last_unstale":"2024-05-07T13:59:19.012636+0000","last_undegraded":"2024-05-07T13:59:19.012636+0000","last_fullsized":"2024-05-07T13:59:19.012636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.012548+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:59.656224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.078706+0000","last_change":"2024-05-07T13:59:11.078729+0000","last_active":"2024-05-07T13:59:11.078706+0000","last_peered":"2024-05-07T13:59:11.078706+0000","last_clean":"2024-05-07T13:59:11.078706+0000","last_became_active":"2024-05-07T13:55:56.332844+0000","last_became_peered":"2024-05-07T13:55:56.332844+0000","last_unstale":"2024-05-07T13:59:11.078706+0000","last_undegraded":"2024-05-07T13:59:11.078706+0000","last_fullsized":"2024-05-07T13:59:11.078706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.078592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:40.007846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:28.184972+0000","last_change":"2024-05-07T13:55:58.348258+0000","last_active":"2024-05-07T13:58:28.184972+0000","last_peered":"2024-05-07T13:58:28.184972+0000","last_clean":"2024-05-07T13:58:28.184972+0000","last_became_active":"2024-05-07T13:55:58.347598+0000","last_became_peered":"2024-05-07T13:55:58.347598+0000","last_unstale":"2024-05-07T13:58:28.184972+0000","last_undegraded":"2024-05-07T13:58:28.184972+0000","last_fullsized":"2024-05-07T13:58:28.184972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'14","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.025831+0000","last_change":"2024-05-07T13:59:28.025859+0000","last_active":"2024-05-07T13:59:28.025831+0000","last_peered":"2024-05-07T13:59:28.025831+0000","last_clean":"2024-05-07T13:59:28.025831+0000","last_became_active":"2024-05-07T13:55:50.326430+0000","last_became_peered":"2024-05-07T13:55:50.326430+0000","last_unstale":"2024-05-07T13:59:28.025831+0000","last_undegraded":"2024-05-07T13:59:28.025831+0000","last_fullsized":"2024-05-07T13:59:28.025831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.025734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:38.245824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182021+0000","last_change":"2024-05-07T13:55:48.332048+0000","last_active":"2024-05-07T13:58:13.182021+0000","last_peered":"2024-05-07T13:58:13.182021+0000","last_clean":"2024-05-07T13:58:13.182021+0000","last_became_active":"2024-05-07T13:55:48.331660+0000","last_became_peered":"2024-05-07T13:55:48.331660+0000","last_unstale":"2024-05-07T13:58:13.182021+0000","last_undegraded":"2024-05-07T13:58:13.182021+0000","last_fullsized":"2024-05-07T13:58:13.182021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.845806+0000","last_change":"2024-05-07T13:59:10.845836+0000","last_active":"2024-05-07T13:59:10.845806+0000","last_peered":"2024-05-07T13:59:10.845806+0000","last_clean":"2024-05-07T13:59:10.845806+0000","last_became_active":"2024-05-07T13:55:52.320520+0000","last_became_peered":"2024-05-07T13:55:52.320520+0000","last_unstale":"2024-05-07T13:59:10.845806+0000","last_undegraded":"2024-05-07T13:59:10.845806+0000","last_fullsized":"2024-05-07T13:59:10.845806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.845698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:25:38.217921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.157708+0000","last_change":"2024-05-07T13:59:23.157743+0000","last_active":"2024-05-07T13:59:23.157708+0000","last_peered":"2024-05-07T13:59:23.157708+0000","last_clean":"2024-05-07T13:59:23.157708+0000","last_became_active":"2024-05-07T13:55:54.320266+0000","last_became_peered":"2024-05-07T13:55:54.320266+0000","last_unstale":"2024-05-07T13:59:23.157708+0000","last_undegraded":"2024-05-07T13:59:23.157708+0000","last_fullsized":"2024-05-07T13:59:23.157708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.157605+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:28.358470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.079062+0000","last_change":"2024-05-07T13:59:15.079086+0000","last_active":"2024-05-07T13:59:15.079062+0000","last_peered":"2024-05-07T13:59:15.079062+0000","last_clean":"2024-05-07T13:59:15.079062+0000","last_became_active":"2024-05-07T13:55:56.330251+0000","last_became_peered":"2024-05-07T13:55:56.330251+0000","last_unstale":"2024-05-07T13:59:15.079062+0000","last_undegraded":"2024-05-07T13:59:15.079062+0000","last_fullsized":"2024-05-07T13:59:15.079062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:55.222720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149900+0000","last_change":"2024-05-07T13:55:50.323450+0000","last_active":"2024-05-07T13:58:59.149900+0000","last_peered":"2024-05-07T13:58:59.149900+0000","last_clean":"2024-05-07T13:58:59.149900+0000","last_became_active":"2024-05-07T13:55:50.323159+0000","last_became_peered":"2024-05-07T13:55:50.323159+0000","last_unstale":"2024-05-07T13:58:59.149900+0000","last_undegraded":"2024-05-07T13:58:59.149900+0000","last_fullsized":"2024-05-07T13:58:59.149900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182255+0000","last_change":"2024-05-07T13:55:48.352309+0000","last_active":"2024-05-07T13:58:13.182255+0000","last_peered":"2024-05-07T13:58:13.182255+0000","last_clean":"2024-05-07T13:58:13.182255+0000","last_became_active":"2024-05-07T13:55:48.350462+0000","last_became_peered":"2024-05-07T13:55:48.350462+0000","last_unstale":"2024-05-07T13:58:13.182255+0000","last_undegraded":"2024-05-07T13:58:13.182255+0000","last_fullsized":"2024-05-07T13:58:13.182255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.177573+0000","last_change":"2024-05-07T13:55:52.321486+0000","last_active":"2024-05-07T13:57:53.177573+0000","last_peered":"2024-05-07T13:57:53.177573+0000","last_clean":"2024-05-07T13:57:53.177573+0000","last_became_active":"2024-05-07T13:55:52.321171+0000","last_became_peered":"2024-05-07T13:55:52.321171+0000","last_unstale":"2024-05-07T13:57:53.177573+0000","last_undegraded":"2024-05-07T13:57:53.177573+0000","last_fullsized":"2024-05-07T13:57:53.177573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.985304+0000","last_change":"2024-05-07T13:59:23.985348+0000","last_active":"2024-05-07T13:59:23.985304+0000","last_peered":"2024-05-07T13:59:23.985304+0000","last_clean":"2024-05-07T13:59:23.985304+0000","last_became_active":"2024-05-07T13:55:54.319819+0000","last_became_peered":"2024-05-07T13:55:54.319819+0000","last_unstale":"2024-05-07T13:59:23.985304+0000","last_undegraded":"2024-05-07T13:59:23.985304+0000","last_fullsized":"2024-05-07T13:59:23.985304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.985209+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:20.683798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.078791+0000","last_change":"2024-05-07T13:59:14.078817+0000","last_active":"2024-05-07T13:59:14.078791+0000","last_peered":"2024-05-07T13:59:14.078791+0000","last_clean":"2024-05-07T13:59:14.078791+0000","last_became_active":"2024-05-07T13:55:56.330190+0000","last_became_peered":"2024-05-07T13:55:56.330190+0000","last_unstale":"2024-05-07T13:59:14.078791+0000","last_undegraded":"2024-05-07T13:59:14.078791+0000","last_fullsized":"2024-05-07T13:59:14.078791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.078700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:50:02.500890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.181130+0000","last_change":"2024-05-07T13:55:58.341039+0000","last_active":"2024-05-07T13:58:18.181130+0000","last_peered":"2024-05-07T13:58:18.181130+0000","last_clean":"2024-05-07T13:58:18.181130+0000","last_became_active":"2024-05-07T13:55:58.340674+0000","last_became_peered":"2024-05-07T13:55:58.340674+0000","last_unstale":"2024-05-07T13:58:18.181130+0000","last_undegraded":"2024-05-07T13:58:18.181130+0000","last_fullsized":"2024-05-07T13:58:18.181130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415320+0000","last_change":"2024-05-07T13:55:50.318936+0000","last_active":"2024-05-07T13:58:59.415320+0000","last_peered":"2024-05-07T13:58:59.415320+0000","last_clean":"2024-05-07T13:58:59.415320+0000","last_became_active":"2024-05-07T13:55:50.318546+0000","last_became_peered":"2024-05-07T13:55:50.318546+0000","last_unstale":"2024-05-07T13:58:59.415320+0000","last_undegraded":"2024-05-07T13:58:59.415320+0000","last_fullsized":"2024-05-07T13:58:59.415320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181785+0000","last_change":"2024-05-07T13:55:48.332704+0000","last_active":"2024-05-07T13:58:13.181785+0000","last_peered":"2024-05-07T13:58:13.181785+0000","last_clean":"2024-05-07T13:58:13.181785+0000","last_became_active":"2024-05-07T13:55:48.331278+0000","last_became_peered":"2024-05-07T13:55:48.331278+0000","last_unstale":"2024-05-07T13:58:13.181785+0000","last_undegraded":"2024-05-07T13:58:13.181785+0000","last_fullsized":"2024-05-07T13:58:13.181785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.182238+0000","last_change":"2024-05-07T13:55:52.317997+0000","last_active":"2024-05-07T13:57:58.182238+0000","last_peered":"2024-05-07T13:57:58.182238+0000","last_clean":"2024-05-07T13:57:58.182238+0000","last_became_active":"2024-05-07T13:55:52.317564+0000","last_became_peered":"2024-05-07T13:55:52.317564+0000","last_unstale":"2024-05-07T13:57:58.182238+0000","last_undegraded":"2024-05-07T13:57:58.182238+0000","last_fullsized":"2024-05-07T13:57:58.182238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'40","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.224333+0000","last_change":"2024-05-07T13:55:54.330150+0000","last_active":"2024-05-07T13:59:06.224333+0000","last_peered":"2024-05-07T13:59:06.224333+0000","last_clean":"2024-05-07T13:59:06.224333+0000","last_became_active":"2024-05-07T13:55:54.329443+0000","last_became_peered":"2024-05-07T13:55:54.329443+0000","last_unstale":"2024-05-07T13:59:06.224333+0000","last_undegraded":"2024-05-07T13:59:06.224333+0000","last_fullsized":"2024-05-07T13:59:06.224333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:28.184289+0000","last_change":"2024-05-07T13:55:56.344810+0000","last_active":"2024-05-07T13:58:28.184289+0000","last_peered":"2024-05-07T13:58:28.184289+0000","last_clean":"2024-05-07T13:58:28.184289+0000","last_became_active":"2024-05-07T13:55:56.344470+0000","last_became_peered":"2024-05-07T13:55:56.344470+0000","last_unstale":"2024-05-07T13:58:28.184289+0000","last_undegraded":"2024-05-07T13:58:28.184289+0000","last_fullsized":"2024-05-07T13:58:28.184289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.147041+0000","last_change":"2024-05-07T13:55:58.351086+0000","last_active":"2024-05-07T13:58:59.147041+0000","last_peered":"2024-05-07T13:58:59.147041+0000","last_clean":"2024-05-07T13:58:59.147041+0000","last_became_active":"2024-05-07T13:55:58.350796+0000","last_became_peered":"2024-05-07T13:55:58.350796+0000","last_unstale":"2024-05-07T13:58:59.147041+0000","last_undegraded":"2024-05-07T13:58:59.147041+0000","last_fullsized":"2024-05-07T13:58:59.147041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.935454+0000","last_change":"2024-05-07T13:59:23.935508+0000","last_active":"2024-05-07T13:59:23.935454+0000","last_peered":"2024-05-07T13:59:23.935454+0000","last_clean":"2024-05-07T13:59:23.935454+0000","last_became_active":"2024-05-07T13:55:50.326424+0000","last_became_peered":"2024-05-07T13:55:50.326424+0000","last_unstale":"2024-05-07T13:59:23.935454+0000","last_undegraded":"2024-05-07T13:59:23.935454+0000","last_fullsized":"2024-05-07T13:59:23.935454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.935328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:15.191912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.210678+0000","last_change":"2024-05-07T13:55:48.342464+0000","last_active":"2024-05-07T13:59:06.210678+0000","last_peered":"2024-05-07T13:59:06.210678+0000","last_clean":"2024-05-07T13:59:06.210678+0000","last_became_active":"2024-05-07T13:55:48.342072+0000","last_became_peered":"2024-05-07T13:55:48.342072+0000","last_unstale":"2024-05-07T13:59:06.210678+0000","last_undegraded":"2024-05-07T13:59:06.210678+0000","last_fullsized":"2024-05-07T13:59:06.210678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.185321+0000","last_change":"2024-05-07T13:55:52.318946+0000","last_active":"2024-05-07T13:58:23.185321+0000","last_peered":"2024-05-07T13:58:23.185321+0000","last_clean":"2024-05-07T13:58:23.185321+0000","last_became_active":"2024-05-07T13:55:52.318605+0000","last_became_peered":"2024-05-07T13:55:52.318605+0000","last_unstale":"2024-05-07T13:58:23.185321+0000","last_undegraded":"2024-05-07T13:58:23.185321+0000","last_fullsized":"2024-05-07T13:58:23.185321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.957010+0000","last_change":"2024-05-07T13:59:22.957062+0000","last_active":"2024-05-07T13:59:22.957010+0000","last_peered":"2024-05-07T13:59:22.957010+0000","last_clean":"2024-05-07T13:59:22.957010+0000","last_became_active":"2024-05-07T13:55:54.326599+0000","last_became_peered":"2024-05-07T13:55:54.326599+0000","last_unstale":"2024-05-07T13:59:22.957010+0000","last_undegraded":"2024-05-07T13:59:22.957010+0000","last_fullsized":"2024-05-07T13:59:22.957010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.956910+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:05.203075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:09.875280+0000","last_change":"2024-05-07T13:59:09.875299+0000","last_active":"2024-05-07T13:59:09.875280+0000","last_peered":"2024-05-07T13:59:09.875280+0000","last_clean":"2024-05-07T13:59:09.875280+0000","last_became_active":"2024-05-07T13:55:56.334226+0000","last_became_peered":"2024-05-07T13:55:56.334226+0000","last_unstale":"2024-05-07T13:59:09.875280+0000","last_undegraded":"2024-05-07T13:59:09.875280+0000","last_fullsized":"2024-05-07T13:59:09.875280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_clean_scrub_stamp":"2024-05-07T13:59:09.875192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:33.279728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183272+0000","last_change":"2024-05-07T13:55:58.352585+0000","last_active":"2024-05-07T13:58:18.183272+0000","last_peered":"2024-05-07T13:58:18.183272+0000","last_clean":"2024-05-07T13:58:18.183272+0000","last_became_active":"2024-05-07T13:55:58.352263+0000","last_became_peered":"2024-05-07T13:55:58.352263+0000","last_unstale":"2024-05-07T13:58:18.183272+0000","last_undegraded":"2024-05-07T13:58:18.183272+0000","last_fullsized":"2024-05-07T13:58:18.183272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.182039+0000","last_change":"2024-05-07T13:55:50.313466+0000","last_active":"2024-05-07T13:58:23.182039+0000","last_peered":"2024-05-07T13:58:23.182039+0000","last_clean":"2024-05-07T13:58:23.182039+0000","last_became_active":"2024-05-07T13:55:50.312852+0000","last_became_peered":"2024-05-07T13:55:50.312852+0000","last_unstale":"2024-05-07T13:58:23.182039+0000","last_undegraded":"2024-05-07T13:58:23.182039+0000","last_fullsized":"2024-05-07T13:58:23.182039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183378+0000","last_change":"2024-05-07T13:55:48.351068+0000","last_active":"2024-05-07T13:58:18.183378+0000","last_peered":"2024-05-07T13:58:18.183378+0000","last_clean":"2024-05-07T13:58:18.183378+0000","last_became_active":"2024-05-07T13:55:48.348476+0000","last_became_peered":"2024-05-07T13:55:48.348476+0000","last_unstale":"2024-05-07T13:58:18.183378+0000","last_undegraded":"2024-05-07T13:58:18.183378+0000","last_fullsized":"2024-05-07T13:58:18.183378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.019050+0000","last_change":"2024-05-07T13:59:21.019075+0000","last_active":"2024-05-07T13:59:21.019050+0000","last_peered":"2024-05-07T13:59:21.019050+0000","last_clean":"2024-05-07T13:59:21.019050+0000","last_became_active":"2024-05-07T13:55:52.322431+0000","last_became_peered":"2024-05-07T13:55:52.322431+0000","last_unstale":"2024-05-07T13:59:21.019050+0000","last_undegraded":"2024-05-07T13:59:21.019050+0000","last_fullsized":"2024-05-07T13:59:21.019050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.018959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:33:21.518908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.180174+0000","last_change":"2024-05-07T13:55:54.329901+0000","last_active":"2024-05-07T13:57:58.180174+0000","last_peered":"2024-05-07T13:57:58.180174+0000","last_clean":"2024-05-07T13:57:58.180174+0000","last_became_active":"2024-05-07T13:55:54.329539+0000","last_became_peered":"2024-05-07T13:55:54.329539+0000","last_unstale":"2024-05-07T13:57:58.180174+0000","last_undegraded":"2024-05-07T13:57:58.180174+0000","last_fullsized":"2024-05-07T13:57:58.180174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:53.305795+0000","last_clean_scrub_stamp":"2024-05-07T13:55:53.305795+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":418,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.068007+0000","last_change":"2024-05-07T13:59:16.068040+0000","last_active":"2024-05-07T13:59:16.068007+0000","last_peered":"2024-05-07T13:59:16.068007+0000","last_clean":"2024-05-07T13:59:16.068007+0000","last_became_active":"2024-05-07T13:55:56.338021+0000","last_became_peered":"2024-05-07T13:55:56.338021+0000","last_unstale":"2024-05-07T13:59:16.068007+0000","last_undegraded":"2024-05-07T13:59:16.068007+0000","last_fullsized":"2024-05-07T13:59:16.068007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.067904+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:55:00.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183170+0000","last_change":"2024-05-07T13:55:58.351904+0000","last_active":"2024-05-07T13:58:18.183170+0000","last_peered":"2024-05-07T13:58:18.183170+0000","last_clean":"2024-05-07T13:58:18.183170+0000","last_became_active":"2024-05-07T13:55:58.351616+0000","last_became_peered":"2024-05-07T13:55:58.351616+0000","last_unstale":"2024-05-07T13:58:18.183170+0000","last_undegraded":"2024-05-07T13:58:18.183170+0000","last_fullsized":"2024-05-07T13:58:18.183170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.591914+0000","last_change":"2024-05-07T13:55:50.313284+0000","last_active":"2024-05-07T13:58:59.591914+0000","last_peered":"2024-05-07T13:58:59.591914+0000","last_clean":"2024-05-07T13:58:59.591914+0000","last_became_active":"2024-05-07T13:55:50.313016+0000","last_became_peered":"2024-05-07T13:55:50.313016+0000","last_unstale":"2024-05-07T13:58:59.591914+0000","last_undegraded":"2024-05-07T13:58:59.591914+0000","last_fullsized":"2024-05-07T13:58:59.591914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.182718+0000","last_change":"2024-05-07T13:55:48.340087+0000","last_active":"2024-05-07T13:58:18.182718+0000","last_peered":"2024-05-07T13:58:18.182718+0000","last_clean":"2024-05-07T13:58:18.182718+0000","last_became_active":"2024-05-07T13:55:48.339639+0000","last_became_peered":"2024-05-07T13:55:48.339639+0000","last_unstale":"2024-05-07T13:58:18.182718+0000","last_undegraded":"2024-05-07T13:58:18.182718+0000","last_fullsized":"2024-05-07T13:58:18.182718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.058938+0000","last_change":"2024-05-07T13:59:18.058974+0000","last_active":"2024-05-07T13:59:18.058938+0000","last_peered":"2024-05-07T13:59:18.058938+0000","last_clean":"2024-05-07T13:59:18.058938+0000","last_became_active":"2024-05-07T13:55:52.324567+0000","last_became_peered":"2024-05-07T13:55:52.324567+0000","last_unstale":"2024-05-07T13:59:18.058938+0000","last_undegraded":"2024-05-07T13:59:18.058938+0000","last_fullsized":"2024-05-07T13:59:18.058938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.058848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:48:50.227510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.085639+0000","last_change":"2024-05-07T13:59:16.085684+0000","last_active":"2024-05-07T13:59:16.085639+0000","last_peered":"2024-05-07T13:59:16.085639+0000","last_clean":"2024-05-07T13:59:16.085639+0000","last_became_active":"2024-05-07T13:55:54.329220+0000","last_became_peered":"2024-05-07T13:55:54.329220+0000","last_unstale":"2024-05-07T13:59:16.085639+0000","last_undegraded":"2024-05-07T13:59:16.085639+0000","last_fullsized":"2024-05-07T13:59:16.085639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.085538+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:26.485669+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.922656+0000","last_change":"2024-05-07T13:59:14.922682+0000","last_active":"2024-05-07T13:59:14.922656+0000","last_peered":"2024-05-07T13:59:14.922656+0000","last_clean":"2024-05-07T13:59:14.922656+0000","last_became_active":"2024-05-07T13:55:56.333373+0000","last_became_peered":"2024-05-07T13:55:56.333373+0000","last_unstale":"2024-05-07T13:59:14.922656+0000","last_undegraded":"2024-05-07T13:59:14.922656+0000","last_fullsized":"2024-05-07T13:59:14.922656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.922551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:15.327295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.183556+0000","last_change":"2024-05-07T13:55:58.347910+0000","last_active":"2024-05-07T13:58:23.183556+0000","last_peered":"2024-05-07T13:58:23.183556+0000","last_clean":"2024-05-07T13:58:23.183556+0000","last_became_active":"2024-05-07T13:55:58.347327+0000","last_became_peered":"2024-05-07T13:55:58.347327+0000","last_unstale":"2024-05-07T13:58:23.183556+0000","last_undegraded":"2024-05-07T13:58:23.183556+0000","last_fullsized":"2024-05-07T13:58:23.183556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.185253+0000","last_change":"2024-05-07T13:55:50.311670+0000","last_active":"2024-05-07T13:58:23.185253+0000","last_peered":"2024-05-07T13:58:23.185253+0000","last_clean":"2024-05-07T13:58:23.185253+0000","last_became_active":"2024-05-07T13:55:50.311340+0000","last_became_peered":"2024-05-07T13:55:50.311340+0000","last_unstale":"2024-05-07T13:58:23.185253+0000","last_undegraded":"2024-05-07T13:58:23.185253+0000","last_fullsized":"2024-05-07T13:58:23.185253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183485+0000","last_change":"2024-05-07T13:55:48.351060+0000","last_active":"2024-05-07T13:58:18.183485+0000","last_peered":"2024-05-07T13:58:18.183485+0000","last_clean":"2024-05-07T13:58:18.183485+0000","last_became_active":"2024-05-07T13:55:48.349589+0000","last_became_peered":"2024-05-07T13:55:48.349589+0000","last_unstale":"2024-05-07T13:58:18.183485+0000","last_undegraded":"2024-05-07T13:58:18.183485+0000","last_fullsized":"2024-05-07T13:58:18.183485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.160962+0000","last_change":"2024-05-07T13:59:27.160985+0000","last_active":"2024-05-07T13:59:27.160962+0000","last_peered":"2024-05-07T13:59:27.160962+0000","last_clean":"2024-05-07T13:59:27.160962+0000","last_became_active":"2024-05-07T13:55:52.323548+0000","last_became_peered":"2024-05-07T13:55:52.323548+0000","last_unstale":"2024-05-07T13:59:27.160962+0000","last_undegraded":"2024-05-07T13:59:27.160962+0000","last_fullsized":"2024-05-07T13:59:27.160962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.160877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:40.043412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.984564+0000","last_change":"2024-05-07T13:59:19.984633+0000","last_active":"2024-05-07T13:59:19.984564+0000","last_peered":"2024-05-07T13:59:19.984564+0000","last_clean":"2024-05-07T13:59:19.984564+0000","last_became_active":"2024-05-07T13:55:54.326844+0000","last_became_peered":"2024-05-07T13:55:54.326844+0000","last_unstale":"2024-05-07T13:59:19.984564+0000","last_undegraded":"2024-05-07T13:59:19.984564+0000","last_fullsized":"2024-05-07T13:59:19.984564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.984455+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:13.620566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184109+0000","last_change":"2024-05-07T13:55:56.345203+0000","last_active":"2024-05-07T13:58:23.184109+0000","last_peered":"2024-05-07T13:58:23.184109+0000","last_clean":"2024-05-07T13:58:23.184109+0000","last_became_active":"2024-05-07T13:55:56.344885+0000","last_became_peered":"2024-05-07T13:55:56.344885+0000","last_unstale":"2024-05-07T13:58:23.184109+0000","last_undegraded":"2024-05-07T13:58:23.184109+0000","last_fullsized":"2024-05-07T13:58:23.184109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184338+0000","last_change":"2024-05-07T13:55:58.348158+0000","last_active":"2024-05-07T13:58:23.184338+0000","last_peered":"2024-05-07T13:58:23.184338+0000","last_clean":"2024-05-07T13:58:23.184338+0000","last_became_active":"2024-05-07T13:55:58.347850+0000","last_became_peered":"2024-05-07T13:55:58.347850+0000","last_unstale":"2024-05-07T13:58:23.184338+0000","last_undegraded":"2024-05-07T13:58:23.184338+0000","last_fullsized":"2024-05-07T13:58:23.184338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'20","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509760+0000","last_change":"2024-05-07T13:55:50.325227+0000","last_active":"2024-05-07T13:58:59.509760+0000","last_peered":"2024-05-07T13:58:59.509760+0000","last_clean":"2024-05-07T13:58:59.509760+0000","last_became_active":"2024-05-07T13:55:50.324745+0000","last_became_peered":"2024-05-07T13:55:50.324745+0000","last_unstale":"2024-05-07T13:58:59.509760+0000","last_undegraded":"2024-05-07T13:58:59.509760+0000","last_fullsized":"2024-05-07T13:58:59.509760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.176894+0000","last_change":"2024-05-07T13:55:48.324008+0000","last_active":"2024-05-07T13:57:48.176894+0000","last_peered":"2024-05-07T13:57:48.176894+0000","last_clean":"2024-05-07T13:57:48.176894+0000","last_became_active":"2024-05-07T13:55:48.323125+0000","last_became_peered":"2024-05-07T13:55:48.323125+0000","last_unstale":"2024-05-07T13:57:48.176894+0000","last_undegraded":"2024-05-07T13:57:48.176894+0000","last_fullsized":"2024-05-07T13:57:48.176894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.003899+0000","last_change":"2024-05-07T13:59:22.003923+0000","last_active":"2024-05-07T13:59:22.003899+0000","last_peered":"2024-05-07T13:59:22.003899+0000","last_clean":"2024-05-07T13:59:22.003899+0000","last_became_active":"2024-05-07T13:55:52.322012+0000","last_became_peered":"2024-05-07T13:55:52.322012+0000","last_unstale":"2024-05-07T13:59:22.003899+0000","last_undegraded":"2024-05-07T13:59:22.003899+0000","last_fullsized":"2024-05-07T13:59:22.003899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.003807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:25:31.144648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'31","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.881145+0000","last_change":"2024-05-07T13:59:20.881181+0000","last_active":"2024-05-07T13:59:20.881145+0000","last_peered":"2024-05-07T13:59:20.881145+0000","last_clean":"2024-05-07T13:59:20.881145+0000","last_became_active":"2024-05-07T13:55:54.326758+0000","last_became_peered":"2024-05-07T13:55:54.326758+0000","last_unstale":"2024-05-07T13:59:20.881145+0000","last_undegraded":"2024-05-07T13:59:20.881145+0000","last_fullsized":"2024-05-07T13:59:20.881145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.881054+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:08.116261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:28.184871+0000","last_change":"2024-05-07T13:55:56.346233+0000","last_active":"2024-05-07T13:58:28.184871+0000","last_peered":"2024-05-07T13:58:28.184871+0000","last_clean":"2024-05-07T13:58:28.184871+0000","last_became_active":"2024-05-07T13:55:56.345933+0000","last_became_peered":"2024-05-07T13:55:56.345933+0000","last_unstale":"2024-05-07T13:58:28.184871+0000","last_undegraded":"2024-05-07T13:58:28.184871+0000","last_fullsized":"2024-05-07T13:58:28.184871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184263+0000","last_change":"2024-05-07T13:55:58.349147+0000","last_active":"2024-05-07T13:58:23.184263+0000","last_peered":"2024-05-07T13:58:23.184263+0000","last_clean":"2024-05-07T13:58:23.184263+0000","last_became_active":"2024-05-07T13:55:58.348763+0000","last_became_peered":"2024-05-07T13:55:58.348763+0000","last_unstale":"2024-05-07T13:58:23.184263+0000","last_undegraded":"2024-05-07T13:58:23.184263+0000","last_fullsized":"2024-05-07T13:58:23.184263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415091+0000","last_change":"2024-05-07T13:55:50.313977+0000","last_active":"2024-05-07T13:58:59.415091+0000","last_peered":"2024-05-07T13:58:59.415091+0000","last_clean":"2024-05-07T13:58:59.415091+0000","last_became_active":"2024-05-07T13:55:50.312605+0000","last_became_peered":"2024-05-07T13:55:50.312605+0000","last_unstale":"2024-05-07T13:58:59.415091+0000","last_undegraded":"2024-05-07T13:58:59.415091+0000","last_fullsized":"2024-05-07T13:58:59.415091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179134+0000","last_change":"2024-05-07T13:55:48.333628+0000","last_active":"2024-05-07T13:57:53.179134+0000","last_peered":"2024-05-07T13:57:53.179134+0000","last_clean":"2024-05-07T13:57:53.179134+0000","last_became_active":"2024-05-07T13:55:48.333254+0000","last_became_peered":"2024-05-07T13:55:48.333254+0000","last_unstale":"2024-05-07T13:57:53.179134+0000","last_undegraded":"2024-05-07T13:57:53.179134+0000","last_fullsized":"2024-05-07T13:57:53.179134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.057867+0000","last_change":"2024-05-07T13:59:26.057899+0000","last_active":"2024-05-07T13:59:26.057867+0000","last_peered":"2024-05-07T13:59:26.057867+0000","last_clean":"2024-05-07T13:59:26.057867+0000","last_became_active":"2024-05-07T13:55:52.321982+0000","last_became_peered":"2024-05-07T13:55:52.321982+0000","last_unstale":"2024-05-07T13:59:26.057867+0000","last_undegraded":"2024-05-07T13:59:26.057867+0000","last_fullsized":"2024-05-07T13:59:26.057867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.057767+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:23.143125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.876939+0000","last_change":"2024-05-07T13:59:16.876994+0000","last_active":"2024-05-07T13:59:16.876939+0000","last_peered":"2024-05-07T13:59:16.876939+0000","last_clean":"2024-05-07T13:59:16.876939+0000","last_became_active":"2024-05-07T13:55:54.326895+0000","last_became_peered":"2024-05-07T13:55:54.326895+0000","last_unstale":"2024-05-07T13:59:16.876939+0000","last_undegraded":"2024-05-07T13:59:16.876939+0000","last_fullsized":"2024-05-07T13:59:16.876939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.876843+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:35.990453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:28.182641+0000","last_change":"2024-05-07T13:55:56.343265+0000","last_active":"2024-05-07T13:58:28.182641+0000","last_peered":"2024-05-07T13:58:28.182641+0000","last_clean":"2024-05-07T13:58:28.182641+0000","last_became_active":"2024-05-07T13:55:56.343002+0000","last_became_peered":"2024-05-07T13:55:56.343002+0000","last_unstale":"2024-05-07T13:58:28.182641+0000","last_undegraded":"2024-05-07T13:58:28.182641+0000","last_fullsized":"2024-05-07T13:58:28.182641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.665404+0000","last_change":"2024-05-07T13:55:58.348783+0000","last_active":"2024-05-07T13:58:59.665404+0000","last_peered":"2024-05-07T13:58:59.665404+0000","last_clean":"2024-05-07T13:58:59.665404+0000","last_became_active":"2024-05-07T13:55:58.347820+0000","last_became_peered":"2024-05-07T13:55:58.347820+0000","last_unstale":"2024-05-07T13:58:59.665404+0000","last_undegraded":"2024-05-07T13:58:59.665404+0000","last_fullsized":"2024-05-07T13:58:59.665404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.478002+0000","last_change":"2024-05-07T13:55:50.330476+0000","last_active":"2024-05-07T13:58:59.478002+0000","last_peered":"2024-05-07T13:58:59.478002+0000","last_clean":"2024-05-07T13:58:59.478002+0000","last_became_active":"2024-05-07T13:55:50.330166+0000","last_became_peered":"2024-05-07T13:55:50.330166+0000","last_unstale":"2024-05-07T13:58:59.478002+0000","last_undegraded":"2024-05-07T13:58:59.478002+0000","last_fullsized":"2024-05-07T13:58:59.478002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.181409+0000","last_change":"2024-05-07T13:55:48.339261+0000","last_active":"2024-05-07T13:57:53.181409+0000","last_peered":"2024-05-07T13:57:53.181409+0000","last_clean":"2024-05-07T13:57:53.181409+0000","last_became_active":"2024-05-07T13:55:48.338874+0000","last_became_peered":"2024-05-07T13:55:48.338874+0000","last_unstale":"2024-05-07T13:57:53.181409+0000","last_undegraded":"2024-05-07T13:57:53.181409+0000","last_fullsized":"2024-05-07T13:57:53.181409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149782+0000","last_change":"2024-05-07T13:55:50.311630+0000","last_active":"2024-05-07T13:58:59.149782+0000","last_peered":"2024-05-07T13:58:59.149782+0000","last_clean":"2024-05-07T13:58:59.149782+0000","last_became_active":"2024-05-07T13:55:50.311324+0000","last_became_peered":"2024-05-07T13:55:50.311324+0000","last_unstale":"2024-05-07T13:58:59.149782+0000","last_undegraded":"2024-05-07T13:58:59.149782+0000","last_fullsized":"2024-05-07T13:58:59.149782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.177461+0000","last_change":"2024-05-07T13:55:48.327068+0000","last_active":"2024-05-07T13:57:53.177461+0000","last_peered":"2024-05-07T13:57:53.177461+0000","last_clean":"2024-05-07T13:57:53.177461+0000","last_became_active":"2024-05-07T13:55:48.325561+0000","last_became_peered":"2024-05-07T13:55:48.325561+0000","last_unstale":"2024-05-07T13:57:53.177461+0000","last_undegraded":"2024-05-07T13:57:53.177461+0000","last_fullsized":"2024-05-07T13:57:53.177461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.983157+0000","last_change":"2024-05-07T13:59:25.983208+0000","last_active":"2024-05-07T13:59:25.983157+0000","last_peered":"2024-05-07T13:59:25.983157+0000","last_clean":"2024-05-07T13:59:25.983157+0000","last_became_active":"2024-05-07T13:55:50.326322+0000","last_became_peered":"2024-05-07T13:55:50.326322+0000","last_unstale":"2024-05-07T13:59:25.983157+0000","last_undegraded":"2024-05-07T13:59:25.983157+0000","last_fullsized":"2024-05-07T13:59:25.983157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.983056+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:20.815531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"27'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179336+0000","last_change":"2024-05-07T13:55:48.352058+0000","last_active":"2024-05-07T13:57:53.179336+0000","last_peered":"2024-05-07T13:57:53.179336+0000","last_clean":"2024-05-07T13:57:53.179336+0000","last_became_active":"2024-05-07T13:55:48.350385+0000","last_became_peered":"2024-05-07T13:55:48.350385+0000","last_unstale":"2024-05-07T13:57:53.179336+0000","last_undegraded":"2024-05-07T13:57:53.179336+0000","last_fullsized":"2024-05-07T13:57:53.179336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.591880+0000","last_change":"2024-05-07T13:55:50.313167+0000","last_active":"2024-05-07T13:58:59.591880+0000","last_peered":"2024-05-07T13:58:59.591880+0000","last_clean":"2024-05-07T13:58:59.591880+0000","last_became_active":"2024-05-07T13:55:50.312703+0000","last_became_peered":"2024-05-07T13:55:50.312703+0000","last_unstale":"2024-05-07T13:58:59.591880+0000","last_undegraded":"2024-05-07T13:58:59.591880+0000","last_fullsized":"2024-05-07T13:58:59.591880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.209243+0000","last_change":"2024-05-07T13:55:48.325914+0000","last_active":"2024-05-07T13:59:06.209243+0000","last_peered":"2024-05-07T13:59:06.209243+0000","last_clean":"2024-05-07T13:59:06.209243+0000","last_became_active":"2024-05-07T13:55:48.323979+0000","last_became_peered":"2024-05-07T13:55:48.323979+0000","last_unstale":"2024-05-07T13:59:06.209243+0000","last_undegraded":"2024-05-07T13:59:06.209243+0000","last_fullsized":"2024-05-07T13:59:06.209243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477009+0000","last_change":"2024-05-07T13:55:50.331631+0000","last_active":"2024-05-07T13:58:59.477009+0000","last_peered":"2024-05-07T13:58:59.477009+0000","last_clean":"2024-05-07T13:58:59.477009+0000","last_became_active":"2024-05-07T13:55:50.331311+0000","last_became_peered":"2024-05-07T13:55:50.331311+0000","last_unstale":"2024-05-07T13:58:59.477009+0000","last_undegraded":"2024-05-07T13:58:59.477009+0000","last_fullsized":"2024-05-07T13:58:59.477009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.209035+0000","last_change":"2024-05-07T13:55:48.326606+0000","last_active":"2024-05-07T13:59:06.209035+0000","last_peered":"2024-05-07T13:59:06.209035+0000","last_clean":"2024-05-07T13:59:06.209035+0000","last_became_active":"2024-05-07T13:55:48.325858+0000","last_became_peered":"2024-05-07T13:55:48.325858+0000","last_unstale":"2024-05-07T13:59:06.209035+0000","last_undegraded":"2024-05-07T13:59:06.209035+0000","last_fullsized":"2024-05-07T13:59:06.209035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.723813+0000","last_change":"2024-05-07T13:55:50.324360+0000","last_active":"2024-05-07T13:57:58.723813+0000","last_peered":"2024-05-07T13:57:58.723813+0000","last_clean":"2024-05-07T13:57:58.723813+0000","last_became_active":"2024-05-07T13:55:50.323573+0000","last_became_peered":"2024-05-07T13:55:50.323573+0000","last_unstale":"2024-05-07T13:57:58.723813+0000","last_undegraded":"2024-05-07T13:57:58.723813+0000","last_fullsized":"2024-05-07T13:57:58.723813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.179712+0000","last_change":"2024-05-07T13:55:48.334670+0000","last_active":"2024-05-07T13:57:58.179712+0000","last_peered":"2024-05-07T13:57:58.179712+0000","last_clean":"2024-05-07T13:57:58.179712+0000","last_became_active":"2024-05-07T13:55:48.334268+0000","last_became_peered":"2024-05-07T13:55:48.334268+0000","last_unstale":"2024-05-07T13:57:58.179712+0000","last_undegraded":"2024-05-07T13:57:58.179712+0000","last_fullsized":"2024-05-07T13:57:58.179712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477401+0000","last_change":"2024-05-07T13:55:50.320633+0000","last_active":"2024-05-07T13:58:59.477401+0000","last_peered":"2024-05-07T13:58:59.477401+0000","last_clean":"2024-05-07T13:58:59.477401+0000","last_became_active":"2024-05-07T13:55:50.320242+0000","last_became_peered":"2024-05-07T13:55:50.320242+0000","last_unstale":"2024-05-07T13:58:59.477401+0000","last_undegraded":"2024-05-07T13:58:59.477401+0000","last_fullsized":"2024-05-07T13:58:59.477401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.208972+0000","last_change":"2024-05-07T13:55:48.341172+0000","last_active":"2024-05-07T13:59:06.208972+0000","last_peered":"2024-05-07T13:59:06.208972+0000","last_clean":"2024-05-07T13:59:06.208972+0000","last_became_active":"2024-05-07T13:55:48.340718+0000","last_became_peered":"2024-05-07T13:55:48.340718+0000","last_unstale":"2024-05-07T13:59:06.208972+0000","last_undegraded":"2024-05-07T13:59:06.208972+0000","last_fullsized":"2024-05-07T13:59:06.208972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'11","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.591970+0000","last_change":"2024-05-07T13:55:50.320724+0000","last_active":"2024-05-07T13:58:59.591970+0000","last_peered":"2024-05-07T13:58:59.591970+0000","last_clean":"2024-05-07T13:58:59.591970+0000","last_became_active":"2024-05-07T13:55:50.320430+0000","last_became_peered":"2024-05-07T13:55:50.320430+0000","last_unstale":"2024-05-07T13:58:59.591970+0000","last_undegraded":"2024-05-07T13:58:59.591970+0000","last_fullsized":"2024-05-07T13:58:59.591970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178224+0000","last_change":"2024-05-07T13:55:48.324349+0000","last_active":"2024-05-07T13:57:58.178224+0000","last_peered":"2024-05-07T13:57:58.178224+0000","last_clean":"2024-05-07T13:57:58.178224+0000","last_became_active":"2024-05-07T13:55:48.323524+0000","last_became_peered":"2024-05-07T13:55:48.323524+0000","last_unstale":"2024-05-07T13:57:58.178224+0000","last_undegraded":"2024-05-07T13:57:58.178224+0000","last_fullsized":"2024-05-07T13:57:58.178224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182063+0000","last_change":"2024-05-07T13:55:50.313308+0000","last_active":"2024-05-07T13:58:13.182063+0000","last_peered":"2024-05-07T13:58:13.182063+0000","last_clean":"2024-05-07T13:58:13.182063+0000","last_became_active":"2024-05-07T13:55:50.313012+0000","last_became_peered":"2024-05-07T13:55:50.313012+0000","last_unstale":"2024-05-07T13:58:13.182063+0000","last_undegraded":"2024-05-07T13:58:13.182063+0000","last_fullsized":"2024-05-07T13:58:13.182063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.180034+0000","last_change":"2024-05-07T13:55:48.353515+0000","last_active":"2024-05-07T13:57:58.180034+0000","last_peered":"2024-05-07T13:57:58.180034+0000","last_clean":"2024-05-07T13:57:58.180034+0000","last_became_active":"2024-05-07T13:55:48.351882+0000","last_became_peered":"2024-05-07T13:55:48.351882+0000","last_unstale":"2024-05-07T13:57:58.180034+0000","last_undegraded":"2024-05-07T13:57:58.180034+0000","last_fullsized":"2024-05-07T13:57:58.180034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415648+0000","last_change":"2024-05-07T13:55:50.326172+0000","last_active":"2024-05-07T13:58:59.415648+0000","last_peered":"2024-05-07T13:58:59.415648+0000","last_clean":"2024-05-07T13:58:59.415648+0000","last_became_active":"2024-05-07T13:55:50.325807+0000","last_became_peered":"2024-05-07T13:55:50.325807+0000","last_unstale":"2024-05-07T13:58:59.415648+0000","last_undegraded":"2024-05-07T13:58:59.415648+0000","last_fullsized":"2024-05-07T13:58:59.415648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.178727+0000","last_change":"2024-05-07T13:55:48.326746+0000","last_active":"2024-05-07T13:58:03.178727+0000","last_peered":"2024-05-07T13:58:03.178727+0000","last_clean":"2024-05-07T13:58:03.178727+0000","last_became_active":"2024-05-07T13:55:48.324919+0000","last_became_peered":"2024-05-07T13:55:48.324919+0000","last_unstale":"2024-05-07T13:58:03.178727+0000","last_undegraded":"2024-05-07T13:58:03.178727+0000","last_fullsized":"2024-05-07T13:58:03.178727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.179720+0000","last_change":"2024-05-07T13:55:50.326002+0000","last_active":"2024-05-07T13:58:08.179720+0000","last_peered":"2024-05-07T13:58:08.179720+0000","last_clean":"2024-05-07T13:58:08.179720+0000","last_became_active":"2024-05-07T13:55:50.325620+0000","last_became_peered":"2024-05-07T13:55:50.325620+0000","last_unstale":"2024-05-07T13:58:08.179720+0000","last_undegraded":"2024-05-07T13:58:08.179720+0000","last_fullsized":"2024-05-07T13:58:08.179720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.209171+0000","last_change":"2024-05-07T13:55:48.342921+0000","last_active":"2024-05-07T13:59:06.209171+0000","last_peered":"2024-05-07T13:59:06.209171+0000","last_clean":"2024-05-07T13:59:06.209171+0000","last_became_active":"2024-05-07T13:55:48.342508+0000","last_became_peered":"2024-05-07T13:55:48.342508+0000","last_unstale":"2024-05-07T13:59:06.209171+0000","last_undegraded":"2024-05-07T13:59:06.209171+0000","last_fullsized":"2024-05-07T13:59:06.209171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.251949+0000","last_change":"2024-05-07T13:55:50.321908+0000","last_active":"2024-05-07T13:58:59.251949+0000","last_peered":"2024-05-07T13:58:59.251949+0000","last_clean":"2024-05-07T13:58:59.251949+0000","last_became_active":"2024-05-07T13:55:50.321606+0000","last_became_peered":"2024-05-07T13:55:50.321606+0000","last_unstale":"2024-05-07T13:58:59.251949+0000","last_undegraded":"2024-05-07T13:58:59.251949+0000","last_fullsized":"2024-05-07T13:58:59.251949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180438+0000","last_change":"2024-05-07T13:55:48.332694+0000","last_active":"2024-05-07T13:58:03.180438+0000","last_peered":"2024-05-07T13:58:03.180438+0000","last_clean":"2024-05-07T13:58:03.180438+0000","last_became_active":"2024-05-07T13:55:48.332247+0000","last_became_peered":"2024-05-07T13:55:48.332247+0000","last_unstale":"2024-05-07T13:58:03.180438+0000","last_undegraded":"2024-05-07T13:58:03.180438+0000","last_fullsized":"2024-05-07T13:58:03.180438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'16","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415172+0000","last_change":"2024-05-07T13:55:50.329959+0000","last_active":"2024-05-07T13:58:59.415172+0000","last_peered":"2024-05-07T13:58:59.415172+0000","last_clean":"2024-05-07T13:58:59.415172+0000","last_became_active":"2024-05-07T13:55:50.329434+0000","last_became_peered":"2024-05-07T13:55:50.329434+0000","last_unstale":"2024-05-07T13:58:59.415172+0000","last_undegraded":"2024-05-07T13:58:59.415172+0000","last_fullsized":"2024-05-07T13:58:59.415172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.500539+0000","last_change":"2024-05-07T13:55:48.348177+0000","last_active":"2024-05-07T13:58:59.500539+0000","last_peered":"2024-05-07T13:58:59.500539+0000","last_clean":"2024-05-07T13:58:59.500539+0000","last_became_active":"2024-05-07T13:55:48.345844+0000","last_became_peered":"2024-05-07T13:55:48.345844+0000","last_unstale":"2024-05-07T13:58:59.500539+0000","last_undegraded":"2024-05-07T13:58:59.500539+0000","last_fullsized":"2024-05-07T13:58:59.500539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181146+0000","last_change":"2024-05-07T13:55:50.313698+0000","last_active":"2024-05-07T13:58:08.181146+0000","last_peered":"2024-05-07T13:58:08.181146+0000","last_clean":"2024-05-07T13:58:08.181146+0000","last_became_active":"2024-05-07T13:55:50.313049+0000","last_became_peered":"2024-05-07T13:55:50.313049+0000","last_unstale":"2024-05-07T13:58:08.181146+0000","last_undegraded":"2024-05-07T13:58:08.181146+0000","last_fullsized":"2024-05-07T13:58:08.181146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.124677+0000","last_change":"2024-05-07T13:55:48.349780+0000","last_active":"2024-05-07T13:58:59.124677+0000","last_peered":"2024-05-07T13:58:59.124677+0000","last_clean":"2024-05-07T13:58:59.124677+0000","last_became_active":"2024-05-07T13:55:48.346691+0000","last_became_peered":"2024-05-07T13:55:48.346691+0000","last_unstale":"2024-05-07T13:58:59.124677+0000","last_undegraded":"2024-05-07T13:58:59.124677+0000","last_fullsized":"2024-05-07T13:58:59.124677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'10","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181589+0000","last_change":"2024-05-07T13:55:50.323717+0000","last_active":"2024-05-07T13:58:08.181589+0000","last_peered":"2024-05-07T13:58:08.181589+0000","last_clean":"2024-05-07T13:58:08.181589+0000","last_became_active":"2024-05-07T13:55:50.322543+0000","last_became_peered":"2024-05-07T13:55:50.322543+0000","last_unstale":"2024-05-07T13:58:08.181589+0000","last_undegraded":"2024-05-07T13:58:08.181589+0000","last_fullsized":"2024-05-07T13:58:08.181589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.183482+0000","last_change":"2024-05-07T13:55:48.340889+0000","last_active":"2024-05-07T13:58:08.183482+0000","last_peered":"2024-05-07T13:58:08.183482+0000","last_clean":"2024-05-07T13:58:08.183482+0000","last_became_active":"2024-05-07T13:55:48.339909+0000","last_became_peered":"2024-05-07T13:55:48.339909+0000","last_unstale":"2024-05-07T13:58:08.183482+0000","last_undegraded":"2024-05-07T13:58:08.183482+0000","last_fullsized":"2024-05-07T13:58:08.183482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415002+0000","last_change":"2024-05-07T13:55:50.323280+0000","last_active":"2024-05-07T13:58:59.415002+0000","last_peered":"2024-05-07T13:58:59.415002+0000","last_clean":"2024-05-07T13:58:59.415002+0000","last_became_active":"2024-05-07T13:55:50.322967+0000","last_became_peered":"2024-05-07T13:55:50.322967+0000","last_unstale":"2024-05-07T13:58:59.415002+0000","last_undegraded":"2024-05-07T13:58:59.415002+0000","last_fullsized":"2024-05-07T13:58:59.415002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.106002+0000","last_change":"2024-05-07T13:55:48.347208+0000","last_active":"2024-05-07T13:58:59.106002+0000","last_peered":"2024-05-07T13:58:59.106002+0000","last_clean":"2024-05-07T13:58:59.106002+0000","last_became_active":"2024-05-07T13:55:48.346724+0000","last_became_peered":"2024-05-07T13:55:48.346724+0000","last_unstale":"2024-05-07T13:58:59.106002+0000","last_undegraded":"2024-05-07T13:58:59.106002+0000","last_fullsized":"2024-05-07T13:58:59.106002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181538+0000","last_change":"2024-05-07T13:55:48.351645+0000","last_active":"2024-05-07T13:58:08.181538+0000","last_peered":"2024-05-07T13:58:08.181538+0000","last_clean":"2024-05-07T13:58:08.181538+0000","last_became_active":"2024-05-07T13:55:48.349852+0000","last_became_peered":"2024-05-07T13:55:48.349852+0000","last_unstale":"2024-05-07T13:58:08.181538+0000","last_undegraded":"2024-05-07T13:58:08.181538+0000","last_fullsized":"2024-05-07T13:58:08.181538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415308+0000","last_change":"2024-05-07T13:55:50.319944+0000","last_active":"2024-05-07T13:58:59.415308+0000","last_peered":"2024-05-07T13:58:59.415308+0000","last_clean":"2024-05-07T13:58:59.415308+0000","last_became_active":"2024-05-07T13:55:50.319033+0000","last_became_peered":"2024-05-07T13:55:50.319033+0000","last_unstale":"2024-05-07T13:58:59.415308+0000","last_undegraded":"2024-05-07T13:58:59.415308+0000","last_fullsized":"2024-05-07T13:58:59.415308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.179619+0000","last_change":"2024-05-07T13:55:48.326709+0000","last_active":"2024-05-07T13:58:08.179619+0000","last_peered":"2024-05-07T13:58:08.179619+0000","last_clean":"2024-05-07T13:58:08.179619+0000","last_became_active":"2024-05-07T13:55:48.324081+0000","last_became_peered":"2024-05-07T13:55:48.324081+0000","last_unstale":"2024-05-07T13:58:08.179619+0000","last_undegraded":"2024-05-07T13:58:08.179619+0000","last_fullsized":"2024-05-07T13:58:08.179619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.182791+0000","last_change":"2024-05-07T13:55:50.330143+0000","last_active":"2024-05-07T13:58:18.182791+0000","last_peered":"2024-05-07T13:58:18.182791+0000","last_clean":"2024-05-07T13:58:18.182791+0000","last_became_active":"2024-05-07T13:55:50.329848+0000","last_became_peered":"2024-05-07T13:55:50.329848+0000","last_unstale":"2024-05-07T13:58:18.182791+0000","last_undegraded":"2024-05-07T13:58:18.182791+0000","last_fullsized":"2024-05-07T13:58:18.182791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1488,"ondisk_log_size":1488,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705713,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":136605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":970752,"data_stored":724702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705713,"num_pgs":157,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":995328,"data_stored":724122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":401408,"data_stored":134585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T13:59:31.285 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.285 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.285 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.285 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.285 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.286 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.287 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.287 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.287 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.287 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.287 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.287 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.287 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.287 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.287 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.288 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.288 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.288 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.288 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.288 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.288 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.288 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.288 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.288 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.289 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.289 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.289 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.289 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.289 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.289 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.289 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.289 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.289 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.290 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.290 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.290 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.290 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.290 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.290 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.290 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.290 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.291 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.291 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.291 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.291 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.291 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.291 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.291 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.291 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.291 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.292 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.292 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.292 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.292 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.292 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.292 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.292 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.292 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.293 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.293 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.293 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.293 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.293 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.293 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.293 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.293 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.293 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.294 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.294 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.294 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.294 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.294 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.294 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.294 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.294 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.295 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.296 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.296 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.296 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.296 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.296 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.296 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.296 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.296 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.297 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.297 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.297 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.297 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.297 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.297 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.297 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.297 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.297 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.298 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.298 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.298 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.298 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.298 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.298 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.298 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.298 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.298 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.299 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.299 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.299 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.299 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.299 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.299 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.299 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.299 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.300 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.300 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.300 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.300 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.300 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.300 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.300 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.300 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.300 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.301 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.301 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-07T13:55:53.305795+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=53, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.301 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.301 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.301 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.301 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.301 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.301 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.302 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.302 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.302 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.302 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.302 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.302 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.302 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.302 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.302 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.303 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.303 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.303 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.303 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.303 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.303 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.303 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.303 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.303 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.304 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.305 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.306 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.306 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.306 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.306 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.306 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.306 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.306 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:31.306 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T13:59:51.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T13:59:51.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.435+0000 7ffb6b380640 1 Processor -- start 2024-05-07T13:59:51.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.435+0000 7ffb6b380640 1 -- start start 2024-05-07T13:59:51.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.435+0000 7ffb6b380640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffb6412c5b0 0x7ffb6412c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:51.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.435+0000 7ffb6b380640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb64113dd0 con 0x7ffb6412ced0 2024-05-07T13:59:51.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.435+0000 7ffb6b380640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ffb64072290 con 0x7ffb6412c5b0 2024-05-07T13:59:51.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.436+0000 7ffb6911c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffb6412c5b0 0x7ffb6412c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:51.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.436+0000 7ffb6891b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ffb6412ced0 0x7ffb6406e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37768/0 (socket says 172.21.15.22:37768) 2024-05-07T13:59:51.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.436+0000 7ffb6891b640 1 -- 172.21.15.22:0/986908767 learned_addr learned my addr 172.21.15.22:0/986908767 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T13:59:51.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.436+0000 7ffb6911c640 1 -- 172.21.15.22:0/986908767 >> v1:172.21.15.22:6789/0 conn(0x7ffb6412ced0 legacy=0x7ffb6406e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:51.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.436+0000 7ffb6911c640 1 -- 172.21.15.22:0/986908767 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6412c390 con 0x7ffb6412c5b0 2024-05-07T13:59:51.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.437+0000 7ffb6911c640 1 --2- 172.21.15.22:0/986908767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 0x7ffb6412c990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009d90 tx=0x7ffb6002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318bffa176483f4e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.437+0000 7ffb5bfff640 1 -- 172.21.15.22:0/986908767 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb60039070 con 0x7ffb6412c5b0 2024-05-07T13:59:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.437+0000 7ffb5bfff640 1 -- 172.21.15.22:0/986908767 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6002cb10 con 0x7ffb6412c5b0 2024-05-07T13:59:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.437+0000 7ffb5bfff640 1 -- 172.21.15.22:0/986908767 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6002ce10 con 0x7ffb6412c5b0 2024-05-07T13:59:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.437+0000 7ffb6b380640 1 -- 172.21.15.22:0/986908767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 msgr2=0x7ffb6412c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.437+0000 7ffb6b380640 1 --2- 172.21.15.22:0/986908767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 0x7ffb6412c990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009d90 tx=0x7ffb6002beb0 comp rx=0 tx=0).stop 2024-05-07T13:59:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.437+0000 7ffb6b380640 1 -- 172.21.15.22:0/986908767 shutdown_connections 2024-05-07T13:59:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.437+0000 7ffb6b380640 1 --2- 172.21.15.22:0/986908767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 0x7ffb6412c990 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:51.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.437+0000 7ffb6b380640 1 -- 172.21.15.22:0/986908767 >> 172.21.15.22:0/986908767 conn(0x7ffb64099380 msgr2=0x7ffb64099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:51.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.438+0000 7ffb6b380640 1 -- 172.21.15.22:0/986908767 shutdown_connections 2024-05-07T13:59:51.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.438+0000 7ffb6b380640 1 -- 172.21.15.22:0/986908767 wait complete. 2024-05-07T13:59:51.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.438+0000 7ffb6b380640 1 Processor -- start 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.438+0000 7ffb6b380640 1 -- start start 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.439+0000 7ffb6b380640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 0x7ffb641c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.439+0000 7ffb6b380640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64113b10 con 0x7ffb6412c5b0 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.439+0000 7ffb6911c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 0x7ffb641c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.439+0000 7ffb6911c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 0x7ffb641c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46778/0 (socket says 172.21.15.22:46778) 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.439+0000 7ffb6911c640 1 -- 172.21.15.22:0/92919018 learned_addr learned my addr 172.21.15.22:0/92919018 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.439+0000 7ffb6911c640 1 -- 172.21.15.22:0/92919018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6411ade0 con 0x7ffb6412c5b0 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.439+0000 7ffb6911c640 1 --2- 172.21.15.22:0/92919018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 0x7ffb641c33d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ffb60037040 tx=0x7ffb60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.440+0000 7ffb59ffb640 1 -- 172.21.15.22:0/92919018 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb60044020 con 0x7ffb6412c5b0 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.440+0000 7ffb59ffb640 1 -- 172.21.15.22:0/92919018 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6003f5a0 con 0x7ffb6412c5b0 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.440+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb640715f0 con 0x7ffb6412c5b0 2024-05-07T13:59:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.440+0000 7ffb59ffb640 1 -- 172.21.15.22:0/92919018 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb60039040 con 0x7ffb6412c5b0 2024-05-07T13:59:51.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.440+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6411ba70 con 0x7ffb6412c5b0 2024-05-07T13:59:51.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.441+0000 7ffb59ffb640 1 -- 172.21.15.22:0/92919018 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffb60047020 con 0x7ffb6412c5b0 2024-05-07T13:59:51.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.441+0000 7ffb59ffb640 1 --2- 172.21.15.22:0/92919018 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ffb48038060 0x7ffb4803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T13:59:51.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.441+0000 7ffb59ffb640 1 -- 172.21.15.22:0/92919018 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ffb6006e860 con 0x7ffb6412c5b0 2024-05-07T13:59:51.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.441+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb64062e90 con 0x7ffb6412c5b0 2024-05-07T13:59:51.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.441+0000 7ffb6891b640 1 --2- 172.21.15.22:0/92919018 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ffb48038060 0x7ffb4803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T13:59:51.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.442+0000 7ffb6891b640 1 --2- 172.21.15.22:0/92919018 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ffb48038060 0x7ffb4803a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffb54000f60 tx=0x7ffb54007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T13:59:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.446+0000 7ffb59ffb640 1 -- 172.21.15.22:0/92919018 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffb6004e030 con 0x7ffb6412c5b0 2024-05-07T13:59:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.629+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb6411c550 con 0x7ffb48038060 2024-05-07T13:59:51.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.646+0000 7ffb59ffb640 1 -- 172.21.15.22:0/92919018 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662073 (secure 0 0 0) 0x7ffb6411c550 con 0x7ffb48038060 2024-05-07T13:59:51.641 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T13:59:51.647 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.650+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ffb48038060 msgr2=0x7ffb4803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.650+0000 7ffb6b380640 1 --2- 172.21.15.22:0/92919018 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ffb48038060 0x7ffb4803a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffb54000f60 tx=0x7ffb54007a80 comp rx=0 tx=0).stop 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.650+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 msgr2=0x7ffb641c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.650+0000 7ffb6b380640 1 --2- 172.21.15.22:0/92919018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 0x7ffb641c33d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ffb60037040 tx=0x7ffb60004a40 comp rx=0 tx=0).stop 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.651+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 shutdown_connections 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.651+0000 7ffb6b380640 1 --2- 172.21.15.22:0/92919018 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7ffb48038060 0x7ffb4803a520 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.651+0000 7ffb6b380640 1 --2- 172.21.15.22:0/92919018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb6412c5b0 0x7ffb641c33d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.651+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 >> 172.21.15.22:0/92919018 conn(0x7ffb64099380 msgr2=0x7ffb64123750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.651+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 shutdown_connections 2024-05-07T13:59:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T13:59:51.651+0000 7ffb6b380640 1 -- 172.21.15.22:0/92919018 wait complete. 2024-05-07T13:59:51.651 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-05-07T13:59:50.176804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5119,"num_read_kb":4700,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4776,"ondisk_log_size":4776,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":131608,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377355752,"statfs":{"total":386547056640,"available":386412290048,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":131917590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003301"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.181540+0000","last_change":"2024-05-07T13:55:48.336201+0000","last_active":"2024-05-07T13:57:53.181540+0000","last_peered":"2024-05-07T13:57:53.181540+0000","last_clean":"2024-05-07T13:57:53.181540+0000","last_became_active":"2024-05-07T13:55:48.335740+0000","last_became_peered":"2024-05-07T13:55:48.335740+0000","last_unstale":"2024-05-07T13:57:53.181540+0000","last_undegraded":"2024-05-07T13:57:53.181540+0000","last_fullsized":"2024-05-07T13:57:53.181540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'13","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.592541+0000","last_change":"2024-05-07T13:55:50.316599+0000","last_active":"2024-05-07T13:58:59.592541+0000","last_peered":"2024-05-07T13:58:59.592541+0000","last_clean":"2024-05-07T13:58:59.592541+0000","last_became_active":"2024-05-07T13:55:50.316253+0000","last_became_peered":"2024-05-07T13:55:50.316253+0000","last_unstale":"2024-05-07T13:58:59.592541+0000","last_undegraded":"2024-05-07T13:58:59.592541+0000","last_fullsized":"2024-05-07T13:58:59.592541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.392972+0000","last_change":"2024-05-07T13:55:48.324242+0000","last_active":"2024-05-07T13:58:59.392972+0000","last_peered":"2024-05-07T13:58:59.392972+0000","last_clean":"2024-05-07T13:58:59.392972+0000","last_became_active":"2024-05-07T13:55:48.323151+0000","last_became_peered":"2024-05-07T13:55:48.323151+0000","last_unstale":"2024-05-07T13:58:59.392972+0000","last_undegraded":"2024-05-07T13:58:59.392972+0000","last_fullsized":"2024-05-07T13:58:59.392972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184151+0000","last_change":"2024-05-07T13:55:50.322812+0000","last_active":"2024-05-07T13:58:23.184151+0000","last_peered":"2024-05-07T13:58:23.184151+0000","last_clean":"2024-05-07T13:58:23.184151+0000","last_became_active":"2024-05-07T13:55:50.322066+0000","last_became_peered":"2024-05-07T13:55:50.322066+0000","last_unstale":"2024-05-07T13:58:23.184151+0000","last_undegraded":"2024-05-07T13:58:23.184151+0000","last_fullsized":"2024-05-07T13:58:23.184151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179448+0000","last_change":"2024-05-07T13:55:48.350450+0000","last_active":"2024-05-07T13:57:53.179448+0000","last_peered":"2024-05-07T13:57:53.179448+0000","last_clean":"2024-05-07T13:57:53.179448+0000","last_became_active":"2024-05-07T13:55:48.347661+0000","last_became_peered":"2024-05-07T13:55:48.347661+0000","last_unstale":"2024-05-07T13:57:53.179448+0000","last_undegraded":"2024-05-07T13:57:53.179448+0000","last_fullsized":"2024-05-07T13:57:53.179448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184195+0000","last_change":"2024-05-07T13:55:50.322032+0000","last_active":"2024-05-07T13:58:23.184195+0000","last_peered":"2024-05-07T13:58:23.184195+0000","last_clean":"2024-05-07T13:58:23.184195+0000","last_became_active":"2024-05-07T13:55:50.321598+0000","last_became_peered":"2024-05-07T13:55:50.321598+0000","last_unstale":"2024-05-07T13:58:23.184195+0000","last_undegraded":"2024-05-07T13:58:23.184195+0000","last_fullsized":"2024-05-07T13:58:23.184195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.063516+0000","last_change":"2024-05-07T13:55:48.337861+0000","last_active":"2024-05-07T13:59:10.063516+0000","last_peered":"2024-05-07T13:59:10.063516+0000","last_clean":"2024-05-07T13:59:10.063516+0000","last_became_active":"2024-05-07T13:55:48.337418+0000","last_became_peered":"2024-05-07T13:55:48.337418+0000","last_unstale":"2024-05-07T13:59:10.063516+0000","last_undegraded":"2024-05-07T13:59:10.063516+0000","last_fullsized":"2024-05-07T13:59:10.063516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:08.190604+0000","last_change":"2024-05-07T13:56:35.367287+0000","last_active":"2024-05-07T13:59:08.190604+0000","last_peered":"2024-05-07T13:59:08.190604+0000","last_clean":"2024-05-07T13:59:08.190604+0000","last_became_active":"2024-05-07T13:56:35.366947+0000","last_became_peered":"2024-05-07T13:56:35.366947+0000","last_unstale":"2024-05-07T13:59:08.190604+0000","last_undegraded":"2024-05-07T13:59:08.190604+0000","last_fullsized":"2024-05-07T13:59:08.190604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183398+0000","last_change":"2024-05-07T13:55:48.349880+0000","last_active":"2024-05-07T13:58:18.183398+0000","last_peered":"2024-05-07T13:58:18.183398+0000","last_clean":"2024-05-07T13:58:18.183398+0000","last_became_active":"2024-05-07T13:55:48.347714+0000","last_became_peered":"2024-05-07T13:55:48.347714+0000","last_unstale":"2024-05-07T13:58:18.183398+0000","last_undegraded":"2024-05-07T13:58:18.183398+0000","last_fullsized":"2024-05-07T13:58:18.183398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'8","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.090534+0000","last_change":"2024-05-07T13:59:47.090564+0000","last_active":"2024-05-07T13:59:47.090534+0000","last_peered":"2024-05-07T13:59:47.090534+0000","last_clean":"2024-05-07T13:59:47.090534+0000","last_became_active":"2024-05-07T13:55:50.314660+0000","last_became_peered":"2024-05-07T13:55:50.314660+0000","last_unstale":"2024-05-07T13:59:47.090534+0000","last_undegraded":"2024-05-07T13:59:47.090534+0000","last_fullsized":"2024-05-07T13:59:47.090534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-07T13:59:47.090435+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-07T13:59:47.090435+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.090435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:22.240440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.153596+0000","last_change":"2024-05-07T13:59:43.153642+0000","last_active":"2024-05-07T13:59:43.153596+0000","last_peered":"2024-05-07T13:59:43.153596+0000","last_clean":"2024-05-07T13:59:43.153596+0000","last_became_active":"2024-05-07T13:55:48.337256+0000","last_became_peered":"2024-05-07T13:55:48.337256+0000","last_unstale":"2024-05-07T13:59:43.153596+0000","last_undegraded":"2024-05-07T13:59:43.153596+0000","last_fullsized":"2024-05-07T13:59:43.153596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:43.153472+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:43.153472+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.153472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:43.479597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.510758+0000","last_change":"2024-05-07T13:55:50.322605+0000","last_active":"2024-05-07T13:58:59.510758+0000","last_peered":"2024-05-07T13:58:59.510758+0000","last_clean":"2024-05-07T13:58:59.510758+0000","last_became_active":"2024-05-07T13:55:50.322204+0000","last_became_peered":"2024-05-07T13:55:50.322204+0000","last_unstale":"2024-05-07T13:58:59.510758+0000","last_undegraded":"2024-05-07T13:58:59.510758+0000","last_fullsized":"2024-05-07T13:58:59.510758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183291+0000","last_change":"2024-05-07T13:55:48.348111+0000","last_active":"2024-05-07T13:58:18.183291+0000","last_peered":"2024-05-07T13:58:18.183291+0000","last_clean":"2024-05-07T13:58:18.183291+0000","last_became_active":"2024-05-07T13:55:48.347006+0000","last_became_peered":"2024-05-07T13:55:48.347006+0000","last_unstale":"2024-05-07T13:58:18.183291+0000","last_undegraded":"2024-05-07T13:58:18.183291+0000","last_fullsized":"2024-05-07T13:58:18.183291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.065088+0000","last_change":"2024-05-07T13:59:34.065113+0000","last_active":"2024-05-07T13:59:34.065088+0000","last_peered":"2024-05-07T13:59:34.065088+0000","last_clean":"2024-05-07T13:59:34.065088+0000","last_became_active":"2024-05-07T13:55:50.312835+0000","last_became_peered":"2024-05-07T13:55:50.312835+0000","last_unstale":"2024-05-07T13:59:34.065088+0000","last_undegraded":"2024-05-07T13:59:34.065088+0000","last_fullsized":"2024-05-07T13:59:34.065088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:34.064991+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:34.064991+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.064991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:30.763581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.181090+0000","last_change":"2024-05-07T13:55:48.325646+0000","last_active":"2024-05-07T13:58:18.181090+0000","last_peered":"2024-05-07T13:58:18.181090+0000","last_clean":"2024-05-07T13:58:18.181090+0000","last_became_active":"2024-05-07T13:55:48.323612+0000","last_became_peered":"2024-05-07T13:55:48.323612+0000","last_unstale":"2024-05-07T13:58:18.181090+0000","last_undegraded":"2024-05-07T13:58:18.181090+0000","last_fullsized":"2024-05-07T13:58:18.181090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'2","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.099775+0000","last_change":"2024-05-07T13:59:46.099829+0000","last_active":"2024-05-07T13:59:46.099775+0000","last_peered":"2024-05-07T13:59:46.099775+0000","last_clean":"2024-05-07T13:59:46.099775+0000","last_became_active":"2024-05-07T13:55:50.325055+0000","last_became_peered":"2024-05-07T13:55:50.325055+0000","last_unstale":"2024-05-07T13:59:46.099775+0000","last_undegraded":"2024-05-07T13:59:46.099775+0000","last_fullsized":"2024-05-07T13:59:46.099775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:46.099644+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:46.099644+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.099644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:50.875891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'22","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.509642+0000","last_change":"2024-05-07T13:55:50.321695+0000","last_active":"2024-05-07T13:58:59.509642+0000","last_peered":"2024-05-07T13:58:59.509642+0000","last_clean":"2024-05-07T13:58:59.509642+0000","last_became_active":"2024-05-07T13:55:50.321385+0000","last_became_peered":"2024-05-07T13:55:50.321385+0000","last_unstale":"2024-05-07T13:58:59.509642+0000","last_undegraded":"2024-05-07T13:58:59.509642+0000","last_fullsized":"2024-05-07T13:58:59.509642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182043+0000","last_change":"2024-05-07T13:55:48.335649+0000","last_active":"2024-05-07T13:58:13.182043+0000","last_peered":"2024-05-07T13:58:13.182043+0000","last_clean":"2024-05-07T13:58:13.182043+0000","last_became_active":"2024-05-07T13:55:48.335213+0000","last_became_peered":"2024-05-07T13:55:48.335213+0000","last_unstale":"2024-05-07T13:58:13.182043+0000","last_undegraded":"2024-05-07T13:58:13.182043+0000","last_fullsized":"2024-05-07T13:58:13.182043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'16","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.067266+0000","last_change":"2024-05-07T13:59:41.067301+0000","last_active":"2024-05-07T13:59:41.067266+0000","last_peered":"2024-05-07T13:59:41.067266+0000","last_clean":"2024-05-07T13:59:41.067266+0000","last_became_active":"2024-05-07T13:55:50.313457+0000","last_became_peered":"2024-05-07T13:55:50.313457+0000","last_unstale":"2024-05-07T13:59:41.067266+0000","last_undegraded":"2024-05-07T13:59:41.067266+0000","last_fullsized":"2024-05-07T13:59:41.067266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:41.067158+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:41.067158+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.067158+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:23.103665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.104844+0000","last_change":"2024-05-07T13:59:37.104889+0000","last_active":"2024-05-07T13:59:37.104844+0000","last_peered":"2024-05-07T13:59:37.104844+0000","last_clean":"2024-05-07T13:59:37.104844+0000","last_became_active":"2024-05-07T13:55:48.340516+0000","last_became_peered":"2024-05-07T13:55:48.340516+0000","last_unstale":"2024-05-07T13:59:37.104844+0000","last_undegraded":"2024-05-07T13:59:37.104844+0000","last_fullsized":"2024-05-07T13:59:37.104844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:37.104722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:37.104722+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.104722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:59.079495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.022073+0000","last_change":"2024-05-07T13:59:43.022101+0000","last_active":"2024-05-07T13:59:43.022073+0000","last_peered":"2024-05-07T13:59:43.022073+0000","last_clean":"2024-05-07T13:59:43.022073+0000","last_became_active":"2024-05-07T13:55:50.313442+0000","last_became_peered":"2024-05-07T13:55:50.313442+0000","last_unstale":"2024-05-07T13:59:43.022073+0000","last_undegraded":"2024-05-07T13:59:43.022073+0000","last_fullsized":"2024-05-07T13:59:43.022073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:43.021976+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:43.021976+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.021976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:09.097926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181951+0000","last_change":"2024-05-07T13:55:48.339008+0000","last_active":"2024-05-07T13:58:13.181951+0000","last_peered":"2024-05-07T13:58:13.181951+0000","last_clean":"2024-05-07T13:58:13.181951+0000","last_became_active":"2024-05-07T13:55:48.338589+0000","last_became_peered":"2024-05-07T13:55:48.338589+0000","last_unstale":"2024-05-07T13:58:13.181951+0000","last_undegraded":"2024-05-07T13:58:13.181951+0000","last_fullsized":"2024-05-07T13:58:13.181951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.043384+0000","last_change":"2024-05-07T13:59:37.043430+0000","last_active":"2024-05-07T13:59:37.043384+0000","last_peered":"2024-05-07T13:59:37.043384+0000","last_clean":"2024-05-07T13:59:37.043384+0000","last_became_active":"2024-05-07T13:55:50.328471+0000","last_became_peered":"2024-05-07T13:55:50.328471+0000","last_unstale":"2024-05-07T13:59:37.043384+0000","last_undegraded":"2024-05-07T13:59:37.043384+0000","last_fullsized":"2024-05-07T13:59:37.043384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:37.043289+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:37.043289+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.043289+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:19.079795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181894+0000","last_change":"2024-05-07T13:55:48.340701+0000","last_active":"2024-05-07T13:58:13.181894+0000","last_peered":"2024-05-07T13:58:13.181894+0000","last_clean":"2024-05-07T13:58:13.181894+0000","last_became_active":"2024-05-07T13:55:48.340284+0000","last_became_peered":"2024-05-07T13:55:48.340284+0000","last_unstale":"2024-05-07T13:58:13.181894+0000","last_undegraded":"2024-05-07T13:58:13.181894+0000","last_fullsized":"2024-05-07T13:58:13.181894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.170442+0000","last_change":"2024-05-07T13:59:42.170509+0000","last_active":"2024-05-07T13:59:42.170442+0000","last_peered":"2024-05-07T13:59:42.170442+0000","last_clean":"2024-05-07T13:59:42.170442+0000","last_became_active":"2024-05-07T13:55:50.322513+0000","last_became_peered":"2024-05-07T13:55:50.322513+0000","last_unstale":"2024-05-07T13:59:42.170442+0000","last_undegraded":"2024-05-07T13:59:42.170442+0000","last_fullsized":"2024-05-07T13:59:42.170442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:42.170338+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:42.170338+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.170338+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:03.826198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.180443+0000","last_change":"2024-05-07T13:55:48.326455+0000","last_active":"2024-05-07T13:58:13.180443+0000","last_peered":"2024-05-07T13:58:13.180443+0000","last_clean":"2024-05-07T13:58:13.180443+0000","last_became_active":"2024-05-07T13:55:48.325321+0000","last_became_peered":"2024-05-07T13:55:48.325321+0000","last_unstale":"2024-05-07T13:58:13.180443+0000","last_undegraded":"2024-05-07T13:58:13.180443+0000","last_fullsized":"2024-05-07T13:58:13.180443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477144+0000","last_change":"2024-05-07T13:55:50.322751+0000","last_active":"2024-05-07T13:58:59.477144+0000","last_peered":"2024-05-07T13:58:59.477144+0000","last_clean":"2024-05-07T13:58:59.477144+0000","last_became_active":"2024-05-07T13:55:50.322476+0000","last_became_peered":"2024-05-07T13:55:50.322476+0000","last_unstale":"2024-05-07T13:58:59.477144+0000","last_undegraded":"2024-05-07T13:58:59.477144+0000","last_fullsized":"2024-05-07T13:58:59.477144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181627+0000","last_change":"2024-05-07T13:55:48.351155+0000","last_active":"2024-05-07T13:58:08.181627+0000","last_peered":"2024-05-07T13:58:08.181627+0000","last_clean":"2024-05-07T13:58:08.181627+0000","last_became_active":"2024-05-07T13:55:48.348714+0000","last_became_peered":"2024-05-07T13:55:48.348714+0000","last_unstale":"2024-05-07T13:58:08.181627+0000","last_undegraded":"2024-05-07T13:58:08.181627+0000","last_fullsized":"2024-05-07T13:58:08.181627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'37","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.519599+0000","last_change":"2024-05-07T13:55:58.348302+0000","last_active":"2024-05-07T13:58:59.519599+0000","last_peered":"2024-05-07T13:58:59.519599+0000","last_clean":"2024-05-07T13:58:59.519599+0000","last_became_active":"2024-05-07T13:55:58.347993+0000","last_became_peered":"2024-05-07T13:55:58.347993+0000","last_unstale":"2024-05-07T13:58:59.519599+0000","last_undegraded":"2024-05-07T13:58:59.519599+0000","last_fullsized":"2024-05-07T13:58:59.519599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182499+0000","last_change":"2024-05-07T13:55:50.323646+0000","last_active":"2024-05-07T13:58:13.182499+0000","last_peered":"2024-05-07T13:58:13.182499+0000","last_clean":"2024-05-07T13:58:13.182499+0000","last_became_active":"2024-05-07T13:55:50.323355+0000","last_became_peered":"2024-05-07T13:55:50.323355+0000","last_unstale":"2024-05-07T13:58:13.182499+0000","last_undegraded":"2024-05-07T13:58:13.182499+0000","last_fullsized":"2024-05-07T13:58:13.182499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.406190+0000","last_change":"2024-05-07T13:55:48.352275+0000","last_active":"2024-05-07T13:58:59.406190+0000","last_peered":"2024-05-07T13:58:59.406190+0000","last_clean":"2024-05-07T13:58:59.406190+0000","last_became_active":"2024-05-07T13:55:48.350161+0000","last_became_peered":"2024-05-07T13:55:48.350161+0000","last_unstale":"2024-05-07T13:58:59.406190+0000","last_undegraded":"2024-05-07T13:58:59.406190+0000","last_fullsized":"2024-05-07T13:58:59.406190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.845677+0000","last_change":"2024-05-07T13:59:13.845708+0000","last_active":"2024-05-07T13:59:13.845677+0000","last_peered":"2024-05-07T13:59:13.845677+0000","last_clean":"2024-05-07T13:59:13.845677+0000","last_became_active":"2024-05-07T13:55:52.318966+0000","last_became_peered":"2024-05-07T13:55:52.318966+0000","last_unstale":"2024-05-07T13:59:13.845677+0000","last_undegraded":"2024-05-07T13:59:13.845677+0000","last_fullsized":"2024-05-07T13:59:13.845677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.845587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:14.171712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.069054+0000","last_change":"2024-05-07T13:59:38.069097+0000","last_active":"2024-05-07T13:59:38.069054+0000","last_peered":"2024-05-07T13:59:38.069054+0000","last_clean":"2024-05-07T13:59:38.069054+0000","last_became_active":"2024-05-07T13:55:54.331835+0000","last_became_peered":"2024-05-07T13:55:54.331835+0000","last_unstale":"2024-05-07T13:59:38.069054+0000","last_undegraded":"2024-05-07T13:59:38.069054+0000","last_fullsized":"2024-05-07T13:59:38.069054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-07T13:59:38.068965+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-07T13:59:38.068965+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.068965+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:29.318982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.049143+0000","last_change":"2024-05-07T13:59:23.049169+0000","last_active":"2024-05-07T13:59:23.049143+0000","last_peered":"2024-05-07T13:59:23.049143+0000","last_clean":"2024-05-07T13:59:23.049143+0000","last_became_active":"2024-05-07T13:55:56.338638+0000","last_became_peered":"2024-05-07T13:55:56.338638+0000","last_unstale":"2024-05-07T13:59:23.049143+0000","last_undegraded":"2024-05-07T13:59:23.049143+0000","last_fullsized":"2024-05-07T13:59:23.049143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.049049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:44:20.135960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'13","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.183386+0000","last_change":"2024-05-07T13:55:58.348663+0000","last_active":"2024-05-07T13:58:23.183386+0000","last_peered":"2024-05-07T13:58:23.183386+0000","last_clean":"2024-05-07T13:58:23.183386+0000","last_became_active":"2024-05-07T13:55:58.348341+0000","last_became_peered":"2024-05-07T13:55:58.348341+0000","last_unstale":"2024-05-07T13:58:23.183386+0000","last_undegraded":"2024-05-07T13:58:23.183386+0000","last_fullsized":"2024-05-07T13:58:23.183386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.166127+0000","last_change":"2024-05-07T13:59:44.166197+0000","last_active":"2024-05-07T13:59:44.166127+0000","last_peered":"2024-05-07T13:59:44.166127+0000","last_clean":"2024-05-07T13:59:44.166127+0000","last_became_active":"2024-05-07T13:55:50.325201+0000","last_became_peered":"2024-05-07T13:55:50.325201+0000","last_unstale":"2024-05-07T13:59:44.166127+0000","last_undegraded":"2024-05-07T13:59:44.166127+0000","last_fullsized":"2024-05-07T13:59:44.166127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:44.166027+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:44.166027+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.166027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:48.666551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.183380+0000","last_change":"2024-05-07T13:55:48.339081+0000","last_active":"2024-05-07T13:58:08.183380+0000","last_peered":"2024-05-07T13:58:08.183380+0000","last_clean":"2024-05-07T13:58:08.183380+0000","last_became_active":"2024-05-07T13:55:48.338704+0000","last_became_peered":"2024-05-07T13:55:48.338704+0000","last_unstale":"2024-05-07T13:58:08.183380+0000","last_undegraded":"2024-05-07T13:58:08.183380+0000","last_fullsized":"2024-05-07T13:58:08.183380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.188527+0000","last_change":"2024-05-07T13:56:35.362029+0000","last_active":"2024-05-07T13:58:58.188527+0000","last_peered":"2024-05-07T13:58:58.188527+0000","last_clean":"2024-05-07T13:58:58.188527+0000","last_became_active":"2024-05-07T13:56:35.361623+0000","last_became_peered":"2024-05-07T13:56:35.361623+0000","last_unstale":"2024-05-07T13:58:58.188527+0000","last_undegraded":"2024-05-07T13:58:58.188527+0000","last_fullsized":"2024-05-07T13:58:58.188527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.125797+0000","last_change":"2024-05-07T13:59:12.125828+0000","last_active":"2024-05-07T13:59:12.125797+0000","last_peered":"2024-05-07T13:59:12.125797+0000","last_clean":"2024-05-07T13:59:12.125797+0000","last_became_active":"2024-05-07T13:55:54.333402+0000","last_became_peered":"2024-05-07T13:55:54.333402+0000","last_unstale":"2024-05-07T13:59:12.125797+0000","last_undegraded":"2024-05-07T13:59:12.125797+0000","last_fullsized":"2024-05-07T13:59:12.125797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.125709+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:10.791591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.010782+0000","last_change":"2024-05-07T13:59:19.010859+0000","last_active":"2024-05-07T13:59:19.010782+0000","last_peered":"2024-05-07T13:59:19.010782+0000","last_clean":"2024-05-07T13:59:19.010782+0000","last_became_active":"2024-05-07T13:55:56.335463+0000","last_became_peered":"2024-05-07T13:55:56.335463+0000","last_unstale":"2024-05-07T13:59:19.010782+0000","last_undegraded":"2024-05-07T13:59:19.010782+0000","last_fullsized":"2024-05-07T13:59:19.010782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.010674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:27.103094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:28.182615+0000","last_change":"2024-05-07T13:55:58.341190+0000","last_active":"2024-05-07T13:58:28.182615+0000","last_peered":"2024-05-07T13:58:28.182615+0000","last_clean":"2024-05-07T13:58:28.182615+0000","last_became_active":"2024-05-07T13:55:58.340688+0000","last_became_peered":"2024-05-07T13:55:58.340688+0000","last_unstale":"2024-05-07T13:58:28.182615+0000","last_undegraded":"2024-05-07T13:58:28.182615+0000","last_fullsized":"2024-05-07T13:58:28.182615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.165617+0000","last_change":"2024-05-07T13:59:47.165656+0000","last_active":"2024-05-07T13:59:47.165617+0000","last_peered":"2024-05-07T13:59:47.165617+0000","last_clean":"2024-05-07T13:59:47.165617+0000","last_became_active":"2024-05-07T13:55:50.323775+0000","last_became_peered":"2024-05-07T13:55:50.323775+0000","last_unstale":"2024-05-07T13:59:47.165617+0000","last_undegraded":"2024-05-07T13:59:47.165617+0000","last_fullsized":"2024-05-07T13:59:47.165617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:47.165529+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:47.165529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.165529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:40:02.425709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.395932+0000","last_change":"2024-05-07T13:55:48.350102+0000","last_active":"2024-05-07T13:58:59.395932+0000","last_peered":"2024-05-07T13:58:59.395932+0000","last_clean":"2024-05-07T13:58:59.395932+0000","last_became_active":"2024-05-07T13:55:48.349636+0000","last_became_peered":"2024-05-07T13:55:48.349636+0000","last_unstale":"2024-05-07T13:58:59.395932+0000","last_undegraded":"2024-05-07T13:58:59.395932+0000","last_fullsized":"2024-05-07T13:58:59.395932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:03.190026+0000","last_change":"2024-05-07T13:56:35.370451+0000","last_active":"2024-05-07T13:59:03.190026+0000","last_peered":"2024-05-07T13:59:03.190026+0000","last_clean":"2024-05-07T13:59:03.190026+0000","last_became_active":"2024-05-07T13:56:35.370109+0000","last_became_peered":"2024-05-07T13:56:35.370109+0000","last_unstale":"2024-05-07T13:59:03.190026+0000","last_undegraded":"2024-05-07T13:59:03.190026+0000","last_fullsized":"2024-05-07T13:59:03.190026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.187173+0000","last_change":"2024-05-07T13:59:22.187264+0000","last_active":"2024-05-07T13:59:22.187173+0000","last_peered":"2024-05-07T13:59:22.187173+0000","last_clean":"2024-05-07T13:59:22.187173+0000","last_became_active":"2024-05-07T13:55:54.327178+0000","last_became_peered":"2024-05-07T13:55:54.327178+0000","last_unstale":"2024-05-07T13:59:22.187173+0000","last_undegraded":"2024-05-07T13:59:22.187173+0000","last_fullsized":"2024-05-07T13:59:22.187173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.187065+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:32.587195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.169072+0000","last_change":"2024-05-07T13:59:45.169121+0000","last_active":"2024-05-07T13:59:45.169072+0000","last_peered":"2024-05-07T13:59:45.169072+0000","last_clean":"2024-05-07T13:59:45.169072+0000","last_became_active":"2024-05-07T13:55:56.345712+0000","last_became_peered":"2024-05-07T13:55:56.345712+0000","last_unstale":"2024-05-07T13:59:45.169072+0000","last_undegraded":"2024-05-07T13:59:45.169072+0000","last_fullsized":"2024-05-07T13:59:45.169072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-05-07T13:59:45.168931+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-05-07T13:59:45.168931+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.168931+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:31:55.102005+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.162805+0000","last_change":"2024-05-07T13:59:28.162826+0000","last_active":"2024-05-07T13:59:28.162805+0000","last_peered":"2024-05-07T13:59:28.162805+0000","last_clean":"2024-05-07T13:59:28.162805+0000","last_became_active":"2024-05-07T13:55:58.339825+0000","last_became_peered":"2024-05-07T13:55:58.339825+0000","last_unstale":"2024-05-07T13:59:28.162805+0000","last_undegraded":"2024-05-07T13:59:28.162805+0000","last_fullsized":"2024-05-07T13:59:28.162805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.162716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:49.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.181251+0000","last_change":"2024-05-07T13:55:50.319097+0000","last_active":"2024-05-07T13:58:18.181251+0000","last_peered":"2024-05-07T13:58:18.181251+0000","last_clean":"2024-05-07T13:58:18.181251+0000","last_became_active":"2024-05-07T13:55:50.318502+0000","last_became_peered":"2024-05-07T13:55:50.318502+0000","last_unstale":"2024-05-07T13:58:18.181251+0000","last_undegraded":"2024-05-07T13:58:18.181251+0000","last_fullsized":"2024-05-07T13:58:18.181251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.052768+0000","last_change":"2024-05-07T13:59:46.052825+0000","last_active":"2024-05-07T13:59:46.052768+0000","last_peered":"2024-05-07T13:59:46.052768+0000","last_clean":"2024-05-07T13:59:46.052768+0000","last_became_active":"2024-05-07T13:55:48.345080+0000","last_became_peered":"2024-05-07T13:55:48.345080+0000","last_unstale":"2024-05-07T13:59:46.052768+0000","last_undegraded":"2024-05-07T13:59:46.052768+0000","last_fullsized":"2024-05-07T13:59:46.052768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:46.052643+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:46.052643+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.052643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:07.843171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.860466+0000","last_change":"2024-05-07T13:59:18.860501+0000","last_active":"2024-05-07T13:59:18.860466+0000","last_peered":"2024-05-07T13:59:18.860466+0000","last_clean":"2024-05-07T13:59:18.860466+0000","last_became_active":"2024-05-07T13:55:52.318178+0000","last_became_peered":"2024-05-07T13:55:52.318178+0000","last_unstale":"2024-05-07T13:59:18.860466+0000","last_undegraded":"2024-05-07T13:59:18.860466+0000","last_fullsized":"2024-05-07T13:59:18.860466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.860344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:31:08.364202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.065120+0000","last_change":"2024-05-07T13:59:17.065153+0000","last_active":"2024-05-07T13:59:17.065120+0000","last_peered":"2024-05-07T13:59:17.065120+0000","last_clean":"2024-05-07T13:59:17.065120+0000","last_became_active":"2024-05-07T13:55:54.330662+0000","last_became_peered":"2024-05-07T13:55:54.330662+0000","last_unstale":"2024-05-07T13:59:17.065120+0000","last_undegraded":"2024-05-07T13:59:17.065120+0000","last_fullsized":"2024-05-07T13:59:17.065120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.065035+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:20.830603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.894290+0000","last_change":"2024-05-07T13:59:10.894332+0000","last_active":"2024-05-07T13:59:10.894290+0000","last_peered":"2024-05-07T13:59:10.894290+0000","last_clean":"2024-05-07T13:59:10.894290+0000","last_became_active":"2024-05-07T13:55:56.334111+0000","last_became_peered":"2024-05-07T13:55:56.334111+0000","last_unstale":"2024-05-07T13:59:10.894290+0000","last_undegraded":"2024-05-07T13:59:10.894290+0000","last_fullsized":"2024-05-07T13:59:10.894290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.894211+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:00.735952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'11","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.031877+0000","last_change":"2024-05-07T13:59:27.031904+0000","last_active":"2024-05-07T13:59:27.031877+0000","last_peered":"2024-05-07T13:59:27.031877+0000","last_clean":"2024-05-07T13:59:27.031877+0000","last_became_active":"2024-05-07T13:55:50.324820+0000","last_became_peered":"2024-05-07T13:55:50.324820+0000","last_unstale":"2024-05-07T13:59:27.031877+0000","last_undegraded":"2024-05-07T13:59:27.031877+0000","last_fullsized":"2024-05-07T13:59:27.031877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.031775+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:22.190354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182839+0000","last_change":"2024-05-07T13:55:48.335906+0000","last_active":"2024-05-07T13:58:03.182839+0000","last_peered":"2024-05-07T13:58:03.182839+0000","last_clean":"2024-05-07T13:58:03.182839+0000","last_became_active":"2024-05-07T13:55:48.335443+0000","last_became_peered":"2024-05-07T13:55:48.335443+0000","last_unstale":"2024-05-07T13:58:03.182839+0000","last_undegraded":"2024-05-07T13:58:03.182839+0000","last_fullsized":"2024-05-07T13:58:03.182839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.073468+0000","last_change":"2024-05-07T13:59:24.073496+0000","last_active":"2024-05-07T13:59:24.073468+0000","last_peered":"2024-05-07T13:59:24.073468+0000","last_clean":"2024-05-07T13:59:24.073468+0000","last_became_active":"2024-05-07T13:55:52.322188+0000","last_became_peered":"2024-05-07T13:55:52.322188+0000","last_unstale":"2024-05-07T13:59:24.073468+0000","last_undegraded":"2024-05-07T13:59:24.073468+0000","last_fullsized":"2024-05-07T13:59:24.073468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.073340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:13.708665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.081851+0000","last_change":"2024-05-07T13:59:18.081901+0000","last_active":"2024-05-07T13:59:18.081851+0000","last_peered":"2024-05-07T13:59:18.081851+0000","last_clean":"2024-05-07T13:59:18.081851+0000","last_became_active":"2024-05-07T13:55:54.330401+0000","last_became_peered":"2024-05-07T13:55:54.330401+0000","last_unstale":"2024-05-07T13:59:18.081851+0000","last_undegraded":"2024-05-07T13:59:18.081851+0000","last_fullsized":"2024-05-07T13:59:18.081851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.081750+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:16:16.381571+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.945644+0000","last_change":"2024-05-07T13:59:13.945668+0000","last_active":"2024-05-07T13:59:13.945644+0000","last_peered":"2024-05-07T13:59:13.945644+0000","last_clean":"2024-05-07T13:59:13.945644+0000","last_became_active":"2024-05-07T13:55:56.334368+0000","last_became_peered":"2024-05-07T13:55:56.334368+0000","last_unstale":"2024-05-07T13:59:13.945644+0000","last_undegraded":"2024-05-07T13:59:13.945644+0000","last_fullsized":"2024-05-07T13:59:13.945644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.945550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:11.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182753+0000","last_change":"2024-05-07T13:55:58.346747+0000","last_active":"2024-05-07T13:58:03.182753+0000","last_peered":"2024-05-07T13:58:03.182753+0000","last_clean":"2024-05-07T13:58:03.182753+0000","last_became_active":"2024-05-07T13:55:58.346457+0000","last_became_peered":"2024-05-07T13:55:58.346457+0000","last_unstale":"2024-05-07T13:58:03.182753+0000","last_undegraded":"2024-05-07T13:58:03.182753+0000","last_fullsized":"2024-05-07T13:58:03.182753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.050432+0000","last_change":"2024-05-07T13:59:44.050463+0000","last_active":"2024-05-07T13:59:44.050432+0000","last_peered":"2024-05-07T13:59:44.050432+0000","last_clean":"2024-05-07T13:59:44.050432+0000","last_became_active":"2024-05-07T13:55:50.312564+0000","last_became_peered":"2024-05-07T13:55:50.312564+0000","last_unstale":"2024-05-07T13:59:44.050432+0000","last_undegraded":"2024-05-07T13:59:44.050432+0000","last_fullsized":"2024-05-07T13:59:44.050432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:44.050311+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:44.050311+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.050311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:31.285519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182806+0000","last_change":"2024-05-07T13:55:48.336211+0000","last_active":"2024-05-07T13:58:03.182806+0000","last_peered":"2024-05-07T13:58:03.182806+0000","last_clean":"2024-05-07T13:58:03.182806+0000","last_became_active":"2024-05-07T13:55:48.335791+0000","last_became_peered":"2024-05-07T13:55:48.335791+0000","last_unstale":"2024-05-07T13:58:03.182806+0000","last_undegraded":"2024-05-07T13:58:03.182806+0000","last_fullsized":"2024-05-07T13:58:03.182806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.088740+0000","last_change":"2024-05-07T13:59:27.088805+0000","last_active":"2024-05-07T13:59:27.088740+0000","last_peered":"2024-05-07T13:59:27.088740+0000","last_clean":"2024-05-07T13:59:27.088740+0000","last_became_active":"2024-05-07T13:55:52.325676+0000","last_became_peered":"2024-05-07T13:55:52.325676+0000","last_unstale":"2024-05-07T13:59:27.088740+0000","last_undegraded":"2024-05-07T13:59:27.088740+0000","last_fullsized":"2024-05-07T13:59:27.088740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.088632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:08.861590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'39","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.053124+0000","last_change":"2024-05-07T13:59:35.053158+0000","last_active":"2024-05-07T13:59:35.053124+0000","last_peered":"2024-05-07T13:59:35.053124+0000","last_clean":"2024-05-07T13:59:35.053124+0000","last_became_active":"2024-05-07T13:55:54.331979+0000","last_became_peered":"2024-05-07T13:55:54.331979+0000","last_unstale":"2024-05-07T13:59:35.053124+0000","last_undegraded":"2024-05-07T13:59:35.053124+0000","last_fullsized":"2024-05-07T13:59:35.053124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:35.053039+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:35.053039+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.053039+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:39.918537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.927280+0000","last_change":"2024-05-07T13:59:12.927307+0000","last_active":"2024-05-07T13:59:12.927280+0000","last_peered":"2024-05-07T13:59:12.927280+0000","last_clean":"2024-05-07T13:59:12.927280+0000","last_became_active":"2024-05-07T13:55:56.333357+0000","last_became_peered":"2024-05-07T13:55:56.333357+0000","last_unstale":"2024-05-07T13:59:12.927280+0000","last_undegraded":"2024-05-07T13:59:12.927280+0000","last_fullsized":"2024-05-07T13:59:12.927280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.927183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:18.128049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.070884+0000","last_change":"2024-05-07T13:59:35.070919+0000","last_active":"2024-05-07T13:59:35.070884+0000","last_peered":"2024-05-07T13:59:35.070884+0000","last_clean":"2024-05-07T13:59:35.070884+0000","last_became_active":"2024-05-07T13:55:58.344955+0000","last_became_peered":"2024-05-07T13:55:58.344955+0000","last_unstale":"2024-05-07T13:59:35.070884+0000","last_undegraded":"2024-05-07T13:59:35.070884+0000","last_fullsized":"2024-05-07T13:59:35.070884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:35.070796+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:35.070796+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.070796+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:54.753266+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.252564+0000","last_change":"2024-05-07T13:55:50.327717+0000","last_active":"2024-05-07T13:58:59.252564+0000","last_peered":"2024-05-07T13:58:59.252564+0000","last_clean":"2024-05-07T13:58:59.252564+0000","last_became_active":"2024-05-07T13:55:50.327059+0000","last_became_peered":"2024-05-07T13:55:50.327059+0000","last_unstale":"2024-05-07T13:58:59.252564+0000","last_undegraded":"2024-05-07T13:58:59.252564+0000","last_fullsized":"2024-05-07T13:58:59.252564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180915+0000","last_change":"2024-05-07T13:55:48.350939+0000","last_active":"2024-05-07T13:58:03.180915+0000","last_peered":"2024-05-07T13:58:03.180915+0000","last_clean":"2024-05-07T13:58:03.180915+0000","last_became_active":"2024-05-07T13:55:48.350442+0000","last_became_peered":"2024-05-07T13:55:48.350442+0000","last_unstale":"2024-05-07T13:58:03.180915+0000","last_undegraded":"2024-05-07T13:58:03.180915+0000","last_fullsized":"2024-05-07T13:58:03.180915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.008622+0000","last_change":"2024-05-07T13:59:31.008644+0000","last_active":"2024-05-07T13:59:31.008622+0000","last_peered":"2024-05-07T13:59:31.008622+0000","last_clean":"2024-05-07T13:59:31.008622+0000","last_became_active":"2024-05-07T13:55:52.321674+0000","last_became_peered":"2024-05-07T13:55:52.321674+0000","last_unstale":"2024-05-07T13:59:31.008622+0000","last_undegraded":"2024-05-07T13:59:31.008622+0000","last_fullsized":"2024-05-07T13:59:31.008622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.008529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.008529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.008529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:13.357119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.831229+0000","last_change":"2024-05-07T13:59:14.831318+0000","last_active":"2024-05-07T13:59:14.831229+0000","last_peered":"2024-05-07T13:59:14.831229+0000","last_clean":"2024-05-07T13:59:14.831229+0000","last_became_active":"2024-05-07T13:55:54.325336+0000","last_became_peered":"2024-05-07T13:55:54.325336+0000","last_unstale":"2024-05-07T13:59:14.831229+0000","last_undegraded":"2024-05-07T13:59:14.831229+0000","last_fullsized":"2024-05-07T13:59:14.831229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.831128+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:26:59.956651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.962074+0000","last_change":"2024-05-07T13:59:17.962101+0000","last_active":"2024-05-07T13:59:17.962074+0000","last_peered":"2024-05-07T13:59:17.962074+0000","last_clean":"2024-05-07T13:59:17.962074+0000","last_became_active":"2024-05-07T13:55:56.334895+0000","last_became_peered":"2024-05-07T13:55:56.334895+0000","last_unstale":"2024-05-07T13:59:17.962074+0000","last_undegraded":"2024-05-07T13:59:17.962074+0000","last_fullsized":"2024-05-07T13:59:17.962074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.961985+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:39.314908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.179732+0000","last_change":"2024-05-07T13:55:58.341127+0000","last_active":"2024-05-07T13:58:08.179732+0000","last_peered":"2024-05-07T13:58:08.179732+0000","last_clean":"2024-05-07T13:58:08.179732+0000","last_became_active":"2024-05-07T13:55:58.340764+0000","last_became_peered":"2024-05-07T13:55:58.340764+0000","last_unstale":"2024-05-07T13:58:08.179732+0000","last_undegraded":"2024-05-07T13:58:08.179732+0000","last_fullsized":"2024-05-07T13:58:08.179732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.114369+0000","last_change":"2024-05-07T13:59:38.114438+0000","last_active":"2024-05-07T13:59:38.114369+0000","last_peered":"2024-05-07T13:59:38.114369+0000","last_clean":"2024-05-07T13:59:38.114369+0000","last_became_active":"2024-05-07T13:55:50.312649+0000","last_became_peered":"2024-05-07T13:55:50.312649+0000","last_unstale":"2024-05-07T13:59:38.114369+0000","last_undegraded":"2024-05-07T13:59:38.114369+0000","last_fullsized":"2024-05-07T13:59:38.114369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:38.114264+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:38.114264+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.114264+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:14:52.055884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180844+0000","last_change":"2024-05-07T13:55:48.347430+0000","last_active":"2024-05-07T13:58:03.180844+0000","last_peered":"2024-05-07T13:58:03.180844+0000","last_clean":"2024-05-07T13:58:03.180844+0000","last_became_active":"2024-05-07T13:55:48.346027+0000","last_became_peered":"2024-05-07T13:55:48.346027+0000","last_unstale":"2024-05-07T13:58:03.180844+0000","last_undegraded":"2024-05-07T13:58:03.180844+0000","last_fullsized":"2024-05-07T13:58:03.180844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.054825+0000","last_change":"2024-05-07T13:59:28.054894+0000","last_active":"2024-05-07T13:59:28.054825+0000","last_peered":"2024-05-07T13:59:28.054825+0000","last_clean":"2024-05-07T13:59:28.054825+0000","last_became_active":"2024-05-07T13:55:52.325427+0000","last_became_peered":"2024-05-07T13:55:52.325427+0000","last_unstale":"2024-05-07T13:59:28.054825+0000","last_undegraded":"2024-05-07T13:59:28.054825+0000","last_fullsized":"2024-05-07T13:59:28.054825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.054722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:47.334525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.081002+0000","last_change":"2024-05-07T13:59:34.081043+0000","last_active":"2024-05-07T13:59:34.081002+0000","last_peered":"2024-05-07T13:59:34.081002+0000","last_clean":"2024-05-07T13:59:34.081002+0000","last_became_active":"2024-05-07T13:55:54.334315+0000","last_became_peered":"2024-05-07T13:55:54.334315+0000","last_unstale":"2024-05-07T13:59:34.081002+0000","last_undegraded":"2024-05-07T13:59:34.081002+0000","last_fullsized":"2024-05-07T13:59:34.081002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-07T13:59:34.080919+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-07T13:59:34.080919+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.080919+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:10.738582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.917795+0000","last_change":"2024-05-07T13:59:16.917820+0000","last_active":"2024-05-07T13:59:16.917795+0000","last_peered":"2024-05-07T13:59:16.917795+0000","last_clean":"2024-05-07T13:59:16.917795+0000","last_became_active":"2024-05-07T13:55:56.330355+0000","last_became_peered":"2024-05-07T13:55:56.330355+0000","last_unstale":"2024-05-07T13:59:16.917795+0000","last_undegraded":"2024-05-07T13:59:16.917795+0000","last_fullsized":"2024-05-07T13:59:16.917795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.917702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:29.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'21","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.010522+0000","last_change":"2024-05-07T13:59:34.010583+0000","last_active":"2024-05-07T13:59:34.010522+0000","last_peered":"2024-05-07T13:59:34.010522+0000","last_clean":"2024-05-07T13:59:34.010522+0000","last_became_active":"2024-05-07T13:55:58.336692+0000","last_became_peered":"2024-05-07T13:55:58.336692+0000","last_unstale":"2024-05-07T13:59:34.010522+0000","last_undegraded":"2024-05-07T13:59:34.010522+0000","last_fullsized":"2024-05-07T13:59:34.010522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:34.010409+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:34.010409+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.010409+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:23.971858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149744+0000","last_change":"2024-05-07T13:55:50.323082+0000","last_active":"2024-05-07T13:58:59.149744+0000","last_peered":"2024-05-07T13:58:59.149744+0000","last_clean":"2024-05-07T13:58:59.149744+0000","last_became_active":"2024-05-07T13:55:50.322764+0000","last_became_peered":"2024-05-07T13:55:50.322764+0000","last_unstale":"2024-05-07T13:58:59.149744+0000","last_undegraded":"2024-05-07T13:58:59.149744+0000","last_fullsized":"2024-05-07T13:58:59.149744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.208997+0000","last_change":"2024-05-07T13:55:48.325995+0000","last_active":"2024-05-07T13:59:06.208997+0000","last_peered":"2024-05-07T13:59:06.208997+0000","last_clean":"2024-05-07T13:59:06.208997+0000","last_became_active":"2024-05-07T13:55:48.325075+0000","last_became_peered":"2024-05-07T13:55:48.325075+0000","last_unstale":"2024-05-07T13:59:06.208997+0000","last_undegraded":"2024-05-07T13:59:06.208997+0000","last_fullsized":"2024-05-07T13:59:06.208997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.138853+0000","last_change":"2024-05-07T13:59:29.138879+0000","last_active":"2024-05-07T13:59:29.138853+0000","last_peered":"2024-05-07T13:59:29.138853+0000","last_clean":"2024-05-07T13:59:29.138853+0000","last_became_active":"2024-05-07T13:55:52.321730+0000","last_became_peered":"2024-05-07T13:55:52.321730+0000","last_unstale":"2024-05-07T13:59:29.138853+0000","last_undegraded":"2024-05-07T13:59:29.138853+0000","last_fullsized":"2024-05-07T13:59:29.138853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:29.138750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:29.138750+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.138750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:09.782425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'41","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.091355+0000","last_change":"2024-05-07T13:59:17.091397+0000","last_active":"2024-05-07T13:59:17.091355+0000","last_peered":"2024-05-07T13:59:17.091355+0000","last_clean":"2024-05-07T13:59:17.091355+0000","last_became_active":"2024-05-07T13:55:54.324530+0000","last_became_peered":"2024-05-07T13:55:54.324530+0000","last_unstale":"2024-05-07T13:59:17.091355+0000","last_undegraded":"2024-05-07T13:59:17.091355+0000","last_fullsized":"2024-05-07T13:59:17.091355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.091253+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:22.292118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.984217+0000","last_change":"2024-05-07T13:59:30.984243+0000","last_active":"2024-05-07T13:59:30.984217+0000","last_peered":"2024-05-07T13:59:30.984217+0000","last_clean":"2024-05-07T13:59:30.984217+0000","last_became_active":"2024-05-07T13:55:56.343900+0000","last_became_peered":"2024-05-07T13:55:56.343900+0000","last_unstale":"2024-05-07T13:59:30.984217+0000","last_undegraded":"2024-05-07T13:59:30.984217+0000","last_fullsized":"2024-05-07T13:59:30.984217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.984114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.984114+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.984114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:14.143436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.595430+0000","last_change":"2024-05-07T13:55:58.352050+0000","last_active":"2024-05-07T13:58:59.595430+0000","last_peered":"2024-05-07T13:58:59.595430+0000","last_clean":"2024-05-07T13:58:59.595430+0000","last_became_active":"2024-05-07T13:55:58.351724+0000","last_became_peered":"2024-05-07T13:55:58.351724+0000","last_unstale":"2024-05-07T13:58:59.595430+0000","last_undegraded":"2024-05-07T13:58:59.595430+0000","last_fullsized":"2024-05-07T13:58:59.595430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.842728+0000","last_change":"2024-05-07T13:59:21.842752+0000","last_active":"2024-05-07T13:59:21.842728+0000","last_peered":"2024-05-07T13:59:21.842728+0000","last_clean":"2024-05-07T13:59:21.842728+0000","last_became_active":"2024-05-07T13:55:50.326050+0000","last_became_peered":"2024-05-07T13:55:50.326050+0000","last_unstale":"2024-05-07T13:59:21.842728+0000","last_undegraded":"2024-05-07T13:59:21.842728+0000","last_fullsized":"2024-05-07T13:59:21.842728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.842623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:38.606939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.180108+0000","last_change":"2024-05-07T13:55:48.352032+0000","last_active":"2024-05-07T13:57:58.180108+0000","last_peered":"2024-05-07T13:57:58.180108+0000","last_clean":"2024-05-07T13:57:58.180108+0000","last_became_active":"2024-05-07T13:55:48.350335+0000","last_became_peered":"2024-05-07T13:55:48.350335+0000","last_unstale":"2024-05-07T13:57:58.180108+0000","last_undegraded":"2024-05-07T13:57:58.180108+0000","last_fullsized":"2024-05-07T13:57:58.180108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.050826+0000","last_change":"2024-05-07T13:59:29.050888+0000","last_active":"2024-05-07T13:59:29.050826+0000","last_peered":"2024-05-07T13:59:29.050826+0000","last_clean":"2024-05-07T13:59:29.050826+0000","last_became_active":"2024-05-07T13:55:52.322006+0000","last_became_peered":"2024-05-07T13:55:52.322006+0000","last_unstale":"2024-05-07T13:59:29.050826+0000","last_undegraded":"2024-05-07T13:59:29.050826+0000","last_fullsized":"2024-05-07T13:59:29.050826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:29.050679+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:29.050679+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.050679+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:28.253848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.102576+0000","last_change":"2024-05-07T13:59:25.102617+0000","last_active":"2024-05-07T13:59:25.102576+0000","last_peered":"2024-05-07T13:59:25.102576+0000","last_clean":"2024-05-07T13:59:25.102576+0000","last_became_active":"2024-05-07T13:55:54.319812+0000","last_became_peered":"2024-05-07T13:55:54.319812+0000","last_unstale":"2024-05-07T13:59:25.102576+0000","last_undegraded":"2024-05-07T13:59:25.102576+0000","last_fullsized":"2024-05-07T13:59:25.102576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.102469+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:25.507214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.102076+0000","last_change":"2024-05-07T13:59:11.102102+0000","last_active":"2024-05-07T13:59:11.102076+0000","last_peered":"2024-05-07T13:59:11.102076+0000","last_clean":"2024-05-07T13:59:11.102076+0000","last_became_active":"2024-05-07T13:55:56.331966+0000","last_became_peered":"2024-05-07T13:55:56.331966+0000","last_unstale":"2024-05-07T13:59:11.102076+0000","last_undegraded":"2024-05-07T13:59:11.102076+0000","last_fullsized":"2024-05-07T13:59:11.102076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.101988+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:35.873097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'21","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.051658+0000","last_change":"2024-05-07T13:59:38.051692+0000","last_active":"2024-05-07T13:59:38.051658+0000","last_peered":"2024-05-07T13:59:38.051658+0000","last_clean":"2024-05-07T13:59:38.051658+0000","last_became_active":"2024-05-07T13:55:58.340608+0000","last_became_peered":"2024-05-07T13:55:58.340608+0000","last_unstale":"2024-05-07T13:59:38.051658+0000","last_undegraded":"2024-05-07T13:59:38.051658+0000","last_fullsized":"2024-05-07T13:59:38.051658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:38.051568+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:38.051568+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.051568+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:32.852712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.106412+0000","last_change":"2024-05-07T13:59:44.106440+0000","last_active":"2024-05-07T13:59:44.106412+0000","last_peered":"2024-05-07T13:59:44.106412+0000","last_clean":"2024-05-07T13:59:44.106412+0000","last_became_active":"2024-05-07T13:55:50.322650+0000","last_became_peered":"2024-05-07T13:55:50.322650+0000","last_unstale":"2024-05-07T13:59:44.106412+0000","last_undegraded":"2024-05-07T13:59:44.106412+0000","last_fullsized":"2024-05-07T13:59:44.106412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:44.106305+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:44.106305+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.106305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:34.067754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.180087+0000","last_change":"2024-05-07T13:55:48.349364+0000","last_active":"2024-05-07T13:57:58.180087+0000","last_peered":"2024-05-07T13:57:58.180087+0000","last_clean":"2024-05-07T13:57:58.180087+0000","last_became_active":"2024-05-07T13:55:48.347434+0000","last_became_peered":"2024-05-07T13:55:48.347434+0000","last_unstale":"2024-05-07T13:57:58.180087+0000","last_undegraded":"2024-05-07T13:57:58.180087+0000","last_fullsized":"2024-05-07T13:57:58.180087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":428,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.028806+0000","last_change":"2024-05-07T13:59:25.028855+0000","last_active":"2024-05-07T13:59:25.028806+0000","last_peered":"2024-05-07T13:59:25.028806+0000","last_clean":"2024-05-07T13:59:25.028806+0000","last_became_active":"2024-05-07T13:55:52.321251+0000","last_became_peered":"2024-05-07T13:55:52.321251+0000","last_unstale":"2024-05-07T13:59:25.028806+0000","last_undegraded":"2024-05-07T13:59:25.028806+0000","last_fullsized":"2024-05-07T13:59:25.028806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.028700+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:12.963826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.075307+0000","last_change":"2024-05-07T13:59:36.075367+0000","last_active":"2024-05-07T13:59:36.075307+0000","last_peered":"2024-05-07T13:59:36.075307+0000","last_clean":"2024-05-07T13:59:36.075307+0000","last_became_active":"2024-05-07T13:55:54.331844+0000","last_became_peered":"2024-05-07T13:55:54.331844+0000","last_unstale":"2024-05-07T13:59:36.075307+0000","last_undegraded":"2024-05-07T13:59:36.075307+0000","last_fullsized":"2024-05-07T13:59:36.075307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:36.075220+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:36.075220+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.075220+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:04.453746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.078501+0000","last_change":"2024-05-07T13:59:15.078526+0000","last_active":"2024-05-07T13:59:15.078501+0000","last_peered":"2024-05-07T13:59:15.078501+0000","last_clean":"2024-05-07T13:59:15.078501+0000","last_became_active":"2024-05-07T13:55:56.332858+0000","last_became_peered":"2024-05-07T13:55:56.332858+0000","last_unstale":"2024-05-07T13:59:15.078501+0000","last_undegraded":"2024-05-07T13:59:15.078501+0000","last_fullsized":"2024-05-07T13:59:15.078501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078412+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:04.920152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.107453+0000","last_change":"2024-05-07T13:59:24.107497+0000","last_active":"2024-05-07T13:59:24.107453+0000","last_peered":"2024-05-07T13:59:24.107453+0000","last_clean":"2024-05-07T13:59:24.107453+0000","last_became_active":"2024-05-07T13:55:58.335341+0000","last_became_peered":"2024-05-07T13:55:58.335341+0000","last_unstale":"2024-05-07T13:59:24.107453+0000","last_undegraded":"2024-05-07T13:59:24.107453+0000","last_fullsized":"2024-05-07T13:59:24.107453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.107327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:21.412357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'5","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.039679+0000","last_change":"2024-05-07T13:59:29.039705+0000","last_active":"2024-05-07T13:59:29.039679+0000","last_peered":"2024-05-07T13:59:29.039679+0000","last_clean":"2024-05-07T13:59:29.039679+0000","last_became_active":"2024-05-07T13:55:50.331295+0000","last_became_peered":"2024-05-07T13:55:50.331295+0000","last_unstale":"2024-05-07T13:59:29.039679+0000","last_undegraded":"2024-05-07T13:59:29.039679+0000","last_fullsized":"2024-05-07T13:59:29.039679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:29.039589+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:29.039589+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.039589+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:05.611702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.180049+0000","last_change":"2024-05-07T13:55:48.352519+0000","last_active":"2024-05-07T13:57:58.180049+0000","last_peered":"2024-05-07T13:57:58.180049+0000","last_clean":"2024-05-07T13:57:58.180049+0000","last_became_active":"2024-05-07T13:55:48.351055+0000","last_became_peered":"2024-05-07T13:55:48.351055+0000","last_unstale":"2024-05-07T13:57:58.180049+0000","last_undegraded":"2024-05-07T13:57:58.180049+0000","last_fullsized":"2024-05-07T13:57:58.180049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"29'5","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.888798+0000","last_change":"2024-05-07T13:59:11.888832+0000","last_active":"2024-05-07T13:59:11.888798+0000","last_peered":"2024-05-07T13:59:11.888798+0000","last_clean":"2024-05-07T13:59:11.888798+0000","last_became_active":"2024-05-07T13:55:52.320027+0000","last_became_peered":"2024-05-07T13:55:52.320027+0000","last_unstale":"2024-05-07T13:59:11.888798+0000","last_undegraded":"2024-05-07T13:59:11.888798+0000","last_fullsized":"2024-05-07T13:59:11.888798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.888710+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:38:54.237300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'49","reported_seq":108,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.067236+0000","last_change":"2024-05-07T13:59:10.067275+0000","last_active":"2024-05-07T13:59:10.067236+0000","last_peered":"2024-05-07T13:59:10.067236+0000","last_clean":"2024-05-07T13:59:10.067236+0000","last_became_active":"2024-05-07T13:55:54.333766+0000","last_became_peered":"2024-05-07T13:55:54.333766+0000","last_unstale":"2024-05-07T13:59:10.067236+0000","last_undegraded":"2024-05-07T13:59:10.067236+0000","last_fullsized":"2024-05-07T13:59:10.067236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.067149+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:19.058798+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.069510+0000","last_change":"2024-05-07T13:59:12.069535+0000","last_active":"2024-05-07T13:59:12.069510+0000","last_peered":"2024-05-07T13:59:12.069510+0000","last_clean":"2024-05-07T13:59:12.069510+0000","last_became_active":"2024-05-07T13:55:56.338195+0000","last_became_peered":"2024-05-07T13:55:56.338195+0000","last_unstale":"2024-05-07T13:59:12.069510+0000","last_undegraded":"2024-05-07T13:59:12.069510+0000","last_fullsized":"2024-05-07T13:59:12.069510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.069419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:19:55.425213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.650464+0000","last_change":"2024-05-07T13:55:58.346374+0000","last_active":"2024-05-07T13:58:59.650464+0000","last_peered":"2024-05-07T13:58:59.650464+0000","last_clean":"2024-05-07T13:58:59.650464+0000","last_became_active":"2024-05-07T13:55:58.346040+0000","last_became_peered":"2024-05-07T13:55:58.346040+0000","last_unstale":"2024-05-07T13:58:59.650464+0000","last_undegraded":"2024-05-07T13:58:59.650464+0000","last_fullsized":"2024-05-07T13:58:59.650464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149919+0000","last_change":"2024-05-07T13:56:35.374383+0000","last_active":"2024-05-07T13:58:59.149919+0000","last_peered":"2024-05-07T13:58:59.149919+0000","last_clean":"2024-05-07T13:58:59.149919+0000","last_became_active":"2024-05-07T13:56:35.369148+0000","last_became_peered":"2024-05-07T13:56:35.369148+0000","last_unstale":"2024-05-07T13:58:59.149919+0000","last_undegraded":"2024-05-07T13:58:59.149919+0000","last_fullsized":"2024-05-07T13:58:59.149919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":199,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:09.613744+0000","last_change":"2024-05-07T13:55:40.043635+0000","last_active":"2024-05-07T13:59:09.613744+0000","last_peered":"2024-05-07T13:59:09.613744+0000","last_clean":"2024-05-07T13:59:09.613744+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:59:09.613744+0000","last_undegraded":"2024-05-07T13:59:09.613744+0000","last_fullsized":"2024-05-07T13:59:09.613744+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.178510+0000","last_change":"2024-05-07T13:55:40.045474+0000","last_active":"2024-05-07T13:57:48.178510+0000","last_peered":"2024-05-07T13:57:48.178510+0000","last_clean":"2024-05-07T13:57:48.178510+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T13:57:48.178510+0000","last_undegraded":"2024-05-07T13:57:48.178510+0000","last_fullsized":"2024-05-07T13:57:48.178510+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179367+0000","last_change":"2024-05-07T13:55:48.352406+0000","last_active":"2024-05-07T13:57:53.179367+0000","last_peered":"2024-05-07T13:57:53.179367+0000","last_clean":"2024-05-07T13:57:53.179367+0000","last_became_active":"2024-05-07T13:55:48.350998+0000","last_became_peered":"2024-05-07T13:55:48.350998+0000","last_unstale":"2024-05-07T13:57:53.179367+0000","last_undegraded":"2024-05-07T13:57:53.179367+0000","last_fullsized":"2024-05-07T13:57:53.179367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.053544+0000","last_change":"2024-05-07T13:59:28.053567+0000","last_active":"2024-05-07T13:59:28.053544+0000","last_peered":"2024-05-07T13:59:28.053544+0000","last_clean":"2024-05-07T13:59:28.053544+0000","last_became_active":"2024-05-07T13:55:52.321406+0000","last_became_peered":"2024-05-07T13:55:52.321406+0000","last_unstale":"2024-05-07T13:59:28.053544+0000","last_undegraded":"2024-05-07T13:59:28.053544+0000","last_fullsized":"2024-05-07T13:59:28.053544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.053456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:40.818094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.891563+0000","last_change":"2024-05-07T13:59:22.891601+0000","last_active":"2024-05-07T13:59:22.891563+0000","last_peered":"2024-05-07T13:59:22.891563+0000","last_clean":"2024-05-07T13:59:22.891563+0000","last_became_active":"2024-05-07T13:55:54.328677+0000","last_became_peered":"2024-05-07T13:55:54.328677+0000","last_unstale":"2024-05-07T13:59:22.891563+0000","last_undegraded":"2024-05-07T13:59:22.891563+0000","last_fullsized":"2024-05-07T13:59:22.891563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.891465+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:38.858949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.993083+0000","last_change":"2024-05-07T13:59:21.993105+0000","last_active":"2024-05-07T13:59:21.993083+0000","last_peered":"2024-05-07T13:59:21.993083+0000","last_clean":"2024-05-07T13:59:21.993083+0000","last_became_active":"2024-05-07T13:55:56.335013+0000","last_became_peered":"2024-05-07T13:55:56.335013+0000","last_unstale":"2024-05-07T13:59:21.993083+0000","last_undegraded":"2024-05-07T13:59:21.993083+0000","last_fullsized":"2024-05-07T13:59:21.993083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.992994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:07:21.511355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'82","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.141155+0000","last_change":"2024-05-07T13:59:20.141198+0000","last_active":"2024-05-07T13:59:20.141155+0000","last_peered":"2024-05-07T13:59:20.141155+0000","last_clean":"2024-05-07T13:59:20.141155+0000","last_became_active":"2024-05-07T13:55:58.335220+0000","last_became_peered":"2024-05-07T13:55:58.335220+0000","last_unstale":"2024-05-07T13:59:20.141155+0000","last_undegraded":"2024-05-07T13:59:20.141155+0000","last_fullsized":"2024-05-07T13:59:20.141155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.141061+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:19.754291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.184233+0000","last_change":"2024-05-07T13:59:48.184294+0000","last_active":"2024-05-07T13:59:48.184233+0000","last_peered":"2024-05-07T13:59:48.184233+0000","last_clean":"2024-05-07T13:59:48.184233+0000","last_became_active":"2024-05-07T13:55:50.323408+0000","last_became_peered":"2024-05-07T13:55:50.323408+0000","last_unstale":"2024-05-07T13:59:48.184233+0000","last_undegraded":"2024-05-07T13:59:48.184233+0000","last_fullsized":"2024-05-07T13:59:48.184233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:48.184128+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:48.184128+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.184128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:05:31.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516514+0000","last_change":"2024-05-07T13:55:40.043428+0000","last_active":"2024-05-07T13:59:10.516514+0000","last_peered":"2024-05-07T13:59:10.516514+0000","last_clean":"2024-05-07T13:59:10.516514+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T13:59:10.516514+0000","last_undegraded":"2024-05-07T13:59:10.516514+0000","last_fullsized":"2024-05-07T13:59:10.516514+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.128052+0000","last_change":"2024-05-07T13:59:43.128078+0000","last_active":"2024-05-07T13:59:43.128052+0000","last_peered":"2024-05-07T13:59:43.128052+0000","last_clean":"2024-05-07T13:59:43.128052+0000","last_became_active":"2024-05-07T13:55:48.325905+0000","last_became_peered":"2024-05-07T13:55:48.325905+0000","last_unstale":"2024-05-07T13:59:43.128052+0000","last_undegraded":"2024-05-07T13:59:43.128052+0000","last_fullsized":"2024-05-07T13:59:43.128052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:43.127954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:43.127954+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.127954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:34.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.859897+0000","last_change":"2024-05-07T13:59:17.859922+0000","last_active":"2024-05-07T13:59:17.859897+0000","last_peered":"2024-05-07T13:59:17.859897+0000","last_clean":"2024-05-07T13:59:17.859897+0000","last_became_active":"2024-05-07T13:55:52.318221+0000","last_became_peered":"2024-05-07T13:55:52.318221+0000","last_unstale":"2024-05-07T13:59:17.859897+0000","last_undegraded":"2024-05-07T13:59:17.859897+0000","last_fullsized":"2024-05-07T13:59:17.859897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.859806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:59.896313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.121926+0000","last_change":"2024-05-07T13:59:14.121985+0000","last_active":"2024-05-07T13:59:14.121926+0000","last_peered":"2024-05-07T13:59:14.121926+0000","last_clean":"2024-05-07T13:59:14.121926+0000","last_became_active":"2024-05-07T13:55:54.329774+0000","last_became_peered":"2024-05-07T13:55:54.329774+0000","last_unstale":"2024-05-07T13:59:14.121926+0000","last_undegraded":"2024-05-07T13:59:14.121926+0000","last_fullsized":"2024-05-07T13:59:14.121926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.121829+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:13.735059+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.058143+0000","last_change":"2024-05-07T13:59:33.058168+0000","last_active":"2024-05-07T13:59:33.058143+0000","last_peered":"2024-05-07T13:59:33.058143+0000","last_clean":"2024-05-07T13:59:33.058143+0000","last_became_active":"2024-05-07T13:55:56.343224+0000","last_became_peered":"2024-05-07T13:55:56.343224+0000","last_unstale":"2024-05-07T13:59:33.058143+0000","last_undegraded":"2024-05-07T13:59:33.058143+0000","last_fullsized":"2024-05-07T13:59:33.058143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:33.058058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:33.058058+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.058058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:31.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.076708+0000","last_change":"2024-05-07T13:59:39.076744+0000","last_active":"2024-05-07T13:59:39.076708+0000","last_peered":"2024-05-07T13:59:39.076708+0000","last_clean":"2024-05-07T13:59:39.076708+0000","last_became_active":"2024-05-07T13:55:58.344996+0000","last_became_peered":"2024-05-07T13:55:58.344996+0000","last_unstale":"2024-05-07T13:59:39.076708+0000","last_undegraded":"2024-05-07T13:59:39.076708+0000","last_fullsized":"2024-05-07T13:59:39.076708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:39.076601+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:39.076601+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.076601+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:24:16.973175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.071593+0000","last_change":"2024-05-07T13:59:48.071620+0000","last_active":"2024-05-07T13:59:48.071593+0000","last_peered":"2024-05-07T13:59:48.071593+0000","last_clean":"2024-05-07T13:59:48.071593+0000","last_became_active":"2024-05-07T13:55:50.318471+0000","last_became_peered":"2024-05-07T13:55:50.318471+0000","last_unstale":"2024-05-07T13:59:48.071593+0000","last_undegraded":"2024-05-07T13:59:48.071593+0000","last_fullsized":"2024-05-07T13:59:48.071593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:48.071503+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:48.071503+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.071503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:22.255533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.063228+0000","last_change":"2024-05-07T13:55:40.043522+0000","last_active":"2024-05-07T13:59:10.063228+0000","last_peered":"2024-05-07T13:59:10.063228+0000","last_clean":"2024-05-07T13:59:10.063228+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:59:10.063228+0000","last_undegraded":"2024-05-07T13:59:10.063228+0000","last_fullsized":"2024-05-07T13:59:10.063228+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:09.165509+0000","last_change":"2024-05-07T13:55:48.326648+0000","last_active":"2024-05-07T13:59:09.165509+0000","last_peered":"2024-05-07T13:59:09.165509+0000","last_clean":"2024-05-07T13:59:09.165509+0000","last_became_active":"2024-05-07T13:55:48.325013+0000","last_became_peered":"2024-05-07T13:55:48.325013+0000","last_unstale":"2024-05-07T13:59:09.165509+0000","last_undegraded":"2024-05-07T13:59:09.165509+0000","last_fullsized":"2024-05-07T13:59:09.165509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182795+0000","last_change":"2024-05-07T13:56:35.376721+0000","last_active":"2024-05-07T13:58:03.182795+0000","last_peered":"2024-05-07T13:58:03.182795+0000","last_clean":"2024-05-07T13:58:03.182795+0000","last_became_active":"2024-05-07T13:56:35.368904+0000","last_became_peered":"2024-05-07T13:56:35.368904+0000","last_unstale":"2024-05-07T13:58:03.182795+0000","last_undegraded":"2024-05-07T13:58:03.182795+0000","last_fullsized":"2024-05-07T13:58:03.182795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.147287+0000","last_change":"2024-05-07T13:59:21.147329+0000","last_active":"2024-05-07T13:59:21.147287+0000","last_peered":"2024-05-07T13:59:21.147287+0000","last_clean":"2024-05-07T13:59:21.147287+0000","last_became_active":"2024-05-07T13:55:54.329778+0000","last_became_peered":"2024-05-07T13:55:54.329778+0000","last_unstale":"2024-05-07T13:59:21.147287+0000","last_undegraded":"2024-05-07T13:59:21.147287+0000","last_fullsized":"2024-05-07T13:59:21.147287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.147200+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:14:48.234250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.061769+0000","last_change":"2024-05-07T13:59:26.061795+0000","last_active":"2024-05-07T13:59:26.061769+0000","last_peered":"2024-05-07T13:59:26.061769+0000","last_clean":"2024-05-07T13:59:26.061769+0000","last_became_active":"2024-05-07T13:55:56.336064+0000","last_became_peered":"2024-05-07T13:55:56.336064+0000","last_unstale":"2024-05-07T13:59:26.061769+0000","last_undegraded":"2024-05-07T13:59:26.061769+0000","last_fullsized":"2024-05-07T13:59:26.061769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.061660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:02.633772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.479098+0000","last_change":"2024-05-07T13:55:58.350552+0000","last_active":"2024-05-07T13:58:59.479098+0000","last_peered":"2024-05-07T13:58:59.479098+0000","last_clean":"2024-05-07T13:58:59.479098+0000","last_became_active":"2024-05-07T13:55:58.350208+0000","last_became_peered":"2024-05-07T13:55:58.350208+0000","last_unstale":"2024-05-07T13:58:59.479098+0000","last_undegraded":"2024-05-07T13:58:59.479098+0000","last_fullsized":"2024-05-07T13:58:59.479098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'8","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.146994+0000","last_change":"2024-05-07T13:59:46.147024+0000","last_active":"2024-05-07T13:59:46.146994+0000","last_peered":"2024-05-07T13:59:46.146994+0000","last_clean":"2024-05-07T13:59:46.146994+0000","last_became_active":"2024-05-07T13:55:50.313163+0000","last_became_peered":"2024-05-07T13:55:50.313163+0000","last_unstale":"2024-05-07T13:59:46.146994+0000","last_undegraded":"2024-05-07T13:59:46.146994+0000","last_fullsized":"2024-05-07T13:59:46.146994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:46.146906+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:46.146906+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.146906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:41.305486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.178453+0000","last_change":"2024-05-07T13:55:40.044279+0000","last_active":"2024-05-07T13:57:48.178453+0000","last_peered":"2024-05-07T13:57:48.178453+0000","last_clean":"2024-05-07T13:57:48.178453+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T13:57:48.178453+0000","last_undegraded":"2024-05-07T13:57:48.178453+0000","last_fullsized":"2024-05-07T13:57:48.178453+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.181466+0000","last_change":"2024-05-07T13:55:48.338820+0000","last_active":"2024-05-07T13:57:53.181466+0000","last_peered":"2024-05-07T13:57:53.181466+0000","last_clean":"2024-05-07T13:57:53.181466+0000","last_became_active":"2024-05-07T13:55:48.338442+0000","last_became_peered":"2024-05-07T13:55:48.338442+0000","last_unstale":"2024-05-07T13:57:53.181466+0000","last_undegraded":"2024-05-07T13:57:53.181466+0000","last_fullsized":"2024-05-07T13:57:53.181466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.005429+0000","last_change":"2024-05-07T13:59:32.005460+0000","last_active":"2024-05-07T13:59:32.005429+0000","last_peered":"2024-05-07T13:59:32.005429+0000","last_clean":"2024-05-07T13:59:32.005429+0000","last_became_active":"2024-05-07T13:55:52.321506+0000","last_became_peered":"2024-05-07T13:55:52.321506+0000","last_unstale":"2024-05-07T13:59:32.005429+0000","last_undegraded":"2024-05-07T13:59:32.005429+0000","last_fullsized":"2024-05-07T13:59:32.005429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.005333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.005333+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.005333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:53.661193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.983795+0000","last_change":"2024-05-07T13:59:24.983843+0000","last_active":"2024-05-07T13:59:24.983795+0000","last_peered":"2024-05-07T13:59:24.983795+0000","last_clean":"2024-05-07T13:59:24.983795+0000","last_became_active":"2024-05-07T13:55:54.328763+0000","last_became_peered":"2024-05-07T13:55:54.328763+0000","last_unstale":"2024-05-07T13:59:24.983795+0000","last_undegraded":"2024-05-07T13:59:24.983795+0000","last_fullsized":"2024-05-07T13:59:24.983795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.983703+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:59.173853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.014361+0000","last_change":"2024-05-07T13:59:32.014388+0000","last_active":"2024-05-07T13:59:32.014361+0000","last_peered":"2024-05-07T13:59:32.014361+0000","last_clean":"2024-05-07T13:59:32.014361+0000","last_became_active":"2024-05-07T13:55:56.343131+0000","last_became_peered":"2024-05-07T13:55:56.343131+0000","last_unstale":"2024-05-07T13:59:32.014361+0000","last_undegraded":"2024-05-07T13:59:32.014361+0000","last_fullsized":"2024-05-07T13:59:32.014361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.014263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.014263+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.014263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:11:56.176284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181055+0000","last_change":"2024-05-07T13:55:58.348390+0000","last_active":"2024-05-07T13:58:08.181055+0000","last_peered":"2024-05-07T13:58:08.181055+0000","last_clean":"2024-05-07T13:58:08.181055+0000","last_became_active":"2024-05-07T13:55:58.348068+0000","last_became_peered":"2024-05-07T13:55:58.348068+0000","last_unstale":"2024-05-07T13:58:08.181055+0000","last_undegraded":"2024-05-07T13:58:08.181055+0000","last_fullsized":"2024-05-07T13:58:08.181055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'14","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.092948+0000","last_change":"2024-05-07T13:59:38.092977+0000","last_active":"2024-05-07T13:59:38.092948+0000","last_peered":"2024-05-07T13:59:38.092948+0000","last_clean":"2024-05-07T13:59:38.092948+0000","last_became_active":"2024-05-07T13:55:50.323820+0000","last_became_peered":"2024-05-07T13:55:50.323820+0000","last_unstale":"2024-05-07T13:59:38.092948+0000","last_undegraded":"2024-05-07T13:59:38.092948+0000","last_fullsized":"2024-05-07T13:59:38.092948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:38.092855+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:38.092855+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.092855+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:57.688105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.181498+0000","last_change":"2024-05-07T13:55:48.338590+0000","last_active":"2024-05-07T13:57:53.181498+0000","last_peered":"2024-05-07T13:57:53.181498+0000","last_clean":"2024-05-07T13:57:53.181498+0000","last_became_active":"2024-05-07T13:55:48.338139+0000","last_became_peered":"2024-05-07T13:55:48.338139+0000","last_unstale":"2024-05-07T13:57:53.181498+0000","last_undegraded":"2024-05-07T13:57:53.181498+0000","last_fullsized":"2024-05-07T13:57:53.181498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.176847+0000","last_change":"2024-05-07T13:55:40.043241+0000","last_active":"2024-05-07T13:57:48.176847+0000","last_peered":"2024-05-07T13:57:48.176847+0000","last_clean":"2024-05-07T13:57:48.176847+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:57:48.176847+0000","last_undegraded":"2024-05-07T13:57:48.176847+0000","last_fullsized":"2024-05-07T13:57:48.176847+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.010308+0000","last_change":"2024-05-07T13:59:33.010339+0000","last_active":"2024-05-07T13:59:33.010308+0000","last_peered":"2024-05-07T13:59:33.010308+0000","last_clean":"2024-05-07T13:59:33.010308+0000","last_became_active":"2024-05-07T13:55:52.321249+0000","last_became_peered":"2024-05-07T13:55:52.321249+0000","last_unstale":"2024-05-07T13:59:33.010308+0000","last_undegraded":"2024-05-07T13:59:33.010308+0000","last_fullsized":"2024-05-07T13:59:33.010308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.010232+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.010232+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.010232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:33.336357+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'74","reported_seq":150,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.980017+0000","last_change":"2024-05-07T13:59:20.980067+0000","last_active":"2024-05-07T13:59:20.980017+0000","last_peered":"2024-05-07T13:59:20.980017+0000","last_clean":"2024-05-07T13:59:20.980017+0000","last_became_active":"2024-05-07T13:55:54.326812+0000","last_became_peered":"2024-05-07T13:55:54.326812+0000","last_unstale":"2024-05-07T13:59:20.980017+0000","last_undegraded":"2024-05-07T13:59:20.980017+0000","last_fullsized":"2024-05-07T13:59:20.980017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.979917+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:21.832415+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.116227+0000","last_change":"2024-05-07T13:59:13.116256+0000","last_active":"2024-05-07T13:59:13.116227+0000","last_peered":"2024-05-07T13:59:13.116227+0000","last_clean":"2024-05-07T13:59:13.116227+0000","last_became_active":"2024-05-07T13:55:56.331343+0000","last_became_peered":"2024-05-07T13:55:56.331343+0000","last_unstale":"2024-05-07T13:59:13.116227+0000","last_undegraded":"2024-05-07T13:59:13.116227+0000","last_fullsized":"2024-05-07T13:59:13.116227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.116129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:37.954463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'11","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.180491+0000","last_change":"2024-05-07T13:55:58.347841+0000","last_active":"2024-05-07T13:58:13.180491+0000","last_peered":"2024-05-07T13:58:13.180491+0000","last_clean":"2024-05-07T13:58:13.180491+0000","last_became_active":"2024-05-07T13:55:58.347566+0000","last_became_peered":"2024-05-07T13:55:58.347566+0000","last_unstale":"2024-05-07T13:58:13.180491+0000","last_undegraded":"2024-05-07T13:58:13.180491+0000","last_fullsized":"2024-05-07T13:58:13.180491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.061506+0000","last_change":"2024-05-07T13:59:30.061535+0000","last_active":"2024-05-07T13:59:30.061506+0000","last_peered":"2024-05-07T13:59:30.061506+0000","last_clean":"2024-05-07T13:59:30.061506+0000","last_became_active":"2024-05-07T13:55:50.330547+0000","last_became_peered":"2024-05-07T13:55:50.330547+0000","last_unstale":"2024-05-07T13:59:30.061506+0000","last_undegraded":"2024-05-07T13:59:30.061506+0000","last_fullsized":"2024-05-07T13:59:30.061506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:30.061415+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:30.061415+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.061415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:52.036188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.177543+0000","last_change":"2024-05-07T13:55:48.325207+0000","last_active":"2024-05-07T13:57:53.177543+0000","last_peered":"2024-05-07T13:57:53.177543+0000","last_clean":"2024-05-07T13:57:53.177543+0000","last_became_active":"2024-05-07T13:55:48.324378+0000","last_became_peered":"2024-05-07T13:55:48.324378+0000","last_unstale":"2024-05-07T13:57:53.177543+0000","last_undegraded":"2024-05-07T13:57:53.177543+0000","last_fullsized":"2024-05-07T13:57:53.177543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.178555+0000","last_change":"2024-05-07T13:55:40.044124+0000","last_active":"2024-05-07T13:57:48.178555+0000","last_peered":"2024-05-07T13:57:48.178555+0000","last_clean":"2024-05-07T13:57:48.178555+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T13:57:48.178555+0000","last_undegraded":"2024-05-07T13:57:48.178555+0000","last_fullsized":"2024-05-07T13:57:48.178555+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:43.187640+0000","last_change":"2024-05-07T13:56:35.366451+0000","last_active":"2024-05-07T13:58:43.187640+0000","last_peered":"2024-05-07T13:58:43.187640+0000","last_clean":"2024-05-07T13:58:43.187640+0000","last_became_active":"2024-05-07T13:56:35.366075+0000","last_became_peered":"2024-05-07T13:56:35.366075+0000","last_unstale":"2024-05-07T13:58:43.187640+0000","last_undegraded":"2024-05-07T13:58:43.187640+0000","last_fullsized":"2024-05-07T13:58:43.187640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"29'21","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.152337+0000","last_change":"2024-05-07T13:59:13.152407+0000","last_active":"2024-05-07T13:59:13.152337+0000","last_peered":"2024-05-07T13:59:13.152337+0000","last_clean":"2024-05-07T13:59:13.152337+0000","last_became_active":"2024-05-07T13:55:54.330896+0000","last_became_peered":"2024-05-07T13:55:54.330896+0000","last_unstale":"2024-05-07T13:59:13.152337+0000","last_undegraded":"2024-05-07T13:59:13.152337+0000","last_fullsized":"2024-05-07T13:59:13.152337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.152223+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.463262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":386,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.085631+0000","last_change":"2024-05-07T13:59:27.085692+0000","last_active":"2024-05-07T13:59:27.085631+0000","last_peered":"2024-05-07T13:59:27.085631+0000","last_clean":"2024-05-07T13:59:27.085631+0000","last_became_active":"2024-05-07T13:55:56.333242+0000","last_became_peered":"2024-05-07T13:55:56.333242+0000","last_unstale":"2024-05-07T13:59:27.085631+0000","last_undegraded":"2024-05-07T13:59:27.085631+0000","last_fullsized":"2024-05-07T13:59:27.085631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.085530+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:23.784119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182607+0000","last_change":"2024-05-07T13:55:58.346596+0000","last_active":"2024-05-07T13:58:13.182607+0000","last_peered":"2024-05-07T13:58:13.182607+0000","last_clean":"2024-05-07T13:58:13.182607+0000","last_became_active":"2024-05-07T13:55:58.346295+0000","last_became_peered":"2024-05-07T13:55:58.346295+0000","last_unstale":"2024-05-07T13:58:13.182607+0000","last_undegraded":"2024-05-07T13:58:13.182607+0000","last_fullsized":"2024-05-07T13:58:13.182607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.139657+0000","last_change":"2024-05-07T13:59:43.139684+0000","last_active":"2024-05-07T13:59:43.139657+0000","last_peered":"2024-05-07T13:59:43.139657+0000","last_clean":"2024-05-07T13:59:43.139657+0000","last_became_active":"2024-05-07T13:55:50.325665+0000","last_became_peered":"2024-05-07T13:55:50.325665+0000","last_unstale":"2024-05-07T13:59:43.139657+0000","last_undegraded":"2024-05-07T13:59:43.139657+0000","last_fullsized":"2024-05-07T13:59:43.139657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:43.139573+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:43.139573+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.139573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:38:12.305990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.399241+0000","last_change":"2024-05-07T13:55:48.347535+0000","last_active":"2024-05-07T13:58:59.399241+0000","last_peered":"2024-05-07T13:58:59.399241+0000","last_clean":"2024-05-07T13:58:59.399241+0000","last_became_active":"2024-05-07T13:55:48.346645+0000","last_became_peered":"2024-05-07T13:55:48.346645+0000","last_unstale":"2024-05-07T13:58:59.399241+0000","last_undegraded":"2024-05-07T13:58:59.399241+0000","last_fullsized":"2024-05-07T13:58:59.399241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:48.176884+0000","last_change":"2024-05-07T13:55:40.045556+0000","last_active":"2024-05-07T13:57:48.176884+0000","last_peered":"2024-05-07T13:57:48.176884+0000","last_clean":"2024-05-07T13:57:48.176884+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:57:48.176884+0000","last_undegraded":"2024-05-07T13:57:48.176884+0000","last_fullsized":"2024-05-07T13:57:48.176884+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.841962+0000","last_change":"2024-05-07T13:59:12.842021+0000","last_active":"2024-05-07T13:59:12.841962+0000","last_peered":"2024-05-07T13:59:12.841962+0000","last_clean":"2024-05-07T13:59:12.841962+0000","last_became_active":"2024-05-07T13:55:52.321160+0000","last_became_peered":"2024-05-07T13:55:52.321160+0000","last_unstale":"2024-05-07T13:59:12.841962+0000","last_undegraded":"2024-05-07T13:59:12.841962+0000","last_fullsized":"2024-05-07T13:59:12.841962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.841853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:34.497713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.104619+0000","last_change":"2024-05-07T13:59:40.104664+0000","last_active":"2024-05-07T13:59:40.104619+0000","last_peered":"2024-05-07T13:59:40.104619+0000","last_clean":"2024-05-07T13:59:40.104619+0000","last_became_active":"2024-05-07T13:55:54.329885+0000","last_became_peered":"2024-05-07T13:55:54.329885+0000","last_unstale":"2024-05-07T13:59:40.104619+0000","last_undegraded":"2024-05-07T13:59:40.104619+0000","last_fullsized":"2024-05-07T13:59:40.104619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:40.104516+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:40.104516+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.104516+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:58.439308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.906520+0000","last_change":"2024-05-07T13:59:11.906548+0000","last_active":"2024-05-07T13:59:11.906520+0000","last_peered":"2024-05-07T13:59:11.906520+0000","last_clean":"2024-05-07T13:59:11.906520+0000","last_became_active":"2024-05-07T13:55:56.334023+0000","last_became_peered":"2024-05-07T13:55:56.334023+0000","last_unstale":"2024-05-07T13:59:11.906520+0000","last_undegraded":"2024-05-07T13:59:11.906520+0000","last_fullsized":"2024-05-07T13:59:11.906520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.906422+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:49:19.117395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181875+0000","last_change":"2024-05-07T13:55:58.347319+0000","last_active":"2024-05-07T13:58:13.181875+0000","last_peered":"2024-05-07T13:58:13.181875+0000","last_clean":"2024-05-07T13:58:13.181875+0000","last_became_active":"2024-05-07T13:55:58.346984+0000","last_became_peered":"2024-05-07T13:55:58.346984+0000","last_unstale":"2024-05-07T13:58:13.181875+0000","last_undegraded":"2024-05-07T13:58:13.181875+0000","last_fullsized":"2024-05-07T13:58:13.181875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.079877+0000","last_change":"2024-05-07T13:59:48.079940+0000","last_active":"2024-05-07T13:59:48.079877+0000","last_peered":"2024-05-07T13:59:48.079877+0000","last_clean":"2024-05-07T13:59:48.079877+0000","last_became_active":"2024-05-07T13:55:50.327283+0000","last_became_peered":"2024-05-07T13:55:50.327283+0000","last_unstale":"2024-05-07T13:59:48.079877+0000","last_undegraded":"2024-05-07T13:59:48.079877+0000","last_fullsized":"2024-05-07T13:59:48.079877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:48.079746+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:48.079746+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.079746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:42.880890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.179739+0000","last_change":"2024-05-07T13:55:48.337939+0000","last_active":"2024-05-07T13:57:58.179739+0000","last_peered":"2024-05-07T13:57:58.179739+0000","last_clean":"2024-05-07T13:57:58.179739+0000","last_became_active":"2024-05-07T13:55:48.337553+0000","last_became_peered":"2024-05-07T13:55:48.337553+0000","last_unstale":"2024-05-07T13:57:58.179739+0000","last_undegraded":"2024-05-07T13:57:58.179739+0000","last_fullsized":"2024-05-07T13:57:58.179739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179501+0000","last_change":"2024-05-07T13:55:40.043788+0000","last_active":"2024-05-07T13:57:53.179501+0000","last_peered":"2024-05-07T13:57:53.179501+0000","last_clean":"2024-05-07T13:57:53.179501+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T13:57:53.179501+0000","last_undegraded":"2024-05-07T13:57:53.179501+0000","last_fullsized":"2024-05-07T13:57:53.179501+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.844855+0000","last_change":"2024-05-07T13:59:19.844877+0000","last_active":"2024-05-07T13:59:19.844855+0000","last_peered":"2024-05-07T13:59:19.844855+0000","last_clean":"2024-05-07T13:59:19.844855+0000","last_became_active":"2024-05-07T13:55:52.314793+0000","last_became_peered":"2024-05-07T13:55:52.314793+0000","last_unstale":"2024-05-07T13:59:19.844855+0000","last_undegraded":"2024-05-07T13:59:19.844855+0000","last_fullsized":"2024-05-07T13:59:19.844855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.844768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:57:45.920718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.116000+0000","last_change":"2024-05-07T13:59:19.116043+0000","last_active":"2024-05-07T13:59:19.116000+0000","last_peered":"2024-05-07T13:59:19.116000+0000","last_clean":"2024-05-07T13:59:19.116000+0000","last_became_active":"2024-05-07T13:55:54.329879+0000","last_became_peered":"2024-05-07T13:55:54.329879+0000","last_unstale":"2024-05-07T13:59:19.116000+0000","last_undegraded":"2024-05-07T13:59:19.116000+0000","last_fullsized":"2024-05-07T13:59:19.116000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.115906+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:13.426945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.963155+0000","last_change":"2024-05-07T13:59:15.963178+0000","last_active":"2024-05-07T13:59:15.963155+0000","last_peered":"2024-05-07T13:59:15.963155+0000","last_clean":"2024-05-07T13:59:15.963155+0000","last_became_active":"2024-05-07T13:55:56.332931+0000","last_became_peered":"2024-05-07T13:55:56.332931+0000","last_unstale":"2024-05-07T13:59:15.963155+0000","last_undegraded":"2024-05-07T13:59:15.963155+0000","last_fullsized":"2024-05-07T13:59:15.963155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.963044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:35.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.084979+0000","last_change":"2024-05-07T13:59:32.085005+0000","last_active":"2024-05-07T13:59:32.084979+0000","last_peered":"2024-05-07T13:59:32.084979+0000","last_clean":"2024-05-07T13:59:32.084979+0000","last_became_active":"2024-05-07T13:55:58.340759+0000","last_became_peered":"2024-05-07T13:55:58.340759+0000","last_unstale":"2024-05-07T13:59:32.084979+0000","last_undegraded":"2024-05-07T13:59:32.084979+0000","last_fullsized":"2024-05-07T13:59:32.084979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.084886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.084886+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.084886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:07:31.603247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.182828+0000","last_change":"2024-05-07T13:55:58.348875+0000","last_active":"2024-05-07T13:58:03.182828+0000","last_peered":"2024-05-07T13:58:03.182828+0000","last_clean":"2024-05-07T13:58:03.182828+0000","last_became_active":"2024-05-07T13:55:58.348566+0000","last_became_peered":"2024-05-07T13:55:58.348566+0000","last_unstale":"2024-05-07T13:58:03.182828+0000","last_undegraded":"2024-05-07T13:58:03.182828+0000","last_fullsized":"2024-05-07T13:58:03.182828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.040601+0000","last_change":"2024-05-07T13:59:33.040654+0000","last_active":"2024-05-07T13:59:33.040601+0000","last_peered":"2024-05-07T13:59:33.040601+0000","last_clean":"2024-05-07T13:59:33.040601+0000","last_became_active":"2024-05-07T13:55:50.329615+0000","last_became_peered":"2024-05-07T13:55:50.329615+0000","last_unstale":"2024-05-07T13:59:33.040601+0000","last_undegraded":"2024-05-07T13:59:33.040601+0000","last_fullsized":"2024-05-07T13:59:33.040601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.040493+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.040493+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.040493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:15.286657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181674+0000","last_change":"2024-05-07T13:55:48.348585+0000","last_active":"2024-05-07T13:58:08.181674+0000","last_peered":"2024-05-07T13:58:08.181674+0000","last_clean":"2024-05-07T13:58:08.181674+0000","last_became_active":"2024-05-07T13:55:48.346558+0000","last_became_peered":"2024-05-07T13:55:48.346558+0000","last_unstale":"2024-05-07T13:58:08.181674+0000","last_undegraded":"2024-05-07T13:58:08.181674+0000","last_fullsized":"2024-05-07T13:58:08.181674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.052177+0000","last_change":"2024-05-07T13:59:20.052199+0000","last_active":"2024-05-07T13:59:20.052177+0000","last_peered":"2024-05-07T13:59:20.052177+0000","last_clean":"2024-05-07T13:59:20.052177+0000","last_became_active":"2024-05-07T13:55:52.324083+0000","last_became_peered":"2024-05-07T13:55:52.324083+0000","last_unstale":"2024-05-07T13:59:20.052177+0000","last_undegraded":"2024-05-07T13:59:20.052177+0000","last_fullsized":"2024-05-07T13:59:20.052177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.052084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:52.982817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.110559+0000","last_change":"2024-05-07T13:59:39.110608+0000","last_active":"2024-05-07T13:59:39.110559+0000","last_peered":"2024-05-07T13:59:39.110559+0000","last_clean":"2024-05-07T13:59:39.110559+0000","last_became_active":"2024-05-07T13:55:54.330906+0000","last_became_peered":"2024-05-07T13:55:54.330906+0000","last_unstale":"2024-05-07T13:59:39.110559+0000","last_undegraded":"2024-05-07T13:59:39.110559+0000","last_fullsized":"2024-05-07T13:59:39.110559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-07T13:59:39.110467+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-07T13:59:39.110467+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.110467+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:29.925909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183211+0000","last_change":"2024-05-07T13:55:56.348303+0000","last_active":"2024-05-07T13:58:18.183211+0000","last_peered":"2024-05-07T13:58:18.183211+0000","last_clean":"2024-05-07T13:58:18.183211+0000","last_became_active":"2024-05-07T13:55:56.346371+0000","last_became_peered":"2024-05-07T13:55:56.346371+0000","last_unstale":"2024-05-07T13:58:18.183211+0000","last_undegraded":"2024-05-07T13:58:18.183211+0000","last_fullsized":"2024-05-07T13:58:18.183211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:55.312628+0000","last_clean_scrub_stamp":"2024-05-07T13:55:55.312628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178185+0000","last_change":"2024-05-07T13:55:58.341454+0000","last_active":"2024-05-07T13:57:58.178185+0000","last_peered":"2024-05-07T13:57:58.178185+0000","last_clean":"2024-05-07T13:57:58.178185+0000","last_became_active":"2024-05-07T13:55:58.341102+0000","last_became_peered":"2024-05-07T13:55:58.341102+0000","last_unstale":"2024-05-07T13:57:58.178185+0000","last_undegraded":"2024-05-07T13:57:58.178185+0000","last_fullsized":"2024-05-07T13:57:58.178185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.011707+0000","last_change":"2024-05-07T13:59:33.011759+0000","last_active":"2024-05-07T13:59:33.011707+0000","last_peered":"2024-05-07T13:59:33.011707+0000","last_clean":"2024-05-07T13:59:33.011707+0000","last_became_active":"2024-05-07T13:55:50.329869+0000","last_became_peered":"2024-05-07T13:55:50.329869+0000","last_unstale":"2024-05-07T13:59:33.011707+0000","last_undegraded":"2024-05-07T13:59:33.011707+0000","last_fullsized":"2024-05-07T13:59:33.011707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.011608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.011608+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.011608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:25:02.477664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.070974+0000","last_change":"2024-05-07T13:59:45.071015+0000","last_active":"2024-05-07T13:59:45.070974+0000","last_peered":"2024-05-07T13:59:45.070974+0000","last_clean":"2024-05-07T13:59:45.070974+0000","last_became_active":"2024-05-07T13:55:48.336807+0000","last_became_peered":"2024-05-07T13:55:48.336807+0000","last_unstale":"2024-05-07T13:59:45.070974+0000","last_undegraded":"2024-05-07T13:59:45.070974+0000","last_fullsized":"2024-05-07T13:59:45.070974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:45.070865+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:45.070865+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.070865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:21:52.761753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.827428+0000","last_change":"2024-05-07T13:59:15.827453+0000","last_active":"2024-05-07T13:59:15.827428+0000","last_peered":"2024-05-07T13:59:15.827428+0000","last_clean":"2024-05-07T13:59:15.827428+0000","last_became_active":"2024-05-07T13:55:52.318534+0000","last_became_peered":"2024-05-07T13:55:52.318534+0000","last_unstale":"2024-05-07T13:59:15.827428+0000","last_undegraded":"2024-05-07T13:59:15.827428+0000","last_fullsized":"2024-05-07T13:59:15.827428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.827322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:35.422572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.031728+0000","last_change":"2024-05-07T13:59:25.031770+0000","last_active":"2024-05-07T13:59:25.031728+0000","last_peered":"2024-05-07T13:59:25.031728+0000","last_clean":"2024-05-07T13:59:25.031728+0000","last_became_active":"2024-05-07T13:55:54.319714+0000","last_became_peered":"2024-05-07T13:55:54.319714+0000","last_unstale":"2024-05-07T13:59:25.031728+0000","last_undegraded":"2024-05-07T13:59:25.031728+0000","last_fullsized":"2024-05-07T13:59:25.031728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.031629+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:37.796266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.110151+0000","last_change":"2024-05-07T13:59:10.110217+0000","last_active":"2024-05-07T13:59:10.110151+0000","last_peered":"2024-05-07T13:59:10.110151+0000","last_clean":"2024-05-07T13:59:10.110151+0000","last_became_active":"2024-05-07T13:55:56.334342+0000","last_became_peered":"2024-05-07T13:55:56.334342+0000","last_unstale":"2024-05-07T13:59:10.110151+0000","last_undegraded":"2024-05-07T13:59:10.110151+0000","last_fullsized":"2024-05-07T13:59:10.110151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.110045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:09.225940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.412717+0000","last_change":"2024-05-07T13:55:58.342684+0000","last_active":"2024-05-07T13:58:59.412717+0000","last_peered":"2024-05-07T13:58:59.412717+0000","last_clean":"2024-05-07T13:58:59.412717+0000","last_became_active":"2024-05-07T13:55:58.342382+0000","last_became_peered":"2024-05-07T13:55:58.342382+0000","last_unstale":"2024-05-07T13:58:59.412717+0000","last_undegraded":"2024-05-07T13:58:59.412717+0000","last_fullsized":"2024-05-07T13:58:59.412717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415718+0000","last_change":"2024-05-07T13:56:35.366216+0000","last_active":"2024-05-07T13:58:59.415718+0000","last_peered":"2024-05-07T13:58:59.415718+0000","last_clean":"2024-05-07T13:58:59.415718+0000","last_became_active":"2024-05-07T13:56:35.365890+0000","last_became_peered":"2024-05-07T13:56:35.365890+0000","last_unstale":"2024-05-07T13:58:59.415718+0000","last_undegraded":"2024-05-07T13:58:59.415718+0000","last_fullsized":"2024-05-07T13:58:59.415718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.184102+0000","last_change":"2024-05-07T13:55:48.337211+0000","last_active":"2024-05-07T13:58:13.184102+0000","last_peered":"2024-05-07T13:58:13.184102+0000","last_clean":"2024-05-07T13:58:13.184102+0000","last_became_active":"2024-05-07T13:55:48.336730+0000","last_became_peered":"2024-05-07T13:55:48.336730+0000","last_unstale":"2024-05-07T13:58:13.184102+0000","last_undegraded":"2024-05-07T13:58:13.184102+0000","last_fullsized":"2024-05-07T13:58:13.184102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.138495+0000","last_change":"2024-05-07T13:59:26.138549+0000","last_active":"2024-05-07T13:59:26.138495+0000","last_peered":"2024-05-07T13:59:26.138495+0000","last_clean":"2024-05-07T13:59:26.138495+0000","last_became_active":"2024-05-07T13:55:52.324639+0000","last_became_peered":"2024-05-07T13:55:52.324639+0000","last_unstale":"2024-05-07T13:59:26.138495+0000","last_undegraded":"2024-05-07T13:59:26.138495+0000","last_fullsized":"2024-05-07T13:59:26.138495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.138376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:46.117728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'48","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.012636+0000","last_change":"2024-05-07T13:59:19.012678+0000","last_active":"2024-05-07T13:59:19.012636+0000","last_peered":"2024-05-07T13:59:19.012636+0000","last_clean":"2024-05-07T13:59:19.012636+0000","last_became_active":"2024-05-07T13:55:54.330738+0000","last_became_peered":"2024-05-07T13:55:54.330738+0000","last_unstale":"2024-05-07T13:59:19.012636+0000","last_undegraded":"2024-05-07T13:59:19.012636+0000","last_fullsized":"2024-05-07T13:59:19.012636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.012548+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:59.656224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.078706+0000","last_change":"2024-05-07T13:59:11.078729+0000","last_active":"2024-05-07T13:59:11.078706+0000","last_peered":"2024-05-07T13:59:11.078706+0000","last_clean":"2024-05-07T13:59:11.078706+0000","last_became_active":"2024-05-07T13:55:56.332844+0000","last_became_peered":"2024-05-07T13:55:56.332844+0000","last_unstale":"2024-05-07T13:59:11.078706+0000","last_undegraded":"2024-05-07T13:59:11.078706+0000","last_fullsized":"2024-05-07T13:59:11.078706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.078592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:40.007846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:28.184972+0000","last_change":"2024-05-07T13:55:58.348258+0000","last_active":"2024-05-07T13:58:28.184972+0000","last_peered":"2024-05-07T13:58:28.184972+0000","last_clean":"2024-05-07T13:58:28.184972+0000","last_became_active":"2024-05-07T13:55:58.347598+0000","last_became_peered":"2024-05-07T13:55:58.347598+0000","last_unstale":"2024-05-07T13:58:28.184972+0000","last_undegraded":"2024-05-07T13:58:28.184972+0000","last_fullsized":"2024-05-07T13:58:28.184972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'14","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.025831+0000","last_change":"2024-05-07T13:59:28.025859+0000","last_active":"2024-05-07T13:59:28.025831+0000","last_peered":"2024-05-07T13:59:28.025831+0000","last_clean":"2024-05-07T13:59:28.025831+0000","last_became_active":"2024-05-07T13:55:50.326430+0000","last_became_peered":"2024-05-07T13:55:50.326430+0000","last_unstale":"2024-05-07T13:59:28.025831+0000","last_undegraded":"2024-05-07T13:59:28.025831+0000","last_fullsized":"2024-05-07T13:59:28.025831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.025734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:38.245824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182021+0000","last_change":"2024-05-07T13:55:48.332048+0000","last_active":"2024-05-07T13:58:13.182021+0000","last_peered":"2024-05-07T13:58:13.182021+0000","last_clean":"2024-05-07T13:58:13.182021+0000","last_became_active":"2024-05-07T13:55:48.331660+0000","last_became_peered":"2024-05-07T13:55:48.331660+0000","last_unstale":"2024-05-07T13:58:13.182021+0000","last_undegraded":"2024-05-07T13:58:13.182021+0000","last_fullsized":"2024-05-07T13:58:13.182021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.845806+0000","last_change":"2024-05-07T13:59:10.845836+0000","last_active":"2024-05-07T13:59:10.845806+0000","last_peered":"2024-05-07T13:59:10.845806+0000","last_clean":"2024-05-07T13:59:10.845806+0000","last_became_active":"2024-05-07T13:55:52.320520+0000","last_became_peered":"2024-05-07T13:55:52.320520+0000","last_unstale":"2024-05-07T13:59:10.845806+0000","last_undegraded":"2024-05-07T13:59:10.845806+0000","last_fullsized":"2024-05-07T13:59:10.845806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.845698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:25:38.217921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.157708+0000","last_change":"2024-05-07T13:59:23.157743+0000","last_active":"2024-05-07T13:59:23.157708+0000","last_peered":"2024-05-07T13:59:23.157708+0000","last_clean":"2024-05-07T13:59:23.157708+0000","last_became_active":"2024-05-07T13:55:54.320266+0000","last_became_peered":"2024-05-07T13:55:54.320266+0000","last_unstale":"2024-05-07T13:59:23.157708+0000","last_undegraded":"2024-05-07T13:59:23.157708+0000","last_fullsized":"2024-05-07T13:59:23.157708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.157605+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:28.358470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.079062+0000","last_change":"2024-05-07T13:59:15.079086+0000","last_active":"2024-05-07T13:59:15.079062+0000","last_peered":"2024-05-07T13:59:15.079062+0000","last_clean":"2024-05-07T13:59:15.079062+0000","last_became_active":"2024-05-07T13:55:56.330251+0000","last_became_peered":"2024-05-07T13:55:56.330251+0000","last_unstale":"2024-05-07T13:59:15.079062+0000","last_undegraded":"2024-05-07T13:59:15.079062+0000","last_fullsized":"2024-05-07T13:59:15.079062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:55.222720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.149900+0000","last_change":"2024-05-07T13:55:50.323450+0000","last_active":"2024-05-07T13:58:59.149900+0000","last_peered":"2024-05-07T13:58:59.149900+0000","last_clean":"2024-05-07T13:58:59.149900+0000","last_became_active":"2024-05-07T13:55:50.323159+0000","last_became_peered":"2024-05-07T13:55:50.323159+0000","last_unstale":"2024-05-07T13:58:59.149900+0000","last_undegraded":"2024-05-07T13:58:59.149900+0000","last_fullsized":"2024-05-07T13:58:59.149900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182255+0000","last_change":"2024-05-07T13:55:48.352309+0000","last_active":"2024-05-07T13:58:13.182255+0000","last_peered":"2024-05-07T13:58:13.182255+0000","last_clean":"2024-05-07T13:58:13.182255+0000","last_became_active":"2024-05-07T13:55:48.350462+0000","last_became_peered":"2024-05-07T13:55:48.350462+0000","last_unstale":"2024-05-07T13:58:13.182255+0000","last_undegraded":"2024-05-07T13:58:13.182255+0000","last_fullsized":"2024-05-07T13:58:13.182255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.020839+0000","last_change":"2024-05-07T13:59:35.020866+0000","last_active":"2024-05-07T13:59:35.020839+0000","last_peered":"2024-05-07T13:59:35.020839+0000","last_clean":"2024-05-07T13:59:35.020839+0000","last_became_active":"2024-05-07T13:55:52.321171+0000","last_became_peered":"2024-05-07T13:55:52.321171+0000","last_unstale":"2024-05-07T13:59:35.020839+0000","last_undegraded":"2024-05-07T13:59:35.020839+0000","last_fullsized":"2024-05-07T13:59:35.020839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:35.020743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:35.020743+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.020743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:21:42.711631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.985304+0000","last_change":"2024-05-07T13:59:23.985348+0000","last_active":"2024-05-07T13:59:23.985304+0000","last_peered":"2024-05-07T13:59:23.985304+0000","last_clean":"2024-05-07T13:59:23.985304+0000","last_became_active":"2024-05-07T13:55:54.319819+0000","last_became_peered":"2024-05-07T13:55:54.319819+0000","last_unstale":"2024-05-07T13:59:23.985304+0000","last_undegraded":"2024-05-07T13:59:23.985304+0000","last_fullsized":"2024-05-07T13:59:23.985304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.985209+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:20.683798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.078791+0000","last_change":"2024-05-07T13:59:14.078817+0000","last_active":"2024-05-07T13:59:14.078791+0000","last_peered":"2024-05-07T13:59:14.078791+0000","last_clean":"2024-05-07T13:59:14.078791+0000","last_became_active":"2024-05-07T13:55:56.330190+0000","last_became_peered":"2024-05-07T13:55:56.330190+0000","last_unstale":"2024-05-07T13:59:14.078791+0000","last_undegraded":"2024-05-07T13:59:14.078791+0000","last_fullsized":"2024-05-07T13:59:14.078791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.078700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:50:02.500890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.181130+0000","last_change":"2024-05-07T13:55:58.341039+0000","last_active":"2024-05-07T13:58:18.181130+0000","last_peered":"2024-05-07T13:58:18.181130+0000","last_clean":"2024-05-07T13:58:18.181130+0000","last_became_active":"2024-05-07T13:55:58.340674+0000","last_became_peered":"2024-05-07T13:55:58.340674+0000","last_unstale":"2024-05-07T13:58:18.181130+0000","last_undegraded":"2024-05-07T13:58:18.181130+0000","last_fullsized":"2024-05-07T13:58:18.181130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415320+0000","last_change":"2024-05-07T13:55:50.318936+0000","last_active":"2024-05-07T13:58:59.415320+0000","last_peered":"2024-05-07T13:58:59.415320+0000","last_clean":"2024-05-07T13:58:59.415320+0000","last_became_active":"2024-05-07T13:55:50.318546+0000","last_became_peered":"2024-05-07T13:55:50.318546+0000","last_unstale":"2024-05-07T13:58:59.415320+0000","last_undegraded":"2024-05-07T13:58:59.415320+0000","last_fullsized":"2024-05-07T13:58:59.415320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.181785+0000","last_change":"2024-05-07T13:55:48.332704+0000","last_active":"2024-05-07T13:58:13.181785+0000","last_peered":"2024-05-07T13:58:13.181785+0000","last_clean":"2024-05-07T13:58:13.181785+0000","last_became_active":"2024-05-07T13:55:48.331278+0000","last_became_peered":"2024-05-07T13:55:48.331278+0000","last_unstale":"2024-05-07T13:58:13.181785+0000","last_undegraded":"2024-05-07T13:58:13.181785+0000","last_fullsized":"2024-05-07T13:58:13.181785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.132265+0000","last_change":"2024-05-07T13:59:31.132317+0000","last_active":"2024-05-07T13:59:31.132265+0000","last_peered":"2024-05-07T13:59:31.132265+0000","last_clean":"2024-05-07T13:59:31.132265+0000","last_became_active":"2024-05-07T13:55:52.317564+0000","last_became_peered":"2024-05-07T13:55:52.317564+0000","last_unstale":"2024-05-07T13:59:31.132265+0000","last_undegraded":"2024-05-07T13:59:31.132265+0000","last_fullsized":"2024-05-07T13:59:31.132265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.132155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.132155+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.132155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:31.984653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.150663+0000","last_change":"2024-05-07T13:59:42.150703+0000","last_active":"2024-05-07T13:59:42.150663+0000","last_peered":"2024-05-07T13:59:42.150663+0000","last_clean":"2024-05-07T13:59:42.150663+0000","last_became_active":"2024-05-07T13:55:54.329443+0000","last_became_peered":"2024-05-07T13:55:54.329443+0000","last_unstale":"2024-05-07T13:59:42.150663+0000","last_undegraded":"2024-05-07T13:59:42.150663+0000","last_fullsized":"2024-05-07T13:59:42.150663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-07T13:59:42.150568+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-07T13:59:42.150568+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.150568+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:03:28.616407+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.090783+0000","last_change":"2024-05-07T13:59:31.090805+0000","last_active":"2024-05-07T13:59:31.090783+0000","last_peered":"2024-05-07T13:59:31.090783+0000","last_clean":"2024-05-07T13:59:31.090783+0000","last_became_active":"2024-05-07T13:55:56.344470+0000","last_became_peered":"2024-05-07T13:55:56.344470+0000","last_unstale":"2024-05-07T13:59:31.090783+0000","last_undegraded":"2024-05-07T13:59:31.090783+0000","last_fullsized":"2024-05-07T13:59:31.090783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.090686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.090686+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.090686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:29.889110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.147041+0000","last_change":"2024-05-07T13:55:58.351086+0000","last_active":"2024-05-07T13:58:59.147041+0000","last_peered":"2024-05-07T13:58:59.147041+0000","last_clean":"2024-05-07T13:58:59.147041+0000","last_became_active":"2024-05-07T13:55:58.350796+0000","last_became_peered":"2024-05-07T13:55:58.350796+0000","last_unstale":"2024-05-07T13:58:59.147041+0000","last_undegraded":"2024-05-07T13:58:59.147041+0000","last_fullsized":"2024-05-07T13:58:59.147041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.935454+0000","last_change":"2024-05-07T13:59:23.935508+0000","last_active":"2024-05-07T13:59:23.935454+0000","last_peered":"2024-05-07T13:59:23.935454+0000","last_clean":"2024-05-07T13:59:23.935454+0000","last_became_active":"2024-05-07T13:55:50.326424+0000","last_became_peered":"2024-05-07T13:55:50.326424+0000","last_unstale":"2024-05-07T13:59:23.935454+0000","last_undegraded":"2024-05-07T13:59:23.935454+0000","last_fullsized":"2024-05-07T13:59:23.935454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.935328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:15.191912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.210678+0000","last_change":"2024-05-07T13:55:48.342464+0000","last_active":"2024-05-07T13:59:06.210678+0000","last_peered":"2024-05-07T13:59:06.210678+0000","last_clean":"2024-05-07T13:59:06.210678+0000","last_became_active":"2024-05-07T13:55:48.342072+0000","last_became_peered":"2024-05-07T13:55:48.342072+0000","last_unstale":"2024-05-07T13:59:06.210678+0000","last_undegraded":"2024-05-07T13:59:06.210678+0000","last_fullsized":"2024-05-07T13:59:06.210678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.097749+0000","last_change":"2024-05-07T13:59:30.097790+0000","last_active":"2024-05-07T13:59:30.097749+0000","last_peered":"2024-05-07T13:59:30.097749+0000","last_clean":"2024-05-07T13:59:30.097749+0000","last_became_active":"2024-05-07T13:55:52.318605+0000","last_became_peered":"2024-05-07T13:55:52.318605+0000","last_unstale":"2024-05-07T13:59:30.097749+0000","last_undegraded":"2024-05-07T13:59:30.097749+0000","last_fullsized":"2024-05-07T13:59:30.097749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.097647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.097647+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.097647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:23.733758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.957010+0000","last_change":"2024-05-07T13:59:22.957062+0000","last_active":"2024-05-07T13:59:22.957010+0000","last_peered":"2024-05-07T13:59:22.957010+0000","last_clean":"2024-05-07T13:59:22.957010+0000","last_became_active":"2024-05-07T13:55:54.326599+0000","last_became_peered":"2024-05-07T13:55:54.326599+0000","last_unstale":"2024-05-07T13:59:22.957010+0000","last_undegraded":"2024-05-07T13:59:22.957010+0000","last_fullsized":"2024-05-07T13:59:22.957010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.956910+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:05.203075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:09.875280+0000","last_change":"2024-05-07T13:59:09.875299+0000","last_active":"2024-05-07T13:59:09.875280+0000","last_peered":"2024-05-07T13:59:09.875280+0000","last_clean":"2024-05-07T13:59:09.875280+0000","last_became_active":"2024-05-07T13:55:56.334226+0000","last_became_peered":"2024-05-07T13:55:56.334226+0000","last_unstale":"2024-05-07T13:59:09.875280+0000","last_undegraded":"2024-05-07T13:59:09.875280+0000","last_fullsized":"2024-05-07T13:59:09.875280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_clean_scrub_stamp":"2024-05-07T13:59:09.875192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:33.279728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183272+0000","last_change":"2024-05-07T13:55:58.352585+0000","last_active":"2024-05-07T13:58:18.183272+0000","last_peered":"2024-05-07T13:58:18.183272+0000","last_clean":"2024-05-07T13:58:18.183272+0000","last_became_active":"2024-05-07T13:55:58.352263+0000","last_became_peered":"2024-05-07T13:55:58.352263+0000","last_unstale":"2024-05-07T13:58:18.183272+0000","last_undegraded":"2024-05-07T13:58:18.183272+0000","last_fullsized":"2024-05-07T13:58:18.183272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.159755+0000","last_change":"2024-05-07T13:59:44.159801+0000","last_active":"2024-05-07T13:59:44.159755+0000","last_peered":"2024-05-07T13:59:44.159755+0000","last_clean":"2024-05-07T13:59:44.159755+0000","last_became_active":"2024-05-07T13:55:50.312852+0000","last_became_peered":"2024-05-07T13:55:50.312852+0000","last_unstale":"2024-05-07T13:59:44.159755+0000","last_undegraded":"2024-05-07T13:59:44.159755+0000","last_fullsized":"2024-05-07T13:59:44.159755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:44.159658+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:44.159658+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.159658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:17.764814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183378+0000","last_change":"2024-05-07T13:55:48.351068+0000","last_active":"2024-05-07T13:58:18.183378+0000","last_peered":"2024-05-07T13:58:18.183378+0000","last_clean":"2024-05-07T13:58:18.183378+0000","last_became_active":"2024-05-07T13:55:48.348476+0000","last_became_peered":"2024-05-07T13:55:48.348476+0000","last_unstale":"2024-05-07T13:58:18.183378+0000","last_undegraded":"2024-05-07T13:58:18.183378+0000","last_fullsized":"2024-05-07T13:58:18.183378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.019050+0000","last_change":"2024-05-07T13:59:21.019075+0000","last_active":"2024-05-07T13:59:21.019050+0000","last_peered":"2024-05-07T13:59:21.019050+0000","last_clean":"2024-05-07T13:59:21.019050+0000","last_became_active":"2024-05-07T13:55:52.322431+0000","last_became_peered":"2024-05-07T13:55:52.322431+0000","last_unstale":"2024-05-07T13:59:21.019050+0000","last_undegraded":"2024-05-07T13:59:21.019050+0000","last_fullsized":"2024-05-07T13:59:21.019050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.018959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:33:21.518908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.997637+0000","last_change":"2024-05-07T13:59:28.997674+0000","last_active":"2024-05-07T13:59:28.997637+0000","last_peered":"2024-05-07T13:59:28.997637+0000","last_clean":"2024-05-07T13:59:28.997637+0000","last_became_active":"2024-05-07T13:55:54.329539+0000","last_became_peered":"2024-05-07T13:55:54.329539+0000","last_unstale":"2024-05-07T13:59:28.997637+0000","last_undegraded":"2024-05-07T13:59:28.997637+0000","last_fullsized":"2024-05-07T13:59:28.997637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-07T13:59:28.997538+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-07T13:59:28.997538+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.997538+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:03.181568+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":418,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.068007+0000","last_change":"2024-05-07T13:59:16.068040+0000","last_active":"2024-05-07T13:59:16.068007+0000","last_peered":"2024-05-07T13:59:16.068007+0000","last_clean":"2024-05-07T13:59:16.068007+0000","last_became_active":"2024-05-07T13:55:56.338021+0000","last_became_peered":"2024-05-07T13:55:56.338021+0000","last_unstale":"2024-05-07T13:59:16.068007+0000","last_undegraded":"2024-05-07T13:59:16.068007+0000","last_fullsized":"2024-05-07T13:59:16.068007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.067904+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:55:00.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183170+0000","last_change":"2024-05-07T13:55:58.351904+0000","last_active":"2024-05-07T13:58:18.183170+0000","last_peered":"2024-05-07T13:58:18.183170+0000","last_clean":"2024-05-07T13:58:18.183170+0000","last_became_active":"2024-05-07T13:55:58.351616+0000","last_became_peered":"2024-05-07T13:55:58.351616+0000","last_unstale":"2024-05-07T13:58:18.183170+0000","last_undegraded":"2024-05-07T13:58:18.183170+0000","last_fullsized":"2024-05-07T13:58:18.183170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.073813+0000","last_change":"2024-05-07T13:59:36.073866+0000","last_active":"2024-05-07T13:59:36.073813+0000","last_peered":"2024-05-07T13:59:36.073813+0000","last_clean":"2024-05-07T13:59:36.073813+0000","last_became_active":"2024-05-07T13:55:50.313016+0000","last_became_peered":"2024-05-07T13:55:50.313016+0000","last_unstale":"2024-05-07T13:59:36.073813+0000","last_undegraded":"2024-05-07T13:59:36.073813+0000","last_fullsized":"2024-05-07T13:59:36.073813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:36.073646+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:36.073646+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.073646+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:12.645759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.182718+0000","last_change":"2024-05-07T13:55:48.340087+0000","last_active":"2024-05-07T13:58:18.182718+0000","last_peered":"2024-05-07T13:58:18.182718+0000","last_clean":"2024-05-07T13:58:18.182718+0000","last_became_active":"2024-05-07T13:55:48.339639+0000","last_became_peered":"2024-05-07T13:55:48.339639+0000","last_unstale":"2024-05-07T13:58:18.182718+0000","last_undegraded":"2024-05-07T13:58:18.182718+0000","last_fullsized":"2024-05-07T13:58:18.182718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.058938+0000","last_change":"2024-05-07T13:59:18.058974+0000","last_active":"2024-05-07T13:59:18.058938+0000","last_peered":"2024-05-07T13:59:18.058938+0000","last_clean":"2024-05-07T13:59:18.058938+0000","last_became_active":"2024-05-07T13:55:52.324567+0000","last_became_peered":"2024-05-07T13:55:52.324567+0000","last_unstale":"2024-05-07T13:59:18.058938+0000","last_undegraded":"2024-05-07T13:59:18.058938+0000","last_fullsized":"2024-05-07T13:59:18.058938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.058848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:48:50.227510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.085639+0000","last_change":"2024-05-07T13:59:16.085684+0000","last_active":"2024-05-07T13:59:16.085639+0000","last_peered":"2024-05-07T13:59:16.085639+0000","last_clean":"2024-05-07T13:59:16.085639+0000","last_became_active":"2024-05-07T13:55:54.329220+0000","last_became_peered":"2024-05-07T13:55:54.329220+0000","last_unstale":"2024-05-07T13:59:16.085639+0000","last_undegraded":"2024-05-07T13:59:16.085639+0000","last_fullsized":"2024-05-07T13:59:16.085639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.085538+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:26.485669+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.922656+0000","last_change":"2024-05-07T13:59:14.922682+0000","last_active":"2024-05-07T13:59:14.922656+0000","last_peered":"2024-05-07T13:59:14.922656+0000","last_clean":"2024-05-07T13:59:14.922656+0000","last_became_active":"2024-05-07T13:55:56.333373+0000","last_became_peered":"2024-05-07T13:55:56.333373+0000","last_unstale":"2024-05-07T13:59:14.922656+0000","last_undegraded":"2024-05-07T13:59:14.922656+0000","last_fullsized":"2024-05-07T13:59:14.922656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.922551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:15.327295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.183556+0000","last_change":"2024-05-07T13:55:58.347910+0000","last_active":"2024-05-07T13:58:23.183556+0000","last_peered":"2024-05-07T13:58:23.183556+0000","last_clean":"2024-05-07T13:58:23.183556+0000","last_became_active":"2024-05-07T13:55:58.347327+0000","last_became_peered":"2024-05-07T13:55:58.347327+0000","last_unstale":"2024-05-07T13:58:23.183556+0000","last_undegraded":"2024-05-07T13:58:23.183556+0000","last_fullsized":"2024-05-07T13:58:23.183556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.036902+0000","last_change":"2024-05-07T13:59:35.036926+0000","last_active":"2024-05-07T13:59:35.036902+0000","last_peered":"2024-05-07T13:59:35.036902+0000","last_clean":"2024-05-07T13:59:35.036902+0000","last_became_active":"2024-05-07T13:55:50.311340+0000","last_became_peered":"2024-05-07T13:55:50.311340+0000","last_unstale":"2024-05-07T13:59:35.036902+0000","last_undegraded":"2024-05-07T13:59:35.036902+0000","last_fullsized":"2024-05-07T13:59:35.036902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:35.036806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:35.036806+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.036806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:47.801444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183485+0000","last_change":"2024-05-07T13:55:48.351060+0000","last_active":"2024-05-07T13:58:18.183485+0000","last_peered":"2024-05-07T13:58:18.183485+0000","last_clean":"2024-05-07T13:58:18.183485+0000","last_became_active":"2024-05-07T13:55:48.349589+0000","last_became_peered":"2024-05-07T13:55:48.349589+0000","last_unstale":"2024-05-07T13:58:18.183485+0000","last_undegraded":"2024-05-07T13:58:18.183485+0000","last_fullsized":"2024-05-07T13:58:18.183485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.160962+0000","last_change":"2024-05-07T13:59:27.160985+0000","last_active":"2024-05-07T13:59:27.160962+0000","last_peered":"2024-05-07T13:59:27.160962+0000","last_clean":"2024-05-07T13:59:27.160962+0000","last_became_active":"2024-05-07T13:55:52.323548+0000","last_became_peered":"2024-05-07T13:55:52.323548+0000","last_unstale":"2024-05-07T13:59:27.160962+0000","last_undegraded":"2024-05-07T13:59:27.160962+0000","last_fullsized":"2024-05-07T13:59:27.160962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.160877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:40.043412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.984564+0000","last_change":"2024-05-07T13:59:19.984633+0000","last_active":"2024-05-07T13:59:19.984564+0000","last_peered":"2024-05-07T13:59:19.984564+0000","last_clean":"2024-05-07T13:59:19.984564+0000","last_became_active":"2024-05-07T13:55:54.326844+0000","last_became_peered":"2024-05-07T13:55:54.326844+0000","last_unstale":"2024-05-07T13:59:19.984564+0000","last_undegraded":"2024-05-07T13:59:19.984564+0000","last_fullsized":"2024-05-07T13:59:19.984564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.984455+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:13.620566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.047751+0000","last_change":"2024-05-07T13:59:37.047777+0000","last_active":"2024-05-07T13:59:37.047751+0000","last_peered":"2024-05-07T13:59:37.047751+0000","last_clean":"2024-05-07T13:59:37.047751+0000","last_became_active":"2024-05-07T13:55:56.344885+0000","last_became_peered":"2024-05-07T13:55:56.344885+0000","last_unstale":"2024-05-07T13:59:37.047751+0000","last_undegraded":"2024-05-07T13:59:37.047751+0000","last_fullsized":"2024-05-07T13:59:37.047751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:37.047656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:37.047656+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.047656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:50:54.107543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184338+0000","last_change":"2024-05-07T13:55:58.348158+0000","last_active":"2024-05-07T13:58:23.184338+0000","last_peered":"2024-05-07T13:58:23.184338+0000","last_clean":"2024-05-07T13:58:23.184338+0000","last_became_active":"2024-05-07T13:55:58.347850+0000","last_became_peered":"2024-05-07T13:55:58.347850+0000","last_unstale":"2024-05-07T13:58:23.184338+0000","last_undegraded":"2024-05-07T13:58:23.184338+0000","last_fullsized":"2024-05-07T13:58:23.184338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'20","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.133242+0000","last_change":"2024-05-07T13:59:46.133286+0000","last_active":"2024-05-07T13:59:46.133242+0000","last_peered":"2024-05-07T13:59:46.133242+0000","last_clean":"2024-05-07T13:59:46.133242+0000","last_became_active":"2024-05-07T13:55:50.324745+0000","last_became_peered":"2024-05-07T13:55:50.324745+0000","last_unstale":"2024-05-07T13:59:46.133242+0000","last_undegraded":"2024-05-07T13:59:46.133242+0000","last_fullsized":"2024-05-07T13:59:46.133242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-07T13:59:46.133156+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-07T13:59:46.133156+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.133156+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:54.805339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:09.165615+0000","last_change":"2024-05-07T13:55:48.324008+0000","last_active":"2024-05-07T13:59:09.165615+0000","last_peered":"2024-05-07T13:59:09.165615+0000","last_clean":"2024-05-07T13:59:09.165615+0000","last_became_active":"2024-05-07T13:55:48.323125+0000","last_became_peered":"2024-05-07T13:55:48.323125+0000","last_unstale":"2024-05-07T13:59:09.165615+0000","last_undegraded":"2024-05-07T13:59:09.165615+0000","last_fullsized":"2024-05-07T13:59:09.165615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.003899+0000","last_change":"2024-05-07T13:59:22.003923+0000","last_active":"2024-05-07T13:59:22.003899+0000","last_peered":"2024-05-07T13:59:22.003899+0000","last_clean":"2024-05-07T13:59:22.003899+0000","last_became_active":"2024-05-07T13:55:52.322012+0000","last_became_peered":"2024-05-07T13:55:52.322012+0000","last_unstale":"2024-05-07T13:59:22.003899+0000","last_undegraded":"2024-05-07T13:59:22.003899+0000","last_fullsized":"2024-05-07T13:59:22.003899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.003807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:25:31.144648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'31","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.881145+0000","last_change":"2024-05-07T13:59:20.881181+0000","last_active":"2024-05-07T13:59:20.881145+0000","last_peered":"2024-05-07T13:59:20.881145+0000","last_clean":"2024-05-07T13:59:20.881145+0000","last_became_active":"2024-05-07T13:55:54.326758+0000","last_became_peered":"2024-05-07T13:55:54.326758+0000","last_unstale":"2024-05-07T13:59:20.881145+0000","last_undegraded":"2024-05-07T13:59:20.881145+0000","last_fullsized":"2024-05-07T13:59:20.881145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.881054+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:08.116261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.101452+0000","last_change":"2024-05-07T13:59:41.101476+0000","last_active":"2024-05-07T13:59:41.101452+0000","last_peered":"2024-05-07T13:59:41.101452+0000","last_clean":"2024-05-07T13:59:41.101452+0000","last_became_active":"2024-05-07T13:55:56.345933+0000","last_became_peered":"2024-05-07T13:55:56.345933+0000","last_unstale":"2024-05-07T13:59:41.101452+0000","last_undegraded":"2024-05-07T13:59:41.101452+0000","last_fullsized":"2024-05-07T13:59:41.101452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.101346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.101346+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.101346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:09.656228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184263+0000","last_change":"2024-05-07T13:55:58.349147+0000","last_active":"2024-05-07T13:58:23.184263+0000","last_peered":"2024-05-07T13:58:23.184263+0000","last_clean":"2024-05-07T13:58:23.184263+0000","last_became_active":"2024-05-07T13:55:58.348763+0000","last_became_peered":"2024-05-07T13:55:58.348763+0000","last_unstale":"2024-05-07T13:58:23.184263+0000","last_undegraded":"2024-05-07T13:58:23.184263+0000","last_fullsized":"2024-05-07T13:58:23.184263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.125138+0000","last_change":"2024-05-07T13:59:40.125168+0000","last_active":"2024-05-07T13:59:40.125138+0000","last_peered":"2024-05-07T13:59:40.125138+0000","last_clean":"2024-05-07T13:59:40.125138+0000","last_became_active":"2024-05-07T13:55:50.312605+0000","last_became_peered":"2024-05-07T13:55:50.312605+0000","last_unstale":"2024-05-07T13:59:40.125138+0000","last_undegraded":"2024-05-07T13:59:40.125138+0000","last_fullsized":"2024-05-07T13:59:40.125138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:40.125038+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:40.125038+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.125038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:59.307579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179134+0000","last_change":"2024-05-07T13:55:48.333628+0000","last_active":"2024-05-07T13:57:53.179134+0000","last_peered":"2024-05-07T13:57:53.179134+0000","last_clean":"2024-05-07T13:57:53.179134+0000","last_became_active":"2024-05-07T13:55:48.333254+0000","last_became_peered":"2024-05-07T13:55:48.333254+0000","last_unstale":"2024-05-07T13:57:53.179134+0000","last_undegraded":"2024-05-07T13:57:53.179134+0000","last_fullsized":"2024-05-07T13:57:53.179134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.057867+0000","last_change":"2024-05-07T13:59:26.057899+0000","last_active":"2024-05-07T13:59:26.057867+0000","last_peered":"2024-05-07T13:59:26.057867+0000","last_clean":"2024-05-07T13:59:26.057867+0000","last_became_active":"2024-05-07T13:55:52.321982+0000","last_became_peered":"2024-05-07T13:55:52.321982+0000","last_unstale":"2024-05-07T13:59:26.057867+0000","last_undegraded":"2024-05-07T13:59:26.057867+0000","last_fullsized":"2024-05-07T13:59:26.057867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.057767+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:23.143125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.876939+0000","last_change":"2024-05-07T13:59:16.876994+0000","last_active":"2024-05-07T13:59:16.876939+0000","last_peered":"2024-05-07T13:59:16.876939+0000","last_clean":"2024-05-07T13:59:16.876939+0000","last_became_active":"2024-05-07T13:55:54.326895+0000","last_became_peered":"2024-05-07T13:55:54.326895+0000","last_unstale":"2024-05-07T13:59:16.876939+0000","last_undegraded":"2024-05-07T13:59:16.876939+0000","last_fullsized":"2024-05-07T13:59:16.876939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.876843+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:35.990453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.058174+0000","last_change":"2024-05-07T13:59:30.058208+0000","last_active":"2024-05-07T13:59:30.058174+0000","last_peered":"2024-05-07T13:59:30.058174+0000","last_clean":"2024-05-07T13:59:30.058174+0000","last_became_active":"2024-05-07T13:55:56.343002+0000","last_became_peered":"2024-05-07T13:55:56.343002+0000","last_unstale":"2024-05-07T13:59:30.058174+0000","last_undegraded":"2024-05-07T13:59:30.058174+0000","last_fullsized":"2024-05-07T13:59:30.058174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.058080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.058080+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.058080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:49.240621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.665404+0000","last_change":"2024-05-07T13:55:58.348783+0000","last_active":"2024-05-07T13:58:59.665404+0000","last_peered":"2024-05-07T13:58:59.665404+0000","last_clean":"2024-05-07T13:58:59.665404+0000","last_became_active":"2024-05-07T13:55:58.347820+0000","last_became_peered":"2024-05-07T13:55:58.347820+0000","last_unstale":"2024-05-07T13:58:59.665404+0000","last_undegraded":"2024-05-07T13:58:59.665404+0000","last_fullsized":"2024-05-07T13:58:59.665404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.055046+0000","last_change":"2024-05-07T13:59:32.055073+0000","last_active":"2024-05-07T13:59:32.055046+0000","last_peered":"2024-05-07T13:59:32.055046+0000","last_clean":"2024-05-07T13:59:32.055046+0000","last_became_active":"2024-05-07T13:55:50.330166+0000","last_became_peered":"2024-05-07T13:55:50.330166+0000","last_unstale":"2024-05-07T13:59:32.055046+0000","last_undegraded":"2024-05-07T13:59:32.055046+0000","last_fullsized":"2024-05-07T13:59:32.055046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:32.054935+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:32.054935+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.054935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:31.258103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.120944+0000","last_change":"2024-05-07T13:59:47.120996+0000","last_active":"2024-05-07T13:59:47.120944+0000","last_peered":"2024-05-07T13:59:47.120944+0000","last_clean":"2024-05-07T13:59:47.120944+0000","last_became_active":"2024-05-07T13:55:48.338874+0000","last_became_peered":"2024-05-07T13:55:48.338874+0000","last_unstale":"2024-05-07T13:59:47.120944+0000","last_undegraded":"2024-05-07T13:59:47.120944+0000","last_fullsized":"2024-05-07T13:59:47.120944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:47.120819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:47.120819+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.120819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:29.157325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.065959+0000","last_change":"2024-05-07T13:59:40.065990+0000","last_active":"2024-05-07T13:59:40.065959+0000","last_peered":"2024-05-07T13:59:40.065959+0000","last_clean":"2024-05-07T13:59:40.065959+0000","last_became_active":"2024-05-07T13:55:50.311324+0000","last_became_peered":"2024-05-07T13:55:50.311324+0000","last_unstale":"2024-05-07T13:59:40.065959+0000","last_undegraded":"2024-05-07T13:59:40.065959+0000","last_fullsized":"2024-05-07T13:59:40.065959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:40.065867+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:40.065867+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.065867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:27.301075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.039636+0000","last_change":"2024-05-07T13:59:41.039704+0000","last_active":"2024-05-07T13:59:41.039636+0000","last_peered":"2024-05-07T13:59:41.039636+0000","last_clean":"2024-05-07T13:59:41.039636+0000","last_became_active":"2024-05-07T13:55:48.325561+0000","last_became_peered":"2024-05-07T13:55:48.325561+0000","last_unstale":"2024-05-07T13:59:41.039636+0000","last_undegraded":"2024-05-07T13:59:41.039636+0000","last_fullsized":"2024-05-07T13:59:41.039636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.039521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.039521+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.039521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:57.803837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.983157+0000","last_change":"2024-05-07T13:59:25.983208+0000","last_active":"2024-05-07T13:59:25.983157+0000","last_peered":"2024-05-07T13:59:25.983157+0000","last_clean":"2024-05-07T13:59:25.983157+0000","last_became_active":"2024-05-07T13:55:50.326322+0000","last_became_peered":"2024-05-07T13:55:50.326322+0000","last_unstale":"2024-05-07T13:59:25.983157+0000","last_undegraded":"2024-05-07T13:59:25.983157+0000","last_fullsized":"2024-05-07T13:59:25.983157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.983056+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:20.815531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"27'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:53.179336+0000","last_change":"2024-05-07T13:55:48.352058+0000","last_active":"2024-05-07T13:57:53.179336+0000","last_peered":"2024-05-07T13:57:53.179336+0000","last_clean":"2024-05-07T13:57:53.179336+0000","last_became_active":"2024-05-07T13:55:48.350385+0000","last_became_peered":"2024-05-07T13:55:48.350385+0000","last_unstale":"2024-05-07T13:57:53.179336+0000","last_undegraded":"2024-05-07T13:57:53.179336+0000","last_fullsized":"2024-05-07T13:57:53.179336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.084229+0000","last_change":"2024-05-07T13:59:42.084260+0000","last_active":"2024-05-07T13:59:42.084229+0000","last_peered":"2024-05-07T13:59:42.084229+0000","last_clean":"2024-05-07T13:59:42.084229+0000","last_became_active":"2024-05-07T13:55:50.312703+0000","last_became_peered":"2024-05-07T13:55:50.312703+0000","last_unstale":"2024-05-07T13:59:42.084229+0000","last_undegraded":"2024-05-07T13:59:42.084229+0000","last_fullsized":"2024-05-07T13:59:42.084229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:42.084125+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:42.084125+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.084125+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:03.874653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.209243+0000","last_change":"2024-05-07T13:55:48.325914+0000","last_active":"2024-05-07T13:59:06.209243+0000","last_peered":"2024-05-07T13:59:06.209243+0000","last_clean":"2024-05-07T13:59:06.209243+0000","last_became_active":"2024-05-07T13:55:48.323979+0000","last_became_peered":"2024-05-07T13:55:48.323979+0000","last_unstale":"2024-05-07T13:59:06.209243+0000","last_undegraded":"2024-05-07T13:59:06.209243+0000","last_fullsized":"2024-05-07T13:59:06.209243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.019162+0000","last_change":"2024-05-07T13:59:36.019212+0000","last_active":"2024-05-07T13:59:36.019162+0000","last_peered":"2024-05-07T13:59:36.019162+0000","last_clean":"2024-05-07T13:59:36.019162+0000","last_became_active":"2024-05-07T13:55:50.331311+0000","last_became_peered":"2024-05-07T13:55:50.331311+0000","last_unstale":"2024-05-07T13:59:36.019162+0000","last_undegraded":"2024-05-07T13:59:36.019162+0000","last_fullsized":"2024-05-07T13:59:36.019162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:36.019068+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:36.019068+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.019068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:40.795315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:06.209035+0000","last_change":"2024-05-07T13:55:48.326606+0000","last_active":"2024-05-07T13:59:06.209035+0000","last_peered":"2024-05-07T13:59:06.209035+0000","last_clean":"2024-05-07T13:59:06.209035+0000","last_became_active":"2024-05-07T13:55:48.325858+0000","last_became_peered":"2024-05-07T13:55:48.325858+0000","last_unstale":"2024-05-07T13:59:06.209035+0000","last_undegraded":"2024-05-07T13:59:06.209035+0000","last_fullsized":"2024-05-07T13:59:06.209035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.064896+0000","last_change":"2024-05-07T13:59:37.064923+0000","last_active":"2024-05-07T13:59:37.064896+0000","last_peered":"2024-05-07T13:59:37.064896+0000","last_clean":"2024-05-07T13:59:37.064896+0000","last_became_active":"2024-05-07T13:55:50.323573+0000","last_became_peered":"2024-05-07T13:55:50.323573+0000","last_unstale":"2024-05-07T13:59:37.064896+0000","last_undegraded":"2024-05-07T13:59:37.064896+0000","last_fullsized":"2024-05-07T13:59:37.064896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:37.064807+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:37.064807+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.064807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:27:22.190330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.179712+0000","last_change":"2024-05-07T13:55:48.334670+0000","last_active":"2024-05-07T13:57:58.179712+0000","last_peered":"2024-05-07T13:57:58.179712+0000","last_clean":"2024-05-07T13:57:58.179712+0000","last_became_active":"2024-05-07T13:55:48.334268+0000","last_became_peered":"2024-05-07T13:55:48.334268+0000","last_unstale":"2024-05-07T13:57:58.179712+0000","last_undegraded":"2024-05-07T13:57:58.179712+0000","last_fullsized":"2024-05-07T13:57:58.179712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.477401+0000","last_change":"2024-05-07T13:55:50.320633+0000","last_active":"2024-05-07T13:58:59.477401+0000","last_peered":"2024-05-07T13:58:59.477401+0000","last_clean":"2024-05-07T13:58:59.477401+0000","last_became_active":"2024-05-07T13:55:50.320242+0000","last_became_peered":"2024-05-07T13:55:50.320242+0000","last_unstale":"2024-05-07T13:58:59.477401+0000","last_undegraded":"2024-05-07T13:58:59.477401+0000","last_fullsized":"2024-05-07T13:58:59.477401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.098445+0000","last_change":"2024-05-07T13:59:39.098472+0000","last_active":"2024-05-07T13:59:39.098445+0000","last_peered":"2024-05-07T13:59:39.098445+0000","last_clean":"2024-05-07T13:59:39.098445+0000","last_became_active":"2024-05-07T13:55:48.340718+0000","last_became_peered":"2024-05-07T13:55:48.340718+0000","last_unstale":"2024-05-07T13:59:39.098445+0000","last_undegraded":"2024-05-07T13:59:39.098445+0000","last_fullsized":"2024-05-07T13:59:39.098445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:39.098327+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:39.098327+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.098327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:06.470550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'11","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.591970+0000","last_change":"2024-05-07T13:55:50.320724+0000","last_active":"2024-05-07T13:58:59.591970+0000","last_peered":"2024-05-07T13:58:59.591970+0000","last_clean":"2024-05-07T13:58:59.591970+0000","last_became_active":"2024-05-07T13:55:50.320430+0000","last_became_peered":"2024-05-07T13:55:50.320430+0000","last_unstale":"2024-05-07T13:58:59.591970+0000","last_undegraded":"2024-05-07T13:58:59.591970+0000","last_fullsized":"2024-05-07T13:58:59.591970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.178224+0000","last_change":"2024-05-07T13:55:48.324349+0000","last_active":"2024-05-07T13:57:58.178224+0000","last_peered":"2024-05-07T13:57:58.178224+0000","last_clean":"2024-05-07T13:57:58.178224+0000","last_became_active":"2024-05-07T13:55:48.323524+0000","last_became_peered":"2024-05-07T13:55:48.323524+0000","last_unstale":"2024-05-07T13:57:58.178224+0000","last_undegraded":"2024-05-07T13:57:58.178224+0000","last_fullsized":"2024-05-07T13:57:58.178224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.097729+0000","last_change":"2024-05-07T13:59:45.097757+0000","last_active":"2024-05-07T13:59:45.097729+0000","last_peered":"2024-05-07T13:59:45.097729+0000","last_clean":"2024-05-07T13:59:45.097729+0000","last_became_active":"2024-05-07T13:55:50.313012+0000","last_became_peered":"2024-05-07T13:55:50.313012+0000","last_unstale":"2024-05-07T13:59:45.097729+0000","last_undegraded":"2024-05-07T13:59:45.097729+0000","last_fullsized":"2024-05-07T13:59:45.097729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-07T13:59:45.097632+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-07T13:59:45.097632+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.097632+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:52:01.861948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:57:58.180034+0000","last_change":"2024-05-07T13:55:48.353515+0000","last_active":"2024-05-07T13:57:58.180034+0000","last_peered":"2024-05-07T13:57:58.180034+0000","last_clean":"2024-05-07T13:57:58.180034+0000","last_became_active":"2024-05-07T13:55:48.351882+0000","last_became_peered":"2024-05-07T13:55:48.351882+0000","last_unstale":"2024-05-07T13:57:58.180034+0000","last_undegraded":"2024-05-07T13:57:58.180034+0000","last_fullsized":"2024-05-07T13:57:58.180034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'8","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.983342+0000","last_change":"2024-05-07T13:59:29.983379+0000","last_active":"2024-05-07T13:59:29.983342+0000","last_peered":"2024-05-07T13:59:29.983342+0000","last_clean":"2024-05-07T13:59:29.983342+0000","last_became_active":"2024-05-07T13:55:50.325807+0000","last_became_peered":"2024-05-07T13:55:50.325807+0000","last_unstale":"2024-05-07T13:59:29.983342+0000","last_undegraded":"2024-05-07T13:59:29.983342+0000","last_fullsized":"2024-05-07T13:59:29.983342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:29.983257+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:29.983257+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.983257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:23.280897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.148376+0000","last_change":"2024-05-07T13:59:45.148407+0000","last_active":"2024-05-07T13:59:45.148376+0000","last_peered":"2024-05-07T13:59:45.148376+0000","last_clean":"2024-05-07T13:59:45.148376+0000","last_became_active":"2024-05-07T13:55:48.324919+0000","last_became_peered":"2024-05-07T13:55:48.324919+0000","last_unstale":"2024-05-07T13:59:45.148376+0000","last_undegraded":"2024-05-07T13:59:45.148376+0000","last_fullsized":"2024-05-07T13:59:45.148376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:45.148279+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:45.148279+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.148279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:40.994289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.037530+0000","last_change":"2024-05-07T13:59:39.037562+0000","last_active":"2024-05-07T13:59:39.037530+0000","last_peered":"2024-05-07T13:59:39.037530+0000","last_clean":"2024-05-07T13:59:39.037530+0000","last_became_active":"2024-05-07T13:55:50.325620+0000","last_became_peered":"2024-05-07T13:55:50.325620+0000","last_unstale":"2024-05-07T13:59:39.037530+0000","last_undegraded":"2024-05-07T13:59:39.037530+0000","last_fullsized":"2024-05-07T13:59:39.037530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:39.037426+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:39.037426+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.037426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:05.113376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.117972+0000","last_change":"2024-05-07T13:59:48.118048+0000","last_active":"2024-05-07T13:59:48.117972+0000","last_peered":"2024-05-07T13:59:48.117972+0000","last_clean":"2024-05-07T13:59:48.117972+0000","last_became_active":"2024-05-07T13:55:48.342508+0000","last_became_peered":"2024-05-07T13:55:48.342508+0000","last_unstale":"2024-05-07T13:59:48.117972+0000","last_undegraded":"2024-05-07T13:59:48.117972+0000","last_fullsized":"2024-05-07T13:59:48.117972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:48.117871+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:48.117871+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.117871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:21.723026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.251949+0000","last_change":"2024-05-07T13:55:50.321908+0000","last_active":"2024-05-07T13:58:59.251949+0000","last_peered":"2024-05-07T13:58:59.251949+0000","last_clean":"2024-05-07T13:58:59.251949+0000","last_became_active":"2024-05-07T13:55:50.321606+0000","last_became_peered":"2024-05-07T13:55:50.321606+0000","last_unstale":"2024-05-07T13:58:59.251949+0000","last_undegraded":"2024-05-07T13:58:59.251949+0000","last_fullsized":"2024-05-07T13:58:59.251949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180438+0000","last_change":"2024-05-07T13:55:48.332694+0000","last_active":"2024-05-07T13:58:03.180438+0000","last_peered":"2024-05-07T13:58:03.180438+0000","last_clean":"2024-05-07T13:58:03.180438+0000","last_became_active":"2024-05-07T13:55:48.332247+0000","last_became_peered":"2024-05-07T13:55:48.332247+0000","last_unstale":"2024-05-07T13:58:03.180438+0000","last_undegraded":"2024-05-07T13:58:03.180438+0000","last_fullsized":"2024-05-07T13:58:03.180438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'16","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.097944+0000","last_change":"2024-05-07T13:59:36.097975+0000","last_active":"2024-05-07T13:59:36.097944+0000","last_peered":"2024-05-07T13:59:36.097944+0000","last_clean":"2024-05-07T13:59:36.097944+0000","last_became_active":"2024-05-07T13:55:50.329434+0000","last_became_peered":"2024-05-07T13:55:50.329434+0000","last_unstale":"2024-05-07T13:59:36.097944+0000","last_undegraded":"2024-05-07T13:59:36.097944+0000","last_fullsized":"2024-05-07T13:59:36.097944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:36.097848+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:36.097848+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.097848+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:05:27.587259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.500539+0000","last_change":"2024-05-07T13:55:48.348177+0000","last_active":"2024-05-07T13:58:59.500539+0000","last_peered":"2024-05-07T13:58:59.500539+0000","last_clean":"2024-05-07T13:58:59.500539+0000","last_became_active":"2024-05-07T13:55:48.345844+0000","last_became_peered":"2024-05-07T13:55:48.345844+0000","last_unstale":"2024-05-07T13:58:59.500539+0000","last_undegraded":"2024-05-07T13:58:59.500539+0000","last_fullsized":"2024-05-07T13:58:59.500539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.052977+0000","last_change":"2024-05-07T13:59:42.053031+0000","last_active":"2024-05-07T13:59:42.052977+0000","last_peered":"2024-05-07T13:59:42.052977+0000","last_clean":"2024-05-07T13:59:42.052977+0000","last_became_active":"2024-05-07T13:55:50.313049+0000","last_became_peered":"2024-05-07T13:55:50.313049+0000","last_unstale":"2024-05-07T13:59:42.052977+0000","last_undegraded":"2024-05-07T13:59:42.052977+0000","last_fullsized":"2024-05-07T13:59:42.052977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:42.052863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:42.052863+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.052863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:36.854007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.124677+0000","last_change":"2024-05-07T13:55:48.349780+0000","last_active":"2024-05-07T13:58:59.124677+0000","last_peered":"2024-05-07T13:58:59.124677+0000","last_clean":"2024-05-07T13:58:59.124677+0000","last_became_active":"2024-05-07T13:55:48.346691+0000","last_became_peered":"2024-05-07T13:55:48.346691+0000","last_unstale":"2024-05-07T13:58:59.124677+0000","last_undegraded":"2024-05-07T13:58:59.124677+0000","last_fullsized":"2024-05-07T13:58:59.124677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'10","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181589+0000","last_change":"2024-05-07T13:55:50.323717+0000","last_active":"2024-05-07T13:58:08.181589+0000","last_peered":"2024-05-07T13:58:08.181589+0000","last_clean":"2024-05-07T13:58:08.181589+0000","last_became_active":"2024-05-07T13:55:50.322543+0000","last_became_peered":"2024-05-07T13:55:50.322543+0000","last_unstale":"2024-05-07T13:58:08.181589+0000","last_undegraded":"2024-05-07T13:58:08.181589+0000","last_fullsized":"2024-05-07T13:58:08.181589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.140150+0000","last_change":"2024-05-07T13:59:41.140179+0000","last_active":"2024-05-07T13:59:41.140150+0000","last_peered":"2024-05-07T13:59:41.140150+0000","last_clean":"2024-05-07T13:59:41.140150+0000","last_became_active":"2024-05-07T13:55:48.339909+0000","last_became_peered":"2024-05-07T13:55:48.339909+0000","last_unstale":"2024-05-07T13:59:41.140150+0000","last_undegraded":"2024-05-07T13:59:41.140150+0000","last_fullsized":"2024-05-07T13:59:41.140150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.140056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.140056+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.140056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:23.488647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.113258+0000","last_change":"2024-05-07T13:59:40.113305+0000","last_active":"2024-05-07T13:59:40.113258+0000","last_peered":"2024-05-07T13:59:40.113258+0000","last_clean":"2024-05-07T13:59:40.113258+0000","last_became_active":"2024-05-07T13:55:50.322967+0000","last_became_peered":"2024-05-07T13:55:50.322967+0000","last_unstale":"2024-05-07T13:59:40.113258+0000","last_undegraded":"2024-05-07T13:59:40.113258+0000","last_fullsized":"2024-05-07T13:59:40.113258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:40.113131+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:40.113131+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.113131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:44.889378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.106002+0000","last_change":"2024-05-07T13:55:48.347208+0000","last_active":"2024-05-07T13:58:59.106002+0000","last_peered":"2024-05-07T13:58:59.106002+0000","last_clean":"2024-05-07T13:58:59.106002+0000","last_became_active":"2024-05-07T13:55:48.346724+0000","last_became_peered":"2024-05-07T13:55:48.346724+0000","last_unstale":"2024-05-07T13:58:59.106002+0000","last_undegraded":"2024-05-07T13:58:59.106002+0000","last_fullsized":"2024-05-07T13:58:59.106002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181538+0000","last_change":"2024-05-07T13:55:48.351645+0000","last_active":"2024-05-07T13:58:08.181538+0000","last_peered":"2024-05-07T13:58:08.181538+0000","last_clean":"2024-05-07T13:58:08.181538+0000","last_became_active":"2024-05-07T13:55:48.349852+0000","last_became_peered":"2024-05-07T13:55:48.349852+0000","last_unstale":"2024-05-07T13:58:08.181538+0000","last_undegraded":"2024-05-07T13:58:08.181538+0000","last_fullsized":"2024-05-07T13:58:08.181538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415308+0000","last_change":"2024-05-07T13:55:50.319944+0000","last_active":"2024-05-07T13:58:59.415308+0000","last_peered":"2024-05-07T13:58:59.415308+0000","last_clean":"2024-05-07T13:58:59.415308+0000","last_became_active":"2024-05-07T13:55:50.319033+0000","last_became_peered":"2024-05-07T13:55:50.319033+0000","last_unstale":"2024-05-07T13:58:59.415308+0000","last_undegraded":"2024-05-07T13:58:59.415308+0000","last_fullsized":"2024-05-07T13:58:59.415308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.100730+0000","last_change":"2024-05-07T13:59:47.100759+0000","last_active":"2024-05-07T13:59:47.100730+0000","last_peered":"2024-05-07T13:59:47.100730+0000","last_clean":"2024-05-07T13:59:47.100730+0000","last_became_active":"2024-05-07T13:55:48.324081+0000","last_became_peered":"2024-05-07T13:55:48.324081+0000","last_unstale":"2024-05-07T13:59:47.100730+0000","last_undegraded":"2024-05-07T13:59:47.100730+0000","last_fullsized":"2024-05-07T13:59:47.100730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:47.100641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:47.100641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.100641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:57.320731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.027329+0000","last_change":"2024-05-07T13:59:34.027372+0000","last_active":"2024-05-07T13:59:34.027329+0000","last_peered":"2024-05-07T13:59:34.027329+0000","last_clean":"2024-05-07T13:59:34.027329+0000","last_became_active":"2024-05-07T13:55:50.329848+0000","last_became_peered":"2024-05-07T13:55:50.329848+0000","last_unstale":"2024-05-07T13:59:34.027329+0000","last_undegraded":"2024-05-07T13:59:34.027329+0000","last_fullsized":"2024-05-07T13:59:34.027329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:34.027225+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:34.027225+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.027225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:34.330181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":479,"ondisk_log_size":479,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705717,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":136605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705717,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":970752,"data_stored":724702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705717,"num_pgs":157,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44628,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327212,"statfs":{"total":96636764160,"available":96591065088,"internally_reserved":0,"allocated":995328,"data_stored":724122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":401408,"data_stored":134585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T13:59:51.662 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.662 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.662 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.662 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.663 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.663 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.663 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.663 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.663 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.663 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.663 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.663 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.664 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.664 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.664 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.664 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.664 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.664 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.664 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.665 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.665 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.665 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.665 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.665 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.665 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.665 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.666 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.666 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.666 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.666 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.666 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.666 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.667 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.667 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.667 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.667 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.667 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.667 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.668 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.668 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.668 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.668 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.668 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.668 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.669 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.669 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.669 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.669 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.669 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.669 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.670 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.670 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.670 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.670 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.670 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.670 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.670 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.671 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.671 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.671 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.671 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.671 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.671 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.671 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.672 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.672 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.672 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.672 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.672 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.672 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-07T13:55:55.312628+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=55, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.672 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.673 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.673 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.673 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.673 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.673 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.673 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.674 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.674 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.674 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.674 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.674 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.674 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.674 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.675 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.675 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.675 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.675 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.675 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.675 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.676 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.676 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.676 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.676 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.676 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.676 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.676 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.677 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.677 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.677 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.677 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.677 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.677 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.677 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.678 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.678 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.678 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.678 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.678 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.678 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T13:59:51.678 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T14:00:11.680 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:00:11.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.810+0000 7efc09ee6640 1 Processor -- start 2024-05-07T14:00:11.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.810+0000 7efc09ee6640 1 -- start start 2024-05-07T14:00:11.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.810+0000 7efc09ee6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc0412f580 0x7efc04131970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:11.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.810+0000 7efc09ee6640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc04113dd0 con 0x7efc0412c5b0 2024-05-07T14:00:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.810+0000 7efc09ee6640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7efc04072290 con 0x7efc0412f580 2024-05-07T14:00:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.810+0000 7efbfaffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc0412f580 0x7efc04131970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.810+0000 7efc037fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efc0412c5b0 0x7efc0412c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42924/0 (socket says 172.21.15.22:42924) 2024-05-07T14:00:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.810+0000 7efc037fe640 1 -- 172.21.15.22:0/1068011932 learned_addr learned my addr 172.21.15.22:0/1068011932 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T14:00:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.811+0000 7efbfaffd640 1 -- 172.21.15.22:0/1068011932 >> v1:172.21.15.22:6789/0 conn(0x7efc0412c5b0 legacy=0x7efc0412c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:11.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.811+0000 7efbfaffd640 1 -- 172.21.15.22:0/1068011932 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0412c390 con 0x7efc0412f580 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.811+0000 7efbfaffd640 1 --2- 172.21.15.22:0/1068011932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412f580 0x7efc04131970 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efbec009720 tx=0x7efbec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5f49ed0a614e8e server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc02ffd640 1 -- 172.21.15.22:0/1068011932 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbec0316d0 con 0x7efc0412f580 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc02ffd640 1 -- 172.21.15.22:0/1068011932 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbec037070 con 0x7efc0412f580 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc02ffd640 1 -- 172.21.15.22:0/1068011932 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbec0319c0 con 0x7efc0412f580 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc09ee6640 1 -- 172.21.15.22:0/1068011932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412f580 msgr2=0x7efc04131970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc09ee6640 1 --2- 172.21.15.22:0/1068011932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412f580 0x7efc04131970 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efbec009720 tx=0x7efbec02b840 comp rx=0 tx=0).stop 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc09ee6640 1 -- 172.21.15.22:0/1068011932 shutdown_connections 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc09ee6640 1 --2- 172.21.15.22:0/1068011932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412f580 0x7efc04131970 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc09ee6640 1 -- 172.21.15.22:0/1068011932 >> 172.21.15.22:0/1068011932 conn(0x7efc04099380 msgr2=0x7efc04099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc09ee6640 1 -- 172.21.15.22:0/1068011932 shutdown_connections 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.812+0000 7efc09ee6640 1 -- 172.21.15.22:0/1068011932 wait complete. 2024-05-07T14:00:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.813+0000 7efc09ee6640 1 Processor -- start 2024-05-07T14:00:11.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.813+0000 7efc09ee6640 1 -- start start 2024-05-07T14:00:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc09ee6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412c5b0 0x7efc04127e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc09ee6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc04113990 con 0x7efc0412c5b0 2024-05-07T14:00:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc037fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412c5b0 0x7efc04127e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc037fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412c5b0 0x7efc04127e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53280/0 (socket says 172.21.15.22:53280) 2024-05-07T14:00:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc037fe640 1 -- 172.21.15.22:0/400617409 learned_addr learned my addr 172.21.15.22:0/400617409 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T14:00:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc037fe640 1 -- 172.21.15.22:0/400617409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc04071a10 con 0x7efc0412c5b0 2024-05-07T14:00:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc037fe640 1 --2- 172.21.15.22:0/400617409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412c5b0 0x7efc04127e10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efbf400c380 tx=0x7efbf400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:11.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc00ff9640 1 -- 172.21.15.22:0/400617409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4005c10 con 0x7efc0412c5b0 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc00ff9640 1 -- 172.21.15.22:0/400617409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf4005db0 con 0x7efc0412c5b0 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc00ff9640 1 -- 172.21.15.22:0/400617409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4004930 con 0x7efc0412c5b0 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc04131980 con 0x7efc0412c5b0 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.814+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc04070b50 con 0x7efc0412c5b0 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.815+0000 7efc00ff9640 1 -- 172.21.15.22:0/400617409 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efbf401a020 con 0x7efc0412c5b0 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.816+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0406ef60 con 0x7efc0412c5b0 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.816+0000 7efc00ff9640 1 --2- 172.21.15.22:0/400617409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efbe4038060 0x7efbe403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.816+0000 7efc00ff9640 1 -- 172.21.15.22:0/400617409 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7efbf404b230 con 0x7efc0412c5b0 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.816+0000 7efbfaffd640 1 --2- 172.21.15.22:0/400617409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efbe4038060 0x7efbe403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:11.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.817+0000 7efbfaffd640 1 --2- 172.21.15.22:0/400617409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efbe4038060 0x7efbe403a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efbec036000 tx=0x7efbec008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:11.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:11.821+0000 7efc00ff9640 1 -- 172.21.15.22:0/400617409 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efc0406ef60 con 0x7efc0412c5b0 2024-05-07T14:00:11.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.001+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc04113360 con 0x7efbe4038060 2024-05-07T14:00:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.017+0000 7efc00ff9640 1 -- 172.21.15.22:0/400617409 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665035 (secure 0 0 0) 0x7efc04113360 con 0x7efbe4038060 2024-05-07T14:00:12.013 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T14:00:12.019 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T14:00:12.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.022+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efbe4038060 msgr2=0x7efbe403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:12.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.022+0000 7efc09ee6640 1 --2- 172.21.15.22:0/400617409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efbe4038060 0x7efbe403a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efbec036000 tx=0x7efbec008030 comp rx=0 tx=0).stop 2024-05-07T14:00:12.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.022+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412c5b0 msgr2=0x7efc04127e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:12.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.022+0000 7efc09ee6640 1 --2- 172.21.15.22:0/400617409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412c5b0 0x7efc04127e10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efbf400c380 tx=0x7efbf400c840 comp rx=0 tx=0).stop 2024-05-07T14:00:12.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.022+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 shutdown_connections 2024-05-07T14:00:12.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.022+0000 7efc09ee6640 1 --2- 172.21.15.22:0/400617409 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efbe4038060 0x7efbe403a520 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:12.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.022+0000 7efc09ee6640 1 --2- 172.21.15.22:0/400617409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc0412c5b0 0x7efc04127e10 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:12.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.022+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 >> 172.21.15.22:0/400617409 conn(0x7efc04099380 msgr2=0x7efc0412ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T14:00:12.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.023+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 shutdown_connections 2024-05-07T14:00:12.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:12.023+0000 7efc09ee6640 1 -- 172.21.15.22:0/400617409 wait complete. 2024-05-07T14:00:12.023 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-05-07T14:00:10.182901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5119,"num_read_kb":4700,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4782,"ondisk_log_size":4782,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":131608,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377355752,"statfs":{"total":386547056640,"available":386412290048,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":131917590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003334"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.910461+0000","last_change":"2024-05-07T13:59:51.910461+0000","last_active":"2024-05-07T13:59:51.910461+0000","last_peered":"2024-05-07T13:59:51.910461+0000","last_clean":"2024-05-07T13:59:51.910461+0000","last_became_active":"2024-05-07T13:55:48.335740+0000","last_became_peered":"2024-05-07T13:55:48.335740+0000","last_unstale":"2024-05-07T13:59:51.910461+0000","last_undegraded":"2024-05-07T13:59:51.910461+0000","last_fullsized":"2024-05-07T13:59:51.910461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:51.910320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:51.910320+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.910320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:13.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'14","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.100728+0000","last_change":"2024-05-07T13:59:49.100756+0000","last_active":"2024-05-07T13:59:49.100728+0000","last_peered":"2024-05-07T13:59:49.100728+0000","last_clean":"2024-05-07T13:59:49.100728+0000","last_became_active":"2024-05-07T13:55:50.316253+0000","last_became_peered":"2024-05-07T13:55:50.316253+0000","last_unstale":"2024-05-07T13:59:49.100728+0000","last_undegraded":"2024-05-07T13:59:49.100728+0000","last_fullsized":"2024-05-07T13:59:49.100728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:49.100641+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:49.100641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.100641+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:44.946651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.198506+0000","last_change":"2024-05-07T13:59:59.198533+0000","last_active":"2024-05-07T13:59:59.198506+0000","last_peered":"2024-05-07T13:59:59.198506+0000","last_clean":"2024-05-07T13:59:59.198506+0000","last_became_active":"2024-05-07T13:55:48.323151+0000","last_became_peered":"2024-05-07T13:55:48.323151+0000","last_unstale":"2024-05-07T13:59:59.198506+0000","last_undegraded":"2024-05-07T13:59:59.198506+0000","last_fullsized":"2024-05-07T13:59:59.198506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:59.198410+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:59.198410+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.198410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:17.533202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:55.185191+0000","last_change":"2024-05-07T13:59:55.185213+0000","last_active":"2024-05-07T13:59:55.185191+0000","last_peered":"2024-05-07T13:59:55.185191+0000","last_clean":"2024-05-07T13:59:55.185191+0000","last_became_active":"2024-05-07T13:55:50.322066+0000","last_became_peered":"2024-05-07T13:55:50.322066+0000","last_unstale":"2024-05-07T13:59:55.185191+0000","last_undegraded":"2024-05-07T13:59:55.185191+0000","last_fullsized":"2024-05-07T13:59:55.185191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:55.185090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:55.185090+0000","last_clean_scrub_stamp":"2024-05-07T13:59:55.185090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:57:41.597583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.098344+0000","last_change":"2024-05-07T14:00:04.098378+0000","last_active":"2024-05-07T14:00:04.098344+0000","last_peered":"2024-05-07T14:00:04.098344+0000","last_clean":"2024-05-07T14:00:04.098344+0000","last_became_active":"2024-05-07T13:55:48.347661+0000","last_became_peered":"2024-05-07T13:55:48.347661+0000","last_unstale":"2024-05-07T14:00:04.098344+0000","last_undegraded":"2024-05-07T14:00:04.098344+0000","last_fullsized":"2024-05-07T14:00:04.098344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:04.098253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:04.098253+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.098253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:24:11.641731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.273171+0000","last_change":"2024-05-07T13:59:50.273197+0000","last_active":"2024-05-07T13:59:50.273171+0000","last_peered":"2024-05-07T13:59:50.273171+0000","last_clean":"2024-05-07T13:59:50.273171+0000","last_became_active":"2024-05-07T13:55:50.321598+0000","last_became_peered":"2024-05-07T13:55:50.321598+0000","last_unstale":"2024-05-07T13:59:50.273171+0000","last_undegraded":"2024-05-07T13:59:50.273171+0000","last_fullsized":"2024-05-07T13:59:50.273171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:50.273079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:50.273079+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.273079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:41.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.888847+0000","last_change":"2024-05-07T13:59:54.888873+0000","last_active":"2024-05-07T13:59:54.888847+0000","last_peered":"2024-05-07T13:59:54.888847+0000","last_clean":"2024-05-07T13:59:54.888847+0000","last_became_active":"2024-05-07T13:55:48.337418+0000","last_became_peered":"2024-05-07T13:55:48.337418+0000","last_unstale":"2024-05-07T13:59:54.888847+0000","last_undegraded":"2024-05-07T13:59:54.888847+0000","last_fullsized":"2024-05-07T13:59:54.888847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:54.888740+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:54.888740+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.888740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:50.734750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.873096+0000","last_change":"2024-05-07T14:00:01.873127+0000","last_active":"2024-05-07T14:00:01.873096+0000","last_peered":"2024-05-07T14:00:01.873096+0000","last_clean":"2024-05-07T14:00:01.873096+0000","last_became_active":"2024-05-07T13:56:35.366947+0000","last_became_peered":"2024-05-07T13:56:35.366947+0000","last_unstale":"2024-05-07T14:00:01.873096+0000","last_undegraded":"2024-05-07T14:00:01.873096+0000","last_fullsized":"2024-05-07T14:00:01.873096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:01.873006+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:01.873006+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.873006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:22:00.612116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:08.132135+0000","last_change":"2024-05-07T14:00:08.132159+0000","last_active":"2024-05-07T14:00:08.132135+0000","last_peered":"2024-05-07T14:00:08.132135+0000","last_clean":"2024-05-07T14:00:08.132135+0000","last_became_active":"2024-05-07T13:55:48.347714+0000","last_became_peered":"2024-05-07T13:55:48.347714+0000","last_unstale":"2024-05-07T14:00:08.132135+0000","last_undegraded":"2024-05-07T14:00:08.132135+0000","last_fullsized":"2024-05-07T14:00:08.132135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:08.132042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:08.132042+0000","last_clean_scrub_stamp":"2024-05-07T14:00:08.132042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:12:48.834991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.090564+0000","last_change":"2024-05-07T13:59:47.090564+0000","last_active":"2024-05-07T13:59:47.090564+0000","last_peered":"2024-05-07T13:59:47.090564+0000","last_clean":"2024-05-07T13:59:47.090564+0000","last_became_active":"2024-05-07T13:55:50.314660+0000","last_became_peered":"2024-05-07T13:55:50.314660+0000","last_unstale":"2024-05-07T13:59:47.090564+0000","last_undegraded":"2024-05-07T13:59:47.090564+0000","last_fullsized":"2024-05-07T13:59:47.090564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-07T13:59:47.090435+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-07T13:59:47.090435+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.090435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:22.240440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.153596+0000","last_change":"2024-05-07T13:59:43.153642+0000","last_active":"2024-05-07T13:59:43.153596+0000","last_peered":"2024-05-07T13:59:43.153596+0000","last_clean":"2024-05-07T13:59:43.153596+0000","last_became_active":"2024-05-07T13:55:48.337256+0000","last_became_peered":"2024-05-07T13:55:48.337256+0000","last_unstale":"2024-05-07T13:59:43.153596+0000","last_undegraded":"2024-05-07T13:59:43.153596+0000","last_fullsized":"2024-05-07T13:59:43.153596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:43.153472+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:43.153472+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.153472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:43.479597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.225152+0000","last_change":"2024-05-07T13:59:56.225152+0000","last_active":"2024-05-07T13:59:56.225152+0000","last_peered":"2024-05-07T13:59:56.225152+0000","last_clean":"2024-05-07T13:59:56.225152+0000","last_became_active":"2024-05-07T13:55:50.322204+0000","last_became_peered":"2024-05-07T13:55:50.322204+0000","last_unstale":"2024-05-07T13:59:56.225152+0000","last_undegraded":"2024-05-07T13:59:56.225152+0000","last_fullsized":"2024-05-07T13:59:56.225152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:56.225019+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:56.225019+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.225019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:31:35.247577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183291+0000","last_change":"2024-05-07T13:55:48.348111+0000","last_active":"2024-05-07T13:58:18.183291+0000","last_peered":"2024-05-07T13:58:18.183291+0000","last_clean":"2024-05-07T13:58:18.183291+0000","last_became_active":"2024-05-07T13:55:48.347006+0000","last_became_peered":"2024-05-07T13:55:48.347006+0000","last_unstale":"2024-05-07T13:58:18.183291+0000","last_undegraded":"2024-05-07T13:58:18.183291+0000","last_fullsized":"2024-05-07T13:58:18.183291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.065113+0000","last_change":"2024-05-07T13:59:34.065113+0000","last_active":"2024-05-07T13:59:34.065113+0000","last_peered":"2024-05-07T13:59:34.065113+0000","last_clean":"2024-05-07T13:59:34.065113+0000","last_became_active":"2024-05-07T13:55:50.312835+0000","last_became_peered":"2024-05-07T13:55:50.312835+0000","last_unstale":"2024-05-07T13:59:34.065113+0000","last_undegraded":"2024-05-07T13:59:34.065113+0000","last_fullsized":"2024-05-07T13:59:34.065113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:34.064991+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:34.064991+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.064991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:30.763581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.131455+0000","last_change":"2024-05-07T14:00:02.131481+0000","last_active":"2024-05-07T14:00:02.131455+0000","last_peered":"2024-05-07T14:00:02.131455+0000","last_clean":"2024-05-07T14:00:02.131455+0000","last_became_active":"2024-05-07T13:55:48.323612+0000","last_became_peered":"2024-05-07T13:55:48.323612+0000","last_unstale":"2024-05-07T14:00:02.131455+0000","last_undegraded":"2024-05-07T14:00:02.131455+0000","last_fullsized":"2024-05-07T14:00:02.131455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-07T14:00:02.131343+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-07T14:00:02.131343+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.131343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:38:31.297761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.099829+0000","last_change":"2024-05-07T13:59:46.099829+0000","last_active":"2024-05-07T13:59:46.099829+0000","last_peered":"2024-05-07T13:59:46.099829+0000","last_clean":"2024-05-07T13:59:46.099829+0000","last_became_active":"2024-05-07T13:55:50.325055+0000","last_became_peered":"2024-05-07T13:55:50.325055+0000","last_unstale":"2024-05-07T13:59:46.099829+0000","last_undegraded":"2024-05-07T13:59:46.099829+0000","last_fullsized":"2024-05-07T13:59:46.099829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:46.099644+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:46.099644+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.099644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:50.875891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'22","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.185762+0000","last_change":"2024-05-07T13:59:58.185788+0000","last_active":"2024-05-07T13:59:58.185762+0000","last_peered":"2024-05-07T13:59:58.185762+0000","last_clean":"2024-05-07T13:59:58.185762+0000","last_became_active":"2024-05-07T13:55:50.321385+0000","last_became_peered":"2024-05-07T13:55:50.321385+0000","last_unstale":"2024-05-07T13:59:58.185762+0000","last_undegraded":"2024-05-07T13:59:58.185762+0000","last_fullsized":"2024-05-07T13:59:58.185762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-07T13:59:58.185680+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-07T13:59:58.185680+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.185680+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:35:22.015706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.916292+0000","last_change":"2024-05-07T14:00:02.916321+0000","last_active":"2024-05-07T14:00:02.916292+0000","last_peered":"2024-05-07T14:00:02.916292+0000","last_clean":"2024-05-07T14:00:02.916292+0000","last_became_active":"2024-05-07T13:55:48.335213+0000","last_became_peered":"2024-05-07T13:55:48.335213+0000","last_unstale":"2024-05-07T14:00:02.916292+0000","last_undegraded":"2024-05-07T14:00:02.916292+0000","last_fullsized":"2024-05-07T14:00:02.916292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T14:00:02.916198+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T14:00:02.916198+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.916198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:21.250990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'16","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.067266+0000","last_change":"2024-05-07T13:59:41.067301+0000","last_active":"2024-05-07T13:59:41.067266+0000","last_peered":"2024-05-07T13:59:41.067266+0000","last_clean":"2024-05-07T13:59:41.067266+0000","last_became_active":"2024-05-07T13:55:50.313457+0000","last_became_peered":"2024-05-07T13:55:50.313457+0000","last_unstale":"2024-05-07T13:59:41.067266+0000","last_undegraded":"2024-05-07T13:59:41.067266+0000","last_fullsized":"2024-05-07T13:59:41.067266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:41.067158+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:41.067158+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.067158+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:23.103665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.104844+0000","last_change":"2024-05-07T13:59:37.104889+0000","last_active":"2024-05-07T13:59:37.104844+0000","last_peered":"2024-05-07T13:59:37.104844+0000","last_clean":"2024-05-07T13:59:37.104844+0000","last_became_active":"2024-05-07T13:55:48.340516+0000","last_became_peered":"2024-05-07T13:55:48.340516+0000","last_unstale":"2024-05-07T13:59:37.104844+0000","last_undegraded":"2024-05-07T13:59:37.104844+0000","last_fullsized":"2024-05-07T13:59:37.104844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:37.104722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:37.104722+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.104722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:59.079495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.022073+0000","last_change":"2024-05-07T13:59:43.022101+0000","last_active":"2024-05-07T13:59:43.022073+0000","last_peered":"2024-05-07T13:59:43.022073+0000","last_clean":"2024-05-07T13:59:43.022073+0000","last_became_active":"2024-05-07T13:55:50.313442+0000","last_became_peered":"2024-05-07T13:55:50.313442+0000","last_unstale":"2024-05-07T13:59:43.022073+0000","last_undegraded":"2024-05-07T13:59:43.022073+0000","last_fullsized":"2024-05-07T13:59:43.022073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:43.021976+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:43.021976+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.021976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:09.097926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.004534+0000","last_change":"2024-05-07T13:59:56.004588+0000","last_active":"2024-05-07T13:59:56.004534+0000","last_peered":"2024-05-07T13:59:56.004534+0000","last_clean":"2024-05-07T13:59:56.004534+0000","last_became_active":"2024-05-07T13:55:48.338589+0000","last_became_peered":"2024-05-07T13:55:48.338589+0000","last_unstale":"2024-05-07T13:59:56.004534+0000","last_undegraded":"2024-05-07T13:59:56.004534+0000","last_fullsized":"2024-05-07T13:59:56.004534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:56.004403+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:56.004403+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.004403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:54.743513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.043384+0000","last_change":"2024-05-07T13:59:37.043430+0000","last_active":"2024-05-07T13:59:37.043384+0000","last_peered":"2024-05-07T13:59:37.043384+0000","last_clean":"2024-05-07T13:59:37.043384+0000","last_became_active":"2024-05-07T13:55:50.328471+0000","last_became_peered":"2024-05-07T13:55:50.328471+0000","last_unstale":"2024-05-07T13:59:37.043384+0000","last_undegraded":"2024-05-07T13:59:37.043384+0000","last_fullsized":"2024-05-07T13:59:37.043384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:37.043289+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:37.043289+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.043289+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:19.079795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.047879+0000","last_change":"2024-05-07T13:59:52.047904+0000","last_active":"2024-05-07T13:59:52.047879+0000","last_peered":"2024-05-07T13:59:52.047879+0000","last_clean":"2024-05-07T13:59:52.047879+0000","last_became_active":"2024-05-07T13:55:48.340284+0000","last_became_peered":"2024-05-07T13:55:48.340284+0000","last_unstale":"2024-05-07T13:59:52.047879+0000","last_undegraded":"2024-05-07T13:59:52.047879+0000","last_fullsized":"2024-05-07T13:59:52.047879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:52.047788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:52.047788+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.047788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:40:09.958765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.170442+0000","last_change":"2024-05-07T13:59:42.170509+0000","last_active":"2024-05-07T13:59:42.170442+0000","last_peered":"2024-05-07T13:59:42.170442+0000","last_clean":"2024-05-07T13:59:42.170442+0000","last_became_active":"2024-05-07T13:55:50.322513+0000","last_became_peered":"2024-05-07T13:55:50.322513+0000","last_unstale":"2024-05-07T13:59:42.170442+0000","last_undegraded":"2024-05-07T13:59:42.170442+0000","last_fullsized":"2024-05-07T13:59:42.170442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:42.170338+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:42.170338+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.170338+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:03.826198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.123147+0000","last_change":"2024-05-07T13:59:53.123172+0000","last_active":"2024-05-07T13:59:53.123147+0000","last_peered":"2024-05-07T13:59:53.123147+0000","last_clean":"2024-05-07T13:59:53.123147+0000","last_became_active":"2024-05-07T13:55:48.325321+0000","last_became_peered":"2024-05-07T13:55:48.325321+0000","last_unstale":"2024-05-07T13:59:53.123147+0000","last_undegraded":"2024-05-07T13:59:53.123147+0000","last_fullsized":"2024-05-07T13:59:53.123147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:53.123049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:53.123049+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.123049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:29.780712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.981980+0000","last_change":"2024-05-07T13:59:54.982030+0000","last_active":"2024-05-07T13:59:54.981980+0000","last_peered":"2024-05-07T13:59:54.981980+0000","last_clean":"2024-05-07T13:59:54.981980+0000","last_became_active":"2024-05-07T13:55:50.322476+0000","last_became_peered":"2024-05-07T13:55:50.322476+0000","last_unstale":"2024-05-07T13:59:54.981980+0000","last_undegraded":"2024-05-07T13:59:54.981980+0000","last_fullsized":"2024-05-07T13:59:54.981980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:54.981876+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:54.981876+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.981876+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:27.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:07.102275+0000","last_change":"2024-05-07T14:00:07.102310+0000","last_active":"2024-05-07T14:00:07.102275+0000","last_peered":"2024-05-07T14:00:07.102275+0000","last_clean":"2024-05-07T14:00:07.102275+0000","last_became_active":"2024-05-07T13:55:48.348714+0000","last_became_peered":"2024-05-07T13:55:48.348714+0000","last_unstale":"2024-05-07T14:00:07.102275+0000","last_undegraded":"2024-05-07T14:00:07.102275+0000","last_fullsized":"2024-05-07T14:00:07.102275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:07.102163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:07.102163+0000","last_clean_scrub_stamp":"2024-05-07T14:00:07.102163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:27:32.277841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'37","reported_seq":102,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.519599+0000","last_change":"2024-05-07T13:55:58.348302+0000","last_active":"2024-05-07T13:58:59.519599+0000","last_peered":"2024-05-07T13:58:59.519599+0000","last_clean":"2024-05-07T13:58:59.519599+0000","last_became_active":"2024-05-07T13:55:58.347993+0000","last_became_peered":"2024-05-07T13:55:58.347993+0000","last_unstale":"2024-05-07T13:58:59.519599+0000","last_undegraded":"2024-05-07T13:58:59.519599+0000","last_fullsized":"2024-05-07T13:58:59.519599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.216561+0000","last_change":"2024-05-07T13:59:52.216587+0000","last_active":"2024-05-07T13:59:52.216561+0000","last_peered":"2024-05-07T13:59:52.216561+0000","last_clean":"2024-05-07T13:59:52.216561+0000","last_became_active":"2024-05-07T13:55:50.323355+0000","last_became_peered":"2024-05-07T13:55:50.323355+0000","last_unstale":"2024-05-07T13:59:52.216561+0000","last_undegraded":"2024-05-07T13:59:52.216561+0000","last_fullsized":"2024-05-07T13:59:52.216561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:52.216464+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:52.216464+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.216464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:13.424313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.406190+0000","last_change":"2024-05-07T13:55:48.352275+0000","last_active":"2024-05-07T13:58:59.406190+0000","last_peered":"2024-05-07T13:58:59.406190+0000","last_clean":"2024-05-07T13:58:59.406190+0000","last_became_active":"2024-05-07T13:55:48.350161+0000","last_became_peered":"2024-05-07T13:55:48.350161+0000","last_unstale":"2024-05-07T13:58:59.406190+0000","last_undegraded":"2024-05-07T13:58:59.406190+0000","last_fullsized":"2024-05-07T13:58:59.406190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.845677+0000","last_change":"2024-05-07T13:59:13.845708+0000","last_active":"2024-05-07T13:59:13.845677+0000","last_peered":"2024-05-07T13:59:13.845677+0000","last_clean":"2024-05-07T13:59:13.845677+0000","last_became_active":"2024-05-07T13:55:52.318966+0000","last_became_peered":"2024-05-07T13:55:52.318966+0000","last_unstale":"2024-05-07T13:59:13.845677+0000","last_undegraded":"2024-05-07T13:59:13.845677+0000","last_fullsized":"2024-05-07T13:59:13.845677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.845587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:14.171712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.069054+0000","last_change":"2024-05-07T13:59:38.069097+0000","last_active":"2024-05-07T13:59:38.069054+0000","last_peered":"2024-05-07T13:59:38.069054+0000","last_clean":"2024-05-07T13:59:38.069054+0000","last_became_active":"2024-05-07T13:55:54.331835+0000","last_became_peered":"2024-05-07T13:55:54.331835+0000","last_unstale":"2024-05-07T13:59:38.069054+0000","last_undegraded":"2024-05-07T13:59:38.069054+0000","last_fullsized":"2024-05-07T13:59:38.069054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-07T13:59:38.068965+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-07T13:59:38.068965+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.068965+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:29.318982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.049143+0000","last_change":"2024-05-07T13:59:23.049169+0000","last_active":"2024-05-07T13:59:23.049143+0000","last_peered":"2024-05-07T13:59:23.049143+0000","last_clean":"2024-05-07T13:59:23.049143+0000","last_became_active":"2024-05-07T13:55:56.338638+0000","last_became_peered":"2024-05-07T13:55:56.338638+0000","last_unstale":"2024-05-07T13:59:23.049143+0000","last_undegraded":"2024-05-07T13:59:23.049143+0000","last_fullsized":"2024-05-07T13:59:23.049143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.049049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:44:20.135960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'13","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.183386+0000","last_change":"2024-05-07T13:55:58.348663+0000","last_active":"2024-05-07T13:58:23.183386+0000","last_peered":"2024-05-07T13:58:23.183386+0000","last_clean":"2024-05-07T13:58:23.183386+0000","last_became_active":"2024-05-07T13:55:58.348341+0000","last_became_peered":"2024-05-07T13:55:58.348341+0000","last_unstale":"2024-05-07T13:58:23.183386+0000","last_undegraded":"2024-05-07T13:58:23.183386+0000","last_fullsized":"2024-05-07T13:58:23.183386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.166127+0000","last_change":"2024-05-07T13:59:44.166197+0000","last_active":"2024-05-07T13:59:44.166127+0000","last_peered":"2024-05-07T13:59:44.166127+0000","last_clean":"2024-05-07T13:59:44.166127+0000","last_became_active":"2024-05-07T13:55:50.325201+0000","last_became_peered":"2024-05-07T13:55:50.325201+0000","last_unstale":"2024-05-07T13:59:44.166127+0000","last_undegraded":"2024-05-07T13:59:44.166127+0000","last_fullsized":"2024-05-07T13:59:44.166127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:44.166027+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:44.166027+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.166027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:48.666551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.852614+0000","last_change":"2024-05-07T13:59:56.852646+0000","last_active":"2024-05-07T13:59:56.852614+0000","last_peered":"2024-05-07T13:59:56.852614+0000","last_clean":"2024-05-07T13:59:56.852614+0000","last_became_active":"2024-05-07T13:55:48.338704+0000","last_became_peered":"2024-05-07T13:55:48.338704+0000","last_unstale":"2024-05-07T13:59:56.852614+0000","last_undegraded":"2024-05-07T13:59:56.852614+0000","last_fullsized":"2024-05-07T13:59:56.852614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:56.852511+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:56.852511+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.852511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:41.972519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:58.188527+0000","last_change":"2024-05-07T13:56:35.362029+0000","last_active":"2024-05-07T13:58:58.188527+0000","last_peered":"2024-05-07T13:58:58.188527+0000","last_clean":"2024-05-07T13:58:58.188527+0000","last_became_active":"2024-05-07T13:56:35.361623+0000","last_became_peered":"2024-05-07T13:56:35.361623+0000","last_unstale":"2024-05-07T13:58:58.188527+0000","last_undegraded":"2024-05-07T13:58:58.188527+0000","last_fullsized":"2024-05-07T13:58:58.188527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:51.298593+0000","last_clean_scrub_stamp":"2024-05-07T13:55:51.298593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.125797+0000","last_change":"2024-05-07T13:59:12.125828+0000","last_active":"2024-05-07T13:59:12.125797+0000","last_peered":"2024-05-07T13:59:12.125797+0000","last_clean":"2024-05-07T13:59:12.125797+0000","last_became_active":"2024-05-07T13:55:54.333402+0000","last_became_peered":"2024-05-07T13:55:54.333402+0000","last_unstale":"2024-05-07T13:59:12.125797+0000","last_undegraded":"2024-05-07T13:59:12.125797+0000","last_fullsized":"2024-05-07T13:59:12.125797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.125709+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:10.791591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.010782+0000","last_change":"2024-05-07T13:59:19.010859+0000","last_active":"2024-05-07T13:59:19.010782+0000","last_peered":"2024-05-07T13:59:19.010782+0000","last_clean":"2024-05-07T13:59:19.010782+0000","last_became_active":"2024-05-07T13:55:56.335463+0000","last_became_peered":"2024-05-07T13:55:56.335463+0000","last_unstale":"2024-05-07T13:59:19.010782+0000","last_undegraded":"2024-05-07T13:59:19.010782+0000","last_fullsized":"2024-05-07T13:59:19.010782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.010674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:27.103094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:07.101518+0000","last_change":"2024-05-07T14:00:07.101546+0000","last_active":"2024-05-07T14:00:07.101518+0000","last_peered":"2024-05-07T14:00:07.101518+0000","last_clean":"2024-05-07T14:00:07.101518+0000","last_became_active":"2024-05-07T13:55:58.340688+0000","last_became_peered":"2024-05-07T13:55:58.340688+0000","last_unstale":"2024-05-07T14:00:07.101518+0000","last_undegraded":"2024-05-07T14:00:07.101518+0000","last_fullsized":"2024-05-07T14:00:07.101518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T14:00:07.101412+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T14:00:07.101412+0000","last_clean_scrub_stamp":"2024-05-07T14:00:07.101412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:05:50.740119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.165617+0000","last_change":"2024-05-07T13:59:47.165656+0000","last_active":"2024-05-07T13:59:47.165617+0000","last_peered":"2024-05-07T13:59:47.165617+0000","last_clean":"2024-05-07T13:59:47.165617+0000","last_became_active":"2024-05-07T13:55:50.323775+0000","last_became_peered":"2024-05-07T13:55:50.323775+0000","last_unstale":"2024-05-07T13:59:47.165617+0000","last_undegraded":"2024-05-07T13:59:47.165617+0000","last_fullsized":"2024-05-07T13:59:47.165617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:47.165529+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:47.165529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.165529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:40:02.425709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:06.096703+0000","last_change":"2024-05-07T14:00:06.096751+0000","last_active":"2024-05-07T14:00:06.096703+0000","last_peered":"2024-05-07T14:00:06.096703+0000","last_clean":"2024-05-07T14:00:06.096703+0000","last_became_active":"2024-05-07T13:55:48.349636+0000","last_became_peered":"2024-05-07T13:55:48.349636+0000","last_unstale":"2024-05-07T14:00:06.096703+0000","last_undegraded":"2024-05-07T14:00:06.096703+0000","last_fullsized":"2024-05-07T14:00:06.096703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:06.096608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:06.096608+0000","last_clean_scrub_stamp":"2024-05-07T14:00:06.096608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:42:01.919712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.889687+0000","last_change":"2024-05-07T14:00:02.889730+0000","last_active":"2024-05-07T14:00:02.889687+0000","last_peered":"2024-05-07T14:00:02.889687+0000","last_clean":"2024-05-07T14:00:02.889687+0000","last_became_active":"2024-05-07T13:56:35.370109+0000","last_became_peered":"2024-05-07T13:56:35.370109+0000","last_unstale":"2024-05-07T14:00:02.889687+0000","last_undegraded":"2024-05-07T14:00:02.889687+0000","last_fullsized":"2024-05-07T14:00:02.889687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:02.889568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:02.889568+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.889568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:39.547231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.187173+0000","last_change":"2024-05-07T13:59:22.187264+0000","last_active":"2024-05-07T13:59:22.187173+0000","last_peered":"2024-05-07T13:59:22.187173+0000","last_clean":"2024-05-07T13:59:22.187173+0000","last_became_active":"2024-05-07T13:55:54.327178+0000","last_became_peered":"2024-05-07T13:55:54.327178+0000","last_unstale":"2024-05-07T13:59:22.187173+0000","last_undegraded":"2024-05-07T13:59:22.187173+0000","last_fullsized":"2024-05-07T13:59:22.187173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.187065+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:32.587195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.169072+0000","last_change":"2024-05-07T13:59:45.169121+0000","last_active":"2024-05-07T13:59:45.169072+0000","last_peered":"2024-05-07T13:59:45.169072+0000","last_clean":"2024-05-07T13:59:45.169072+0000","last_became_active":"2024-05-07T13:55:56.345712+0000","last_became_peered":"2024-05-07T13:55:56.345712+0000","last_unstale":"2024-05-07T13:59:45.169072+0000","last_undegraded":"2024-05-07T13:59:45.169072+0000","last_fullsized":"2024-05-07T13:59:45.169072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-05-07T13:59:45.168931+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-05-07T13:59:45.168931+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.168931+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:31:55.102005+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.162805+0000","last_change":"2024-05-07T13:59:28.162826+0000","last_active":"2024-05-07T13:59:28.162805+0000","last_peered":"2024-05-07T13:59:28.162805+0000","last_clean":"2024-05-07T13:59:28.162805+0000","last_became_active":"2024-05-07T13:55:58.339825+0000","last_became_peered":"2024-05-07T13:55:58.339825+0000","last_unstale":"2024-05-07T13:59:28.162805+0000","last_undegraded":"2024-05-07T13:59:28.162805+0000","last_fullsized":"2024-05-07T13:59:28.162805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.162716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:49.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.074088+0000","last_change":"2024-05-07T13:59:52.074112+0000","last_active":"2024-05-07T13:59:52.074088+0000","last_peered":"2024-05-07T13:59:52.074088+0000","last_clean":"2024-05-07T13:59:52.074088+0000","last_became_active":"2024-05-07T13:55:50.318502+0000","last_became_peered":"2024-05-07T13:55:50.318502+0000","last_unstale":"2024-05-07T13:59:52.074088+0000","last_undegraded":"2024-05-07T13:59:52.074088+0000","last_fullsized":"2024-05-07T13:59:52.074088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:52.074006+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:52.074006+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.074006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:50.813115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.052768+0000","last_change":"2024-05-07T13:59:46.052825+0000","last_active":"2024-05-07T13:59:46.052768+0000","last_peered":"2024-05-07T13:59:46.052768+0000","last_clean":"2024-05-07T13:59:46.052768+0000","last_became_active":"2024-05-07T13:55:48.345080+0000","last_became_peered":"2024-05-07T13:55:48.345080+0000","last_unstale":"2024-05-07T13:59:46.052768+0000","last_undegraded":"2024-05-07T13:59:46.052768+0000","last_fullsized":"2024-05-07T13:59:46.052768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:46.052643+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:46.052643+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.052643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:07.843171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.860466+0000","last_change":"2024-05-07T13:59:18.860501+0000","last_active":"2024-05-07T13:59:18.860466+0000","last_peered":"2024-05-07T13:59:18.860466+0000","last_clean":"2024-05-07T13:59:18.860466+0000","last_became_active":"2024-05-07T13:55:52.318178+0000","last_became_peered":"2024-05-07T13:55:52.318178+0000","last_unstale":"2024-05-07T13:59:18.860466+0000","last_undegraded":"2024-05-07T13:59:18.860466+0000","last_fullsized":"2024-05-07T13:59:18.860466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.860344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:31:08.364202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.065120+0000","last_change":"2024-05-07T13:59:17.065153+0000","last_active":"2024-05-07T13:59:17.065120+0000","last_peered":"2024-05-07T13:59:17.065120+0000","last_clean":"2024-05-07T13:59:17.065120+0000","last_became_active":"2024-05-07T13:55:54.330662+0000","last_became_peered":"2024-05-07T13:55:54.330662+0000","last_unstale":"2024-05-07T13:59:17.065120+0000","last_undegraded":"2024-05-07T13:59:17.065120+0000","last_fullsized":"2024-05-07T13:59:17.065120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.065035+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:20.830603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.894290+0000","last_change":"2024-05-07T13:59:10.894332+0000","last_active":"2024-05-07T13:59:10.894290+0000","last_peered":"2024-05-07T13:59:10.894290+0000","last_clean":"2024-05-07T13:59:10.894290+0000","last_became_active":"2024-05-07T13:55:56.334111+0000","last_became_peered":"2024-05-07T13:55:56.334111+0000","last_unstale":"2024-05-07T13:59:10.894290+0000","last_undegraded":"2024-05-07T13:59:10.894290+0000","last_fullsized":"2024-05-07T13:59:10.894290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.894211+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:00.735952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'11","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.031877+0000","last_change":"2024-05-07T13:59:27.031904+0000","last_active":"2024-05-07T13:59:27.031877+0000","last_peered":"2024-05-07T13:59:27.031877+0000","last_clean":"2024-05-07T13:59:27.031877+0000","last_became_active":"2024-05-07T13:55:50.324820+0000","last_became_peered":"2024-05-07T13:55:50.324820+0000","last_unstale":"2024-05-07T13:59:27.031877+0000","last_undegraded":"2024-05-07T13:59:27.031877+0000","last_fullsized":"2024-05-07T13:59:27.031877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.031775+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:22.190354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.956806+0000","last_change":"2024-05-07T13:59:50.956851+0000","last_active":"2024-05-07T13:59:50.956806+0000","last_peered":"2024-05-07T13:59:50.956806+0000","last_clean":"2024-05-07T13:59:50.956806+0000","last_became_active":"2024-05-07T13:55:48.335443+0000","last_became_peered":"2024-05-07T13:55:48.335443+0000","last_unstale":"2024-05-07T13:59:50.956806+0000","last_undegraded":"2024-05-07T13:59:50.956806+0000","last_fullsized":"2024-05-07T13:59:50.956806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:50.956641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:50.956641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.956641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:52:07.720957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.073468+0000","last_change":"2024-05-07T13:59:24.073496+0000","last_active":"2024-05-07T13:59:24.073468+0000","last_peered":"2024-05-07T13:59:24.073468+0000","last_clean":"2024-05-07T13:59:24.073468+0000","last_became_active":"2024-05-07T13:55:52.322188+0000","last_became_peered":"2024-05-07T13:55:52.322188+0000","last_unstale":"2024-05-07T13:59:24.073468+0000","last_undegraded":"2024-05-07T13:59:24.073468+0000","last_fullsized":"2024-05-07T13:59:24.073468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.073340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:13.708665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.081851+0000","last_change":"2024-05-07T13:59:18.081901+0000","last_active":"2024-05-07T13:59:18.081851+0000","last_peered":"2024-05-07T13:59:18.081851+0000","last_clean":"2024-05-07T13:59:18.081851+0000","last_became_active":"2024-05-07T13:55:54.330401+0000","last_became_peered":"2024-05-07T13:55:54.330401+0000","last_unstale":"2024-05-07T13:59:18.081851+0000","last_undegraded":"2024-05-07T13:59:18.081851+0000","last_fullsized":"2024-05-07T13:59:18.081851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.081750+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:16:16.381571+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.945644+0000","last_change":"2024-05-07T13:59:13.945668+0000","last_active":"2024-05-07T13:59:13.945644+0000","last_peered":"2024-05-07T13:59:13.945644+0000","last_clean":"2024-05-07T13:59:13.945644+0000","last_became_active":"2024-05-07T13:55:56.334368+0000","last_became_peered":"2024-05-07T13:55:56.334368+0000","last_unstale":"2024-05-07T13:59:13.945644+0000","last_undegraded":"2024-05-07T13:59:13.945644+0000","last_fullsized":"2024-05-07T13:59:13.945644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.945550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:11.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.843455+0000","last_change":"2024-05-07T13:59:58.843455+0000","last_active":"2024-05-07T13:59:58.843455+0000","last_peered":"2024-05-07T13:59:58.843455+0000","last_clean":"2024-05-07T13:59:58.843455+0000","last_became_active":"2024-05-07T13:55:58.346457+0000","last_became_peered":"2024-05-07T13:55:58.346457+0000","last_unstale":"2024-05-07T13:59:58.843455+0000","last_undegraded":"2024-05-07T13:59:58.843455+0000","last_fullsized":"2024-05-07T13:59:58.843455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T13:59:58.843311+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T13:59:58.843311+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.843311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:52.140951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.050432+0000","last_change":"2024-05-07T13:59:44.050463+0000","last_active":"2024-05-07T13:59:44.050432+0000","last_peered":"2024-05-07T13:59:44.050432+0000","last_clean":"2024-05-07T13:59:44.050432+0000","last_became_active":"2024-05-07T13:55:50.312564+0000","last_became_peered":"2024-05-07T13:55:50.312564+0000","last_unstale":"2024-05-07T13:59:44.050432+0000","last_undegraded":"2024-05-07T13:59:44.050432+0000","last_fullsized":"2024-05-07T13:59:44.050432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:44.050311+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:44.050311+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.050311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:31.285519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.933022+0000","last_change":"2024-05-07T13:59:52.933051+0000","last_active":"2024-05-07T13:59:52.933022+0000","last_peered":"2024-05-07T13:59:52.933022+0000","last_clean":"2024-05-07T13:59:52.933022+0000","last_became_active":"2024-05-07T13:55:48.335791+0000","last_became_peered":"2024-05-07T13:55:48.335791+0000","last_unstale":"2024-05-07T13:59:52.933022+0000","last_undegraded":"2024-05-07T13:59:52.933022+0000","last_fullsized":"2024-05-07T13:59:52.933022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:52.932909+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:52.932909+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.932909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:28.082914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.088740+0000","last_change":"2024-05-07T13:59:27.088805+0000","last_active":"2024-05-07T13:59:27.088740+0000","last_peered":"2024-05-07T13:59:27.088740+0000","last_clean":"2024-05-07T13:59:27.088740+0000","last_became_active":"2024-05-07T13:55:52.325676+0000","last_became_peered":"2024-05-07T13:55:52.325676+0000","last_unstale":"2024-05-07T13:59:27.088740+0000","last_undegraded":"2024-05-07T13:59:27.088740+0000","last_fullsized":"2024-05-07T13:59:27.088740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.088632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:08.861590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'39","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.053124+0000","last_change":"2024-05-07T13:59:35.053158+0000","last_active":"2024-05-07T13:59:35.053124+0000","last_peered":"2024-05-07T13:59:35.053124+0000","last_clean":"2024-05-07T13:59:35.053124+0000","last_became_active":"2024-05-07T13:55:54.331979+0000","last_became_peered":"2024-05-07T13:55:54.331979+0000","last_unstale":"2024-05-07T13:59:35.053124+0000","last_undegraded":"2024-05-07T13:59:35.053124+0000","last_fullsized":"2024-05-07T13:59:35.053124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:35.053039+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:35.053039+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.053039+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:39.918537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.927280+0000","last_change":"2024-05-07T13:59:12.927307+0000","last_active":"2024-05-07T13:59:12.927280+0000","last_peered":"2024-05-07T13:59:12.927280+0000","last_clean":"2024-05-07T13:59:12.927280+0000","last_became_active":"2024-05-07T13:55:56.333357+0000","last_became_peered":"2024-05-07T13:55:56.333357+0000","last_unstale":"2024-05-07T13:59:12.927280+0000","last_undegraded":"2024-05-07T13:59:12.927280+0000","last_fullsized":"2024-05-07T13:59:12.927280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.927183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:18.128049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.070919+0000","last_change":"2024-05-07T13:59:35.070919+0000","last_active":"2024-05-07T13:59:35.070919+0000","last_peered":"2024-05-07T13:59:35.070919+0000","last_clean":"2024-05-07T13:59:35.070919+0000","last_became_active":"2024-05-07T13:55:58.344955+0000","last_became_peered":"2024-05-07T13:55:58.344955+0000","last_unstale":"2024-05-07T13:59:35.070919+0000","last_undegraded":"2024-05-07T13:59:35.070919+0000","last_fullsized":"2024-05-07T13:59:35.070919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:35.070796+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:35.070796+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.070796+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:54.753266+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.890099+0000","last_change":"2024-05-07T13:59:57.890156+0000","last_active":"2024-05-07T13:59:57.890099+0000","last_peered":"2024-05-07T13:59:57.890099+0000","last_clean":"2024-05-07T13:59:57.890099+0000","last_became_active":"2024-05-07T13:55:50.327059+0000","last_became_peered":"2024-05-07T13:55:50.327059+0000","last_unstale":"2024-05-07T13:59:57.890099+0000","last_undegraded":"2024-05-07T13:59:57.890099+0000","last_fullsized":"2024-05-07T13:59:57.890099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:57.889977+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:57.889977+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.889977+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:40:15.800954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.126608+0000","last_change":"2024-05-07T14:00:03.126658+0000","last_active":"2024-05-07T14:00:03.126608+0000","last_peered":"2024-05-07T14:00:03.126608+0000","last_clean":"2024-05-07T14:00:03.126608+0000","last_became_active":"2024-05-07T13:55:48.350442+0000","last_became_peered":"2024-05-07T13:55:48.350442+0000","last_unstale":"2024-05-07T14:00:03.126608+0000","last_undegraded":"2024-05-07T14:00:03.126608+0000","last_fullsized":"2024-05-07T14:00:03.126608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:03.126502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:03.126502+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.126502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:54:47.586769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.008622+0000","last_change":"2024-05-07T13:59:31.008644+0000","last_active":"2024-05-07T13:59:31.008622+0000","last_peered":"2024-05-07T13:59:31.008622+0000","last_clean":"2024-05-07T13:59:31.008622+0000","last_became_active":"2024-05-07T13:55:52.321674+0000","last_became_peered":"2024-05-07T13:55:52.321674+0000","last_unstale":"2024-05-07T13:59:31.008622+0000","last_undegraded":"2024-05-07T13:59:31.008622+0000","last_fullsized":"2024-05-07T13:59:31.008622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.008529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.008529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.008529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:13.357119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.831229+0000","last_change":"2024-05-07T13:59:14.831318+0000","last_active":"2024-05-07T13:59:14.831229+0000","last_peered":"2024-05-07T13:59:14.831229+0000","last_clean":"2024-05-07T13:59:14.831229+0000","last_became_active":"2024-05-07T13:55:54.325336+0000","last_became_peered":"2024-05-07T13:55:54.325336+0000","last_unstale":"2024-05-07T13:59:14.831229+0000","last_undegraded":"2024-05-07T13:59:14.831229+0000","last_fullsized":"2024-05-07T13:59:14.831229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.831128+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:26:59.956651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":366,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.962074+0000","last_change":"2024-05-07T13:59:17.962101+0000","last_active":"2024-05-07T13:59:17.962074+0000","last_peered":"2024-05-07T13:59:17.962074+0000","last_clean":"2024-05-07T13:59:17.962074+0000","last_became_active":"2024-05-07T13:55:56.334895+0000","last_became_peered":"2024-05-07T13:55:56.334895+0000","last_unstale":"2024-05-07T13:59:17.962074+0000","last_undegraded":"2024-05-07T13:59:17.962074+0000","last_fullsized":"2024-05-07T13:59:17.962074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.961985+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:39.314908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:06.098564+0000","last_change":"2024-05-07T14:00:06.098595+0000","last_active":"2024-05-07T14:00:06.098564+0000","last_peered":"2024-05-07T14:00:06.098564+0000","last_clean":"2024-05-07T14:00:06.098564+0000","last_became_active":"2024-05-07T13:55:58.340764+0000","last_became_peered":"2024-05-07T13:55:58.340764+0000","last_unstale":"2024-05-07T14:00:06.098564+0000","last_undegraded":"2024-05-07T14:00:06.098564+0000","last_fullsized":"2024-05-07T14:00:06.098564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:06.098465+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:06.098465+0000","last_clean_scrub_stamp":"2024-05-07T14:00:06.098465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:01:05.493626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.114369+0000","last_change":"2024-05-07T13:59:38.114438+0000","last_active":"2024-05-07T13:59:38.114369+0000","last_peered":"2024-05-07T13:59:38.114369+0000","last_clean":"2024-05-07T13:59:38.114369+0000","last_became_active":"2024-05-07T13:55:50.312649+0000","last_became_peered":"2024-05-07T13:55:50.312649+0000","last_unstale":"2024-05-07T13:59:38.114369+0000","last_undegraded":"2024-05-07T13:59:38.114369+0000","last_fullsized":"2024-05-07T13:59:38.114369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:38.114264+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:38.114264+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.114264+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:14:52.055884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:03.180844+0000","last_change":"2024-05-07T13:55:48.347430+0000","last_active":"2024-05-07T13:58:03.180844+0000","last_peered":"2024-05-07T13:58:03.180844+0000","last_clean":"2024-05-07T13:58:03.180844+0000","last_became_active":"2024-05-07T13:55:48.346027+0000","last_became_peered":"2024-05-07T13:55:48.346027+0000","last_unstale":"2024-05-07T13:58:03.180844+0000","last_undegraded":"2024-05-07T13:58:03.180844+0000","last_fullsized":"2024-05-07T13:58:03.180844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.054825+0000","last_change":"2024-05-07T13:59:28.054894+0000","last_active":"2024-05-07T13:59:28.054825+0000","last_peered":"2024-05-07T13:59:28.054825+0000","last_clean":"2024-05-07T13:59:28.054825+0000","last_became_active":"2024-05-07T13:55:52.325427+0000","last_became_peered":"2024-05-07T13:55:52.325427+0000","last_unstale":"2024-05-07T13:59:28.054825+0000","last_undegraded":"2024-05-07T13:59:28.054825+0000","last_fullsized":"2024-05-07T13:59:28.054825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.054722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:47.334525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.081002+0000","last_change":"2024-05-07T13:59:34.081043+0000","last_active":"2024-05-07T13:59:34.081002+0000","last_peered":"2024-05-07T13:59:34.081002+0000","last_clean":"2024-05-07T13:59:34.081002+0000","last_became_active":"2024-05-07T13:55:54.334315+0000","last_became_peered":"2024-05-07T13:55:54.334315+0000","last_unstale":"2024-05-07T13:59:34.081002+0000","last_undegraded":"2024-05-07T13:59:34.081002+0000","last_fullsized":"2024-05-07T13:59:34.081002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-07T13:59:34.080919+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-07T13:59:34.080919+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.080919+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:10.738582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.917795+0000","last_change":"2024-05-07T13:59:16.917820+0000","last_active":"2024-05-07T13:59:16.917795+0000","last_peered":"2024-05-07T13:59:16.917795+0000","last_clean":"2024-05-07T13:59:16.917795+0000","last_became_active":"2024-05-07T13:55:56.330355+0000","last_became_peered":"2024-05-07T13:55:56.330355+0000","last_unstale":"2024-05-07T13:59:16.917795+0000","last_undegraded":"2024-05-07T13:59:16.917795+0000","last_fullsized":"2024-05-07T13:59:16.917795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.917702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:29.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'21","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.010522+0000","last_change":"2024-05-07T13:59:34.010583+0000","last_active":"2024-05-07T13:59:34.010522+0000","last_peered":"2024-05-07T13:59:34.010522+0000","last_clean":"2024-05-07T13:59:34.010522+0000","last_became_active":"2024-05-07T13:55:58.336692+0000","last_became_peered":"2024-05-07T13:55:58.336692+0000","last_unstale":"2024-05-07T13:59:34.010522+0000","last_undegraded":"2024-05-07T13:59:34.010522+0000","last_fullsized":"2024-05-07T13:59:34.010522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:34.010409+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:34.010409+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.010409+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:23.971858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.957243+0000","last_change":"2024-05-07T14:00:04.957267+0000","last_active":"2024-05-07T14:00:04.957243+0000","last_peered":"2024-05-07T14:00:04.957243+0000","last_clean":"2024-05-07T14:00:04.957243+0000","last_became_active":"2024-05-07T13:55:50.322764+0000","last_became_peered":"2024-05-07T13:55:50.322764+0000","last_unstale":"2024-05-07T14:00:04.957243+0000","last_undegraded":"2024-05-07T14:00:04.957243+0000","last_fullsized":"2024-05-07T14:00:04.957243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T14:00:04.957162+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T14:00:04.957162+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.957162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:34:40.825959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:55.201380+0000","last_change":"2024-05-07T13:59:55.201411+0000","last_active":"2024-05-07T13:59:55.201380+0000","last_peered":"2024-05-07T13:59:55.201380+0000","last_clean":"2024-05-07T13:59:55.201380+0000","last_became_active":"2024-05-07T13:55:48.325075+0000","last_became_peered":"2024-05-07T13:55:48.325075+0000","last_unstale":"2024-05-07T13:59:55.201380+0000","last_undegraded":"2024-05-07T13:59:55.201380+0000","last_fullsized":"2024-05-07T13:59:55.201380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:55.201253+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:55.201253+0000","last_clean_scrub_stamp":"2024-05-07T13:59:55.201253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:23.579779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.138853+0000","last_change":"2024-05-07T13:59:29.138879+0000","last_active":"2024-05-07T13:59:29.138853+0000","last_peered":"2024-05-07T13:59:29.138853+0000","last_clean":"2024-05-07T13:59:29.138853+0000","last_became_active":"2024-05-07T13:55:52.321730+0000","last_became_peered":"2024-05-07T13:55:52.321730+0000","last_unstale":"2024-05-07T13:59:29.138853+0000","last_undegraded":"2024-05-07T13:59:29.138853+0000","last_fullsized":"2024-05-07T13:59:29.138853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:29.138750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:29.138750+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.138750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:09.782425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'41","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.091355+0000","last_change":"2024-05-07T13:59:17.091397+0000","last_active":"2024-05-07T13:59:17.091355+0000","last_peered":"2024-05-07T13:59:17.091355+0000","last_clean":"2024-05-07T13:59:17.091355+0000","last_became_active":"2024-05-07T13:55:54.324530+0000","last_became_peered":"2024-05-07T13:55:54.324530+0000","last_unstale":"2024-05-07T13:59:17.091355+0000","last_undegraded":"2024-05-07T13:59:17.091355+0000","last_fullsized":"2024-05-07T13:59:17.091355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.091253+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:22.292118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.984217+0000","last_change":"2024-05-07T13:59:30.984243+0000","last_active":"2024-05-07T13:59:30.984217+0000","last_peered":"2024-05-07T13:59:30.984217+0000","last_clean":"2024-05-07T13:59:30.984217+0000","last_became_active":"2024-05-07T13:55:56.343900+0000","last_became_peered":"2024-05-07T13:55:56.343900+0000","last_unstale":"2024-05-07T13:59:30.984217+0000","last_undegraded":"2024-05-07T13:59:30.984217+0000","last_fullsized":"2024-05-07T13:59:30.984217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.984114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.984114+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.984114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:14.143436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.518237+0000","last_change":"2024-05-07T13:55:58.352050+0000","last_active":"2024-05-07T13:59:10.518237+0000","last_peered":"2024-05-07T13:59:10.518237+0000","last_clean":"2024-05-07T13:59:10.518237+0000","last_became_active":"2024-05-07T13:55:58.351724+0000","last_became_peered":"2024-05-07T13:55:58.351724+0000","last_unstale":"2024-05-07T13:59:10.518237+0000","last_undegraded":"2024-05-07T13:59:10.518237+0000","last_fullsized":"2024-05-07T13:59:10.518237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.842728+0000","last_change":"2024-05-07T13:59:21.842752+0000","last_active":"2024-05-07T13:59:21.842728+0000","last_peered":"2024-05-07T13:59:21.842728+0000","last_clean":"2024-05-07T13:59:21.842728+0000","last_became_active":"2024-05-07T13:55:50.326050+0000","last_became_peered":"2024-05-07T13:55:50.326050+0000","last_unstale":"2024-05-07T13:59:21.842728+0000","last_undegraded":"2024-05-07T13:59:21.842728+0000","last_fullsized":"2024-05-07T13:59:21.842728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.842623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:38.606939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516672+0000","last_change":"2024-05-07T13:55:48.352032+0000","last_active":"2024-05-07T13:59:10.516672+0000","last_peered":"2024-05-07T13:59:10.516672+0000","last_clean":"2024-05-07T13:59:10.516672+0000","last_became_active":"2024-05-07T13:55:48.350335+0000","last_became_peered":"2024-05-07T13:55:48.350335+0000","last_unstale":"2024-05-07T13:59:10.516672+0000","last_undegraded":"2024-05-07T13:59:10.516672+0000","last_fullsized":"2024-05-07T13:59:10.516672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.050826+0000","last_change":"2024-05-07T13:59:29.050888+0000","last_active":"2024-05-07T13:59:29.050826+0000","last_peered":"2024-05-07T13:59:29.050826+0000","last_clean":"2024-05-07T13:59:29.050826+0000","last_became_active":"2024-05-07T13:55:52.322006+0000","last_became_peered":"2024-05-07T13:55:52.322006+0000","last_unstale":"2024-05-07T13:59:29.050826+0000","last_undegraded":"2024-05-07T13:59:29.050826+0000","last_fullsized":"2024-05-07T13:59:29.050826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:29.050679+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:29.050679+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.050679+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:28.253848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.102576+0000","last_change":"2024-05-07T13:59:25.102617+0000","last_active":"2024-05-07T13:59:25.102576+0000","last_peered":"2024-05-07T13:59:25.102576+0000","last_clean":"2024-05-07T13:59:25.102576+0000","last_became_active":"2024-05-07T13:55:54.319812+0000","last_became_peered":"2024-05-07T13:55:54.319812+0000","last_unstale":"2024-05-07T13:59:25.102576+0000","last_undegraded":"2024-05-07T13:59:25.102576+0000","last_fullsized":"2024-05-07T13:59:25.102576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.102469+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:25.507214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":442,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.102076+0000","last_change":"2024-05-07T13:59:11.102102+0000","last_active":"2024-05-07T13:59:11.102076+0000","last_peered":"2024-05-07T13:59:11.102076+0000","last_clean":"2024-05-07T13:59:11.102076+0000","last_became_active":"2024-05-07T13:55:56.331966+0000","last_became_peered":"2024-05-07T13:55:56.331966+0000","last_unstale":"2024-05-07T13:59:11.102076+0000","last_undegraded":"2024-05-07T13:59:11.102076+0000","last_fullsized":"2024-05-07T13:59:11.102076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.101988+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:35.873097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'21","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.051692+0000","last_change":"2024-05-07T13:59:38.051692+0000","last_active":"2024-05-07T13:59:38.051692+0000","last_peered":"2024-05-07T13:59:38.051692+0000","last_clean":"2024-05-07T13:59:38.051692+0000","last_became_active":"2024-05-07T13:55:58.340608+0000","last_became_peered":"2024-05-07T13:55:58.340608+0000","last_unstale":"2024-05-07T13:59:38.051692+0000","last_undegraded":"2024-05-07T13:59:38.051692+0000","last_fullsized":"2024-05-07T13:59:38.051692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:38.051568+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:38.051568+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.051568+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:32.852712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.106412+0000","last_change":"2024-05-07T13:59:44.106440+0000","last_active":"2024-05-07T13:59:44.106412+0000","last_peered":"2024-05-07T13:59:44.106412+0000","last_clean":"2024-05-07T13:59:44.106412+0000","last_became_active":"2024-05-07T13:55:50.322650+0000","last_became_peered":"2024-05-07T13:55:50.322650+0000","last_unstale":"2024-05-07T13:59:44.106412+0000","last_undegraded":"2024-05-07T13:59:44.106412+0000","last_fullsized":"2024-05-07T13:59:44.106412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:44.106305+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:44.106305+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.106305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:34.067754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516683+0000","last_change":"2024-05-07T13:55:48.349364+0000","last_active":"2024-05-07T13:59:10.516683+0000","last_peered":"2024-05-07T13:59:10.516683+0000","last_clean":"2024-05-07T13:59:10.516683+0000","last_became_active":"2024-05-07T13:55:48.347434+0000","last_became_peered":"2024-05-07T13:55:48.347434+0000","last_unstale":"2024-05-07T13:59:10.516683+0000","last_undegraded":"2024-05-07T13:59:10.516683+0000","last_fullsized":"2024-05-07T13:59:10.516683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":428,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.028806+0000","last_change":"2024-05-07T13:59:25.028855+0000","last_active":"2024-05-07T13:59:25.028806+0000","last_peered":"2024-05-07T13:59:25.028806+0000","last_clean":"2024-05-07T13:59:25.028806+0000","last_became_active":"2024-05-07T13:55:52.321251+0000","last_became_peered":"2024-05-07T13:55:52.321251+0000","last_unstale":"2024-05-07T13:59:25.028806+0000","last_undegraded":"2024-05-07T13:59:25.028806+0000","last_fullsized":"2024-05-07T13:59:25.028806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.028700+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:12.963826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.075307+0000","last_change":"2024-05-07T13:59:36.075367+0000","last_active":"2024-05-07T13:59:36.075307+0000","last_peered":"2024-05-07T13:59:36.075307+0000","last_clean":"2024-05-07T13:59:36.075307+0000","last_became_active":"2024-05-07T13:55:54.331844+0000","last_became_peered":"2024-05-07T13:55:54.331844+0000","last_unstale":"2024-05-07T13:59:36.075307+0000","last_undegraded":"2024-05-07T13:59:36.075307+0000","last_fullsized":"2024-05-07T13:59:36.075307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:36.075220+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:36.075220+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.075220+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:04.453746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.078501+0000","last_change":"2024-05-07T13:59:15.078526+0000","last_active":"2024-05-07T13:59:15.078501+0000","last_peered":"2024-05-07T13:59:15.078501+0000","last_clean":"2024-05-07T13:59:15.078501+0000","last_became_active":"2024-05-07T13:55:56.332858+0000","last_became_peered":"2024-05-07T13:55:56.332858+0000","last_unstale":"2024-05-07T13:59:15.078501+0000","last_undegraded":"2024-05-07T13:59:15.078501+0000","last_fullsized":"2024-05-07T13:59:15.078501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078412+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:04.920152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.107497+0000","last_change":"2024-05-07T13:59:24.107497+0000","last_active":"2024-05-07T13:59:24.107497+0000","last_peered":"2024-05-07T13:59:24.107497+0000","last_clean":"2024-05-07T13:59:24.107497+0000","last_became_active":"2024-05-07T13:55:58.335341+0000","last_became_peered":"2024-05-07T13:55:58.335341+0000","last_unstale":"2024-05-07T13:59:24.107497+0000","last_undegraded":"2024-05-07T13:59:24.107497+0000","last_fullsized":"2024-05-07T13:59:24.107497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.107327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:21.412357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'5","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.039679+0000","last_change":"2024-05-07T13:59:29.039705+0000","last_active":"2024-05-07T13:59:29.039679+0000","last_peered":"2024-05-07T13:59:29.039679+0000","last_clean":"2024-05-07T13:59:29.039679+0000","last_became_active":"2024-05-07T13:55:50.331295+0000","last_became_peered":"2024-05-07T13:55:50.331295+0000","last_unstale":"2024-05-07T13:59:29.039679+0000","last_undegraded":"2024-05-07T13:59:29.039679+0000","last_fullsized":"2024-05-07T13:59:29.039679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:29.039589+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:29.039589+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.039589+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:05.611702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.138775+0000","last_change":"2024-05-07T14:00:00.138775+0000","last_active":"2024-05-07T14:00:00.138775+0000","last_peered":"2024-05-07T14:00:00.138775+0000","last_clean":"2024-05-07T14:00:00.138775+0000","last_became_active":"2024-05-07T13:55:48.351055+0000","last_became_peered":"2024-05-07T13:55:48.351055+0000","last_unstale":"2024-05-07T14:00:00.138775+0000","last_undegraded":"2024-05-07T14:00:00.138775+0000","last_fullsized":"2024-05-07T14:00:00.138775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.138659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.138659+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.138659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:34.608921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"29'5","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.888798+0000","last_change":"2024-05-07T13:59:11.888832+0000","last_active":"2024-05-07T13:59:11.888798+0000","last_peered":"2024-05-07T13:59:11.888798+0000","last_clean":"2024-05-07T13:59:11.888798+0000","last_became_active":"2024-05-07T13:55:52.320027+0000","last_became_peered":"2024-05-07T13:55:52.320027+0000","last_unstale":"2024-05-07T13:59:11.888798+0000","last_undegraded":"2024-05-07T13:59:11.888798+0000","last_fullsized":"2024-05-07T13:59:11.888798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.888710+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:38:54.237300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'49","reported_seq":108,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.067236+0000","last_change":"2024-05-07T13:59:10.067275+0000","last_active":"2024-05-07T13:59:10.067236+0000","last_peered":"2024-05-07T13:59:10.067236+0000","last_clean":"2024-05-07T13:59:10.067236+0000","last_became_active":"2024-05-07T13:55:54.333766+0000","last_became_peered":"2024-05-07T13:55:54.333766+0000","last_unstale":"2024-05-07T13:59:10.067236+0000","last_undegraded":"2024-05-07T13:59:10.067236+0000","last_fullsized":"2024-05-07T13:59:10.067236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.067149+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:19.058798+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.069510+0000","last_change":"2024-05-07T13:59:12.069535+0000","last_active":"2024-05-07T13:59:12.069510+0000","last_peered":"2024-05-07T13:59:12.069510+0000","last_clean":"2024-05-07T13:59:12.069510+0000","last_became_active":"2024-05-07T13:55:56.338195+0000","last_became_peered":"2024-05-07T13:55:56.338195+0000","last_unstale":"2024-05-07T13:59:12.069510+0000","last_undegraded":"2024-05-07T13:59:12.069510+0000","last_fullsized":"2024-05-07T13:59:12.069510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.069419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:19:55.425213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:05.979447+0000","last_change":"2024-05-07T14:00:05.979447+0000","last_active":"2024-05-07T14:00:05.979447+0000","last_peered":"2024-05-07T14:00:05.979447+0000","last_clean":"2024-05-07T14:00:05.979447+0000","last_became_active":"2024-05-07T13:55:58.346040+0000","last_became_peered":"2024-05-07T13:55:58.346040+0000","last_unstale":"2024-05-07T14:00:05.979447+0000","last_undegraded":"2024-05-07T14:00:05.979447+0000","last_fullsized":"2024-05-07T14:00:05.979447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-07T14:00:05.979333+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-07T14:00:05.979333+0000","last_clean_scrub_stamp":"2024-05-07T14:00:05.979333+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:17:00.089927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'16","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.895902+0000","last_change":"2024-05-07T14:00:03.895973+0000","last_active":"2024-05-07T14:00:03.895902+0000","last_peered":"2024-05-07T14:00:03.895902+0000","last_clean":"2024-05-07T14:00:03.895902+0000","last_became_active":"2024-05-07T13:56:35.369148+0000","last_became_peered":"2024-05-07T13:56:35.369148+0000","last_unstale":"2024-05-07T14:00:03.895902+0000","last_undegraded":"2024-05-07T14:00:03.895902+0000","last_fullsized":"2024-05-07T14:00:03.895902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T14:00:03.895789+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T14:00:03.895789+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.895789+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:45:08.761287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.004137+0000","last_change":"2024-05-07T13:59:57.004204+0000","last_active":"2024-05-07T13:59:57.004137+0000","last_peered":"2024-05-07T13:59:57.004137+0000","last_clean":"2024-05-07T13:59:57.004137+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:59:57.004137+0000","last_undegraded":"2024-05-07T13:59:57.004137+0000","last_fullsized":"2024-05-07T13:59:57.004137+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-05-07T13:59:57.004031+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-05-07T13:59:57.004031+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.004031+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:33.661694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516515+0000","last_change":"2024-05-07T13:55:40.045474+0000","last_active":"2024-05-07T13:59:10.516515+0000","last_peered":"2024-05-07T13:59:10.516515+0000","last_clean":"2024-05-07T13:59:10.516515+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T13:59:10.516515+0000","last_undegraded":"2024-05-07T13:59:10.516515+0000","last_fullsized":"2024-05-07T13:59:10.516515+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.150595+0000","last_change":"2024-05-07T14:00:02.150624+0000","last_active":"2024-05-07T14:00:02.150595+0000","last_peered":"2024-05-07T14:00:02.150595+0000","last_clean":"2024-05-07T14:00:02.150595+0000","last_became_active":"2024-05-07T13:55:48.350998+0000","last_became_peered":"2024-05-07T13:55:48.350998+0000","last_unstale":"2024-05-07T14:00:02.150595+0000","last_undegraded":"2024-05-07T14:00:02.150595+0000","last_fullsized":"2024-05-07T14:00:02.150595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T14:00:02.150501+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T14:00:02.150501+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.150501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:43.337012+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.053567+0000","last_change":"2024-05-07T13:59:28.053567+0000","last_active":"2024-05-07T13:59:28.053567+0000","last_peered":"2024-05-07T13:59:28.053567+0000","last_clean":"2024-05-07T13:59:28.053567+0000","last_became_active":"2024-05-07T13:55:52.321406+0000","last_became_peered":"2024-05-07T13:55:52.321406+0000","last_unstale":"2024-05-07T13:59:28.053567+0000","last_undegraded":"2024-05-07T13:59:28.053567+0000","last_fullsized":"2024-05-07T13:59:28.053567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.053456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:40.818094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.891563+0000","last_change":"2024-05-07T13:59:22.891601+0000","last_active":"2024-05-07T13:59:22.891563+0000","last_peered":"2024-05-07T13:59:22.891563+0000","last_clean":"2024-05-07T13:59:22.891563+0000","last_became_active":"2024-05-07T13:55:54.328677+0000","last_became_peered":"2024-05-07T13:55:54.328677+0000","last_unstale":"2024-05-07T13:59:22.891563+0000","last_undegraded":"2024-05-07T13:59:22.891563+0000","last_fullsized":"2024-05-07T13:59:22.891563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.891465+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:38.858949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.993083+0000","last_change":"2024-05-07T13:59:21.993105+0000","last_active":"2024-05-07T13:59:21.993083+0000","last_peered":"2024-05-07T13:59:21.993083+0000","last_clean":"2024-05-07T13:59:21.993083+0000","last_became_active":"2024-05-07T13:55:56.335013+0000","last_became_peered":"2024-05-07T13:55:56.335013+0000","last_unstale":"2024-05-07T13:59:21.993083+0000","last_undegraded":"2024-05-07T13:59:21.993083+0000","last_fullsized":"2024-05-07T13:59:21.993083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.992994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:07:21.511355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'82","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.141155+0000","last_change":"2024-05-07T13:59:20.141198+0000","last_active":"2024-05-07T13:59:20.141155+0000","last_peered":"2024-05-07T13:59:20.141155+0000","last_clean":"2024-05-07T13:59:20.141155+0000","last_became_active":"2024-05-07T13:55:58.335220+0000","last_became_peered":"2024-05-07T13:55:58.335220+0000","last_unstale":"2024-05-07T13:59:20.141155+0000","last_undegraded":"2024-05-07T13:59:20.141155+0000","last_fullsized":"2024-05-07T13:59:20.141155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.141061+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:19.754291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.184233+0000","last_change":"2024-05-07T13:59:48.184294+0000","last_active":"2024-05-07T13:59:48.184233+0000","last_peered":"2024-05-07T13:59:48.184233+0000","last_clean":"2024-05-07T13:59:48.184233+0000","last_became_active":"2024-05-07T13:55:50.323408+0000","last_became_peered":"2024-05-07T13:55:50.323408+0000","last_unstale":"2024-05-07T13:59:48.184233+0000","last_undegraded":"2024-05-07T13:59:48.184233+0000","last_fullsized":"2024-05-07T13:59:48.184233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:48.184128+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:48.184128+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.184128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:05:31.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516514+0000","last_change":"2024-05-07T13:55:40.043428+0000","last_active":"2024-05-07T13:59:10.516514+0000","last_peered":"2024-05-07T13:59:10.516514+0000","last_clean":"2024-05-07T13:59:10.516514+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T13:59:10.516514+0000","last_undegraded":"2024-05-07T13:59:10.516514+0000","last_fullsized":"2024-05-07T13:59:10.516514+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.128078+0000","last_change":"2024-05-07T13:59:43.128078+0000","last_active":"2024-05-07T13:59:43.128078+0000","last_peered":"2024-05-07T13:59:43.128078+0000","last_clean":"2024-05-07T13:59:43.128078+0000","last_became_active":"2024-05-07T13:55:48.325905+0000","last_became_peered":"2024-05-07T13:55:48.325905+0000","last_unstale":"2024-05-07T13:59:43.128078+0000","last_undegraded":"2024-05-07T13:59:43.128078+0000","last_fullsized":"2024-05-07T13:59:43.128078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:43.127954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:43.127954+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.127954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:34.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.859897+0000","last_change":"2024-05-07T13:59:17.859922+0000","last_active":"2024-05-07T13:59:17.859897+0000","last_peered":"2024-05-07T13:59:17.859897+0000","last_clean":"2024-05-07T13:59:17.859897+0000","last_became_active":"2024-05-07T13:55:52.318221+0000","last_became_peered":"2024-05-07T13:55:52.318221+0000","last_unstale":"2024-05-07T13:59:17.859897+0000","last_undegraded":"2024-05-07T13:59:17.859897+0000","last_fullsized":"2024-05-07T13:59:17.859897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.859806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:59.896313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.121985+0000","last_change":"2024-05-07T13:59:14.121985+0000","last_active":"2024-05-07T13:59:14.121985+0000","last_peered":"2024-05-07T13:59:14.121985+0000","last_clean":"2024-05-07T13:59:14.121985+0000","last_became_active":"2024-05-07T13:55:54.329774+0000","last_became_peered":"2024-05-07T13:55:54.329774+0000","last_unstale":"2024-05-07T13:59:14.121985+0000","last_undegraded":"2024-05-07T13:59:14.121985+0000","last_fullsized":"2024-05-07T13:59:14.121985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.121829+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:13.735059+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.058168+0000","last_change":"2024-05-07T13:59:33.058168+0000","last_active":"2024-05-07T13:59:33.058168+0000","last_peered":"2024-05-07T13:59:33.058168+0000","last_clean":"2024-05-07T13:59:33.058168+0000","last_became_active":"2024-05-07T13:55:56.343224+0000","last_became_peered":"2024-05-07T13:55:56.343224+0000","last_unstale":"2024-05-07T13:59:33.058168+0000","last_undegraded":"2024-05-07T13:59:33.058168+0000","last_fullsized":"2024-05-07T13:59:33.058168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:33.058058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:33.058058+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.058058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:31.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.076708+0000","last_change":"2024-05-07T13:59:39.076744+0000","last_active":"2024-05-07T13:59:39.076708+0000","last_peered":"2024-05-07T13:59:39.076708+0000","last_clean":"2024-05-07T13:59:39.076708+0000","last_became_active":"2024-05-07T13:55:58.344996+0000","last_became_peered":"2024-05-07T13:55:58.344996+0000","last_unstale":"2024-05-07T13:59:39.076708+0000","last_undegraded":"2024-05-07T13:59:39.076708+0000","last_fullsized":"2024-05-07T13:59:39.076708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:39.076601+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:39.076601+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.076601+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:24:16.973175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.071593+0000","last_change":"2024-05-07T13:59:48.071620+0000","last_active":"2024-05-07T13:59:48.071593+0000","last_peered":"2024-05-07T13:59:48.071593+0000","last_clean":"2024-05-07T13:59:48.071593+0000","last_became_active":"2024-05-07T13:55:50.318471+0000","last_became_peered":"2024-05-07T13:55:50.318471+0000","last_unstale":"2024-05-07T13:59:48.071593+0000","last_undegraded":"2024-05-07T13:59:48.071593+0000","last_fullsized":"2024-05-07T13:59:48.071593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:48.071503+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:48.071503+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.071503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:22.255533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.988080+0000","last_change":"2024-05-07T13:59:49.988108+0000","last_active":"2024-05-07T13:59:49.988080+0000","last_peered":"2024-05-07T13:59:49.988080+0000","last_clean":"2024-05-07T13:59:49.988080+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:59:49.988080+0000","last_undegraded":"2024-05-07T13:59:49.988080+0000","last_fullsized":"2024-05-07T13:59:49.988080+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.987988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.987988+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.987988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:37.223196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.086185+0000","last_change":"2024-05-07T13:59:49.086219+0000","last_active":"2024-05-07T13:59:49.086185+0000","last_peered":"2024-05-07T13:59:49.086185+0000","last_clean":"2024-05-07T13:59:49.086185+0000","last_became_active":"2024-05-07T13:55:48.325013+0000","last_became_peered":"2024-05-07T13:55:48.325013+0000","last_unstale":"2024-05-07T13:59:49.086185+0000","last_undegraded":"2024-05-07T13:59:49.086185+0000","last_fullsized":"2024-05-07T13:59:49.086185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.086089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.086089+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.086089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:42.383729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.874421+0000","last_change":"2024-05-07T14:00:04.874466+0000","last_active":"2024-05-07T14:00:04.874421+0000","last_peered":"2024-05-07T14:00:04.874421+0000","last_clean":"2024-05-07T14:00:04.874421+0000","last_became_active":"2024-05-07T13:56:35.368904+0000","last_became_peered":"2024-05-07T13:56:35.368904+0000","last_unstale":"2024-05-07T14:00:04.874421+0000","last_undegraded":"2024-05-07T14:00:04.874421+0000","last_fullsized":"2024-05-07T14:00:04.874421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:04.874325+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:04.874325+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.874325+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:33.252851+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.147329+0000","last_change":"2024-05-07T13:59:21.147329+0000","last_active":"2024-05-07T13:59:21.147329+0000","last_peered":"2024-05-07T13:59:21.147329+0000","last_clean":"2024-05-07T13:59:21.147329+0000","last_became_active":"2024-05-07T13:55:54.329778+0000","last_became_peered":"2024-05-07T13:55:54.329778+0000","last_unstale":"2024-05-07T13:59:21.147329+0000","last_undegraded":"2024-05-07T13:59:21.147329+0000","last_fullsized":"2024-05-07T13:59:21.147329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.147200+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:14:48.234250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.061795+0000","last_change":"2024-05-07T13:59:26.061795+0000","last_active":"2024-05-07T13:59:26.061795+0000","last_peered":"2024-05-07T13:59:26.061795+0000","last_clean":"2024-05-07T13:59:26.061795+0000","last_became_active":"2024-05-07T13:55:56.336064+0000","last_became_peered":"2024-05-07T13:55:56.336064+0000","last_unstale":"2024-05-07T13:59:26.061795+0000","last_undegraded":"2024-05-07T13:59:26.061795+0000","last_fullsized":"2024-05-07T13:59:26.061795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.061660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:02.633772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.479098+0000","last_change":"2024-05-07T13:55:58.350552+0000","last_active":"2024-05-07T13:58:59.479098+0000","last_peered":"2024-05-07T13:58:59.479098+0000","last_clean":"2024-05-07T13:58:59.479098+0000","last_became_active":"2024-05-07T13:55:58.350208+0000","last_became_peered":"2024-05-07T13:55:58.350208+0000","last_unstale":"2024-05-07T13:58:59.479098+0000","last_undegraded":"2024-05-07T13:58:59.479098+0000","last_fullsized":"2024-05-07T13:58:59.479098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.147024+0000","last_change":"2024-05-07T13:59:46.147024+0000","last_active":"2024-05-07T13:59:46.147024+0000","last_peered":"2024-05-07T13:59:46.147024+0000","last_clean":"2024-05-07T13:59:46.147024+0000","last_became_active":"2024-05-07T13:55:50.313163+0000","last_became_peered":"2024-05-07T13:55:50.313163+0000","last_unstale":"2024-05-07T13:59:46.147024+0000","last_undegraded":"2024-05-07T13:59:46.147024+0000","last_fullsized":"2024-05-07T13:59:46.147024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:46.146906+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:46.146906+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.146906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:41.305486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516519+0000","last_change":"2024-05-07T13:55:40.044279+0000","last_active":"2024-05-07T13:59:10.516519+0000","last_peered":"2024-05-07T13:59:10.516519+0000","last_clean":"2024-05-07T13:59:10.516519+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T13:59:10.516519+0000","last_undegraded":"2024-05-07T13:59:10.516519+0000","last_fullsized":"2024-05-07T13:59:10.516519+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:55.875626+0000","last_change":"2024-05-07T13:59:55.875626+0000","last_active":"2024-05-07T13:59:55.875626+0000","last_peered":"2024-05-07T13:59:55.875626+0000","last_clean":"2024-05-07T13:59:55.875626+0000","last_became_active":"2024-05-07T13:55:48.338442+0000","last_became_peered":"2024-05-07T13:55:48.338442+0000","last_unstale":"2024-05-07T13:59:55.875626+0000","last_undegraded":"2024-05-07T13:59:55.875626+0000","last_fullsized":"2024-05-07T13:59:55.875626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:55.875457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:55.875457+0000","last_clean_scrub_stamp":"2024-05-07T13:59:55.875457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:51.034037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.005460+0000","last_change":"2024-05-07T13:59:32.005460+0000","last_active":"2024-05-07T13:59:32.005460+0000","last_peered":"2024-05-07T13:59:32.005460+0000","last_clean":"2024-05-07T13:59:32.005460+0000","last_became_active":"2024-05-07T13:55:52.321506+0000","last_became_peered":"2024-05-07T13:55:52.321506+0000","last_unstale":"2024-05-07T13:59:32.005460+0000","last_undegraded":"2024-05-07T13:59:32.005460+0000","last_fullsized":"2024-05-07T13:59:32.005460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.005333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.005333+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.005333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:53.661193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.983795+0000","last_change":"2024-05-07T13:59:24.983843+0000","last_active":"2024-05-07T13:59:24.983795+0000","last_peered":"2024-05-07T13:59:24.983795+0000","last_clean":"2024-05-07T13:59:24.983795+0000","last_became_active":"2024-05-07T13:55:54.328763+0000","last_became_peered":"2024-05-07T13:55:54.328763+0000","last_unstale":"2024-05-07T13:59:24.983795+0000","last_undegraded":"2024-05-07T13:59:24.983795+0000","last_fullsized":"2024-05-07T13:59:24.983795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.983703+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:59.173853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.014361+0000","last_change":"2024-05-07T13:59:32.014388+0000","last_active":"2024-05-07T13:59:32.014361+0000","last_peered":"2024-05-07T13:59:32.014361+0000","last_clean":"2024-05-07T13:59:32.014361+0000","last_became_active":"2024-05-07T13:55:56.343131+0000","last_became_peered":"2024-05-07T13:55:56.343131+0000","last_unstale":"2024-05-07T13:59:32.014361+0000","last_undegraded":"2024-05-07T13:59:32.014361+0000","last_fullsized":"2024-05-07T13:59:32.014361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.014263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.014263+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.014263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:11:56.176284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181055+0000","last_change":"2024-05-07T13:55:58.348390+0000","last_active":"2024-05-07T13:58:08.181055+0000","last_peered":"2024-05-07T13:58:08.181055+0000","last_clean":"2024-05-07T13:58:08.181055+0000","last_became_active":"2024-05-07T13:55:58.348068+0000","last_became_peered":"2024-05-07T13:55:58.348068+0000","last_unstale":"2024-05-07T13:58:08.181055+0000","last_undegraded":"2024-05-07T13:58:08.181055+0000","last_fullsized":"2024-05-07T13:58:08.181055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'14","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.092977+0000","last_change":"2024-05-07T13:59:38.092977+0000","last_active":"2024-05-07T13:59:38.092977+0000","last_peered":"2024-05-07T13:59:38.092977+0000","last_clean":"2024-05-07T13:59:38.092977+0000","last_became_active":"2024-05-07T13:55:50.323820+0000","last_became_peered":"2024-05-07T13:55:50.323820+0000","last_unstale":"2024-05-07T13:59:38.092977+0000","last_undegraded":"2024-05-07T13:59:38.092977+0000","last_fullsized":"2024-05-07T13:59:38.092977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:38.092855+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:38.092855+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.092855+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:57.688105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.031920+0000","last_change":"2024-05-07T13:59:49.031920+0000","last_active":"2024-05-07T13:59:49.031920+0000","last_peered":"2024-05-07T13:59:49.031920+0000","last_clean":"2024-05-07T13:59:49.031920+0000","last_became_active":"2024-05-07T13:55:48.338139+0000","last_became_peered":"2024-05-07T13:55:48.338139+0000","last_unstale":"2024-05-07T13:59:49.031920+0000","last_undegraded":"2024-05-07T13:59:49.031920+0000","last_fullsized":"2024-05-07T13:59:49.031920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.031788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.031788+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.031788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:15.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.216260+0000","last_change":"2024-05-07T13:59:56.216304+0000","last_active":"2024-05-07T13:59:56.216260+0000","last_peered":"2024-05-07T13:59:56.216260+0000","last_clean":"2024-05-07T13:59:56.216260+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:59:56.216260+0000","last_undegraded":"2024-05-07T13:59:56.216260+0000","last_fullsized":"2024-05-07T13:59:56.216260+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:56.216155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:56.216155+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.216155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:51:13.276042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.010339+0000","last_change":"2024-05-07T13:59:33.010339+0000","last_active":"2024-05-07T13:59:33.010339+0000","last_peered":"2024-05-07T13:59:33.010339+0000","last_clean":"2024-05-07T13:59:33.010339+0000","last_became_active":"2024-05-07T13:55:52.321249+0000","last_became_peered":"2024-05-07T13:55:52.321249+0000","last_unstale":"2024-05-07T13:59:33.010339+0000","last_undegraded":"2024-05-07T13:59:33.010339+0000","last_fullsized":"2024-05-07T13:59:33.010339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.010232+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.010232+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.010232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:33.336357+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'74","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.980067+0000","last_change":"2024-05-07T13:59:20.980067+0000","last_active":"2024-05-07T13:59:20.980067+0000","last_peered":"2024-05-07T13:59:20.980067+0000","last_clean":"2024-05-07T13:59:20.980067+0000","last_became_active":"2024-05-07T13:55:54.326812+0000","last_became_peered":"2024-05-07T13:55:54.326812+0000","last_unstale":"2024-05-07T13:59:20.980067+0000","last_undegraded":"2024-05-07T13:59:20.980067+0000","last_fullsized":"2024-05-07T13:59:20.980067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.979917+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:21.832415+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.116256+0000","last_change":"2024-05-07T13:59:13.116256+0000","last_active":"2024-05-07T13:59:13.116256+0000","last_peered":"2024-05-07T13:59:13.116256+0000","last_clean":"2024-05-07T13:59:13.116256+0000","last_became_active":"2024-05-07T13:55:56.331343+0000","last_became_peered":"2024-05-07T13:55:56.331343+0000","last_unstale":"2024-05-07T13:59:13.116256+0000","last_undegraded":"2024-05-07T13:59:13.116256+0000","last_fullsized":"2024-05-07T13:59:13.116256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.116129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:37.954463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'11","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.180491+0000","last_change":"2024-05-07T13:55:58.347841+0000","last_active":"2024-05-07T13:58:13.180491+0000","last_peered":"2024-05-07T13:58:13.180491+0000","last_clean":"2024-05-07T13:58:13.180491+0000","last_became_active":"2024-05-07T13:55:58.347566+0000","last_became_peered":"2024-05-07T13:55:58.347566+0000","last_unstale":"2024-05-07T13:58:13.180491+0000","last_undegraded":"2024-05-07T13:58:13.180491+0000","last_fullsized":"2024-05-07T13:58:13.180491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'8","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.061535+0000","last_change":"2024-05-07T13:59:30.061535+0000","last_active":"2024-05-07T13:59:30.061535+0000","last_peered":"2024-05-07T13:59:30.061535+0000","last_clean":"2024-05-07T13:59:30.061535+0000","last_became_active":"2024-05-07T13:55:50.330547+0000","last_became_peered":"2024-05-07T13:55:50.330547+0000","last_unstale":"2024-05-07T13:59:30.061535+0000","last_undegraded":"2024-05-07T13:59:30.061535+0000","last_fullsized":"2024-05-07T13:59:30.061535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:30.061415+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:30.061415+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.061415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:52.036188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.111799+0000","last_change":"2024-05-07T14:00:01.111847+0000","last_active":"2024-05-07T14:00:01.111799+0000","last_peered":"2024-05-07T14:00:01.111799+0000","last_clean":"2024-05-07T14:00:01.111799+0000","last_became_active":"2024-05-07T13:55:48.324378+0000","last_became_peered":"2024-05-07T13:55:48.324378+0000","last_unstale":"2024-05-07T14:00:01.111799+0000","last_undegraded":"2024-05-07T14:00:01.111799+0000","last_fullsized":"2024-05-07T14:00:01.111799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:01.111703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:01.111703+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.111703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:34:36.980500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516553+0000","last_change":"2024-05-07T13:55:40.044124+0000","last_active":"2024-05-07T13:59:10.516553+0000","last_peered":"2024-05-07T13:59:10.516553+0000","last_clean":"2024-05-07T13:59:10.516553+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T13:59:10.516553+0000","last_undegraded":"2024-05-07T13:59:10.516553+0000","last_fullsized":"2024-05-07T13:59:10.516553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.855760+0000","last_change":"2024-05-07T14:00:00.855799+0000","last_active":"2024-05-07T14:00:00.855760+0000","last_peered":"2024-05-07T14:00:00.855760+0000","last_clean":"2024-05-07T14:00:00.855760+0000","last_became_active":"2024-05-07T13:56:35.366075+0000","last_became_peered":"2024-05-07T13:56:35.366075+0000","last_unstale":"2024-05-07T14:00:00.855760+0000","last_undegraded":"2024-05-07T14:00:00.855760+0000","last_fullsized":"2024-05-07T14:00:00.855760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.855661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.855661+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.855661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:12:25.017681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"29'21","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.152407+0000","last_change":"2024-05-07T13:59:13.152407+0000","last_active":"2024-05-07T13:59:13.152407+0000","last_peered":"2024-05-07T13:59:13.152407+0000","last_clean":"2024-05-07T13:59:13.152407+0000","last_became_active":"2024-05-07T13:55:54.330896+0000","last_became_peered":"2024-05-07T13:55:54.330896+0000","last_unstale":"2024-05-07T13:59:13.152407+0000","last_undegraded":"2024-05-07T13:59:13.152407+0000","last_fullsized":"2024-05-07T13:59:13.152407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.152223+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.463262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.085692+0000","last_change":"2024-05-07T13:59:27.085692+0000","last_active":"2024-05-07T13:59:27.085692+0000","last_peered":"2024-05-07T13:59:27.085692+0000","last_clean":"2024-05-07T13:59:27.085692+0000","last_became_active":"2024-05-07T13:55:56.333242+0000","last_became_peered":"2024-05-07T13:55:56.333242+0000","last_unstale":"2024-05-07T13:59:27.085692+0000","last_undegraded":"2024-05-07T13:59:27.085692+0000","last_fullsized":"2024-05-07T13:59:27.085692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.085530+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:23.784119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.217726+0000","last_change":"2024-05-07T13:59:53.217771+0000","last_active":"2024-05-07T13:59:53.217726+0000","last_peered":"2024-05-07T13:59:53.217726+0000","last_clean":"2024-05-07T13:59:53.217726+0000","last_became_active":"2024-05-07T13:55:58.346295+0000","last_became_peered":"2024-05-07T13:55:58.346295+0000","last_unstale":"2024-05-07T13:59:53.217726+0000","last_undegraded":"2024-05-07T13:59:53.217726+0000","last_fullsized":"2024-05-07T13:59:53.217726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:53.217633+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:53.217633+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.217633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:19:36.621308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.139684+0000","last_change":"2024-05-07T13:59:43.139684+0000","last_active":"2024-05-07T13:59:43.139684+0000","last_peered":"2024-05-07T13:59:43.139684+0000","last_clean":"2024-05-07T13:59:43.139684+0000","last_became_active":"2024-05-07T13:55:50.325665+0000","last_became_peered":"2024-05-07T13:55:50.325665+0000","last_unstale":"2024-05-07T13:59:43.139684+0000","last_undegraded":"2024-05-07T13:59:43.139684+0000","last_fullsized":"2024-05-07T13:59:43.139684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:43.139573+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:43.139573+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.139573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:38:12.305990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516642+0000","last_change":"2024-05-07T13:55:48.347535+0000","last_active":"2024-05-07T13:59:10.516642+0000","last_peered":"2024-05-07T13:59:10.516642+0000","last_clean":"2024-05-07T13:59:10.516642+0000","last_became_active":"2024-05-07T13:55:48.346645+0000","last_became_peered":"2024-05-07T13:55:48.346645+0000","last_unstale":"2024-05-07T13:59:10.516642+0000","last_undegraded":"2024-05-07T13:59:10.516642+0000","last_fullsized":"2024-05-07T13:59:10.516642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.188866+0000","last_change":"2024-05-07T13:59:57.188866+0000","last_active":"2024-05-07T13:59:57.188866+0000","last_peered":"2024-05-07T13:59:57.188866+0000","last_clean":"2024-05-07T13:59:57.188866+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:59:57.188866+0000","last_undegraded":"2024-05-07T13:59:57.188866+0000","last_fullsized":"2024-05-07T13:59:57.188866+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:57.188686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:57.188686+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.188686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:48.438703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.842021+0000","last_change":"2024-05-07T13:59:12.842021+0000","last_active":"2024-05-07T13:59:12.842021+0000","last_peered":"2024-05-07T13:59:12.842021+0000","last_clean":"2024-05-07T13:59:12.842021+0000","last_became_active":"2024-05-07T13:55:52.321160+0000","last_became_peered":"2024-05-07T13:55:52.321160+0000","last_unstale":"2024-05-07T13:59:12.842021+0000","last_undegraded":"2024-05-07T13:59:12.842021+0000","last_fullsized":"2024-05-07T13:59:12.842021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.841853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:34.497713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.104664+0000","last_change":"2024-05-07T13:59:40.104664+0000","last_active":"2024-05-07T13:59:40.104664+0000","last_peered":"2024-05-07T13:59:40.104664+0000","last_clean":"2024-05-07T13:59:40.104664+0000","last_became_active":"2024-05-07T13:55:54.329885+0000","last_became_peered":"2024-05-07T13:55:54.329885+0000","last_unstale":"2024-05-07T13:59:40.104664+0000","last_undegraded":"2024-05-07T13:59:40.104664+0000","last_fullsized":"2024-05-07T13:59:40.104664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:40.104516+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:40.104516+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.104516+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:58.439308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":402,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.906548+0000","last_change":"2024-05-07T13:59:11.906548+0000","last_active":"2024-05-07T13:59:11.906548+0000","last_peered":"2024-05-07T13:59:11.906548+0000","last_clean":"2024-05-07T13:59:11.906548+0000","last_became_active":"2024-05-07T13:55:56.334023+0000","last_became_peered":"2024-05-07T13:55:56.334023+0000","last_unstale":"2024-05-07T13:59:11.906548+0000","last_undegraded":"2024-05-07T13:59:11.906548+0000","last_fullsized":"2024-05-07T13:59:11.906548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.906422+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:49:19.117395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:06.941644+0000","last_change":"2024-05-07T14:00:06.941687+0000","last_active":"2024-05-07T14:00:06.941644+0000","last_peered":"2024-05-07T14:00:06.941644+0000","last_clean":"2024-05-07T14:00:06.941644+0000","last_became_active":"2024-05-07T13:55:58.346984+0000","last_became_peered":"2024-05-07T13:55:58.346984+0000","last_unstale":"2024-05-07T14:00:06.941644+0000","last_undegraded":"2024-05-07T14:00:06.941644+0000","last_fullsized":"2024-05-07T14:00:06.941644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-07T14:00:06.941537+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-07T14:00:06.941537+0000","last_clean_scrub_stamp":"2024-05-07T14:00:06.941537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:08:16.094580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.079940+0000","last_change":"2024-05-07T13:59:48.079940+0000","last_active":"2024-05-07T13:59:48.079940+0000","last_peered":"2024-05-07T13:59:48.079940+0000","last_clean":"2024-05-07T13:59:48.079940+0000","last_became_active":"2024-05-07T13:55:50.327283+0000","last_became_peered":"2024-05-07T13:55:50.327283+0000","last_unstale":"2024-05-07T13:59:48.079940+0000","last_undegraded":"2024-05-07T13:59:48.079940+0000","last_fullsized":"2024-05-07T13:59:48.079940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:48.079746+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:48.079746+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.079746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:42.880890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.942824+0000","last_change":"2024-05-07T14:00:03.942824+0000","last_active":"2024-05-07T14:00:03.942824+0000","last_peered":"2024-05-07T14:00:03.942824+0000","last_clean":"2024-05-07T14:00:03.942824+0000","last_became_active":"2024-05-07T13:55:48.337553+0000","last_became_peered":"2024-05-07T13:55:48.337553+0000","last_unstale":"2024-05-07T14:00:03.942824+0000","last_undegraded":"2024-05-07T14:00:03.942824+0000","last_fullsized":"2024-05-07T14:00:03.942824+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:03.942685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:03.942685+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.942685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:18:05.627452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516595+0000","last_change":"2024-05-07T13:55:40.043788+0000","last_active":"2024-05-07T13:59:10.516595+0000","last_peered":"2024-05-07T13:59:10.516595+0000","last_clean":"2024-05-07T13:59:10.516595+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T13:59:10.516595+0000","last_undegraded":"2024-05-07T13:59:10.516595+0000","last_fullsized":"2024-05-07T13:59:10.516595+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:39.034385+0000","last_clean_scrub_stamp":"2024-05-07T13:55:39.034385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.844877+0000","last_change":"2024-05-07T13:59:19.844877+0000","last_active":"2024-05-07T13:59:19.844877+0000","last_peered":"2024-05-07T13:59:19.844877+0000","last_clean":"2024-05-07T13:59:19.844877+0000","last_became_active":"2024-05-07T13:55:52.314793+0000","last_became_peered":"2024-05-07T13:55:52.314793+0000","last_unstale":"2024-05-07T13:59:19.844877+0000","last_undegraded":"2024-05-07T13:59:19.844877+0000","last_fullsized":"2024-05-07T13:59:19.844877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.844768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:57:45.920718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.116043+0000","last_change":"2024-05-07T13:59:19.116043+0000","last_active":"2024-05-07T13:59:19.116043+0000","last_peered":"2024-05-07T13:59:19.116043+0000","last_clean":"2024-05-07T13:59:19.116043+0000","last_became_active":"2024-05-07T13:55:54.329879+0000","last_became_peered":"2024-05-07T13:55:54.329879+0000","last_unstale":"2024-05-07T13:59:19.116043+0000","last_undegraded":"2024-05-07T13:59:19.116043+0000","last_fullsized":"2024-05-07T13:59:19.116043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.115906+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:13.426945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.963178+0000","last_change":"2024-05-07T13:59:15.963178+0000","last_active":"2024-05-07T13:59:15.963178+0000","last_peered":"2024-05-07T13:59:15.963178+0000","last_clean":"2024-05-07T13:59:15.963178+0000","last_became_active":"2024-05-07T13:55:56.332931+0000","last_became_peered":"2024-05-07T13:55:56.332931+0000","last_unstale":"2024-05-07T13:59:15.963178+0000","last_undegraded":"2024-05-07T13:59:15.963178+0000","last_fullsized":"2024-05-07T13:59:15.963178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.963044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:35.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.084979+0000","last_change":"2024-05-07T13:59:32.085005+0000","last_active":"2024-05-07T13:59:32.084979+0000","last_peered":"2024-05-07T13:59:32.084979+0000","last_clean":"2024-05-07T13:59:32.084979+0000","last_became_active":"2024-05-07T13:55:58.340759+0000","last_became_peered":"2024-05-07T13:55:58.340759+0000","last_unstale":"2024-05-07T13:59:32.084979+0000","last_undegraded":"2024-05-07T13:59:32.084979+0000","last_fullsized":"2024-05-07T13:59:32.084979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.084886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.084886+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.084886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:07:31.603247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.839594+0000","last_change":"2024-05-07T13:59:59.839594+0000","last_active":"2024-05-07T13:59:59.839594+0000","last_peered":"2024-05-07T13:59:59.839594+0000","last_clean":"2024-05-07T13:59:59.839594+0000","last_became_active":"2024-05-07T13:55:58.348566+0000","last_became_peered":"2024-05-07T13:55:58.348566+0000","last_unstale":"2024-05-07T13:59:59.839594+0000","last_undegraded":"2024-05-07T13:59:59.839594+0000","last_fullsized":"2024-05-07T13:59:59.839594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-07T13:59:59.839470+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-07T13:59:59.839470+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.839470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:42.998791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.040601+0000","last_change":"2024-05-07T13:59:33.040654+0000","last_active":"2024-05-07T13:59:33.040601+0000","last_peered":"2024-05-07T13:59:33.040601+0000","last_clean":"2024-05-07T13:59:33.040601+0000","last_became_active":"2024-05-07T13:55:50.329615+0000","last_became_peered":"2024-05-07T13:55:50.329615+0000","last_unstale":"2024-05-07T13:59:33.040601+0000","last_undegraded":"2024-05-07T13:59:33.040601+0000","last_fullsized":"2024-05-07T13:59:33.040601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.040493+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.040493+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.040493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:15.286657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181674+0000","last_change":"2024-05-07T13:55:48.348585+0000","last_active":"2024-05-07T13:58:08.181674+0000","last_peered":"2024-05-07T13:58:08.181674+0000","last_clean":"2024-05-07T13:58:08.181674+0000","last_became_active":"2024-05-07T13:55:48.346558+0000","last_became_peered":"2024-05-07T13:55:48.346558+0000","last_unstale":"2024-05-07T13:58:08.181674+0000","last_undegraded":"2024-05-07T13:58:08.181674+0000","last_fullsized":"2024-05-07T13:58:08.181674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.052177+0000","last_change":"2024-05-07T13:59:20.052199+0000","last_active":"2024-05-07T13:59:20.052177+0000","last_peered":"2024-05-07T13:59:20.052177+0000","last_clean":"2024-05-07T13:59:20.052177+0000","last_became_active":"2024-05-07T13:55:52.324083+0000","last_became_peered":"2024-05-07T13:55:52.324083+0000","last_unstale":"2024-05-07T13:59:20.052177+0000","last_undegraded":"2024-05-07T13:59:20.052177+0000","last_fullsized":"2024-05-07T13:59:20.052177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.052084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:52.982817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.110559+0000","last_change":"2024-05-07T13:59:39.110608+0000","last_active":"2024-05-07T13:59:39.110559+0000","last_peered":"2024-05-07T13:59:39.110559+0000","last_clean":"2024-05-07T13:59:39.110559+0000","last_became_active":"2024-05-07T13:55:54.330906+0000","last_became_peered":"2024-05-07T13:55:54.330906+0000","last_unstale":"2024-05-07T13:59:39.110559+0000","last_undegraded":"2024-05-07T13:59:39.110559+0000","last_fullsized":"2024-05-07T13:59:39.110559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-07T13:59:39.110467+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-07T13:59:39.110467+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.110467+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:29.925909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.230824+0000","last_change":"2024-05-07T13:59:49.230880+0000","last_active":"2024-05-07T13:59:49.230824+0000","last_peered":"2024-05-07T13:59:49.230824+0000","last_clean":"2024-05-07T13:59:49.230824+0000","last_became_active":"2024-05-07T13:55:56.346371+0000","last_became_peered":"2024-05-07T13:55:56.346371+0000","last_unstale":"2024-05-07T13:59:49.230824+0000","last_undegraded":"2024-05-07T13:59:49.230824+0000","last_fullsized":"2024-05-07T13:59:49.230824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.230724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.230724+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.230724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:52.504500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:08.056848+0000","last_change":"2024-05-07T14:00:08.056875+0000","last_active":"2024-05-07T14:00:08.056848+0000","last_peered":"2024-05-07T14:00:08.056848+0000","last_clean":"2024-05-07T14:00:08.056848+0000","last_became_active":"2024-05-07T13:55:58.341102+0000","last_became_peered":"2024-05-07T13:55:58.341102+0000","last_unstale":"2024-05-07T14:00:08.056848+0000","last_undegraded":"2024-05-07T14:00:08.056848+0000","last_fullsized":"2024-05-07T14:00:08.056848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T14:00:08.056756+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T14:00:08.056756+0000","last_clean_scrub_stamp":"2024-05-07T14:00:08.056756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:36:11.330532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.011707+0000","last_change":"2024-05-07T13:59:33.011759+0000","last_active":"2024-05-07T13:59:33.011707+0000","last_peered":"2024-05-07T13:59:33.011707+0000","last_clean":"2024-05-07T13:59:33.011707+0000","last_became_active":"2024-05-07T13:55:50.329869+0000","last_became_peered":"2024-05-07T13:55:50.329869+0000","last_unstale":"2024-05-07T13:59:33.011707+0000","last_undegraded":"2024-05-07T13:59:33.011707+0000","last_fullsized":"2024-05-07T13:59:33.011707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.011608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.011608+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.011608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:25:02.477664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.070974+0000","last_change":"2024-05-07T13:59:45.071015+0000","last_active":"2024-05-07T13:59:45.070974+0000","last_peered":"2024-05-07T13:59:45.070974+0000","last_clean":"2024-05-07T13:59:45.070974+0000","last_became_active":"2024-05-07T13:55:48.336807+0000","last_became_peered":"2024-05-07T13:55:48.336807+0000","last_unstale":"2024-05-07T13:59:45.070974+0000","last_undegraded":"2024-05-07T13:59:45.070974+0000","last_fullsized":"2024-05-07T13:59:45.070974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:45.070865+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:45.070865+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.070865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:21:52.761753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.827428+0000","last_change":"2024-05-07T13:59:15.827453+0000","last_active":"2024-05-07T13:59:15.827428+0000","last_peered":"2024-05-07T13:59:15.827428+0000","last_clean":"2024-05-07T13:59:15.827428+0000","last_became_active":"2024-05-07T13:55:52.318534+0000","last_became_peered":"2024-05-07T13:55:52.318534+0000","last_unstale":"2024-05-07T13:59:15.827428+0000","last_undegraded":"2024-05-07T13:59:15.827428+0000","last_fullsized":"2024-05-07T13:59:15.827428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.827322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:35.422572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.031728+0000","last_change":"2024-05-07T13:59:25.031770+0000","last_active":"2024-05-07T13:59:25.031728+0000","last_peered":"2024-05-07T13:59:25.031728+0000","last_clean":"2024-05-07T13:59:25.031728+0000","last_became_active":"2024-05-07T13:55:54.319714+0000","last_became_peered":"2024-05-07T13:55:54.319714+0000","last_unstale":"2024-05-07T13:59:25.031728+0000","last_undegraded":"2024-05-07T13:59:25.031728+0000","last_fullsized":"2024-05-07T13:59:25.031728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.031629+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:37.796266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.110151+0000","last_change":"2024-05-07T13:59:10.110217+0000","last_active":"2024-05-07T13:59:10.110151+0000","last_peered":"2024-05-07T13:59:10.110151+0000","last_clean":"2024-05-07T13:59:10.110151+0000","last_became_active":"2024-05-07T13:55:56.334342+0000","last_became_peered":"2024-05-07T13:55:56.334342+0000","last_unstale":"2024-05-07T13:59:10.110151+0000","last_undegraded":"2024-05-07T13:59:10.110151+0000","last_fullsized":"2024-05-07T13:59:10.110151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.110045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:09.225940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.412717+0000","last_change":"2024-05-07T13:55:58.342684+0000","last_active":"2024-05-07T13:58:59.412717+0000","last_peered":"2024-05-07T13:58:59.412717+0000","last_clean":"2024-05-07T13:58:59.412717+0000","last_became_active":"2024-05-07T13:55:58.342382+0000","last_became_peered":"2024-05-07T13:55:58.342382+0000","last_unstale":"2024-05-07T13:58:59.412717+0000","last_undegraded":"2024-05-07T13:58:59.412717+0000","last_fullsized":"2024-05-07T13:58:59.412717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.415718+0000","last_change":"2024-05-07T13:56:35.366216+0000","last_active":"2024-05-07T13:58:59.415718+0000","last_peered":"2024-05-07T13:58:59.415718+0000","last_clean":"2024-05-07T13:58:59.415718+0000","last_became_active":"2024-05-07T13:56:35.365890+0000","last_became_peered":"2024-05-07T13:56:35.365890+0000","last_unstale":"2024-05-07T13:58:59.415718+0000","last_undegraded":"2024-05-07T13:58:59.415718+0000","last_fullsized":"2024-05-07T13:58:59.415718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:49.291718+0000","last_clean_scrub_stamp":"2024-05-07T13:55:49.291718+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.896282+0000","last_change":"2024-05-07T13:59:53.896309+0000","last_active":"2024-05-07T13:59:53.896282+0000","last_peered":"2024-05-07T13:59:53.896282+0000","last_clean":"2024-05-07T13:59:53.896282+0000","last_became_active":"2024-05-07T13:55:48.336730+0000","last_became_peered":"2024-05-07T13:55:48.336730+0000","last_unstale":"2024-05-07T13:59:53.896282+0000","last_undegraded":"2024-05-07T13:59:53.896282+0000","last_fullsized":"2024-05-07T13:59:53.896282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:53.896185+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:53.896185+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.896185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:27.501340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.138495+0000","last_change":"2024-05-07T13:59:26.138549+0000","last_active":"2024-05-07T13:59:26.138495+0000","last_peered":"2024-05-07T13:59:26.138495+0000","last_clean":"2024-05-07T13:59:26.138495+0000","last_became_active":"2024-05-07T13:55:52.324639+0000","last_became_peered":"2024-05-07T13:55:52.324639+0000","last_unstale":"2024-05-07T13:59:26.138495+0000","last_undegraded":"2024-05-07T13:59:26.138495+0000","last_fullsized":"2024-05-07T13:59:26.138495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.138376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:46.117728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'48","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.012636+0000","last_change":"2024-05-07T13:59:19.012678+0000","last_active":"2024-05-07T13:59:19.012636+0000","last_peered":"2024-05-07T13:59:19.012636+0000","last_clean":"2024-05-07T13:59:19.012636+0000","last_became_active":"2024-05-07T13:55:54.330738+0000","last_became_peered":"2024-05-07T13:55:54.330738+0000","last_unstale":"2024-05-07T13:59:19.012636+0000","last_undegraded":"2024-05-07T13:59:19.012636+0000","last_fullsized":"2024-05-07T13:59:19.012636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.012548+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:59.656224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.078706+0000","last_change":"2024-05-07T13:59:11.078729+0000","last_active":"2024-05-07T13:59:11.078706+0000","last_peered":"2024-05-07T13:59:11.078706+0000","last_clean":"2024-05-07T13:59:11.078706+0000","last_became_active":"2024-05-07T13:55:56.332844+0000","last_became_peered":"2024-05-07T13:55:56.332844+0000","last_unstale":"2024-05-07T13:59:11.078706+0000","last_undegraded":"2024-05-07T13:59:11.078706+0000","last_fullsized":"2024-05-07T13:59:11.078706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.078592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:40.007846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.170568+0000","last_change":"2024-05-07T14:00:01.170594+0000","last_active":"2024-05-07T14:00:01.170568+0000","last_peered":"2024-05-07T14:00:01.170568+0000","last_clean":"2024-05-07T14:00:01.170568+0000","last_became_active":"2024-05-07T13:55:58.347598+0000","last_became_peered":"2024-05-07T13:55:58.347598+0000","last_unstale":"2024-05-07T14:00:01.170568+0000","last_undegraded":"2024-05-07T14:00:01.170568+0000","last_fullsized":"2024-05-07T14:00:01.170568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:01.170476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:01.170476+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.170476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:15.339892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'14","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.025831+0000","last_change":"2024-05-07T13:59:28.025859+0000","last_active":"2024-05-07T13:59:28.025831+0000","last_peered":"2024-05-07T13:59:28.025831+0000","last_clean":"2024-05-07T13:59:28.025831+0000","last_became_active":"2024-05-07T13:55:50.326430+0000","last_became_peered":"2024-05-07T13:55:50.326430+0000","last_unstale":"2024-05-07T13:59:28.025831+0000","last_undegraded":"2024-05-07T13:59:28.025831+0000","last_fullsized":"2024-05-07T13:59:28.025831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.025734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:38.245824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.965273+0000","last_change":"2024-05-07T13:59:57.965301+0000","last_active":"2024-05-07T13:59:57.965273+0000","last_peered":"2024-05-07T13:59:57.965273+0000","last_clean":"2024-05-07T13:59:57.965273+0000","last_became_active":"2024-05-07T13:55:48.331660+0000","last_became_peered":"2024-05-07T13:55:48.331660+0000","last_unstale":"2024-05-07T13:59:57.965273+0000","last_undegraded":"2024-05-07T13:59:57.965273+0000","last_fullsized":"2024-05-07T13:59:57.965273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:57.965178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:57.965178+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.965178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:45:02.830676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.845806+0000","last_change":"2024-05-07T13:59:10.845836+0000","last_active":"2024-05-07T13:59:10.845806+0000","last_peered":"2024-05-07T13:59:10.845806+0000","last_clean":"2024-05-07T13:59:10.845806+0000","last_became_active":"2024-05-07T13:55:52.320520+0000","last_became_peered":"2024-05-07T13:55:52.320520+0000","last_unstale":"2024-05-07T13:59:10.845806+0000","last_undegraded":"2024-05-07T13:59:10.845806+0000","last_fullsized":"2024-05-07T13:59:10.845806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.845698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:25:38.217921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.157708+0000","last_change":"2024-05-07T13:59:23.157743+0000","last_active":"2024-05-07T13:59:23.157708+0000","last_peered":"2024-05-07T13:59:23.157708+0000","last_clean":"2024-05-07T13:59:23.157708+0000","last_became_active":"2024-05-07T13:55:54.320266+0000","last_became_peered":"2024-05-07T13:55:54.320266+0000","last_unstale":"2024-05-07T13:59:23.157708+0000","last_undegraded":"2024-05-07T13:59:23.157708+0000","last_fullsized":"2024-05-07T13:59:23.157708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.157605+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:28.358470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.079062+0000","last_change":"2024-05-07T13:59:15.079086+0000","last_active":"2024-05-07T13:59:15.079062+0000","last_peered":"2024-05-07T13:59:15.079062+0000","last_clean":"2024-05-07T13:59:15.079062+0000","last_became_active":"2024-05-07T13:55:56.330251+0000","last_became_peered":"2024-05-07T13:55:56.330251+0000","last_unstale":"2024-05-07T13:59:15.079062+0000","last_undegraded":"2024-05-07T13:59:15.079062+0000","last_fullsized":"2024-05-07T13:59:15.079062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:55.222720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.189084+0000","last_change":"2024-05-07T13:59:54.189084+0000","last_active":"2024-05-07T13:59:54.189084+0000","last_peered":"2024-05-07T13:59:54.189084+0000","last_clean":"2024-05-07T13:59:54.189084+0000","last_became_active":"2024-05-07T13:55:50.323159+0000","last_became_peered":"2024-05-07T13:55:50.323159+0000","last_unstale":"2024-05-07T13:59:54.189084+0000","last_undegraded":"2024-05-07T13:59:54.189084+0000","last_fullsized":"2024-05-07T13:59:54.189084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:54.188966+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:54.188966+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.188966+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:45:09.716257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:13.182255+0000","last_change":"2024-05-07T13:55:48.352309+0000","last_active":"2024-05-07T13:58:13.182255+0000","last_peered":"2024-05-07T13:58:13.182255+0000","last_clean":"2024-05-07T13:58:13.182255+0000","last_became_active":"2024-05-07T13:55:48.350462+0000","last_became_peered":"2024-05-07T13:55:48.350462+0000","last_unstale":"2024-05-07T13:58:13.182255+0000","last_undegraded":"2024-05-07T13:58:13.182255+0000","last_fullsized":"2024-05-07T13:58:13.182255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.020866+0000","last_change":"2024-05-07T13:59:35.020866+0000","last_active":"2024-05-07T13:59:35.020866+0000","last_peered":"2024-05-07T13:59:35.020866+0000","last_clean":"2024-05-07T13:59:35.020866+0000","last_became_active":"2024-05-07T13:55:52.321171+0000","last_became_peered":"2024-05-07T13:55:52.321171+0000","last_unstale":"2024-05-07T13:59:35.020866+0000","last_undegraded":"2024-05-07T13:59:35.020866+0000","last_fullsized":"2024-05-07T13:59:35.020866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:35.020743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:35.020743+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.020743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:21:42.711631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.985304+0000","last_change":"2024-05-07T13:59:23.985348+0000","last_active":"2024-05-07T13:59:23.985304+0000","last_peered":"2024-05-07T13:59:23.985304+0000","last_clean":"2024-05-07T13:59:23.985304+0000","last_became_active":"2024-05-07T13:55:54.319819+0000","last_became_peered":"2024-05-07T13:55:54.319819+0000","last_unstale":"2024-05-07T13:59:23.985304+0000","last_undegraded":"2024-05-07T13:59:23.985304+0000","last_fullsized":"2024-05-07T13:59:23.985304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.985209+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:20.683798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.078791+0000","last_change":"2024-05-07T13:59:14.078817+0000","last_active":"2024-05-07T13:59:14.078791+0000","last_peered":"2024-05-07T13:59:14.078791+0000","last_clean":"2024-05-07T13:59:14.078791+0000","last_became_active":"2024-05-07T13:55:56.330190+0000","last_became_peered":"2024-05-07T13:55:56.330190+0000","last_unstale":"2024-05-07T13:59:14.078791+0000","last_undegraded":"2024-05-07T13:59:14.078791+0000","last_fullsized":"2024-05-07T13:59:14.078791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.078700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:50:02.500890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:05.075583+0000","last_change":"2024-05-07T14:00:05.075614+0000","last_active":"2024-05-07T14:00:05.075583+0000","last_peered":"2024-05-07T14:00:05.075583+0000","last_clean":"2024-05-07T14:00:05.075583+0000","last_became_active":"2024-05-07T13:55:58.340674+0000","last_became_peered":"2024-05-07T13:55:58.340674+0000","last_unstale":"2024-05-07T14:00:05.075583+0000","last_undegraded":"2024-05-07T14:00:05.075583+0000","last_fullsized":"2024-05-07T14:00:05.075583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T14:00:05.075491+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T14:00:05.075491+0000","last_clean_scrub_stamp":"2024-05-07T14:00:05.075491+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:13.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.075066+0000","last_change":"2024-05-07T13:59:50.075066+0000","last_active":"2024-05-07T13:59:50.075066+0000","last_peered":"2024-05-07T13:59:50.075066+0000","last_clean":"2024-05-07T13:59:50.075066+0000","last_became_active":"2024-05-07T13:55:50.318546+0000","last_became_peered":"2024-05-07T13:55:50.318546+0000","last_unstale":"2024-05-07T13:59:50.075066+0000","last_undegraded":"2024-05-07T13:59:50.075066+0000","last_fullsized":"2024-05-07T13:59:50.075066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:50.074938+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:50.074938+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.074938+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:33.234260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.897247+0000","last_change":"2024-05-07T13:59:59.897301+0000","last_active":"2024-05-07T13:59:59.897247+0000","last_peered":"2024-05-07T13:59:59.897247+0000","last_clean":"2024-05-07T13:59:59.897247+0000","last_became_active":"2024-05-07T13:55:48.331278+0000","last_became_peered":"2024-05-07T13:55:48.331278+0000","last_unstale":"2024-05-07T13:59:59.897247+0000","last_undegraded":"2024-05-07T13:59:59.897247+0000","last_fullsized":"2024-05-07T13:59:59.897247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:59.897110+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:59.897110+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.897110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:51:16.956997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.132317+0000","last_change":"2024-05-07T13:59:31.132317+0000","last_active":"2024-05-07T13:59:31.132317+0000","last_peered":"2024-05-07T13:59:31.132317+0000","last_clean":"2024-05-07T13:59:31.132317+0000","last_became_active":"2024-05-07T13:55:52.317564+0000","last_became_peered":"2024-05-07T13:55:52.317564+0000","last_unstale":"2024-05-07T13:59:31.132317+0000","last_undegraded":"2024-05-07T13:59:31.132317+0000","last_fullsized":"2024-05-07T13:59:31.132317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.132155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.132155+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.132155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:31.984653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.150663+0000","last_change":"2024-05-07T13:59:42.150703+0000","last_active":"2024-05-07T13:59:42.150663+0000","last_peered":"2024-05-07T13:59:42.150663+0000","last_clean":"2024-05-07T13:59:42.150663+0000","last_became_active":"2024-05-07T13:55:54.329443+0000","last_became_peered":"2024-05-07T13:55:54.329443+0000","last_unstale":"2024-05-07T13:59:42.150663+0000","last_undegraded":"2024-05-07T13:59:42.150663+0000","last_fullsized":"2024-05-07T13:59:42.150663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-07T13:59:42.150568+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-07T13:59:42.150568+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.150568+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:03:28.616407+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.090783+0000","last_change":"2024-05-07T13:59:31.090805+0000","last_active":"2024-05-07T13:59:31.090783+0000","last_peered":"2024-05-07T13:59:31.090783+0000","last_clean":"2024-05-07T13:59:31.090783+0000","last_became_active":"2024-05-07T13:55:56.344470+0000","last_became_peered":"2024-05-07T13:55:56.344470+0000","last_unstale":"2024-05-07T13:59:31.090783+0000","last_undegraded":"2024-05-07T13:59:31.090783+0000","last_fullsized":"2024-05-07T13:59:31.090783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.090686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.090686+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.090686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:29.889110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.147041+0000","last_change":"2024-05-07T13:55:58.351086+0000","last_active":"2024-05-07T13:58:59.147041+0000","last_peered":"2024-05-07T13:58:59.147041+0000","last_clean":"2024-05-07T13:58:59.147041+0000","last_became_active":"2024-05-07T13:55:58.350796+0000","last_became_peered":"2024-05-07T13:55:58.350796+0000","last_unstale":"2024-05-07T13:58:59.147041+0000","last_undegraded":"2024-05-07T13:58:59.147041+0000","last_fullsized":"2024-05-07T13:58:59.147041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.935454+0000","last_change":"2024-05-07T13:59:23.935508+0000","last_active":"2024-05-07T13:59:23.935454+0000","last_peered":"2024-05-07T13:59:23.935454+0000","last_clean":"2024-05-07T13:59:23.935454+0000","last_became_active":"2024-05-07T13:55:50.326424+0000","last_became_peered":"2024-05-07T13:55:50.326424+0000","last_unstale":"2024-05-07T13:59:23.935454+0000","last_undegraded":"2024-05-07T13:59:23.935454+0000","last_fullsized":"2024-05-07T13:59:23.935454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.935328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:15.191912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.103945+0000","last_change":"2024-05-07T13:59:50.103971+0000","last_active":"2024-05-07T13:59:50.103945+0000","last_peered":"2024-05-07T13:59:50.103945+0000","last_clean":"2024-05-07T13:59:50.103945+0000","last_became_active":"2024-05-07T13:55:48.342072+0000","last_became_peered":"2024-05-07T13:55:48.342072+0000","last_unstale":"2024-05-07T13:59:50.103945+0000","last_undegraded":"2024-05-07T13:59:50.103945+0000","last_fullsized":"2024-05-07T13:59:50.103945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:50.103851+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:50.103851+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.103851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:45.262431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.097749+0000","last_change":"2024-05-07T13:59:30.097790+0000","last_active":"2024-05-07T13:59:30.097749+0000","last_peered":"2024-05-07T13:59:30.097749+0000","last_clean":"2024-05-07T13:59:30.097749+0000","last_became_active":"2024-05-07T13:55:52.318605+0000","last_became_peered":"2024-05-07T13:55:52.318605+0000","last_unstale":"2024-05-07T13:59:30.097749+0000","last_undegraded":"2024-05-07T13:59:30.097749+0000","last_fullsized":"2024-05-07T13:59:30.097749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.097647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.097647+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.097647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:23.733758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.957062+0000","last_change":"2024-05-07T13:59:22.957062+0000","last_active":"2024-05-07T13:59:22.957062+0000","last_peered":"2024-05-07T13:59:22.957062+0000","last_clean":"2024-05-07T13:59:22.957062+0000","last_became_active":"2024-05-07T13:55:54.326599+0000","last_became_peered":"2024-05-07T13:55:54.326599+0000","last_unstale":"2024-05-07T13:59:22.957062+0000","last_undegraded":"2024-05-07T13:59:22.957062+0000","last_fullsized":"2024-05-07T13:59:22.957062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.956910+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:05.203075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:09.875299+0000","last_change":"2024-05-07T13:59:09.875299+0000","last_active":"2024-05-07T13:59:09.875299+0000","last_peered":"2024-05-07T13:59:09.875299+0000","last_clean":"2024-05-07T13:59:09.875299+0000","last_became_active":"2024-05-07T13:55:56.334226+0000","last_became_peered":"2024-05-07T13:55:56.334226+0000","last_unstale":"2024-05-07T13:59:09.875299+0000","last_undegraded":"2024-05-07T13:59:09.875299+0000","last_fullsized":"2024-05-07T13:59:09.875299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_clean_scrub_stamp":"2024-05-07T13:59:09.875192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:33.279728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183272+0000","last_change":"2024-05-07T13:55:58.352585+0000","last_active":"2024-05-07T13:58:18.183272+0000","last_peered":"2024-05-07T13:58:18.183272+0000","last_clean":"2024-05-07T13:58:18.183272+0000","last_became_active":"2024-05-07T13:55:58.352263+0000","last_became_peered":"2024-05-07T13:55:58.352263+0000","last_unstale":"2024-05-07T13:58:18.183272+0000","last_undegraded":"2024-05-07T13:58:18.183272+0000","last_fullsized":"2024-05-07T13:58:18.183272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.159755+0000","last_change":"2024-05-07T13:59:44.159801+0000","last_active":"2024-05-07T13:59:44.159755+0000","last_peered":"2024-05-07T13:59:44.159755+0000","last_clean":"2024-05-07T13:59:44.159755+0000","last_became_active":"2024-05-07T13:55:50.312852+0000","last_became_peered":"2024-05-07T13:55:50.312852+0000","last_unstale":"2024-05-07T13:59:44.159755+0000","last_undegraded":"2024-05-07T13:59:44.159755+0000","last_fullsized":"2024-05-07T13:59:44.159755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:44.159658+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:44.159658+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.159658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:17.764814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183378+0000","last_change":"2024-05-07T13:55:48.351068+0000","last_active":"2024-05-07T13:58:18.183378+0000","last_peered":"2024-05-07T13:58:18.183378+0000","last_clean":"2024-05-07T13:58:18.183378+0000","last_became_active":"2024-05-07T13:55:48.348476+0000","last_became_peered":"2024-05-07T13:55:48.348476+0000","last_unstale":"2024-05-07T13:58:18.183378+0000","last_undegraded":"2024-05-07T13:58:18.183378+0000","last_fullsized":"2024-05-07T13:58:18.183378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.019050+0000","last_change":"2024-05-07T13:59:21.019075+0000","last_active":"2024-05-07T13:59:21.019050+0000","last_peered":"2024-05-07T13:59:21.019050+0000","last_clean":"2024-05-07T13:59:21.019050+0000","last_became_active":"2024-05-07T13:55:52.322431+0000","last_became_peered":"2024-05-07T13:55:52.322431+0000","last_unstale":"2024-05-07T13:59:21.019050+0000","last_undegraded":"2024-05-07T13:59:21.019050+0000","last_fullsized":"2024-05-07T13:59:21.019050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.018959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:33:21.518908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.997674+0000","last_change":"2024-05-07T13:59:28.997674+0000","last_active":"2024-05-07T13:59:28.997674+0000","last_peered":"2024-05-07T13:59:28.997674+0000","last_clean":"2024-05-07T13:59:28.997674+0000","last_became_active":"2024-05-07T13:55:54.329539+0000","last_became_peered":"2024-05-07T13:55:54.329539+0000","last_unstale":"2024-05-07T13:59:28.997674+0000","last_undegraded":"2024-05-07T13:59:28.997674+0000","last_fullsized":"2024-05-07T13:59:28.997674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-07T13:59:28.997538+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-07T13:59:28.997538+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.997538+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:03.181568+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.068040+0000","last_change":"2024-05-07T13:59:16.068040+0000","last_active":"2024-05-07T13:59:16.068040+0000","last_peered":"2024-05-07T13:59:16.068040+0000","last_clean":"2024-05-07T13:59:16.068040+0000","last_became_active":"2024-05-07T13:55:56.338021+0000","last_became_peered":"2024-05-07T13:55:56.338021+0000","last_unstale":"2024-05-07T13:59:16.068040+0000","last_undegraded":"2024-05-07T13:59:16.068040+0000","last_fullsized":"2024-05-07T13:59:16.068040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.067904+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:55:00.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183170+0000","last_change":"2024-05-07T13:55:58.351904+0000","last_active":"2024-05-07T13:58:18.183170+0000","last_peered":"2024-05-07T13:58:18.183170+0000","last_clean":"2024-05-07T13:58:18.183170+0000","last_became_active":"2024-05-07T13:55:58.351616+0000","last_became_peered":"2024-05-07T13:55:58.351616+0000","last_unstale":"2024-05-07T13:58:18.183170+0000","last_undegraded":"2024-05-07T13:58:18.183170+0000","last_fullsized":"2024-05-07T13:58:18.183170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.073813+0000","last_change":"2024-05-07T13:59:36.073866+0000","last_active":"2024-05-07T13:59:36.073813+0000","last_peered":"2024-05-07T13:59:36.073813+0000","last_clean":"2024-05-07T13:59:36.073813+0000","last_became_active":"2024-05-07T13:55:50.313016+0000","last_became_peered":"2024-05-07T13:55:50.313016+0000","last_unstale":"2024-05-07T13:59:36.073813+0000","last_undegraded":"2024-05-07T13:59:36.073813+0000","last_fullsized":"2024-05-07T13:59:36.073813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:36.073646+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:36.073646+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.073646+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:12.645759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.999483+0000","last_change":"2024-05-07T13:59:53.999532+0000","last_active":"2024-05-07T13:59:53.999483+0000","last_peered":"2024-05-07T13:59:53.999483+0000","last_clean":"2024-05-07T13:59:53.999483+0000","last_became_active":"2024-05-07T13:55:48.339639+0000","last_became_peered":"2024-05-07T13:55:48.339639+0000","last_unstale":"2024-05-07T13:59:53.999483+0000","last_undegraded":"2024-05-07T13:59:53.999483+0000","last_fullsized":"2024-05-07T13:59:53.999483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:53.999377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:53.999377+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.999377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:37.158698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.058938+0000","last_change":"2024-05-07T13:59:18.058974+0000","last_active":"2024-05-07T13:59:18.058938+0000","last_peered":"2024-05-07T13:59:18.058938+0000","last_clean":"2024-05-07T13:59:18.058938+0000","last_became_active":"2024-05-07T13:55:52.324567+0000","last_became_peered":"2024-05-07T13:55:52.324567+0000","last_unstale":"2024-05-07T13:59:18.058938+0000","last_undegraded":"2024-05-07T13:59:18.058938+0000","last_fullsized":"2024-05-07T13:59:18.058938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.058848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:48:50.227510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.085639+0000","last_change":"2024-05-07T13:59:16.085684+0000","last_active":"2024-05-07T13:59:16.085639+0000","last_peered":"2024-05-07T13:59:16.085639+0000","last_clean":"2024-05-07T13:59:16.085639+0000","last_became_active":"2024-05-07T13:55:54.329220+0000","last_became_peered":"2024-05-07T13:55:54.329220+0000","last_unstale":"2024-05-07T13:59:16.085639+0000","last_undegraded":"2024-05-07T13:59:16.085639+0000","last_fullsized":"2024-05-07T13:59:16.085639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.085538+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:26.485669+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.922656+0000","last_change":"2024-05-07T13:59:14.922682+0000","last_active":"2024-05-07T13:59:14.922656+0000","last_peered":"2024-05-07T13:59:14.922656+0000","last_clean":"2024-05-07T13:59:14.922656+0000","last_became_active":"2024-05-07T13:55:56.333373+0000","last_became_peered":"2024-05-07T13:55:56.333373+0000","last_unstale":"2024-05-07T13:59:14.922656+0000","last_undegraded":"2024-05-07T13:59:14.922656+0000","last_fullsized":"2024-05-07T13:59:14.922656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.922551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:15.327295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:07.957645+0000","last_change":"2024-05-07T14:00:07.957668+0000","last_active":"2024-05-07T14:00:07.957645+0000","last_peered":"2024-05-07T14:00:07.957645+0000","last_clean":"2024-05-07T14:00:07.957645+0000","last_became_active":"2024-05-07T13:55:58.347327+0000","last_became_peered":"2024-05-07T13:55:58.347327+0000","last_unstale":"2024-05-07T14:00:07.957645+0000","last_undegraded":"2024-05-07T14:00:07.957645+0000","last_fullsized":"2024-05-07T14:00:07.957645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:07.957550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:07.957550+0000","last_clean_scrub_stamp":"2024-05-07T14:00:07.957550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:12.458074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.036902+0000","last_change":"2024-05-07T13:59:35.036926+0000","last_active":"2024-05-07T13:59:35.036902+0000","last_peered":"2024-05-07T13:59:35.036902+0000","last_clean":"2024-05-07T13:59:35.036902+0000","last_became_active":"2024-05-07T13:55:50.311340+0000","last_became_peered":"2024-05-07T13:55:50.311340+0000","last_unstale":"2024-05-07T13:59:35.036902+0000","last_undegraded":"2024-05-07T13:59:35.036902+0000","last_fullsized":"2024-05-07T13:59:35.036902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:35.036806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:35.036806+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.036806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:47.801444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:05.069311+0000","last_change":"2024-05-07T14:00:05.069333+0000","last_active":"2024-05-07T14:00:05.069311+0000","last_peered":"2024-05-07T14:00:05.069311+0000","last_clean":"2024-05-07T14:00:05.069311+0000","last_became_active":"2024-05-07T13:55:48.349589+0000","last_became_peered":"2024-05-07T13:55:48.349589+0000","last_unstale":"2024-05-07T14:00:05.069311+0000","last_undegraded":"2024-05-07T14:00:05.069311+0000","last_fullsized":"2024-05-07T14:00:05.069311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:05.069220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:05.069220+0000","last_clean_scrub_stamp":"2024-05-07T14:00:05.069220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:01:27.326304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.160962+0000","last_change":"2024-05-07T13:59:27.160985+0000","last_active":"2024-05-07T13:59:27.160962+0000","last_peered":"2024-05-07T13:59:27.160962+0000","last_clean":"2024-05-07T13:59:27.160962+0000","last_became_active":"2024-05-07T13:55:52.323548+0000","last_became_peered":"2024-05-07T13:55:52.323548+0000","last_unstale":"2024-05-07T13:59:27.160962+0000","last_undegraded":"2024-05-07T13:59:27.160962+0000","last_fullsized":"2024-05-07T13:59:27.160962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.160877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:40.043412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.984564+0000","last_change":"2024-05-07T13:59:19.984633+0000","last_active":"2024-05-07T13:59:19.984564+0000","last_peered":"2024-05-07T13:59:19.984564+0000","last_clean":"2024-05-07T13:59:19.984564+0000","last_became_active":"2024-05-07T13:55:54.326844+0000","last_became_peered":"2024-05-07T13:55:54.326844+0000","last_unstale":"2024-05-07T13:59:19.984564+0000","last_undegraded":"2024-05-07T13:59:19.984564+0000","last_fullsized":"2024-05-07T13:59:19.984564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.984455+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:13.620566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.047751+0000","last_change":"2024-05-07T13:59:37.047777+0000","last_active":"2024-05-07T13:59:37.047751+0000","last_peered":"2024-05-07T13:59:37.047751+0000","last_clean":"2024-05-07T13:59:37.047751+0000","last_became_active":"2024-05-07T13:55:56.344885+0000","last_became_peered":"2024-05-07T13:55:56.344885+0000","last_unstale":"2024-05-07T13:59:37.047751+0000","last_undegraded":"2024-05-07T13:59:37.047751+0000","last_fullsized":"2024-05-07T13:59:37.047751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:37.047656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:37.047656+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.047656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:50:54.107543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.182882+0000","last_change":"2024-05-07T13:59:57.182908+0000","last_active":"2024-05-07T13:59:57.182882+0000","last_peered":"2024-05-07T13:59:57.182882+0000","last_clean":"2024-05-07T13:59:57.182882+0000","last_became_active":"2024-05-07T13:55:58.347850+0000","last_became_peered":"2024-05-07T13:55:58.347850+0000","last_unstale":"2024-05-07T13:59:57.182882+0000","last_undegraded":"2024-05-07T13:59:57.182882+0000","last_fullsized":"2024-05-07T13:59:57.182882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:57.182784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:57.182784+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.182784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:52:09.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'20","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.133242+0000","last_change":"2024-05-07T13:59:46.133286+0000","last_active":"2024-05-07T13:59:46.133242+0000","last_peered":"2024-05-07T13:59:46.133242+0000","last_clean":"2024-05-07T13:59:46.133242+0000","last_became_active":"2024-05-07T13:55:50.324745+0000","last_became_peered":"2024-05-07T13:55:50.324745+0000","last_unstale":"2024-05-07T13:59:46.133242+0000","last_undegraded":"2024-05-07T13:59:46.133242+0000","last_fullsized":"2024-05-07T13:59:46.133242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-07T13:59:46.133156+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-07T13:59:46.133156+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.133156+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:54.805339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.169448+0000","last_change":"2024-05-07T13:59:58.169504+0000","last_active":"2024-05-07T13:59:58.169448+0000","last_peered":"2024-05-07T13:59:58.169448+0000","last_clean":"2024-05-07T13:59:58.169448+0000","last_became_active":"2024-05-07T13:55:48.323125+0000","last_became_peered":"2024-05-07T13:55:48.323125+0000","last_unstale":"2024-05-07T13:59:58.169448+0000","last_undegraded":"2024-05-07T13:59:58.169448+0000","last_fullsized":"2024-05-07T13:59:58.169448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:58.169302+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:58.169302+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.169302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:48.984745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.003899+0000","last_change":"2024-05-07T13:59:22.003923+0000","last_active":"2024-05-07T13:59:22.003899+0000","last_peered":"2024-05-07T13:59:22.003899+0000","last_clean":"2024-05-07T13:59:22.003899+0000","last_became_active":"2024-05-07T13:55:52.322012+0000","last_became_peered":"2024-05-07T13:55:52.322012+0000","last_unstale":"2024-05-07T13:59:22.003899+0000","last_undegraded":"2024-05-07T13:59:22.003899+0000","last_fullsized":"2024-05-07T13:59:22.003899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.003807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:25:31.144648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'31","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.881145+0000","last_change":"2024-05-07T13:59:20.881181+0000","last_active":"2024-05-07T13:59:20.881145+0000","last_peered":"2024-05-07T13:59:20.881145+0000","last_clean":"2024-05-07T13:59:20.881145+0000","last_became_active":"2024-05-07T13:55:54.326758+0000","last_became_peered":"2024-05-07T13:55:54.326758+0000","last_unstale":"2024-05-07T13:59:20.881145+0000","last_undegraded":"2024-05-07T13:59:20.881145+0000","last_fullsized":"2024-05-07T13:59:20.881145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.881054+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:08.116261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.101452+0000","last_change":"2024-05-07T13:59:41.101476+0000","last_active":"2024-05-07T13:59:41.101452+0000","last_peered":"2024-05-07T13:59:41.101452+0000","last_clean":"2024-05-07T13:59:41.101452+0000","last_became_active":"2024-05-07T13:55:56.345933+0000","last_became_peered":"2024-05-07T13:55:56.345933+0000","last_unstale":"2024-05-07T13:59:41.101452+0000","last_undegraded":"2024-05-07T13:59:41.101452+0000","last_fullsized":"2024-05-07T13:59:41.101452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.101346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.101346+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.101346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:09.656228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184263+0000","last_change":"2024-05-07T13:55:58.349147+0000","last_active":"2024-05-07T13:58:23.184263+0000","last_peered":"2024-05-07T13:58:23.184263+0000","last_clean":"2024-05-07T13:58:23.184263+0000","last_became_active":"2024-05-07T13:55:58.348763+0000","last_became_peered":"2024-05-07T13:55:58.348763+0000","last_unstale":"2024-05-07T13:58:23.184263+0000","last_undegraded":"2024-05-07T13:58:23.184263+0000","last_fullsized":"2024-05-07T13:58:23.184263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.125138+0000","last_change":"2024-05-07T13:59:40.125168+0000","last_active":"2024-05-07T13:59:40.125138+0000","last_peered":"2024-05-07T13:59:40.125138+0000","last_clean":"2024-05-07T13:59:40.125138+0000","last_became_active":"2024-05-07T13:55:50.312605+0000","last_became_peered":"2024-05-07T13:55:50.312605+0000","last_unstale":"2024-05-07T13:59:40.125138+0000","last_undegraded":"2024-05-07T13:59:40.125138+0000","last_fullsized":"2024-05-07T13:59:40.125138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:40.125038+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:40.125038+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.125038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:59.307579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.920369+0000","last_change":"2024-05-07T14:00:00.920398+0000","last_active":"2024-05-07T14:00:00.920369+0000","last_peered":"2024-05-07T14:00:00.920369+0000","last_clean":"2024-05-07T14:00:00.920369+0000","last_became_active":"2024-05-07T13:55:48.333254+0000","last_became_peered":"2024-05-07T13:55:48.333254+0000","last_unstale":"2024-05-07T14:00:00.920369+0000","last_undegraded":"2024-05-07T14:00:00.920369+0000","last_fullsized":"2024-05-07T14:00:00.920369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.920262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.920262+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.920262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:52.170279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.057867+0000","last_change":"2024-05-07T13:59:26.057899+0000","last_active":"2024-05-07T13:59:26.057867+0000","last_peered":"2024-05-07T13:59:26.057867+0000","last_clean":"2024-05-07T13:59:26.057867+0000","last_became_active":"2024-05-07T13:55:52.321982+0000","last_became_peered":"2024-05-07T13:55:52.321982+0000","last_unstale":"2024-05-07T13:59:26.057867+0000","last_undegraded":"2024-05-07T13:59:26.057867+0000","last_fullsized":"2024-05-07T13:59:26.057867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.057767+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:23.143125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.876939+0000","last_change":"2024-05-07T13:59:16.876994+0000","last_active":"2024-05-07T13:59:16.876939+0000","last_peered":"2024-05-07T13:59:16.876939+0000","last_clean":"2024-05-07T13:59:16.876939+0000","last_became_active":"2024-05-07T13:55:54.326895+0000","last_became_peered":"2024-05-07T13:55:54.326895+0000","last_unstale":"2024-05-07T13:59:16.876939+0000","last_undegraded":"2024-05-07T13:59:16.876939+0000","last_fullsized":"2024-05-07T13:59:16.876939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.876843+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:35.990453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.058174+0000","last_change":"2024-05-07T13:59:30.058208+0000","last_active":"2024-05-07T13:59:30.058174+0000","last_peered":"2024-05-07T13:59:30.058174+0000","last_clean":"2024-05-07T13:59:30.058174+0000","last_became_active":"2024-05-07T13:55:56.343002+0000","last_became_peered":"2024-05-07T13:55:56.343002+0000","last_unstale":"2024-05-07T13:59:30.058174+0000","last_undegraded":"2024-05-07T13:59:30.058174+0000","last_fullsized":"2024-05-07T13:59:30.058174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.058080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.058080+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.058080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:49.240621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.665404+0000","last_change":"2024-05-07T13:55:58.348783+0000","last_active":"2024-05-07T13:58:59.665404+0000","last_peered":"2024-05-07T13:58:59.665404+0000","last_clean":"2024-05-07T13:58:59.665404+0000","last_became_active":"2024-05-07T13:55:58.347820+0000","last_became_peered":"2024-05-07T13:55:58.347820+0000","last_unstale":"2024-05-07T13:58:59.665404+0000","last_undegraded":"2024-05-07T13:58:59.665404+0000","last_fullsized":"2024-05-07T13:58:59.665404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.055046+0000","last_change":"2024-05-07T13:59:32.055073+0000","last_active":"2024-05-07T13:59:32.055046+0000","last_peered":"2024-05-07T13:59:32.055046+0000","last_clean":"2024-05-07T13:59:32.055046+0000","last_became_active":"2024-05-07T13:55:50.330166+0000","last_became_peered":"2024-05-07T13:55:50.330166+0000","last_unstale":"2024-05-07T13:59:32.055046+0000","last_undegraded":"2024-05-07T13:59:32.055046+0000","last_fullsized":"2024-05-07T13:59:32.055046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:32.054935+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:32.054935+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.054935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:31.258103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.120996+0000","last_change":"2024-05-07T13:59:47.120996+0000","last_active":"2024-05-07T13:59:47.120996+0000","last_peered":"2024-05-07T13:59:47.120996+0000","last_clean":"2024-05-07T13:59:47.120996+0000","last_became_active":"2024-05-07T13:55:48.338874+0000","last_became_peered":"2024-05-07T13:55:48.338874+0000","last_unstale":"2024-05-07T13:59:47.120996+0000","last_undegraded":"2024-05-07T13:59:47.120996+0000","last_fullsized":"2024-05-07T13:59:47.120996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:47.120819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:47.120819+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.120819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:29.157325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.065959+0000","last_change":"2024-05-07T13:59:40.065990+0000","last_active":"2024-05-07T13:59:40.065959+0000","last_peered":"2024-05-07T13:59:40.065959+0000","last_clean":"2024-05-07T13:59:40.065959+0000","last_became_active":"2024-05-07T13:55:50.311324+0000","last_became_peered":"2024-05-07T13:55:50.311324+0000","last_unstale":"2024-05-07T13:59:40.065959+0000","last_undegraded":"2024-05-07T13:59:40.065959+0000","last_fullsized":"2024-05-07T13:59:40.065959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:40.065867+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:40.065867+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.065867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:27.301075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.039704+0000","last_change":"2024-05-07T13:59:41.039704+0000","last_active":"2024-05-07T13:59:41.039704+0000","last_peered":"2024-05-07T13:59:41.039704+0000","last_clean":"2024-05-07T13:59:41.039704+0000","last_became_active":"2024-05-07T13:55:48.325561+0000","last_became_peered":"2024-05-07T13:55:48.325561+0000","last_unstale":"2024-05-07T13:59:41.039704+0000","last_undegraded":"2024-05-07T13:59:41.039704+0000","last_fullsized":"2024-05-07T13:59:41.039704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.039521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.039521+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.039521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:57.803837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.983157+0000","last_change":"2024-05-07T13:59:25.983208+0000","last_active":"2024-05-07T13:59:25.983157+0000","last_peered":"2024-05-07T13:59:25.983157+0000","last_clean":"2024-05-07T13:59:25.983157+0000","last_became_active":"2024-05-07T13:55:50.326322+0000","last_became_peered":"2024-05-07T13:55:50.326322+0000","last_unstale":"2024-05-07T13:59:25.983157+0000","last_undegraded":"2024-05-07T13:59:25.983157+0000","last_fullsized":"2024-05-07T13:59:25.983157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.983056+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:20.815531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"27'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.516989+0000","last_change":"2024-05-07T13:55:48.352058+0000","last_active":"2024-05-07T13:59:10.516989+0000","last_peered":"2024-05-07T13:59:10.516989+0000","last_clean":"2024-05-07T13:59:10.516989+0000","last_became_active":"2024-05-07T13:55:48.350385+0000","last_became_peered":"2024-05-07T13:55:48.350385+0000","last_unstale":"2024-05-07T13:59:10.516989+0000","last_undegraded":"2024-05-07T13:59:10.516989+0000","last_fullsized":"2024-05-07T13:59:10.516989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.084229+0000","last_change":"2024-05-07T13:59:42.084260+0000","last_active":"2024-05-07T13:59:42.084229+0000","last_peered":"2024-05-07T13:59:42.084229+0000","last_clean":"2024-05-07T13:59:42.084229+0000","last_became_active":"2024-05-07T13:55:50.312703+0000","last_became_peered":"2024-05-07T13:55:50.312703+0000","last_unstale":"2024-05-07T13:59:42.084229+0000","last_undegraded":"2024-05-07T13:59:42.084229+0000","last_fullsized":"2024-05-07T13:59:42.084229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:42.084125+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:42.084125+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.084125+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:03.874653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.109470+0000","last_change":"2024-05-07T14:00:03.109504+0000","last_active":"2024-05-07T14:00:03.109470+0000","last_peered":"2024-05-07T14:00:03.109470+0000","last_clean":"2024-05-07T14:00:03.109470+0000","last_became_active":"2024-05-07T13:55:48.323979+0000","last_became_peered":"2024-05-07T13:55:48.323979+0000","last_unstale":"2024-05-07T14:00:03.109470+0000","last_undegraded":"2024-05-07T14:00:03.109470+0000","last_fullsized":"2024-05-07T14:00:03.109470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:03.109379+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:03.109379+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.109379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:07.609903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.019212+0000","last_change":"2024-05-07T13:59:36.019212+0000","last_active":"2024-05-07T13:59:36.019212+0000","last_peered":"2024-05-07T13:59:36.019212+0000","last_clean":"2024-05-07T13:59:36.019212+0000","last_became_active":"2024-05-07T13:55:50.331311+0000","last_became_peered":"2024-05-07T13:55:50.331311+0000","last_unstale":"2024-05-07T13:59:36.019212+0000","last_undegraded":"2024-05-07T13:59:36.019212+0000","last_fullsized":"2024-05-07T13:59:36.019212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:36.019068+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:36.019068+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.019068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:40.795315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.030870+0000","last_change":"2024-05-07T13:59:51.030870+0000","last_active":"2024-05-07T13:59:51.030870+0000","last_peered":"2024-05-07T13:59:51.030870+0000","last_clean":"2024-05-07T13:59:51.030870+0000","last_became_active":"2024-05-07T13:55:48.325858+0000","last_became_peered":"2024-05-07T13:55:48.325858+0000","last_unstale":"2024-05-07T13:59:51.030870+0000","last_undegraded":"2024-05-07T13:59:51.030870+0000","last_fullsized":"2024-05-07T13:59:51.030870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:51.030727+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:51.030727+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.030727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:23.693886+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'8","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.064923+0000","last_change":"2024-05-07T13:59:37.064923+0000","last_active":"2024-05-07T13:59:37.064923+0000","last_peered":"2024-05-07T13:59:37.064923+0000","last_clean":"2024-05-07T13:59:37.064923+0000","last_became_active":"2024-05-07T13:55:50.323573+0000","last_became_peered":"2024-05-07T13:55:50.323573+0000","last_unstale":"2024-05-07T13:59:37.064923+0000","last_undegraded":"2024-05-07T13:59:37.064923+0000","last_fullsized":"2024-05-07T13:59:37.064923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:37.064807+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:37.064807+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.064807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:27:22.190330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.913691+0000","last_change":"2024-05-07T14:00:01.913691+0000","last_active":"2024-05-07T14:00:01.913691+0000","last_peered":"2024-05-07T14:00:01.913691+0000","last_clean":"2024-05-07T14:00:01.913691+0000","last_became_active":"2024-05-07T13:55:48.334268+0000","last_became_peered":"2024-05-07T13:55:48.334268+0000","last_unstale":"2024-05-07T14:00:01.913691+0000","last_undegraded":"2024-05-07T14:00:01.913691+0000","last_fullsized":"2024-05-07T14:00:01.913691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T14:00:01.913563+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T14:00:01.913563+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.913563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:52.729005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.072192+0000","last_change":"2024-05-07T14:00:04.072255+0000","last_active":"2024-05-07T14:00:04.072192+0000","last_peered":"2024-05-07T14:00:04.072192+0000","last_clean":"2024-05-07T14:00:04.072192+0000","last_became_active":"2024-05-07T13:55:50.320242+0000","last_became_peered":"2024-05-07T13:55:50.320242+0000","last_unstale":"2024-05-07T14:00:04.072192+0000","last_undegraded":"2024-05-07T14:00:04.072192+0000","last_fullsized":"2024-05-07T14:00:04.072192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T14:00:04.072088+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T14:00:04.072088+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.072088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:32:14.005162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.098472+0000","last_change":"2024-05-07T13:59:39.098472+0000","last_active":"2024-05-07T13:59:39.098472+0000","last_peered":"2024-05-07T13:59:39.098472+0000","last_clean":"2024-05-07T13:59:39.098472+0000","last_became_active":"2024-05-07T13:55:48.340718+0000","last_became_peered":"2024-05-07T13:55:48.340718+0000","last_unstale":"2024-05-07T13:59:39.098472+0000","last_undegraded":"2024-05-07T13:59:39.098472+0000","last_fullsized":"2024-05-07T13:59:39.098472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:39.098327+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:39.098327+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.098327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:06.470550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'12","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.080660+0000","last_change":"2024-05-07T13:59:51.080660+0000","last_active":"2024-05-07T13:59:51.080660+0000","last_peered":"2024-05-07T13:59:51.080660+0000","last_clean":"2024-05-07T13:59:51.080660+0000","last_became_active":"2024-05-07T13:55:50.320430+0000","last_became_peered":"2024-05-07T13:55:50.320430+0000","last_unstale":"2024-05-07T13:59:51.080660+0000","last_undegraded":"2024-05-07T13:59:51.080660+0000","last_fullsized":"2024-05-07T13:59:51.080660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:51.080529+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:51.080529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.080529+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:36.200537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.150670+0000","last_change":"2024-05-07T14:00:00.150670+0000","last_active":"2024-05-07T14:00:00.150670+0000","last_peered":"2024-05-07T14:00:00.150670+0000","last_clean":"2024-05-07T14:00:00.150670+0000","last_became_active":"2024-05-07T13:55:48.323524+0000","last_became_peered":"2024-05-07T13:55:48.323524+0000","last_unstale":"2024-05-07T14:00:00.150670+0000","last_undegraded":"2024-05-07T14:00:00.150670+0000","last_fullsized":"2024-05-07T14:00:00.150670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.150551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.150551+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.150551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:28.705432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.097729+0000","last_change":"2024-05-07T13:59:45.097757+0000","last_active":"2024-05-07T13:59:45.097729+0000","last_peered":"2024-05-07T13:59:45.097729+0000","last_clean":"2024-05-07T13:59:45.097729+0000","last_became_active":"2024-05-07T13:55:50.313012+0000","last_became_peered":"2024-05-07T13:55:50.313012+0000","last_unstale":"2024-05-07T13:59:45.097729+0000","last_undegraded":"2024-05-07T13:59:45.097729+0000","last_fullsized":"2024-05-07T13:59:45.097729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-07T13:59:45.097632+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-07T13:59:45.097632+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.097632+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:52:01.861948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.169146+0000","last_change":"2024-05-07T13:59:59.169146+0000","last_active":"2024-05-07T13:59:59.169146+0000","last_peered":"2024-05-07T13:59:59.169146+0000","last_clean":"2024-05-07T13:59:59.169146+0000","last_became_active":"2024-05-07T13:55:48.351882+0000","last_became_peered":"2024-05-07T13:55:48.351882+0000","last_unstale":"2024-05-07T13:59:59.169146+0000","last_undegraded":"2024-05-07T13:59:59.169146+0000","last_fullsized":"2024-05-07T13:59:59.169146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:59.169028+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:59.169028+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.169028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:32:41.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'8","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.983342+0000","last_change":"2024-05-07T13:59:29.983379+0000","last_active":"2024-05-07T13:59:29.983342+0000","last_peered":"2024-05-07T13:59:29.983342+0000","last_clean":"2024-05-07T13:59:29.983342+0000","last_became_active":"2024-05-07T13:55:50.325807+0000","last_became_peered":"2024-05-07T13:55:50.325807+0000","last_unstale":"2024-05-07T13:59:29.983342+0000","last_undegraded":"2024-05-07T13:59:29.983342+0000","last_fullsized":"2024-05-07T13:59:29.983342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:29.983257+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:29.983257+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.983257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:23.280897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.148376+0000","last_change":"2024-05-07T13:59:45.148407+0000","last_active":"2024-05-07T13:59:45.148376+0000","last_peered":"2024-05-07T13:59:45.148376+0000","last_clean":"2024-05-07T13:59:45.148376+0000","last_became_active":"2024-05-07T13:55:48.324919+0000","last_became_peered":"2024-05-07T13:55:48.324919+0000","last_unstale":"2024-05-07T13:59:45.148376+0000","last_undegraded":"2024-05-07T13:59:45.148376+0000","last_fullsized":"2024-05-07T13:59:45.148376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:45.148279+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:45.148279+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.148279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:40.994289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.037530+0000","last_change":"2024-05-07T13:59:39.037562+0000","last_active":"2024-05-07T13:59:39.037530+0000","last_peered":"2024-05-07T13:59:39.037530+0000","last_clean":"2024-05-07T13:59:39.037530+0000","last_became_active":"2024-05-07T13:55:50.325620+0000","last_became_peered":"2024-05-07T13:55:50.325620+0000","last_unstale":"2024-05-07T13:59:39.037530+0000","last_undegraded":"2024-05-07T13:59:39.037530+0000","last_fullsized":"2024-05-07T13:59:39.037530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:39.037426+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:39.037426+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.037426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:05.113376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.117972+0000","last_change":"2024-05-07T13:59:48.118048+0000","last_active":"2024-05-07T13:59:48.117972+0000","last_peered":"2024-05-07T13:59:48.117972+0000","last_clean":"2024-05-07T13:59:48.117972+0000","last_became_active":"2024-05-07T13:55:48.342508+0000","last_became_peered":"2024-05-07T13:55:48.342508+0000","last_unstale":"2024-05-07T13:59:48.117972+0000","last_undegraded":"2024-05-07T13:59:48.117972+0000","last_fullsized":"2024-05-07T13:59:48.117972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:48.117871+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:48.117871+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.117871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:21.723026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.019439+0000","last_change":"2024-05-07T13:59:53.019469+0000","last_active":"2024-05-07T13:59:53.019439+0000","last_peered":"2024-05-07T13:59:53.019439+0000","last_clean":"2024-05-07T13:59:53.019439+0000","last_became_active":"2024-05-07T13:55:50.321606+0000","last_became_peered":"2024-05-07T13:55:50.321606+0000","last_unstale":"2024-05-07T13:59:53.019439+0000","last_undegraded":"2024-05-07T13:59:53.019439+0000","last_fullsized":"2024-05-07T13:59:53.019439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:53.019341+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:53.019341+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.019341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:46.316981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.943586+0000","last_change":"2024-05-07T13:59:58.943614+0000","last_active":"2024-05-07T13:59:58.943586+0000","last_peered":"2024-05-07T13:59:58.943586+0000","last_clean":"2024-05-07T13:59:58.943586+0000","last_became_active":"2024-05-07T13:55:48.332247+0000","last_became_peered":"2024-05-07T13:55:48.332247+0000","last_unstale":"2024-05-07T13:59:58.943586+0000","last_undegraded":"2024-05-07T13:59:58.943586+0000","last_fullsized":"2024-05-07T13:59:58.943586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:58.943486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:58.943486+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.943486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:27.322012+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'16","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.097944+0000","last_change":"2024-05-07T13:59:36.097975+0000","last_active":"2024-05-07T13:59:36.097944+0000","last_peered":"2024-05-07T13:59:36.097944+0000","last_clean":"2024-05-07T13:59:36.097944+0000","last_became_active":"2024-05-07T13:55:50.329434+0000","last_became_peered":"2024-05-07T13:55:50.329434+0000","last_unstale":"2024-05-07T13:59:36.097944+0000","last_undegraded":"2024-05-07T13:59:36.097944+0000","last_fullsized":"2024-05-07T13:59:36.097944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:36.097848+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:36.097848+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.097848+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:05:27.587259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.500539+0000","last_change":"2024-05-07T13:55:48.348177+0000","last_active":"2024-05-07T13:58:59.500539+0000","last_peered":"2024-05-07T13:58:59.500539+0000","last_clean":"2024-05-07T13:58:59.500539+0000","last_became_active":"2024-05-07T13:55:48.345844+0000","last_became_peered":"2024-05-07T13:55:48.345844+0000","last_unstale":"2024-05-07T13:58:59.500539+0000","last_undegraded":"2024-05-07T13:58:59.500539+0000","last_fullsized":"2024-05-07T13:58:59.500539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.052977+0000","last_change":"2024-05-07T13:59:42.053031+0000","last_active":"2024-05-07T13:59:42.052977+0000","last_peered":"2024-05-07T13:59:42.052977+0000","last_clean":"2024-05-07T13:59:42.052977+0000","last_became_active":"2024-05-07T13:55:50.313049+0000","last_became_peered":"2024-05-07T13:55:50.313049+0000","last_unstale":"2024-05-07T13:59:42.052977+0000","last_undegraded":"2024-05-07T13:59:42.052977+0000","last_fullsized":"2024-05-07T13:59:42.052977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:42.052863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:42.052863+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.052863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:36.854007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.124677+0000","last_change":"2024-05-07T13:55:48.349780+0000","last_active":"2024-05-07T13:58:59.124677+0000","last_peered":"2024-05-07T13:58:59.124677+0000","last_clean":"2024-05-07T13:58:59.124677+0000","last_became_active":"2024-05-07T13:55:48.346691+0000","last_became_peered":"2024-05-07T13:55:48.346691+0000","last_unstale":"2024-05-07T13:58:59.124677+0000","last_undegraded":"2024-05-07T13:58:59.124677+0000","last_fullsized":"2024-05-07T13:58:59.124677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.249336+0000","last_change":"2024-05-07T13:59:51.249376+0000","last_active":"2024-05-07T13:59:51.249336+0000","last_peered":"2024-05-07T13:59:51.249336+0000","last_clean":"2024-05-07T13:59:51.249336+0000","last_became_active":"2024-05-07T13:55:50.322543+0000","last_became_peered":"2024-05-07T13:55:50.322543+0000","last_unstale":"2024-05-07T13:59:51.249336+0000","last_undegraded":"2024-05-07T13:59:51.249336+0000","last_fullsized":"2024-05-07T13:59:51.249336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:51.249245+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:51.249245+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.249245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:52:29.222971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.140150+0000","last_change":"2024-05-07T13:59:41.140179+0000","last_active":"2024-05-07T13:59:41.140150+0000","last_peered":"2024-05-07T13:59:41.140150+0000","last_clean":"2024-05-07T13:59:41.140150+0000","last_became_active":"2024-05-07T13:55:48.339909+0000","last_became_peered":"2024-05-07T13:55:48.339909+0000","last_unstale":"2024-05-07T13:59:41.140150+0000","last_undegraded":"2024-05-07T13:59:41.140150+0000","last_fullsized":"2024-05-07T13:59:41.140150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.140056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.140056+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.140056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:23.488647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.113258+0000","last_change":"2024-05-07T13:59:40.113305+0000","last_active":"2024-05-07T13:59:40.113258+0000","last_peered":"2024-05-07T13:59:40.113258+0000","last_clean":"2024-05-07T13:59:40.113258+0000","last_became_active":"2024-05-07T13:55:50.322967+0000","last_became_peered":"2024-05-07T13:55:50.322967+0000","last_unstale":"2024-05-07T13:59:40.113258+0000","last_undegraded":"2024-05-07T13:59:40.113258+0000","last_fullsized":"2024-05-07T13:59:40.113258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:40.113131+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:40.113131+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.113131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:44.889378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.106002+0000","last_change":"2024-05-07T13:55:48.347208+0000","last_active":"2024-05-07T13:58:59.106002+0000","last_peered":"2024-05-07T13:58:59.106002+0000","last_clean":"2024-05-07T13:58:59.106002+0000","last_became_active":"2024-05-07T13:55:48.346724+0000","last_became_peered":"2024-05-07T13:55:48.346724+0000","last_unstale":"2024-05-07T13:58:59.106002+0000","last_undegraded":"2024-05-07T13:58:59.106002+0000","last_fullsized":"2024-05-07T13:58:59.106002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:08.181538+0000","last_change":"2024-05-07T13:55:48.351645+0000","last_active":"2024-05-07T13:58:08.181538+0000","last_peered":"2024-05-07T13:58:08.181538+0000","last_clean":"2024-05-07T13:58:08.181538+0000","last_became_active":"2024-05-07T13:55:48.349852+0000","last_became_peered":"2024-05-07T13:55:48.349852+0000","last_unstale":"2024-05-07T13:58:08.181538+0000","last_undegraded":"2024-05-07T13:58:08.181538+0000","last_fullsized":"2024-05-07T13:58:08.181538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:47.284080+0000","last_clean_scrub_stamp":"2024-05-07T13:55:47.284080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'4","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.162833+0000","last_change":"2024-05-07T13:59:54.162869+0000","last_active":"2024-05-07T13:59:54.162833+0000","last_peered":"2024-05-07T13:59:54.162833+0000","last_clean":"2024-05-07T13:59:54.162833+0000","last_became_active":"2024-05-07T13:55:50.319033+0000","last_became_peered":"2024-05-07T13:55:50.319033+0000","last_unstale":"2024-05-07T13:59:54.162833+0000","last_undegraded":"2024-05-07T13:59:54.162833+0000","last_fullsized":"2024-05-07T13:59:54.162833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:54.162744+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:54.162744+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.162744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:59.028242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.100730+0000","last_change":"2024-05-07T13:59:47.100759+0000","last_active":"2024-05-07T13:59:47.100730+0000","last_peered":"2024-05-07T13:59:47.100730+0000","last_clean":"2024-05-07T13:59:47.100730+0000","last_became_active":"2024-05-07T13:55:48.324081+0000","last_became_peered":"2024-05-07T13:55:48.324081+0000","last_unstale":"2024-05-07T13:59:47.100730+0000","last_undegraded":"2024-05-07T13:59:47.100730+0000","last_fullsized":"2024-05-07T13:59:47.100730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:47.100641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:47.100641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.100641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:57.320731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.027329+0000","last_change":"2024-05-07T13:59:34.027372+0000","last_active":"2024-05-07T13:59:34.027329+0000","last_peered":"2024-05-07T13:59:34.027329+0000","last_clean":"2024-05-07T13:59:34.027329+0000","last_became_active":"2024-05-07T13:55:50.329848+0000","last_became_peered":"2024-05-07T13:55:50.329848+0000","last_unstale":"2024-05-07T13:59:34.027329+0000","last_undegraded":"2024-05-07T13:59:34.027329+0000","last_fullsized":"2024-05-07T13:59:34.027329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:34.027225+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:34.027225+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.027225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:34.330181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705721,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":136605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":970752,"data_stored":724702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705721,"num_pgs":157,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44628,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327212,"statfs":{"total":96636764160,"available":96591065088,"internally_reserved":0,"allocated":995328,"data_stored":724122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":401408,"data_stored":134585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:00:12.033 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.034 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.034 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.034 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.034 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-07T13:55:51.298593+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=51, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.035 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.035 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.035 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.036 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.036 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.036 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.036 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.036 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.037 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.037 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.037 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.037 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.037 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-07T13:55:39.034385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=39, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.038 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.038 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.038 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-07T13:55:49.291718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=49, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.038 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.039 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.039 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.039 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.039 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.040 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.040 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.040 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.040 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.041 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.041 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.041 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-07T13:55:47.284080+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=47, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:12.041 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T14:00:32.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:00:32.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.170+0000 7f0b10d59640 1 Processor -- start 2024-05-07T14:00:32.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.171+0000 7f0b10d59640 1 -- start start 2024-05-07T14:00:32.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.171+0000 7f0b10d59640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b0c12e460 0x7f0b0c130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:32.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.171+0000 7f0b10d59640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0c071020 con 0x7f0b0c127ea0 2024-05-07T14:00:32.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.171+0000 7f0b10d59640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0b0c071780 con 0x7f0b0c12e460 2024-05-07T14:00:32.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.171+0000 7f0b09d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b0c12e460 0x7f0b0c130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:32.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.171+0000 7f0b0a59c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0b0c127ea0 0x7f0b0c128280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60696/0 (socket says 172.21.15.22:60696) 2024-05-07T14:00:32.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.171+0000 7f0b0a59c640 1 -- 172.21.15.22:0/1498095785 learned_addr learned my addr 172.21.15.22:0/1498095785 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T14:00:32.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.172+0000 7f0b09d9b640 1 -- 172.21.15.22:0/1498095785 >> v1:172.21.15.22:6789/0 conn(0x7f0b0c127ea0 legacy=0x7f0b0c128280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:32.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.172+0000 7f0b09d9b640 1 -- 172.21.15.22:0/1498095785 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c06e6e0 con 0x7f0b0c12e460 2024-05-07T14:00:32.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.172+0000 7f0b09d9b640 1 --2- 172.21.15.22:0/1498095785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c12e460 0x7f0b0c130850 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009720 tx=0x7f0b0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9212a171420220b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:32.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b0959a640 1 -- 172.21.15.22:0/1498095785 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b00035020 con 0x7f0b0c12e460 2024-05-07T14:00:32.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b0959a640 1 -- 172.21.15.22:0/1498095785 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b00031760 con 0x7f0b0c12e460 2024-05-07T14:00:32.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b0959a640 1 -- 172.21.15.22:0/1498095785 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b00031a60 con 0x7f0b0c12e460 2024-05-07T14:00:32.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b10d59640 1 -- 172.21.15.22:0/1498095785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c12e460 msgr2=0x7f0b0c130850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:32.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b10d59640 1 --2- 172.21.15.22:0/1498095785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c12e460 0x7f0b0c130850 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009720 tx=0x7f0b0002b8d0 comp rx=0 tx=0).stop 2024-05-07T14:00:32.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b10d59640 1 -- 172.21.15.22:0/1498095785 shutdown_connections 2024-05-07T14:00:32.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b10d59640 1 --2- 172.21.15.22:0/1498095785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c12e460 0x7f0b0c130850 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:32.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b10d59640 1 -- 172.21.15.22:0/1498095785 >> 172.21.15.22:0/1498095785 conn(0x7f0b0c099380 msgr2=0x7f0b0c099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T14:00:32.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b10d59640 1 -- 172.21.15.22:0/1498095785 shutdown_connections 2024-05-07T14:00:32.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.173+0000 7f0b10d59640 1 -- 172.21.15.22:0/1498095785 wait complete. 2024-05-07T14:00:32.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.174+0000 7f0b10d59640 1 Processor -- start 2024-05-07T14:00:32.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.174+0000 7f0b10d59640 1 -- start start 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.175+0000 7f0b10d59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c127ea0 0x7f0b0c117470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.175+0000 7f0b10d59640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c0725d0 con 0x7f0b0c127ea0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.175+0000 7f0b0a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c127ea0 0x7f0b0c117470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.175+0000 7f0b0a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c127ea0 0x7f0b0c117470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44916/0 (socket says 172.21.15.22:44916) 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.175+0000 7f0b0a59c640 1 -- 172.21.15.22:0/3737423735 learned_addr learned my addr 172.21.15.22:0/3737423735 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.175+0000 7f0b0a59c640 1 -- 172.21.15.22:0/3737423735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c124780 con 0x7f0b0c127ea0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.175+0000 7f0b0a59c640 1 --2- 172.21.15.22:0/3737423735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c127ea0 0x7f0b0c117470 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00c380 tx=0x7f0afc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.175+0000 7f0afaffd640 1 -- 172.21.15.22:0/3737423735 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0afc005c10 con 0x7f0b0c127ea0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.176+0000 7f0afaffd640 1 -- 172.21.15.22:0/3737423735 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc005db0 con 0x7f0b0c127ea0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.176+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0c1249b0 con 0x7f0b0c127ea0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.176+0000 7f0afaffd640 1 -- 172.21.15.22:0/3737423735 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0afc004930 con 0x7f0b0c127ea0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.176+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0c117b90 con 0x7f0b0c127ea0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.176+0000 7f0afaffd640 1 -- 172.21.15.22:0/3737423735 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0afc01a020 con 0x7f0b0c127ea0 2024-05-07T14:00:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.177+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0c1193d0 con 0x7f0b0c127ea0 2024-05-07T14:00:32.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.177+0000 7f0afaffd640 1 --2- 172.21.15.22:0/3737423735 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0aec038060 0x7f0aec03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:32.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.177+0000 7f0afaffd640 1 -- 172.21.15.22:0/3737423735 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0afc04b230 con 0x7f0b0c127ea0 2024-05-07T14:00:32.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.177+0000 7f0b09d9b640 1 --2- 172.21.15.22:0/3737423735 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0aec038060 0x7f0aec03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:32.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.178+0000 7f0b09d9b640 1 --2- 172.21.15.22:0/3737423735 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0aec038060 0x7f0aec03a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0b00036000 tx=0x7f0b00008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:32.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.182+0000 7f0afaffd640 1 -- 172.21.15.22:0/3737423735 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0afc0127f0 con 0x7f0b0c127ea0 2024-05-07T14:00:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.363+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b0c118cc0 con 0x7f0aec038060 2024-05-07T14:00:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.379+0000 7f0afaffd640 1 -- 172.21.15.22:0/3737423735 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666031 (secure 0 0 0) 0x7f0b0c118cc0 con 0x7f0aec038060 2024-05-07T14:00:32.368 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T14:00:32.377 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T14:00:32.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0aec038060 msgr2=0x7f0aec03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:32.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 --2- 172.21.15.22:0/3737423735 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0aec038060 0x7f0aec03a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0b00036000 tx=0x7f0b00008030 comp rx=0 tx=0).stop 2024-05-07T14:00:32.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c127ea0 msgr2=0x7f0b0c117470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:32.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 --2- 172.21.15.22:0/3737423735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c127ea0 0x7f0b0c117470 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00c380 tx=0x7f0afc00c840 comp rx=0 tx=0).stop 2024-05-07T14:00:32.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 shutdown_connections 2024-05-07T14:00:32.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 --2- 172.21.15.22:0/3737423735 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f0aec038060 0x7f0aec03a520 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:32.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 --2- 172.21.15.22:0/3737423735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b0c127ea0 0x7f0b0c117470 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:32.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 >> 172.21.15.22:0/3737423735 conn(0x7f0b0c099380 msgr2=0x7f0b0c09a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T14:00:32.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 shutdown_connections 2024-05-07T14:00:32.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:32.384+0000 7f0b10d59640 1 -- 172.21.15.22:0/3737423735 wait complete. 2024-05-07T14:00:32.404 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-05-07T14:00:32.191288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5119,"num_read_kb":4700,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":131608,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377355752,"statfs":{"total":386547056640,"available":386412290048,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":131917590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005002"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.910461+0000","last_change":"2024-05-07T13:59:51.910461+0000","last_active":"2024-05-07T13:59:51.910461+0000","last_peered":"2024-05-07T13:59:51.910461+0000","last_clean":"2024-05-07T13:59:51.910461+0000","last_became_active":"2024-05-07T13:55:48.335740+0000","last_became_peered":"2024-05-07T13:55:48.335740+0000","last_unstale":"2024-05-07T13:59:51.910461+0000","last_undegraded":"2024-05-07T13:59:51.910461+0000","last_fullsized":"2024-05-07T13:59:51.910461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:51.910320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:51.910320+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.910320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:13.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'14","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.100728+0000","last_change":"2024-05-07T13:59:49.100756+0000","last_active":"2024-05-07T13:59:49.100728+0000","last_peered":"2024-05-07T13:59:49.100728+0000","last_clean":"2024-05-07T13:59:49.100728+0000","last_became_active":"2024-05-07T13:55:50.316253+0000","last_became_peered":"2024-05-07T13:55:50.316253+0000","last_unstale":"2024-05-07T13:59:49.100728+0000","last_undegraded":"2024-05-07T13:59:49.100728+0000","last_fullsized":"2024-05-07T13:59:49.100728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:49.100641+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:49.100641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.100641+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:44.946651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.198506+0000","last_change":"2024-05-07T13:59:59.198533+0000","last_active":"2024-05-07T13:59:59.198506+0000","last_peered":"2024-05-07T13:59:59.198506+0000","last_clean":"2024-05-07T13:59:59.198506+0000","last_became_active":"2024-05-07T13:55:48.323151+0000","last_became_peered":"2024-05-07T13:55:48.323151+0000","last_unstale":"2024-05-07T13:59:59.198506+0000","last_undegraded":"2024-05-07T13:59:59.198506+0000","last_fullsized":"2024-05-07T13:59:59.198506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:59.198410+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:59.198410+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.198410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:17.533202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:55.185191+0000","last_change":"2024-05-07T13:59:55.185213+0000","last_active":"2024-05-07T13:59:55.185191+0000","last_peered":"2024-05-07T13:59:55.185191+0000","last_clean":"2024-05-07T13:59:55.185191+0000","last_became_active":"2024-05-07T13:55:50.322066+0000","last_became_peered":"2024-05-07T13:55:50.322066+0000","last_unstale":"2024-05-07T13:59:55.185191+0000","last_undegraded":"2024-05-07T13:59:55.185191+0000","last_fullsized":"2024-05-07T13:59:55.185191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:55.185090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:55.185090+0000","last_clean_scrub_stamp":"2024-05-07T13:59:55.185090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:57:41.597583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.098344+0000","last_change":"2024-05-07T14:00:04.098378+0000","last_active":"2024-05-07T14:00:04.098344+0000","last_peered":"2024-05-07T14:00:04.098344+0000","last_clean":"2024-05-07T14:00:04.098344+0000","last_became_active":"2024-05-07T13:55:48.347661+0000","last_became_peered":"2024-05-07T13:55:48.347661+0000","last_unstale":"2024-05-07T14:00:04.098344+0000","last_undegraded":"2024-05-07T14:00:04.098344+0000","last_fullsized":"2024-05-07T14:00:04.098344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:04.098253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:04.098253+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.098253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:24:11.641731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.273171+0000","last_change":"2024-05-07T13:59:50.273197+0000","last_active":"2024-05-07T13:59:50.273171+0000","last_peered":"2024-05-07T13:59:50.273171+0000","last_clean":"2024-05-07T13:59:50.273171+0000","last_became_active":"2024-05-07T13:55:50.321598+0000","last_became_peered":"2024-05-07T13:55:50.321598+0000","last_unstale":"2024-05-07T13:59:50.273171+0000","last_undegraded":"2024-05-07T13:59:50.273171+0000","last_fullsized":"2024-05-07T13:59:50.273171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:50.273079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:50.273079+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.273079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:41.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.888847+0000","last_change":"2024-05-07T13:59:54.888873+0000","last_active":"2024-05-07T13:59:54.888847+0000","last_peered":"2024-05-07T13:59:54.888847+0000","last_clean":"2024-05-07T13:59:54.888847+0000","last_became_active":"2024-05-07T13:55:48.337418+0000","last_became_peered":"2024-05-07T13:55:48.337418+0000","last_unstale":"2024-05-07T13:59:54.888847+0000","last_undegraded":"2024-05-07T13:59:54.888847+0000","last_fullsized":"2024-05-07T13:59:54.888847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:54.888740+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:54.888740+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.888740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:50.734750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.873096+0000","last_change":"2024-05-07T14:00:01.873127+0000","last_active":"2024-05-07T14:00:01.873096+0000","last_peered":"2024-05-07T14:00:01.873096+0000","last_clean":"2024-05-07T14:00:01.873096+0000","last_became_active":"2024-05-07T13:56:35.366947+0000","last_became_peered":"2024-05-07T13:56:35.366947+0000","last_unstale":"2024-05-07T14:00:01.873096+0000","last_undegraded":"2024-05-07T14:00:01.873096+0000","last_fullsized":"2024-05-07T14:00:01.873096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:01.873006+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:01.873006+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.873006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:22:00.612116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:08.132135+0000","last_change":"2024-05-07T14:00:08.132159+0000","last_active":"2024-05-07T14:00:08.132135+0000","last_peered":"2024-05-07T14:00:08.132135+0000","last_clean":"2024-05-07T14:00:08.132135+0000","last_became_active":"2024-05-07T13:55:48.347714+0000","last_became_peered":"2024-05-07T13:55:48.347714+0000","last_unstale":"2024-05-07T14:00:08.132135+0000","last_undegraded":"2024-05-07T14:00:08.132135+0000","last_fullsized":"2024-05-07T14:00:08.132135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:08.132042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:08.132042+0000","last_clean_scrub_stamp":"2024-05-07T14:00:08.132042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:12:48.834991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.090564+0000","last_change":"2024-05-07T13:59:47.090564+0000","last_active":"2024-05-07T13:59:47.090564+0000","last_peered":"2024-05-07T13:59:47.090564+0000","last_clean":"2024-05-07T13:59:47.090564+0000","last_became_active":"2024-05-07T13:55:50.314660+0000","last_became_peered":"2024-05-07T13:55:50.314660+0000","last_unstale":"2024-05-07T13:59:47.090564+0000","last_undegraded":"2024-05-07T13:59:47.090564+0000","last_fullsized":"2024-05-07T13:59:47.090564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-07T13:59:47.090435+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-07T13:59:47.090435+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.090435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:22.240440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.153596+0000","last_change":"2024-05-07T13:59:43.153642+0000","last_active":"2024-05-07T13:59:43.153596+0000","last_peered":"2024-05-07T13:59:43.153596+0000","last_clean":"2024-05-07T13:59:43.153596+0000","last_became_active":"2024-05-07T13:55:48.337256+0000","last_became_peered":"2024-05-07T13:55:48.337256+0000","last_unstale":"2024-05-07T13:59:43.153596+0000","last_undegraded":"2024-05-07T13:59:43.153596+0000","last_fullsized":"2024-05-07T13:59:43.153596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:43.153472+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:43.153472+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.153472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:43.479597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.225152+0000","last_change":"2024-05-07T13:59:56.225152+0000","last_active":"2024-05-07T13:59:56.225152+0000","last_peered":"2024-05-07T13:59:56.225152+0000","last_clean":"2024-05-07T13:59:56.225152+0000","last_became_active":"2024-05-07T13:55:50.322204+0000","last_became_peered":"2024-05-07T13:55:50.322204+0000","last_unstale":"2024-05-07T13:59:56.225152+0000","last_undegraded":"2024-05-07T13:59:56.225152+0000","last_fullsized":"2024-05-07T13:59:56.225152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:56.225019+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:56.225019+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.225019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:31:35.247577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:18.186343+0000","last_change":"2024-05-07T14:00:18.186385+0000","last_active":"2024-05-07T14:00:18.186343+0000","last_peered":"2024-05-07T14:00:18.186343+0000","last_clean":"2024-05-07T14:00:18.186343+0000","last_became_active":"2024-05-07T13:55:48.347006+0000","last_became_peered":"2024-05-07T13:55:48.347006+0000","last_unstale":"2024-05-07T14:00:18.186343+0000","last_undegraded":"2024-05-07T14:00:18.186343+0000","last_fullsized":"2024-05-07T14:00:18.186343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:18.186252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:18.186252+0000","last_clean_scrub_stamp":"2024-05-07T14:00:18.186252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:24.119862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.065113+0000","last_change":"2024-05-07T13:59:34.065113+0000","last_active":"2024-05-07T13:59:34.065113+0000","last_peered":"2024-05-07T13:59:34.065113+0000","last_clean":"2024-05-07T13:59:34.065113+0000","last_became_active":"2024-05-07T13:55:50.312835+0000","last_became_peered":"2024-05-07T13:55:50.312835+0000","last_unstale":"2024-05-07T13:59:34.065113+0000","last_undegraded":"2024-05-07T13:59:34.065113+0000","last_fullsized":"2024-05-07T13:59:34.065113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:34.064991+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:34.064991+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.064991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:30.763581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.131455+0000","last_change":"2024-05-07T14:00:02.131481+0000","last_active":"2024-05-07T14:00:02.131455+0000","last_peered":"2024-05-07T14:00:02.131455+0000","last_clean":"2024-05-07T14:00:02.131455+0000","last_became_active":"2024-05-07T13:55:48.323612+0000","last_became_peered":"2024-05-07T13:55:48.323612+0000","last_unstale":"2024-05-07T14:00:02.131455+0000","last_undegraded":"2024-05-07T14:00:02.131455+0000","last_fullsized":"2024-05-07T14:00:02.131455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-07T14:00:02.131343+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-07T14:00:02.131343+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.131343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:38:31.297761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.099829+0000","last_change":"2024-05-07T13:59:46.099829+0000","last_active":"2024-05-07T13:59:46.099829+0000","last_peered":"2024-05-07T13:59:46.099829+0000","last_clean":"2024-05-07T13:59:46.099829+0000","last_became_active":"2024-05-07T13:55:50.325055+0000","last_became_peered":"2024-05-07T13:55:50.325055+0000","last_unstale":"2024-05-07T13:59:46.099829+0000","last_undegraded":"2024-05-07T13:59:46.099829+0000","last_fullsized":"2024-05-07T13:59:46.099829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:46.099644+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:46.099644+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.099644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:50.875891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'22","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.185762+0000","last_change":"2024-05-07T13:59:58.185788+0000","last_active":"2024-05-07T13:59:58.185762+0000","last_peered":"2024-05-07T13:59:58.185762+0000","last_clean":"2024-05-07T13:59:58.185762+0000","last_became_active":"2024-05-07T13:55:50.321385+0000","last_became_peered":"2024-05-07T13:55:50.321385+0000","last_unstale":"2024-05-07T13:59:58.185762+0000","last_undegraded":"2024-05-07T13:59:58.185762+0000","last_fullsized":"2024-05-07T13:59:58.185762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-07T13:59:58.185680+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-07T13:59:58.185680+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.185680+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:35:22.015706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.916292+0000","last_change":"2024-05-07T14:00:02.916321+0000","last_active":"2024-05-07T14:00:02.916292+0000","last_peered":"2024-05-07T14:00:02.916292+0000","last_clean":"2024-05-07T14:00:02.916292+0000","last_became_active":"2024-05-07T13:55:48.335213+0000","last_became_peered":"2024-05-07T13:55:48.335213+0000","last_unstale":"2024-05-07T14:00:02.916292+0000","last_undegraded":"2024-05-07T14:00:02.916292+0000","last_fullsized":"2024-05-07T14:00:02.916292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T14:00:02.916198+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T14:00:02.916198+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.916198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:21.250990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'16","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.067266+0000","last_change":"2024-05-07T13:59:41.067301+0000","last_active":"2024-05-07T13:59:41.067266+0000","last_peered":"2024-05-07T13:59:41.067266+0000","last_clean":"2024-05-07T13:59:41.067266+0000","last_became_active":"2024-05-07T13:55:50.313457+0000","last_became_peered":"2024-05-07T13:55:50.313457+0000","last_unstale":"2024-05-07T13:59:41.067266+0000","last_undegraded":"2024-05-07T13:59:41.067266+0000","last_fullsized":"2024-05-07T13:59:41.067266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:41.067158+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:41.067158+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.067158+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:23.103665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.104844+0000","last_change":"2024-05-07T13:59:37.104889+0000","last_active":"2024-05-07T13:59:37.104844+0000","last_peered":"2024-05-07T13:59:37.104844+0000","last_clean":"2024-05-07T13:59:37.104844+0000","last_became_active":"2024-05-07T13:55:48.340516+0000","last_became_peered":"2024-05-07T13:55:48.340516+0000","last_unstale":"2024-05-07T13:59:37.104844+0000","last_undegraded":"2024-05-07T13:59:37.104844+0000","last_fullsized":"2024-05-07T13:59:37.104844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:37.104722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:37.104722+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.104722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:59.079495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.022073+0000","last_change":"2024-05-07T13:59:43.022101+0000","last_active":"2024-05-07T13:59:43.022073+0000","last_peered":"2024-05-07T13:59:43.022073+0000","last_clean":"2024-05-07T13:59:43.022073+0000","last_became_active":"2024-05-07T13:55:50.313442+0000","last_became_peered":"2024-05-07T13:55:50.313442+0000","last_unstale":"2024-05-07T13:59:43.022073+0000","last_undegraded":"2024-05-07T13:59:43.022073+0000","last_fullsized":"2024-05-07T13:59:43.022073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:43.021976+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:43.021976+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.021976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:09.097926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.004534+0000","last_change":"2024-05-07T13:59:56.004588+0000","last_active":"2024-05-07T13:59:56.004534+0000","last_peered":"2024-05-07T13:59:56.004534+0000","last_clean":"2024-05-07T13:59:56.004534+0000","last_became_active":"2024-05-07T13:55:48.338589+0000","last_became_peered":"2024-05-07T13:55:48.338589+0000","last_unstale":"2024-05-07T13:59:56.004534+0000","last_undegraded":"2024-05-07T13:59:56.004534+0000","last_fullsized":"2024-05-07T13:59:56.004534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:56.004403+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:56.004403+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.004403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:54.743513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.043384+0000","last_change":"2024-05-07T13:59:37.043430+0000","last_active":"2024-05-07T13:59:37.043384+0000","last_peered":"2024-05-07T13:59:37.043384+0000","last_clean":"2024-05-07T13:59:37.043384+0000","last_became_active":"2024-05-07T13:55:50.328471+0000","last_became_peered":"2024-05-07T13:55:50.328471+0000","last_unstale":"2024-05-07T13:59:37.043384+0000","last_undegraded":"2024-05-07T13:59:37.043384+0000","last_fullsized":"2024-05-07T13:59:37.043384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:37.043289+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:37.043289+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.043289+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:19.079795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.047879+0000","last_change":"2024-05-07T13:59:52.047904+0000","last_active":"2024-05-07T13:59:52.047879+0000","last_peered":"2024-05-07T13:59:52.047879+0000","last_clean":"2024-05-07T13:59:52.047879+0000","last_became_active":"2024-05-07T13:55:48.340284+0000","last_became_peered":"2024-05-07T13:55:48.340284+0000","last_unstale":"2024-05-07T13:59:52.047879+0000","last_undegraded":"2024-05-07T13:59:52.047879+0000","last_fullsized":"2024-05-07T13:59:52.047879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:52.047788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:52.047788+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.047788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:40:09.958765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.170442+0000","last_change":"2024-05-07T13:59:42.170509+0000","last_active":"2024-05-07T13:59:42.170442+0000","last_peered":"2024-05-07T13:59:42.170442+0000","last_clean":"2024-05-07T13:59:42.170442+0000","last_became_active":"2024-05-07T13:55:50.322513+0000","last_became_peered":"2024-05-07T13:55:50.322513+0000","last_unstale":"2024-05-07T13:59:42.170442+0000","last_undegraded":"2024-05-07T13:59:42.170442+0000","last_fullsized":"2024-05-07T13:59:42.170442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:42.170338+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:42.170338+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.170338+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:03.826198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.123147+0000","last_change":"2024-05-07T13:59:53.123172+0000","last_active":"2024-05-07T13:59:53.123147+0000","last_peered":"2024-05-07T13:59:53.123147+0000","last_clean":"2024-05-07T13:59:53.123147+0000","last_became_active":"2024-05-07T13:55:48.325321+0000","last_became_peered":"2024-05-07T13:55:48.325321+0000","last_unstale":"2024-05-07T13:59:53.123147+0000","last_undegraded":"2024-05-07T13:59:53.123147+0000","last_fullsized":"2024-05-07T13:59:53.123147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:53.123049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:53.123049+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.123049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:29.780712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.981980+0000","last_change":"2024-05-07T13:59:54.982030+0000","last_active":"2024-05-07T13:59:54.981980+0000","last_peered":"2024-05-07T13:59:54.981980+0000","last_clean":"2024-05-07T13:59:54.981980+0000","last_became_active":"2024-05-07T13:55:50.322476+0000","last_became_peered":"2024-05-07T13:55:50.322476+0000","last_unstale":"2024-05-07T13:59:54.981980+0000","last_undegraded":"2024-05-07T13:59:54.981980+0000","last_fullsized":"2024-05-07T13:59:54.981980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:54.981876+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:54.981876+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.981876+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:27.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:07.102310+0000","last_change":"2024-05-07T14:00:07.102310+0000","last_active":"2024-05-07T14:00:07.102310+0000","last_peered":"2024-05-07T14:00:07.102310+0000","last_clean":"2024-05-07T14:00:07.102310+0000","last_became_active":"2024-05-07T13:55:48.348714+0000","last_became_peered":"2024-05-07T13:55:48.348714+0000","last_unstale":"2024-05-07T14:00:07.102310+0000","last_undegraded":"2024-05-07T14:00:07.102310+0000","last_fullsized":"2024-05-07T14:00:07.102310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:07.102163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:07.102163+0000","last_clean_scrub_stamp":"2024-05-07T14:00:07.102163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:27:32.277841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'38","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:08.961990+0000","last_change":"2024-05-07T14:00:08.962063+0000","last_active":"2024-05-07T14:00:08.961990+0000","last_peered":"2024-05-07T14:00:08.961990+0000","last_clean":"2024-05-07T14:00:08.961990+0000","last_became_active":"2024-05-07T13:55:58.347993+0000","last_became_peered":"2024-05-07T13:55:58.347993+0000","last_unstale":"2024-05-07T14:00:08.961990+0000","last_undegraded":"2024-05-07T14:00:08.961990+0000","last_fullsized":"2024-05-07T14:00:08.961990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-07T14:00:08.961881+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-07T14:00:08.961881+0000","last_clean_scrub_stamp":"2024-05-07T14:00:08.961881+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:27:43.597675+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.216561+0000","last_change":"2024-05-07T13:59:52.216587+0000","last_active":"2024-05-07T13:59:52.216561+0000","last_peered":"2024-05-07T13:59:52.216561+0000","last_clean":"2024-05-07T13:59:52.216561+0000","last_became_active":"2024-05-07T13:55:50.323355+0000","last_became_peered":"2024-05-07T13:55:50.323355+0000","last_unstale":"2024-05-07T13:59:52.216561+0000","last_undegraded":"2024-05-07T13:59:52.216561+0000","last_fullsized":"2024-05-07T13:59:52.216561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:52.216464+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:52.216464+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.216464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:13.424313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:15.204414+0000","last_change":"2024-05-07T14:00:15.204414+0000","last_active":"2024-05-07T14:00:15.204414+0000","last_peered":"2024-05-07T14:00:15.204414+0000","last_clean":"2024-05-07T14:00:15.204414+0000","last_became_active":"2024-05-07T13:55:48.350161+0000","last_became_peered":"2024-05-07T13:55:48.350161+0000","last_unstale":"2024-05-07T14:00:15.204414+0000","last_undegraded":"2024-05-07T14:00:15.204414+0000","last_fullsized":"2024-05-07T14:00:15.204414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:15.204281+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:15.204281+0000","last_clean_scrub_stamp":"2024-05-07T14:00:15.204281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:22:42.244133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.845677+0000","last_change":"2024-05-07T13:59:13.845708+0000","last_active":"2024-05-07T13:59:13.845677+0000","last_peered":"2024-05-07T13:59:13.845677+0000","last_clean":"2024-05-07T13:59:13.845677+0000","last_became_active":"2024-05-07T13:55:52.318966+0000","last_became_peered":"2024-05-07T13:55:52.318966+0000","last_unstale":"2024-05-07T13:59:13.845677+0000","last_undegraded":"2024-05-07T13:59:13.845677+0000","last_fullsized":"2024-05-07T13:59:13.845677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.845587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:14.171712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.069054+0000","last_change":"2024-05-07T13:59:38.069097+0000","last_active":"2024-05-07T13:59:38.069054+0000","last_peered":"2024-05-07T13:59:38.069054+0000","last_clean":"2024-05-07T13:59:38.069054+0000","last_became_active":"2024-05-07T13:55:54.331835+0000","last_became_peered":"2024-05-07T13:55:54.331835+0000","last_unstale":"2024-05-07T13:59:38.069054+0000","last_undegraded":"2024-05-07T13:59:38.069054+0000","last_fullsized":"2024-05-07T13:59:38.069054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-07T13:59:38.068965+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-07T13:59:38.068965+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.068965+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:29.318982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.049143+0000","last_change":"2024-05-07T13:59:23.049169+0000","last_active":"2024-05-07T13:59:23.049143+0000","last_peered":"2024-05-07T13:59:23.049143+0000","last_clean":"2024-05-07T13:59:23.049143+0000","last_became_active":"2024-05-07T13:55:56.338638+0000","last_became_peered":"2024-05-07T13:55:56.338638+0000","last_unstale":"2024-05-07T13:59:23.049143+0000","last_undegraded":"2024-05-07T13:59:23.049143+0000","last_fullsized":"2024-05-07T13:59:23.049143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.049049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:44:20.135960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'13","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:11.011758+0000","last_change":"2024-05-07T14:00:11.011801+0000","last_active":"2024-05-07T14:00:11.011758+0000","last_peered":"2024-05-07T14:00:11.011758+0000","last_clean":"2024-05-07T14:00:11.011758+0000","last_became_active":"2024-05-07T13:55:58.348341+0000","last_became_peered":"2024-05-07T13:55:58.348341+0000","last_unstale":"2024-05-07T14:00:11.011758+0000","last_undegraded":"2024-05-07T14:00:11.011758+0000","last_fullsized":"2024-05-07T14:00:11.011758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-05-07T14:00:11.011662+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-05-07T14:00:11.011662+0000","last_clean_scrub_stamp":"2024-05-07T14:00:11.011662+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:01:10.406823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.166127+0000","last_change":"2024-05-07T13:59:44.166197+0000","last_active":"2024-05-07T13:59:44.166127+0000","last_peered":"2024-05-07T13:59:44.166127+0000","last_clean":"2024-05-07T13:59:44.166127+0000","last_became_active":"2024-05-07T13:55:50.325201+0000","last_became_peered":"2024-05-07T13:55:50.325201+0000","last_unstale":"2024-05-07T13:59:44.166127+0000","last_undegraded":"2024-05-07T13:59:44.166127+0000","last_fullsized":"2024-05-07T13:59:44.166127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:44.166027+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:44.166027+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.166027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:48.666551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.852646+0000","last_change":"2024-05-07T13:59:56.852646+0000","last_active":"2024-05-07T13:59:56.852646+0000","last_peered":"2024-05-07T13:59:56.852646+0000","last_clean":"2024-05-07T13:59:56.852646+0000","last_became_active":"2024-05-07T13:55:48.338704+0000","last_became_peered":"2024-05-07T13:55:48.338704+0000","last_unstale":"2024-05-07T13:59:56.852646+0000","last_undegraded":"2024-05-07T13:59:56.852646+0000","last_fullsized":"2024-05-07T13:59:56.852646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:56.852511+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:56.852511+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.852511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:41.972519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:12.018605+0000","last_change":"2024-05-07T14:00:12.018627+0000","last_active":"2024-05-07T14:00:12.018605+0000","last_peered":"2024-05-07T14:00:12.018605+0000","last_clean":"2024-05-07T14:00:12.018605+0000","last_became_active":"2024-05-07T13:56:35.361623+0000","last_became_peered":"2024-05-07T13:56:35.361623+0000","last_unstale":"2024-05-07T14:00:12.018605+0000","last_undegraded":"2024-05-07T14:00:12.018605+0000","last_fullsized":"2024-05-07T14:00:12.018605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:12.018502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:12.018502+0000","last_clean_scrub_stamp":"2024-05-07T14:00:12.018502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:39.620956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.125797+0000","last_change":"2024-05-07T13:59:12.125828+0000","last_active":"2024-05-07T13:59:12.125797+0000","last_peered":"2024-05-07T13:59:12.125797+0000","last_clean":"2024-05-07T13:59:12.125797+0000","last_became_active":"2024-05-07T13:55:54.333402+0000","last_became_peered":"2024-05-07T13:55:54.333402+0000","last_unstale":"2024-05-07T13:59:12.125797+0000","last_undegraded":"2024-05-07T13:59:12.125797+0000","last_fullsized":"2024-05-07T13:59:12.125797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.125709+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:10.791591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.010782+0000","last_change":"2024-05-07T13:59:19.010859+0000","last_active":"2024-05-07T13:59:19.010782+0000","last_peered":"2024-05-07T13:59:19.010782+0000","last_clean":"2024-05-07T13:59:19.010782+0000","last_became_active":"2024-05-07T13:55:56.335463+0000","last_became_peered":"2024-05-07T13:55:56.335463+0000","last_unstale":"2024-05-07T13:59:19.010782+0000","last_undegraded":"2024-05-07T13:59:19.010782+0000","last_fullsized":"2024-05-07T13:59:19.010782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.010674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:27.103094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:07.101518+0000","last_change":"2024-05-07T14:00:07.101546+0000","last_active":"2024-05-07T14:00:07.101518+0000","last_peered":"2024-05-07T14:00:07.101518+0000","last_clean":"2024-05-07T14:00:07.101518+0000","last_became_active":"2024-05-07T13:55:58.340688+0000","last_became_peered":"2024-05-07T13:55:58.340688+0000","last_unstale":"2024-05-07T14:00:07.101518+0000","last_undegraded":"2024-05-07T14:00:07.101518+0000","last_fullsized":"2024-05-07T14:00:07.101518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T14:00:07.101412+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T14:00:07.101412+0000","last_clean_scrub_stamp":"2024-05-07T14:00:07.101412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:05:50.740119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.165617+0000","last_change":"2024-05-07T13:59:47.165656+0000","last_active":"2024-05-07T13:59:47.165617+0000","last_peered":"2024-05-07T13:59:47.165617+0000","last_clean":"2024-05-07T13:59:47.165617+0000","last_became_active":"2024-05-07T13:55:50.323775+0000","last_became_peered":"2024-05-07T13:55:50.323775+0000","last_unstale":"2024-05-07T13:59:47.165617+0000","last_undegraded":"2024-05-07T13:59:47.165617+0000","last_fullsized":"2024-05-07T13:59:47.165617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:47.165529+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:47.165529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.165529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:40:02.425709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:06.096751+0000","last_change":"2024-05-07T14:00:06.096751+0000","last_active":"2024-05-07T14:00:06.096751+0000","last_peered":"2024-05-07T14:00:06.096751+0000","last_clean":"2024-05-07T14:00:06.096751+0000","last_became_active":"2024-05-07T13:55:48.349636+0000","last_became_peered":"2024-05-07T13:55:48.349636+0000","last_unstale":"2024-05-07T14:00:06.096751+0000","last_undegraded":"2024-05-07T14:00:06.096751+0000","last_fullsized":"2024-05-07T14:00:06.096751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:06.096608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:06.096608+0000","last_clean_scrub_stamp":"2024-05-07T14:00:06.096608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:42:01.919712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.889687+0000","last_change":"2024-05-07T14:00:02.889730+0000","last_active":"2024-05-07T14:00:02.889687+0000","last_peered":"2024-05-07T14:00:02.889687+0000","last_clean":"2024-05-07T14:00:02.889687+0000","last_became_active":"2024-05-07T13:56:35.370109+0000","last_became_peered":"2024-05-07T13:56:35.370109+0000","last_unstale":"2024-05-07T14:00:02.889687+0000","last_undegraded":"2024-05-07T14:00:02.889687+0000","last_fullsized":"2024-05-07T14:00:02.889687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:02.889568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:02.889568+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.889568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:39.547231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.187173+0000","last_change":"2024-05-07T13:59:22.187264+0000","last_active":"2024-05-07T13:59:22.187173+0000","last_peered":"2024-05-07T13:59:22.187173+0000","last_clean":"2024-05-07T13:59:22.187173+0000","last_became_active":"2024-05-07T13:55:54.327178+0000","last_became_peered":"2024-05-07T13:55:54.327178+0000","last_unstale":"2024-05-07T13:59:22.187173+0000","last_undegraded":"2024-05-07T13:59:22.187173+0000","last_fullsized":"2024-05-07T13:59:22.187173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.187065+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:32.587195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.169072+0000","last_change":"2024-05-07T13:59:45.169121+0000","last_active":"2024-05-07T13:59:45.169072+0000","last_peered":"2024-05-07T13:59:45.169072+0000","last_clean":"2024-05-07T13:59:45.169072+0000","last_became_active":"2024-05-07T13:55:56.345712+0000","last_became_peered":"2024-05-07T13:55:56.345712+0000","last_unstale":"2024-05-07T13:59:45.169072+0000","last_undegraded":"2024-05-07T13:59:45.169072+0000","last_fullsized":"2024-05-07T13:59:45.169072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-05-07T13:59:45.168931+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-05-07T13:59:45.168931+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.168931+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:31:55.102005+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.162805+0000","last_change":"2024-05-07T13:59:28.162826+0000","last_active":"2024-05-07T13:59:28.162805+0000","last_peered":"2024-05-07T13:59:28.162805+0000","last_clean":"2024-05-07T13:59:28.162805+0000","last_became_active":"2024-05-07T13:55:58.339825+0000","last_became_peered":"2024-05-07T13:55:58.339825+0000","last_unstale":"2024-05-07T13:59:28.162805+0000","last_undegraded":"2024-05-07T13:59:28.162805+0000","last_fullsized":"2024-05-07T13:59:28.162805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.162716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:49.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.074088+0000","last_change":"2024-05-07T13:59:52.074112+0000","last_active":"2024-05-07T13:59:52.074088+0000","last_peered":"2024-05-07T13:59:52.074088+0000","last_clean":"2024-05-07T13:59:52.074088+0000","last_became_active":"2024-05-07T13:55:50.318502+0000","last_became_peered":"2024-05-07T13:55:50.318502+0000","last_unstale":"2024-05-07T13:59:52.074088+0000","last_undegraded":"2024-05-07T13:59:52.074088+0000","last_fullsized":"2024-05-07T13:59:52.074088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:52.074006+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:52.074006+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.074006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:50.813115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.052825+0000","last_change":"2024-05-07T13:59:46.052825+0000","last_active":"2024-05-07T13:59:46.052825+0000","last_peered":"2024-05-07T13:59:46.052825+0000","last_clean":"2024-05-07T13:59:46.052825+0000","last_became_active":"2024-05-07T13:55:48.345080+0000","last_became_peered":"2024-05-07T13:55:48.345080+0000","last_unstale":"2024-05-07T13:59:46.052825+0000","last_undegraded":"2024-05-07T13:59:46.052825+0000","last_fullsized":"2024-05-07T13:59:46.052825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:46.052643+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:46.052643+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.052643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:07.843171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.860466+0000","last_change":"2024-05-07T13:59:18.860501+0000","last_active":"2024-05-07T13:59:18.860466+0000","last_peered":"2024-05-07T13:59:18.860466+0000","last_clean":"2024-05-07T13:59:18.860466+0000","last_became_active":"2024-05-07T13:55:52.318178+0000","last_became_peered":"2024-05-07T13:55:52.318178+0000","last_unstale":"2024-05-07T13:59:18.860466+0000","last_undegraded":"2024-05-07T13:59:18.860466+0000","last_fullsized":"2024-05-07T13:59:18.860466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.860344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:31:08.364202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'37","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.065120+0000","last_change":"2024-05-07T13:59:17.065153+0000","last_active":"2024-05-07T13:59:17.065120+0000","last_peered":"2024-05-07T13:59:17.065120+0000","last_clean":"2024-05-07T13:59:17.065120+0000","last_became_active":"2024-05-07T13:55:54.330662+0000","last_became_peered":"2024-05-07T13:55:54.330662+0000","last_unstale":"2024-05-07T13:59:17.065120+0000","last_undegraded":"2024-05-07T13:59:17.065120+0000","last_fullsized":"2024-05-07T13:59:17.065120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.065035+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:20.830603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.894290+0000","last_change":"2024-05-07T13:59:10.894332+0000","last_active":"2024-05-07T13:59:10.894290+0000","last_peered":"2024-05-07T13:59:10.894290+0000","last_clean":"2024-05-07T13:59:10.894290+0000","last_became_active":"2024-05-07T13:55:56.334111+0000","last_became_peered":"2024-05-07T13:55:56.334111+0000","last_unstale":"2024-05-07T13:59:10.894290+0000","last_undegraded":"2024-05-07T13:59:10.894290+0000","last_fullsized":"2024-05-07T13:59:10.894290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.894211+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:00.735952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'11","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.031904+0000","last_change":"2024-05-07T13:59:27.031904+0000","last_active":"2024-05-07T13:59:27.031904+0000","last_peered":"2024-05-07T13:59:27.031904+0000","last_clean":"2024-05-07T13:59:27.031904+0000","last_became_active":"2024-05-07T13:55:50.324820+0000","last_became_peered":"2024-05-07T13:55:50.324820+0000","last_unstale":"2024-05-07T13:59:27.031904+0000","last_undegraded":"2024-05-07T13:59:27.031904+0000","last_fullsized":"2024-05-07T13:59:27.031904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.031775+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:22.190354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.956851+0000","last_change":"2024-05-07T13:59:50.956851+0000","last_active":"2024-05-07T13:59:50.956851+0000","last_peered":"2024-05-07T13:59:50.956851+0000","last_clean":"2024-05-07T13:59:50.956851+0000","last_became_active":"2024-05-07T13:55:48.335443+0000","last_became_peered":"2024-05-07T13:55:48.335443+0000","last_unstale":"2024-05-07T13:59:50.956851+0000","last_undegraded":"2024-05-07T13:59:50.956851+0000","last_fullsized":"2024-05-07T13:59:50.956851+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:50.956641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:50.956641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.956641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:52:07.720957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.073496+0000","last_change":"2024-05-07T13:59:24.073496+0000","last_active":"2024-05-07T13:59:24.073496+0000","last_peered":"2024-05-07T13:59:24.073496+0000","last_clean":"2024-05-07T13:59:24.073496+0000","last_became_active":"2024-05-07T13:55:52.322188+0000","last_became_peered":"2024-05-07T13:55:52.322188+0000","last_unstale":"2024-05-07T13:59:24.073496+0000","last_undegraded":"2024-05-07T13:59:24.073496+0000","last_fullsized":"2024-05-07T13:59:24.073496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.073340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:13.708665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.081901+0000","last_change":"2024-05-07T13:59:18.081901+0000","last_active":"2024-05-07T13:59:18.081901+0000","last_peered":"2024-05-07T13:59:18.081901+0000","last_clean":"2024-05-07T13:59:18.081901+0000","last_became_active":"2024-05-07T13:55:54.330401+0000","last_became_peered":"2024-05-07T13:55:54.330401+0000","last_unstale":"2024-05-07T13:59:18.081901+0000","last_undegraded":"2024-05-07T13:59:18.081901+0000","last_fullsized":"2024-05-07T13:59:18.081901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.081750+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:16:16.381571+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.945668+0000","last_change":"2024-05-07T13:59:13.945668+0000","last_active":"2024-05-07T13:59:13.945668+0000","last_peered":"2024-05-07T13:59:13.945668+0000","last_clean":"2024-05-07T13:59:13.945668+0000","last_became_active":"2024-05-07T13:55:56.334368+0000","last_became_peered":"2024-05-07T13:55:56.334368+0000","last_unstale":"2024-05-07T13:59:13.945668+0000","last_undegraded":"2024-05-07T13:59:13.945668+0000","last_fullsized":"2024-05-07T13:59:13.945668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.945550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:11.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.843455+0000","last_change":"2024-05-07T13:59:58.843455+0000","last_active":"2024-05-07T13:59:58.843455+0000","last_peered":"2024-05-07T13:59:58.843455+0000","last_clean":"2024-05-07T13:59:58.843455+0000","last_became_active":"2024-05-07T13:55:58.346457+0000","last_became_peered":"2024-05-07T13:55:58.346457+0000","last_unstale":"2024-05-07T13:59:58.843455+0000","last_undegraded":"2024-05-07T13:59:58.843455+0000","last_fullsized":"2024-05-07T13:59:58.843455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T13:59:58.843311+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T13:59:58.843311+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.843311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:52.140951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.050463+0000","last_change":"2024-05-07T13:59:44.050463+0000","last_active":"2024-05-07T13:59:44.050463+0000","last_peered":"2024-05-07T13:59:44.050463+0000","last_clean":"2024-05-07T13:59:44.050463+0000","last_became_active":"2024-05-07T13:55:50.312564+0000","last_became_peered":"2024-05-07T13:55:50.312564+0000","last_unstale":"2024-05-07T13:59:44.050463+0000","last_undegraded":"2024-05-07T13:59:44.050463+0000","last_fullsized":"2024-05-07T13:59:44.050463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:44.050311+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:44.050311+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.050311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:31.285519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.933051+0000","last_change":"2024-05-07T13:59:52.933051+0000","last_active":"2024-05-07T13:59:52.933051+0000","last_peered":"2024-05-07T13:59:52.933051+0000","last_clean":"2024-05-07T13:59:52.933051+0000","last_became_active":"2024-05-07T13:55:48.335791+0000","last_became_peered":"2024-05-07T13:55:48.335791+0000","last_unstale":"2024-05-07T13:59:52.933051+0000","last_undegraded":"2024-05-07T13:59:52.933051+0000","last_fullsized":"2024-05-07T13:59:52.933051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:52.932909+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:52.932909+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.932909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:28.082914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.088805+0000","last_change":"2024-05-07T13:59:27.088805+0000","last_active":"2024-05-07T13:59:27.088805+0000","last_peered":"2024-05-07T13:59:27.088805+0000","last_clean":"2024-05-07T13:59:27.088805+0000","last_became_active":"2024-05-07T13:55:52.325676+0000","last_became_peered":"2024-05-07T13:55:52.325676+0000","last_unstale":"2024-05-07T13:59:27.088805+0000","last_undegraded":"2024-05-07T13:59:27.088805+0000","last_fullsized":"2024-05-07T13:59:27.088805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.088632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:08.861590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.053158+0000","last_change":"2024-05-07T13:59:35.053158+0000","last_active":"2024-05-07T13:59:35.053158+0000","last_peered":"2024-05-07T13:59:35.053158+0000","last_clean":"2024-05-07T13:59:35.053158+0000","last_became_active":"2024-05-07T13:55:54.331979+0000","last_became_peered":"2024-05-07T13:55:54.331979+0000","last_unstale":"2024-05-07T13:59:35.053158+0000","last_undegraded":"2024-05-07T13:59:35.053158+0000","last_fullsized":"2024-05-07T13:59:35.053158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:35.053039+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:35.053039+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.053039+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:39.918537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.927307+0000","last_change":"2024-05-07T13:59:12.927307+0000","last_active":"2024-05-07T13:59:12.927307+0000","last_peered":"2024-05-07T13:59:12.927307+0000","last_clean":"2024-05-07T13:59:12.927307+0000","last_became_active":"2024-05-07T13:55:56.333357+0000","last_became_peered":"2024-05-07T13:55:56.333357+0000","last_unstale":"2024-05-07T13:59:12.927307+0000","last_undegraded":"2024-05-07T13:59:12.927307+0000","last_fullsized":"2024-05-07T13:59:12.927307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.927183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:18.128049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.070919+0000","last_change":"2024-05-07T13:59:35.070919+0000","last_active":"2024-05-07T13:59:35.070919+0000","last_peered":"2024-05-07T13:59:35.070919+0000","last_clean":"2024-05-07T13:59:35.070919+0000","last_became_active":"2024-05-07T13:55:58.344955+0000","last_became_peered":"2024-05-07T13:55:58.344955+0000","last_unstale":"2024-05-07T13:59:35.070919+0000","last_undegraded":"2024-05-07T13:59:35.070919+0000","last_fullsized":"2024-05-07T13:59:35.070919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:35.070796+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:35.070796+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.070796+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:54.753266+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.890156+0000","last_change":"2024-05-07T13:59:57.890156+0000","last_active":"2024-05-07T13:59:57.890156+0000","last_peered":"2024-05-07T13:59:57.890156+0000","last_clean":"2024-05-07T13:59:57.890156+0000","last_became_active":"2024-05-07T13:55:50.327059+0000","last_became_peered":"2024-05-07T13:55:50.327059+0000","last_unstale":"2024-05-07T13:59:57.890156+0000","last_undegraded":"2024-05-07T13:59:57.890156+0000","last_fullsized":"2024-05-07T13:59:57.890156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:57.889977+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:57.889977+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.889977+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:40:15.800954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.126658+0000","last_change":"2024-05-07T14:00:03.126658+0000","last_active":"2024-05-07T14:00:03.126658+0000","last_peered":"2024-05-07T14:00:03.126658+0000","last_clean":"2024-05-07T14:00:03.126658+0000","last_became_active":"2024-05-07T13:55:48.350442+0000","last_became_peered":"2024-05-07T13:55:48.350442+0000","last_unstale":"2024-05-07T14:00:03.126658+0000","last_undegraded":"2024-05-07T14:00:03.126658+0000","last_fullsized":"2024-05-07T14:00:03.126658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:03.126502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:03.126502+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.126502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:54:47.586769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.008644+0000","last_change":"2024-05-07T13:59:31.008644+0000","last_active":"2024-05-07T13:59:31.008644+0000","last_peered":"2024-05-07T13:59:31.008644+0000","last_clean":"2024-05-07T13:59:31.008644+0000","last_became_active":"2024-05-07T13:55:52.321674+0000","last_became_peered":"2024-05-07T13:55:52.321674+0000","last_unstale":"2024-05-07T13:59:31.008644+0000","last_undegraded":"2024-05-07T13:59:31.008644+0000","last_fullsized":"2024-05-07T13:59:31.008644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.008529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.008529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.008529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:13.357119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.831318+0000","last_change":"2024-05-07T13:59:14.831318+0000","last_active":"2024-05-07T13:59:14.831318+0000","last_peered":"2024-05-07T13:59:14.831318+0000","last_clean":"2024-05-07T13:59:14.831318+0000","last_became_active":"2024-05-07T13:55:54.325336+0000","last_became_peered":"2024-05-07T13:55:54.325336+0000","last_unstale":"2024-05-07T13:59:14.831318+0000","last_undegraded":"2024-05-07T13:59:14.831318+0000","last_fullsized":"2024-05-07T13:59:14.831318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.831128+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:26:59.956651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":367,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.962101+0000","last_change":"2024-05-07T13:59:17.962101+0000","last_active":"2024-05-07T13:59:17.962101+0000","last_peered":"2024-05-07T13:59:17.962101+0000","last_clean":"2024-05-07T13:59:17.962101+0000","last_became_active":"2024-05-07T13:55:56.334895+0000","last_became_peered":"2024-05-07T13:55:56.334895+0000","last_unstale":"2024-05-07T13:59:17.962101+0000","last_undegraded":"2024-05-07T13:59:17.962101+0000","last_fullsized":"2024-05-07T13:59:17.962101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.961985+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:39.314908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:06.098595+0000","last_change":"2024-05-07T14:00:06.098595+0000","last_active":"2024-05-07T14:00:06.098595+0000","last_peered":"2024-05-07T14:00:06.098595+0000","last_clean":"2024-05-07T14:00:06.098595+0000","last_became_active":"2024-05-07T13:55:58.340764+0000","last_became_peered":"2024-05-07T13:55:58.340764+0000","last_unstale":"2024-05-07T14:00:06.098595+0000","last_undegraded":"2024-05-07T14:00:06.098595+0000","last_fullsized":"2024-05-07T14:00:06.098595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:06.098465+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:06.098465+0000","last_clean_scrub_stamp":"2024-05-07T14:00:06.098465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:01:05.493626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'12","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.114438+0000","last_change":"2024-05-07T13:59:38.114438+0000","last_active":"2024-05-07T13:59:38.114438+0000","last_peered":"2024-05-07T13:59:38.114438+0000","last_clean":"2024-05-07T13:59:38.114438+0000","last_became_active":"2024-05-07T13:55:50.312649+0000","last_became_peered":"2024-05-07T13:55:50.312649+0000","last_unstale":"2024-05-07T13:59:38.114438+0000","last_undegraded":"2024-05-07T13:59:38.114438+0000","last_fullsized":"2024-05-07T13:59:38.114438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:38.114264+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:38.114264+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.114264+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:14:52.055884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:26.221506+0000","last_change":"2024-05-07T14:00:26.221559+0000","last_active":"2024-05-07T14:00:26.221506+0000","last_peered":"2024-05-07T14:00:26.221506+0000","last_clean":"2024-05-07T14:00:26.221506+0000","last_became_active":"2024-05-07T13:55:48.346027+0000","last_became_peered":"2024-05-07T13:55:48.346027+0000","last_unstale":"2024-05-07T14:00:26.221506+0000","last_undegraded":"2024-05-07T14:00:26.221506+0000","last_fullsized":"2024-05-07T14:00:26.221506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:26.221367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:26.221367+0000","last_clean_scrub_stamp":"2024-05-07T14:00:26.221367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:05.778287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.054894+0000","last_change":"2024-05-07T13:59:28.054894+0000","last_active":"2024-05-07T13:59:28.054894+0000","last_peered":"2024-05-07T13:59:28.054894+0000","last_clean":"2024-05-07T13:59:28.054894+0000","last_became_active":"2024-05-07T13:55:52.325427+0000","last_became_peered":"2024-05-07T13:55:52.325427+0000","last_unstale":"2024-05-07T13:59:28.054894+0000","last_undegraded":"2024-05-07T13:59:28.054894+0000","last_fullsized":"2024-05-07T13:59:28.054894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.054722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:47.334525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'63","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.081043+0000","last_change":"2024-05-07T13:59:34.081043+0000","last_active":"2024-05-07T13:59:34.081043+0000","last_peered":"2024-05-07T13:59:34.081043+0000","last_clean":"2024-05-07T13:59:34.081043+0000","last_became_active":"2024-05-07T13:55:54.334315+0000","last_became_peered":"2024-05-07T13:55:54.334315+0000","last_unstale":"2024-05-07T13:59:34.081043+0000","last_undegraded":"2024-05-07T13:59:34.081043+0000","last_fullsized":"2024-05-07T13:59:34.081043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-07T13:59:34.080919+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-07T13:59:34.080919+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.080919+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:10.738582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.917820+0000","last_change":"2024-05-07T13:59:16.917820+0000","last_active":"2024-05-07T13:59:16.917820+0000","last_peered":"2024-05-07T13:59:16.917820+0000","last_clean":"2024-05-07T13:59:16.917820+0000","last_became_active":"2024-05-07T13:55:56.330355+0000","last_became_peered":"2024-05-07T13:55:56.330355+0000","last_unstale":"2024-05-07T13:59:16.917820+0000","last_undegraded":"2024-05-07T13:59:16.917820+0000","last_fullsized":"2024-05-07T13:59:16.917820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.917702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:29.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.010583+0000","last_change":"2024-05-07T13:59:34.010583+0000","last_active":"2024-05-07T13:59:34.010583+0000","last_peered":"2024-05-07T13:59:34.010583+0000","last_clean":"2024-05-07T13:59:34.010583+0000","last_became_active":"2024-05-07T13:55:58.336692+0000","last_became_peered":"2024-05-07T13:55:58.336692+0000","last_unstale":"2024-05-07T13:59:34.010583+0000","last_undegraded":"2024-05-07T13:59:34.010583+0000","last_fullsized":"2024-05-07T13:59:34.010583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:34.010409+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:34.010409+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.010409+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:23.971858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.957267+0000","last_change":"2024-05-07T14:00:04.957267+0000","last_active":"2024-05-07T14:00:04.957267+0000","last_peered":"2024-05-07T14:00:04.957267+0000","last_clean":"2024-05-07T14:00:04.957267+0000","last_became_active":"2024-05-07T13:55:50.322764+0000","last_became_peered":"2024-05-07T13:55:50.322764+0000","last_unstale":"2024-05-07T14:00:04.957267+0000","last_undegraded":"2024-05-07T14:00:04.957267+0000","last_fullsized":"2024-05-07T14:00:04.957267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T14:00:04.957162+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T14:00:04.957162+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.957162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:34:40.825959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:55.201411+0000","last_change":"2024-05-07T13:59:55.201411+0000","last_active":"2024-05-07T13:59:55.201411+0000","last_peered":"2024-05-07T13:59:55.201411+0000","last_clean":"2024-05-07T13:59:55.201411+0000","last_became_active":"2024-05-07T13:55:48.325075+0000","last_became_peered":"2024-05-07T13:55:48.325075+0000","last_unstale":"2024-05-07T13:59:55.201411+0000","last_undegraded":"2024-05-07T13:59:55.201411+0000","last_fullsized":"2024-05-07T13:59:55.201411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:55.201253+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:55.201253+0000","last_clean_scrub_stamp":"2024-05-07T13:59:55.201253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:23.579779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.138879+0000","last_change":"2024-05-07T13:59:29.138879+0000","last_active":"2024-05-07T13:59:29.138879+0000","last_peered":"2024-05-07T13:59:29.138879+0000","last_clean":"2024-05-07T13:59:29.138879+0000","last_became_active":"2024-05-07T13:55:52.321730+0000","last_became_peered":"2024-05-07T13:55:52.321730+0000","last_unstale":"2024-05-07T13:59:29.138879+0000","last_undegraded":"2024-05-07T13:59:29.138879+0000","last_fullsized":"2024-05-07T13:59:29.138879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:29.138750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:29.138750+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.138750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:09.782425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'41","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.091397+0000","last_change":"2024-05-07T13:59:17.091397+0000","last_active":"2024-05-07T13:59:17.091397+0000","last_peered":"2024-05-07T13:59:17.091397+0000","last_clean":"2024-05-07T13:59:17.091397+0000","last_became_active":"2024-05-07T13:55:54.324530+0000","last_became_peered":"2024-05-07T13:55:54.324530+0000","last_unstale":"2024-05-07T13:59:17.091397+0000","last_undegraded":"2024-05-07T13:59:17.091397+0000","last_fullsized":"2024-05-07T13:59:17.091397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.091253+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:22.292118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.984243+0000","last_change":"2024-05-07T13:59:30.984243+0000","last_active":"2024-05-07T13:59:30.984243+0000","last_peered":"2024-05-07T13:59:30.984243+0000","last_clean":"2024-05-07T13:59:30.984243+0000","last_became_active":"2024-05-07T13:55:56.343900+0000","last_became_peered":"2024-05-07T13:55:56.343900+0000","last_unstale":"2024-05-07T13:59:30.984243+0000","last_undegraded":"2024-05-07T13:59:30.984243+0000","last_fullsized":"2024-05-07T13:59:30.984243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.984114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.984114+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.984114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:14.143436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.518237+0000","last_change":"2024-05-07T13:55:58.352050+0000","last_active":"2024-05-07T13:59:10.518237+0000","last_peered":"2024-05-07T13:59:10.518237+0000","last_clean":"2024-05-07T13:59:10.518237+0000","last_became_active":"2024-05-07T13:55:58.351724+0000","last_became_peered":"2024-05-07T13:55:58.351724+0000","last_unstale":"2024-05-07T13:59:10.518237+0000","last_undegraded":"2024-05-07T13:59:10.518237+0000","last_fullsized":"2024-05-07T13:59:10.518237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.842752+0000","last_change":"2024-05-07T13:59:21.842752+0000","last_active":"2024-05-07T13:59:21.842752+0000","last_peered":"2024-05-07T13:59:21.842752+0000","last_clean":"2024-05-07T13:59:21.842752+0000","last_became_active":"2024-05-07T13:55:50.326050+0000","last_became_peered":"2024-05-07T13:55:50.326050+0000","last_unstale":"2024-05-07T13:59:21.842752+0000","last_undegraded":"2024-05-07T13:59:21.842752+0000","last_fullsized":"2024-05-07T13:59:21.842752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.842623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:38.606939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:17.169773+0000","last_change":"2024-05-07T14:00:17.169836+0000","last_active":"2024-05-07T14:00:17.169773+0000","last_peered":"2024-05-07T14:00:17.169773+0000","last_clean":"2024-05-07T14:00:17.169773+0000","last_became_active":"2024-05-07T13:55:48.350335+0000","last_became_peered":"2024-05-07T13:55:48.350335+0000","last_unstale":"2024-05-07T14:00:17.169773+0000","last_undegraded":"2024-05-07T14:00:17.169773+0000","last_fullsized":"2024-05-07T14:00:17.169773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:17.169672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:17.169672+0000","last_clean_scrub_stamp":"2024-05-07T14:00:17.169672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:44:42.128993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'2","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.050888+0000","last_change":"2024-05-07T13:59:29.050888+0000","last_active":"2024-05-07T13:59:29.050888+0000","last_peered":"2024-05-07T13:59:29.050888+0000","last_clean":"2024-05-07T13:59:29.050888+0000","last_became_active":"2024-05-07T13:55:52.322006+0000","last_became_peered":"2024-05-07T13:55:52.322006+0000","last_unstale":"2024-05-07T13:59:29.050888+0000","last_undegraded":"2024-05-07T13:59:29.050888+0000","last_fullsized":"2024-05-07T13:59:29.050888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:29.050679+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:29.050679+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.050679+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:28.253848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.102617+0000","last_change":"2024-05-07T13:59:25.102617+0000","last_active":"2024-05-07T13:59:25.102617+0000","last_peered":"2024-05-07T13:59:25.102617+0000","last_clean":"2024-05-07T13:59:25.102617+0000","last_became_active":"2024-05-07T13:55:54.319812+0000","last_became_peered":"2024-05-07T13:55:54.319812+0000","last_unstale":"2024-05-07T13:59:25.102617+0000","last_undegraded":"2024-05-07T13:59:25.102617+0000","last_fullsized":"2024-05-07T13:59:25.102617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.102469+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:25.507214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":443,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.102102+0000","last_change":"2024-05-07T13:59:11.102102+0000","last_active":"2024-05-07T13:59:11.102102+0000","last_peered":"2024-05-07T13:59:11.102102+0000","last_clean":"2024-05-07T13:59:11.102102+0000","last_became_active":"2024-05-07T13:55:56.331966+0000","last_became_peered":"2024-05-07T13:55:56.331966+0000","last_unstale":"2024-05-07T13:59:11.102102+0000","last_undegraded":"2024-05-07T13:59:11.102102+0000","last_fullsized":"2024-05-07T13:59:11.102102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.101988+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:35.873097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'21","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.051692+0000","last_change":"2024-05-07T13:59:38.051692+0000","last_active":"2024-05-07T13:59:38.051692+0000","last_peered":"2024-05-07T13:59:38.051692+0000","last_clean":"2024-05-07T13:59:38.051692+0000","last_became_active":"2024-05-07T13:55:58.340608+0000","last_became_peered":"2024-05-07T13:55:58.340608+0000","last_unstale":"2024-05-07T13:59:38.051692+0000","last_undegraded":"2024-05-07T13:59:38.051692+0000","last_fullsized":"2024-05-07T13:59:38.051692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:38.051568+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:38.051568+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.051568+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:32.852712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.106440+0000","last_change":"2024-05-07T13:59:44.106440+0000","last_active":"2024-05-07T13:59:44.106440+0000","last_peered":"2024-05-07T13:59:44.106440+0000","last_clean":"2024-05-07T13:59:44.106440+0000","last_became_active":"2024-05-07T13:55:50.322650+0000","last_became_peered":"2024-05-07T13:55:50.322650+0000","last_unstale":"2024-05-07T13:59:44.106440+0000","last_undegraded":"2024-05-07T13:59:44.106440+0000","last_fullsized":"2024-05-07T13:59:44.106440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:44.106305+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:44.106305+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.106305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:34.067754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:12.165642+0000","last_change":"2024-05-07T14:00:12.165675+0000","last_active":"2024-05-07T14:00:12.165642+0000","last_peered":"2024-05-07T14:00:12.165642+0000","last_clean":"2024-05-07T14:00:12.165642+0000","last_became_active":"2024-05-07T13:55:48.347434+0000","last_became_peered":"2024-05-07T13:55:48.347434+0000","last_unstale":"2024-05-07T14:00:12.165642+0000","last_undegraded":"2024-05-07T14:00:12.165642+0000","last_fullsized":"2024-05-07T14:00:12.165642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:12.165550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:12.165550+0000","last_clean_scrub_stamp":"2024-05-07T14:00:12.165550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:19:50.586404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.028855+0000","last_change":"2024-05-07T13:59:25.028855+0000","last_active":"2024-05-07T13:59:25.028855+0000","last_peered":"2024-05-07T13:59:25.028855+0000","last_clean":"2024-05-07T13:59:25.028855+0000","last_became_active":"2024-05-07T13:55:52.321251+0000","last_became_peered":"2024-05-07T13:55:52.321251+0000","last_unstale":"2024-05-07T13:59:25.028855+0000","last_undegraded":"2024-05-07T13:59:25.028855+0000","last_fullsized":"2024-05-07T13:59:25.028855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.028700+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:12.963826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.075367+0000","last_change":"2024-05-07T13:59:36.075367+0000","last_active":"2024-05-07T13:59:36.075367+0000","last_peered":"2024-05-07T13:59:36.075367+0000","last_clean":"2024-05-07T13:59:36.075367+0000","last_became_active":"2024-05-07T13:55:54.331844+0000","last_became_peered":"2024-05-07T13:55:54.331844+0000","last_unstale":"2024-05-07T13:59:36.075367+0000","last_undegraded":"2024-05-07T13:59:36.075367+0000","last_fullsized":"2024-05-07T13:59:36.075367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:36.075220+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:36.075220+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.075220+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:04.453746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.078526+0000","last_change":"2024-05-07T13:59:15.078526+0000","last_active":"2024-05-07T13:59:15.078526+0000","last_peered":"2024-05-07T13:59:15.078526+0000","last_clean":"2024-05-07T13:59:15.078526+0000","last_became_active":"2024-05-07T13:55:56.332858+0000","last_became_peered":"2024-05-07T13:55:56.332858+0000","last_unstale":"2024-05-07T13:59:15.078526+0000","last_undegraded":"2024-05-07T13:59:15.078526+0000","last_fullsized":"2024-05-07T13:59:15.078526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078412+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:04.920152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.107497+0000","last_change":"2024-05-07T13:59:24.107497+0000","last_active":"2024-05-07T13:59:24.107497+0000","last_peered":"2024-05-07T13:59:24.107497+0000","last_clean":"2024-05-07T13:59:24.107497+0000","last_became_active":"2024-05-07T13:55:58.335341+0000","last_became_peered":"2024-05-07T13:55:58.335341+0000","last_unstale":"2024-05-07T13:59:24.107497+0000","last_undegraded":"2024-05-07T13:59:24.107497+0000","last_fullsized":"2024-05-07T13:59:24.107497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.107327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:21.412357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'5","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.039705+0000","last_change":"2024-05-07T13:59:29.039705+0000","last_active":"2024-05-07T13:59:29.039705+0000","last_peered":"2024-05-07T13:59:29.039705+0000","last_clean":"2024-05-07T13:59:29.039705+0000","last_became_active":"2024-05-07T13:55:50.331295+0000","last_became_peered":"2024-05-07T13:55:50.331295+0000","last_unstale":"2024-05-07T13:59:29.039705+0000","last_undegraded":"2024-05-07T13:59:29.039705+0000","last_fullsized":"2024-05-07T13:59:29.039705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:29.039589+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:29.039589+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.039589+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:05.611702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.138775+0000","last_change":"2024-05-07T14:00:00.138775+0000","last_active":"2024-05-07T14:00:00.138775+0000","last_peered":"2024-05-07T14:00:00.138775+0000","last_clean":"2024-05-07T14:00:00.138775+0000","last_became_active":"2024-05-07T13:55:48.351055+0000","last_became_peered":"2024-05-07T13:55:48.351055+0000","last_unstale":"2024-05-07T14:00:00.138775+0000","last_undegraded":"2024-05-07T14:00:00.138775+0000","last_fullsized":"2024-05-07T14:00:00.138775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.138659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.138659+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.138659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:34.608921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"29'5","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.888832+0000","last_change":"2024-05-07T13:59:11.888832+0000","last_active":"2024-05-07T13:59:11.888832+0000","last_peered":"2024-05-07T13:59:11.888832+0000","last_clean":"2024-05-07T13:59:11.888832+0000","last_became_active":"2024-05-07T13:55:52.320027+0000","last_became_peered":"2024-05-07T13:55:52.320027+0000","last_unstale":"2024-05-07T13:59:11.888832+0000","last_undegraded":"2024-05-07T13:59:11.888832+0000","last_fullsized":"2024-05-07T13:59:11.888832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.888710+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:38:54.237300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'49","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.067275+0000","last_change":"2024-05-07T13:59:10.067275+0000","last_active":"2024-05-07T13:59:10.067275+0000","last_peered":"2024-05-07T13:59:10.067275+0000","last_clean":"2024-05-07T13:59:10.067275+0000","last_became_active":"2024-05-07T13:55:54.333766+0000","last_became_peered":"2024-05-07T13:55:54.333766+0000","last_unstale":"2024-05-07T13:59:10.067275+0000","last_undegraded":"2024-05-07T13:59:10.067275+0000","last_fullsized":"2024-05-07T13:59:10.067275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.067149+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:19.058798+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.069535+0000","last_change":"2024-05-07T13:59:12.069535+0000","last_active":"2024-05-07T13:59:12.069535+0000","last_peered":"2024-05-07T13:59:12.069535+0000","last_clean":"2024-05-07T13:59:12.069535+0000","last_became_active":"2024-05-07T13:55:56.338195+0000","last_became_peered":"2024-05-07T13:55:56.338195+0000","last_unstale":"2024-05-07T13:59:12.069535+0000","last_undegraded":"2024-05-07T13:59:12.069535+0000","last_fullsized":"2024-05-07T13:59:12.069535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.069419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:19:55.425213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:05.979447+0000","last_change":"2024-05-07T14:00:05.979447+0000","last_active":"2024-05-07T14:00:05.979447+0000","last_peered":"2024-05-07T14:00:05.979447+0000","last_clean":"2024-05-07T14:00:05.979447+0000","last_became_active":"2024-05-07T13:55:58.346040+0000","last_became_peered":"2024-05-07T13:55:58.346040+0000","last_unstale":"2024-05-07T14:00:05.979447+0000","last_undegraded":"2024-05-07T14:00:05.979447+0000","last_fullsized":"2024-05-07T14:00:05.979447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-07T14:00:05.979333+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-07T14:00:05.979333+0000","last_clean_scrub_stamp":"2024-05-07T14:00:05.979333+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:17:00.089927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'16","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.895902+0000","last_change":"2024-05-07T14:00:03.895973+0000","last_active":"2024-05-07T14:00:03.895902+0000","last_peered":"2024-05-07T14:00:03.895902+0000","last_clean":"2024-05-07T14:00:03.895902+0000","last_became_active":"2024-05-07T13:56:35.369148+0000","last_became_peered":"2024-05-07T13:56:35.369148+0000","last_unstale":"2024-05-07T14:00:03.895902+0000","last_undegraded":"2024-05-07T14:00:03.895902+0000","last_fullsized":"2024-05-07T14:00:03.895902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T14:00:03.895789+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T14:00:03.895789+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.895789+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:45:08.761287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.004137+0000","last_change":"2024-05-07T13:59:57.004204+0000","last_active":"2024-05-07T13:59:57.004137+0000","last_peered":"2024-05-07T13:59:57.004137+0000","last_clean":"2024-05-07T13:59:57.004137+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:59:57.004137+0000","last_undegraded":"2024-05-07T13:59:57.004137+0000","last_fullsized":"2024-05-07T13:59:57.004137+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-05-07T13:59:57.004031+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-05-07T13:59:57.004031+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.004031+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:33.661694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:23.325332+0000","last_change":"2024-05-07T14:00:23.325367+0000","last_active":"2024-05-07T14:00:23.325332+0000","last_peered":"2024-05-07T14:00:23.325332+0000","last_clean":"2024-05-07T14:00:23.325332+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T14:00:23.325332+0000","last_undegraded":"2024-05-07T14:00:23.325332+0000","last_fullsized":"2024-05-07T14:00:23.325332+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:23.325234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:23.325234+0000","last_clean_scrub_stamp":"2024-05-07T14:00:23.325234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:36:01.523750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.150595+0000","last_change":"2024-05-07T14:00:02.150624+0000","last_active":"2024-05-07T14:00:02.150595+0000","last_peered":"2024-05-07T14:00:02.150595+0000","last_clean":"2024-05-07T14:00:02.150595+0000","last_became_active":"2024-05-07T13:55:48.350998+0000","last_became_peered":"2024-05-07T13:55:48.350998+0000","last_unstale":"2024-05-07T14:00:02.150595+0000","last_undegraded":"2024-05-07T14:00:02.150595+0000","last_fullsized":"2024-05-07T14:00:02.150595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T14:00:02.150501+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T14:00:02.150501+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.150501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:43.337012+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.053567+0000","last_change":"2024-05-07T13:59:28.053567+0000","last_active":"2024-05-07T13:59:28.053567+0000","last_peered":"2024-05-07T13:59:28.053567+0000","last_clean":"2024-05-07T13:59:28.053567+0000","last_became_active":"2024-05-07T13:55:52.321406+0000","last_became_peered":"2024-05-07T13:55:52.321406+0000","last_unstale":"2024-05-07T13:59:28.053567+0000","last_undegraded":"2024-05-07T13:59:28.053567+0000","last_fullsized":"2024-05-07T13:59:28.053567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.053456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:40.818094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.891601+0000","last_change":"2024-05-07T13:59:22.891601+0000","last_active":"2024-05-07T13:59:22.891601+0000","last_peered":"2024-05-07T13:59:22.891601+0000","last_clean":"2024-05-07T13:59:22.891601+0000","last_became_active":"2024-05-07T13:55:54.328677+0000","last_became_peered":"2024-05-07T13:55:54.328677+0000","last_unstale":"2024-05-07T13:59:22.891601+0000","last_undegraded":"2024-05-07T13:59:22.891601+0000","last_fullsized":"2024-05-07T13:59:22.891601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.891465+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:38.858949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.993105+0000","last_change":"2024-05-07T13:59:21.993105+0000","last_active":"2024-05-07T13:59:21.993105+0000","last_peered":"2024-05-07T13:59:21.993105+0000","last_clean":"2024-05-07T13:59:21.993105+0000","last_became_active":"2024-05-07T13:55:56.335013+0000","last_became_peered":"2024-05-07T13:55:56.335013+0000","last_unstale":"2024-05-07T13:59:21.993105+0000","last_undegraded":"2024-05-07T13:59:21.993105+0000","last_fullsized":"2024-05-07T13:59:21.993105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.992994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:07:21.511355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'82","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.141198+0000","last_change":"2024-05-07T13:59:20.141198+0000","last_active":"2024-05-07T13:59:20.141198+0000","last_peered":"2024-05-07T13:59:20.141198+0000","last_clean":"2024-05-07T13:59:20.141198+0000","last_became_active":"2024-05-07T13:55:58.335220+0000","last_became_peered":"2024-05-07T13:55:58.335220+0000","last_unstale":"2024-05-07T13:59:20.141198+0000","last_undegraded":"2024-05-07T13:59:20.141198+0000","last_fullsized":"2024-05-07T13:59:20.141198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.141061+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:19.754291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.184294+0000","last_change":"2024-05-07T13:59:48.184294+0000","last_active":"2024-05-07T13:59:48.184294+0000","last_peered":"2024-05-07T13:59:48.184294+0000","last_clean":"2024-05-07T13:59:48.184294+0000","last_became_active":"2024-05-07T13:55:50.323408+0000","last_became_peered":"2024-05-07T13:55:50.323408+0000","last_unstale":"2024-05-07T13:59:48.184294+0000","last_undegraded":"2024-05-07T13:59:48.184294+0000","last_fullsized":"2024-05-07T13:59:48.184294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:48.184128+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:48.184128+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.184128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:05:31.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:19.204957+0000","last_change":"2024-05-07T14:00:19.204986+0000","last_active":"2024-05-07T14:00:19.204957+0000","last_peered":"2024-05-07T14:00:19.204957+0000","last_clean":"2024-05-07T14:00:19.204957+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T14:00:19.204957+0000","last_undegraded":"2024-05-07T14:00:19.204957+0000","last_fullsized":"2024-05-07T14:00:19.204957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:19.204863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:19.204863+0000","last_clean_scrub_stamp":"2024-05-07T14:00:19.204863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:55.971116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.128078+0000","last_change":"2024-05-07T13:59:43.128078+0000","last_active":"2024-05-07T13:59:43.128078+0000","last_peered":"2024-05-07T13:59:43.128078+0000","last_clean":"2024-05-07T13:59:43.128078+0000","last_became_active":"2024-05-07T13:55:48.325905+0000","last_became_peered":"2024-05-07T13:55:48.325905+0000","last_unstale":"2024-05-07T13:59:43.128078+0000","last_undegraded":"2024-05-07T13:59:43.128078+0000","last_fullsized":"2024-05-07T13:59:43.128078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:43.127954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:43.127954+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.127954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:34.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.859922+0000","last_change":"2024-05-07T13:59:17.859922+0000","last_active":"2024-05-07T13:59:17.859922+0000","last_peered":"2024-05-07T13:59:17.859922+0000","last_clean":"2024-05-07T13:59:17.859922+0000","last_became_active":"2024-05-07T13:55:52.318221+0000","last_became_peered":"2024-05-07T13:55:52.318221+0000","last_unstale":"2024-05-07T13:59:17.859922+0000","last_undegraded":"2024-05-07T13:59:17.859922+0000","last_fullsized":"2024-05-07T13:59:17.859922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.859806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:59.896313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.121985+0000","last_change":"2024-05-07T13:59:14.121985+0000","last_active":"2024-05-07T13:59:14.121985+0000","last_peered":"2024-05-07T13:59:14.121985+0000","last_clean":"2024-05-07T13:59:14.121985+0000","last_became_active":"2024-05-07T13:55:54.329774+0000","last_became_peered":"2024-05-07T13:55:54.329774+0000","last_unstale":"2024-05-07T13:59:14.121985+0000","last_undegraded":"2024-05-07T13:59:14.121985+0000","last_fullsized":"2024-05-07T13:59:14.121985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.121829+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:13.735059+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.058168+0000","last_change":"2024-05-07T13:59:33.058168+0000","last_active":"2024-05-07T13:59:33.058168+0000","last_peered":"2024-05-07T13:59:33.058168+0000","last_clean":"2024-05-07T13:59:33.058168+0000","last_became_active":"2024-05-07T13:55:56.343224+0000","last_became_peered":"2024-05-07T13:55:56.343224+0000","last_unstale":"2024-05-07T13:59:33.058168+0000","last_undegraded":"2024-05-07T13:59:33.058168+0000","last_fullsized":"2024-05-07T13:59:33.058168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:33.058058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:33.058058+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.058058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:31.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.076744+0000","last_change":"2024-05-07T13:59:39.076744+0000","last_active":"2024-05-07T13:59:39.076744+0000","last_peered":"2024-05-07T13:59:39.076744+0000","last_clean":"2024-05-07T13:59:39.076744+0000","last_became_active":"2024-05-07T13:55:58.344996+0000","last_became_peered":"2024-05-07T13:55:58.344996+0000","last_unstale":"2024-05-07T13:59:39.076744+0000","last_undegraded":"2024-05-07T13:59:39.076744+0000","last_fullsized":"2024-05-07T13:59:39.076744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:39.076601+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:39.076601+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.076601+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:24:16.973175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.071620+0000","last_change":"2024-05-07T13:59:48.071620+0000","last_active":"2024-05-07T13:59:48.071620+0000","last_peered":"2024-05-07T13:59:48.071620+0000","last_clean":"2024-05-07T13:59:48.071620+0000","last_became_active":"2024-05-07T13:55:50.318471+0000","last_became_peered":"2024-05-07T13:55:50.318471+0000","last_unstale":"2024-05-07T13:59:48.071620+0000","last_undegraded":"2024-05-07T13:59:48.071620+0000","last_fullsized":"2024-05-07T13:59:48.071620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:48.071503+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:48.071503+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.071503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:22.255533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.988080+0000","last_change":"2024-05-07T13:59:49.988108+0000","last_active":"2024-05-07T13:59:49.988080+0000","last_peered":"2024-05-07T13:59:49.988080+0000","last_clean":"2024-05-07T13:59:49.988080+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:59:49.988080+0000","last_undegraded":"2024-05-07T13:59:49.988080+0000","last_fullsized":"2024-05-07T13:59:49.988080+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.987988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.987988+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.987988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:37.223196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.086185+0000","last_change":"2024-05-07T13:59:49.086219+0000","last_active":"2024-05-07T13:59:49.086185+0000","last_peered":"2024-05-07T13:59:49.086185+0000","last_clean":"2024-05-07T13:59:49.086185+0000","last_became_active":"2024-05-07T13:55:48.325013+0000","last_became_peered":"2024-05-07T13:55:48.325013+0000","last_unstale":"2024-05-07T13:59:49.086185+0000","last_undegraded":"2024-05-07T13:59:49.086185+0000","last_fullsized":"2024-05-07T13:59:49.086185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.086089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.086089+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.086089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:42.383729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.874466+0000","last_change":"2024-05-07T14:00:04.874466+0000","last_active":"2024-05-07T14:00:04.874466+0000","last_peered":"2024-05-07T14:00:04.874466+0000","last_clean":"2024-05-07T14:00:04.874466+0000","last_became_active":"2024-05-07T13:56:35.368904+0000","last_became_peered":"2024-05-07T13:56:35.368904+0000","last_unstale":"2024-05-07T14:00:04.874466+0000","last_undegraded":"2024-05-07T14:00:04.874466+0000","last_fullsized":"2024-05-07T14:00:04.874466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:04.874325+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:04.874325+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.874325+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:33.252851+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.147329+0000","last_change":"2024-05-07T13:59:21.147329+0000","last_active":"2024-05-07T13:59:21.147329+0000","last_peered":"2024-05-07T13:59:21.147329+0000","last_clean":"2024-05-07T13:59:21.147329+0000","last_became_active":"2024-05-07T13:55:54.329778+0000","last_became_peered":"2024-05-07T13:55:54.329778+0000","last_unstale":"2024-05-07T13:59:21.147329+0000","last_undegraded":"2024-05-07T13:59:21.147329+0000","last_fullsized":"2024-05-07T13:59:21.147329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.147200+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:14:48.234250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.061795+0000","last_change":"2024-05-07T13:59:26.061795+0000","last_active":"2024-05-07T13:59:26.061795+0000","last_peered":"2024-05-07T13:59:26.061795+0000","last_clean":"2024-05-07T13:59:26.061795+0000","last_became_active":"2024-05-07T13:55:56.336064+0000","last_became_peered":"2024-05-07T13:55:56.336064+0000","last_unstale":"2024-05-07T13:59:26.061795+0000","last_undegraded":"2024-05-07T13:59:26.061795+0000","last_fullsized":"2024-05-07T13:59:26.061795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.061660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:02.633772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.518252+0000","last_change":"2024-05-07T13:55:58.350552+0000","last_active":"2024-05-07T13:59:10.518252+0000","last_peered":"2024-05-07T13:59:10.518252+0000","last_clean":"2024-05-07T13:59:10.518252+0000","last_became_active":"2024-05-07T13:55:58.350208+0000","last_became_peered":"2024-05-07T13:55:58.350208+0000","last_unstale":"2024-05-07T13:59:10.518252+0000","last_undegraded":"2024-05-07T13:59:10.518252+0000","last_fullsized":"2024-05-07T13:59:10.518252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.147024+0000","last_change":"2024-05-07T13:59:46.147024+0000","last_active":"2024-05-07T13:59:46.147024+0000","last_peered":"2024-05-07T13:59:46.147024+0000","last_clean":"2024-05-07T13:59:46.147024+0000","last_became_active":"2024-05-07T13:55:50.313163+0000","last_became_peered":"2024-05-07T13:55:50.313163+0000","last_unstale":"2024-05-07T13:59:46.147024+0000","last_undegraded":"2024-05-07T13:59:46.147024+0000","last_fullsized":"2024-05-07T13:59:46.147024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:46.146906+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:46.146906+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.146906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:41.305486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:22.336078+0000","last_change":"2024-05-07T14:00:22.336100+0000","last_active":"2024-05-07T14:00:22.336078+0000","last_peered":"2024-05-07T14:00:22.336078+0000","last_clean":"2024-05-07T14:00:22.336078+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T14:00:22.336078+0000","last_undegraded":"2024-05-07T14:00:22.336078+0000","last_fullsized":"2024-05-07T14:00:22.336078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:22.335987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:22.335987+0000","last_clean_scrub_stamp":"2024-05-07T14:00:22.335987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:54.789383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:55.875626+0000","last_change":"2024-05-07T13:59:55.875626+0000","last_active":"2024-05-07T13:59:55.875626+0000","last_peered":"2024-05-07T13:59:55.875626+0000","last_clean":"2024-05-07T13:59:55.875626+0000","last_became_active":"2024-05-07T13:55:48.338442+0000","last_became_peered":"2024-05-07T13:55:48.338442+0000","last_unstale":"2024-05-07T13:59:55.875626+0000","last_undegraded":"2024-05-07T13:59:55.875626+0000","last_fullsized":"2024-05-07T13:59:55.875626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:55.875457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:55.875457+0000","last_clean_scrub_stamp":"2024-05-07T13:59:55.875457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:51.034037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.005460+0000","last_change":"2024-05-07T13:59:32.005460+0000","last_active":"2024-05-07T13:59:32.005460+0000","last_peered":"2024-05-07T13:59:32.005460+0000","last_clean":"2024-05-07T13:59:32.005460+0000","last_became_active":"2024-05-07T13:55:52.321506+0000","last_became_peered":"2024-05-07T13:55:52.321506+0000","last_unstale":"2024-05-07T13:59:32.005460+0000","last_undegraded":"2024-05-07T13:59:32.005460+0000","last_fullsized":"2024-05-07T13:59:32.005460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.005333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.005333+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.005333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:53.661193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'22","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.983843+0000","last_change":"2024-05-07T13:59:24.983843+0000","last_active":"2024-05-07T13:59:24.983843+0000","last_peered":"2024-05-07T13:59:24.983843+0000","last_clean":"2024-05-07T13:59:24.983843+0000","last_became_active":"2024-05-07T13:55:54.328763+0000","last_became_peered":"2024-05-07T13:55:54.328763+0000","last_unstale":"2024-05-07T13:59:24.983843+0000","last_undegraded":"2024-05-07T13:59:24.983843+0000","last_fullsized":"2024-05-07T13:59:24.983843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.983703+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:59.173853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.014388+0000","last_change":"2024-05-07T13:59:32.014388+0000","last_active":"2024-05-07T13:59:32.014388+0000","last_peered":"2024-05-07T13:59:32.014388+0000","last_clean":"2024-05-07T13:59:32.014388+0000","last_became_active":"2024-05-07T13:55:56.343131+0000","last_became_peered":"2024-05-07T13:55:56.343131+0000","last_unstale":"2024-05-07T13:59:32.014388+0000","last_undegraded":"2024-05-07T13:59:32.014388+0000","last_fullsized":"2024-05-07T13:59:32.014388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.014263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.014263+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.014263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:11:56.176284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:09.996634+0000","last_change":"2024-05-07T14:00:09.996634+0000","last_active":"2024-05-07T14:00:09.996634+0000","last_peered":"2024-05-07T14:00:09.996634+0000","last_clean":"2024-05-07T14:00:09.996634+0000","last_became_active":"2024-05-07T13:55:58.348068+0000","last_became_peered":"2024-05-07T13:55:58.348068+0000","last_unstale":"2024-05-07T14:00:09.996634+0000","last_undegraded":"2024-05-07T14:00:09.996634+0000","last_fullsized":"2024-05-07T14:00:09.996634+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:09.996470+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:09.996470+0000","last_clean_scrub_stamp":"2024-05-07T14:00:09.996470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:18.668653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'14","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.092977+0000","last_change":"2024-05-07T13:59:38.092977+0000","last_active":"2024-05-07T13:59:38.092977+0000","last_peered":"2024-05-07T13:59:38.092977+0000","last_clean":"2024-05-07T13:59:38.092977+0000","last_became_active":"2024-05-07T13:55:50.323820+0000","last_became_peered":"2024-05-07T13:55:50.323820+0000","last_unstale":"2024-05-07T13:59:38.092977+0000","last_undegraded":"2024-05-07T13:59:38.092977+0000","last_fullsized":"2024-05-07T13:59:38.092977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:38.092855+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:38.092855+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.092855+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:57.688105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.031920+0000","last_change":"2024-05-07T13:59:49.031920+0000","last_active":"2024-05-07T13:59:49.031920+0000","last_peered":"2024-05-07T13:59:49.031920+0000","last_clean":"2024-05-07T13:59:49.031920+0000","last_became_active":"2024-05-07T13:55:48.338139+0000","last_became_peered":"2024-05-07T13:55:48.338139+0000","last_unstale":"2024-05-07T13:59:49.031920+0000","last_undegraded":"2024-05-07T13:59:49.031920+0000","last_fullsized":"2024-05-07T13:59:49.031920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.031788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.031788+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.031788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:15.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.216260+0000","last_change":"2024-05-07T13:59:56.216304+0000","last_active":"2024-05-07T13:59:56.216260+0000","last_peered":"2024-05-07T13:59:56.216260+0000","last_clean":"2024-05-07T13:59:56.216260+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:59:56.216260+0000","last_undegraded":"2024-05-07T13:59:56.216260+0000","last_fullsized":"2024-05-07T13:59:56.216260+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:56.216155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:56.216155+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.216155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:51:13.276042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.010339+0000","last_change":"2024-05-07T13:59:33.010339+0000","last_active":"2024-05-07T13:59:33.010339+0000","last_peered":"2024-05-07T13:59:33.010339+0000","last_clean":"2024-05-07T13:59:33.010339+0000","last_became_active":"2024-05-07T13:55:52.321249+0000","last_became_peered":"2024-05-07T13:55:52.321249+0000","last_unstale":"2024-05-07T13:59:33.010339+0000","last_undegraded":"2024-05-07T13:59:33.010339+0000","last_fullsized":"2024-05-07T13:59:33.010339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.010232+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.010232+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.010232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:33.336357+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'74","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.980067+0000","last_change":"2024-05-07T13:59:20.980067+0000","last_active":"2024-05-07T13:59:20.980067+0000","last_peered":"2024-05-07T13:59:20.980067+0000","last_clean":"2024-05-07T13:59:20.980067+0000","last_became_active":"2024-05-07T13:55:54.326812+0000","last_became_peered":"2024-05-07T13:55:54.326812+0000","last_unstale":"2024-05-07T13:59:20.980067+0000","last_undegraded":"2024-05-07T13:59:20.980067+0000","last_fullsized":"2024-05-07T13:59:20.980067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.979917+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:21.832415+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.116256+0000","last_change":"2024-05-07T13:59:13.116256+0000","last_active":"2024-05-07T13:59:13.116256+0000","last_peered":"2024-05-07T13:59:13.116256+0000","last_clean":"2024-05-07T13:59:13.116256+0000","last_became_active":"2024-05-07T13:55:56.331343+0000","last_became_peered":"2024-05-07T13:55:56.331343+0000","last_unstale":"2024-05-07T13:59:13.116256+0000","last_undegraded":"2024-05-07T13:59:13.116256+0000","last_fullsized":"2024-05-07T13:59:13.116256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.116129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:37.954463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'11","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:10.088955+0000","last_change":"2024-05-07T14:00:10.088955+0000","last_active":"2024-05-07T14:00:10.088955+0000","last_peered":"2024-05-07T14:00:10.088955+0000","last_clean":"2024-05-07T14:00:10.088955+0000","last_became_active":"2024-05-07T13:55:58.347566+0000","last_became_peered":"2024-05-07T13:55:58.347566+0000","last_unstale":"2024-05-07T14:00:10.088955+0000","last_undegraded":"2024-05-07T14:00:10.088955+0000","last_fullsized":"2024-05-07T14:00:10.088955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-07T14:00:10.088835+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-07T14:00:10.088835+0000","last_clean_scrub_stamp":"2024-05-07T14:00:10.088835+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:31:45.322682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'8","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.061535+0000","last_change":"2024-05-07T13:59:30.061535+0000","last_active":"2024-05-07T13:59:30.061535+0000","last_peered":"2024-05-07T13:59:30.061535+0000","last_clean":"2024-05-07T13:59:30.061535+0000","last_became_active":"2024-05-07T13:55:50.330547+0000","last_became_peered":"2024-05-07T13:55:50.330547+0000","last_unstale":"2024-05-07T13:59:30.061535+0000","last_undegraded":"2024-05-07T13:59:30.061535+0000","last_fullsized":"2024-05-07T13:59:30.061535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:30.061415+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:30.061415+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.061415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:52.036188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.111799+0000","last_change":"2024-05-07T14:00:01.111847+0000","last_active":"2024-05-07T14:00:01.111799+0000","last_peered":"2024-05-07T14:00:01.111799+0000","last_clean":"2024-05-07T14:00:01.111799+0000","last_became_active":"2024-05-07T13:55:48.324378+0000","last_became_peered":"2024-05-07T13:55:48.324378+0000","last_unstale":"2024-05-07T14:00:01.111799+0000","last_undegraded":"2024-05-07T14:00:01.111799+0000","last_fullsized":"2024-05-07T14:00:01.111799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:01.111703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:01.111703+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.111703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:34:36.980500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:21.292378+0000","last_change":"2024-05-07T14:00:21.292455+0000","last_active":"2024-05-07T14:00:21.292378+0000","last_peered":"2024-05-07T14:00:21.292378+0000","last_clean":"2024-05-07T14:00:21.292378+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T14:00:21.292378+0000","last_undegraded":"2024-05-07T14:00:21.292378+0000","last_fullsized":"2024-05-07T14:00:21.292378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:21.292247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:21.292247+0000","last_clean_scrub_stamp":"2024-05-07T14:00:21.292247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:01:31.566378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.855760+0000","last_change":"2024-05-07T14:00:00.855799+0000","last_active":"2024-05-07T14:00:00.855760+0000","last_peered":"2024-05-07T14:00:00.855760+0000","last_clean":"2024-05-07T14:00:00.855760+0000","last_became_active":"2024-05-07T13:56:35.366075+0000","last_became_peered":"2024-05-07T13:56:35.366075+0000","last_unstale":"2024-05-07T14:00:00.855760+0000","last_undegraded":"2024-05-07T14:00:00.855760+0000","last_fullsized":"2024-05-07T14:00:00.855760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.855661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.855661+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.855661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:12:25.017681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"29'21","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.152407+0000","last_change":"2024-05-07T13:59:13.152407+0000","last_active":"2024-05-07T13:59:13.152407+0000","last_peered":"2024-05-07T13:59:13.152407+0000","last_clean":"2024-05-07T13:59:13.152407+0000","last_became_active":"2024-05-07T13:55:54.330896+0000","last_became_peered":"2024-05-07T13:55:54.330896+0000","last_unstale":"2024-05-07T13:59:13.152407+0000","last_undegraded":"2024-05-07T13:59:13.152407+0000","last_fullsized":"2024-05-07T13:59:13.152407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.152223+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.463262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.085692+0000","last_change":"2024-05-07T13:59:27.085692+0000","last_active":"2024-05-07T13:59:27.085692+0000","last_peered":"2024-05-07T13:59:27.085692+0000","last_clean":"2024-05-07T13:59:27.085692+0000","last_became_active":"2024-05-07T13:55:56.333242+0000","last_became_peered":"2024-05-07T13:55:56.333242+0000","last_unstale":"2024-05-07T13:59:27.085692+0000","last_undegraded":"2024-05-07T13:59:27.085692+0000","last_fullsized":"2024-05-07T13:59:27.085692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.085530+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:23.784119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.217771+0000","last_change":"2024-05-07T13:59:53.217771+0000","last_active":"2024-05-07T13:59:53.217771+0000","last_peered":"2024-05-07T13:59:53.217771+0000","last_clean":"2024-05-07T13:59:53.217771+0000","last_became_active":"2024-05-07T13:55:58.346295+0000","last_became_peered":"2024-05-07T13:55:58.346295+0000","last_unstale":"2024-05-07T13:59:53.217771+0000","last_undegraded":"2024-05-07T13:59:53.217771+0000","last_fullsized":"2024-05-07T13:59:53.217771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:53.217633+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:53.217633+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.217633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:19:36.621308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.139684+0000","last_change":"2024-05-07T13:59:43.139684+0000","last_active":"2024-05-07T13:59:43.139684+0000","last_peered":"2024-05-07T13:59:43.139684+0000","last_clean":"2024-05-07T13:59:43.139684+0000","last_became_active":"2024-05-07T13:55:50.325665+0000","last_became_peered":"2024-05-07T13:55:50.325665+0000","last_unstale":"2024-05-07T13:59:43.139684+0000","last_undegraded":"2024-05-07T13:59:43.139684+0000","last_fullsized":"2024-05-07T13:59:43.139684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:43.139573+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:43.139573+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.139573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:38:12.305990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:25.264849+0000","last_change":"2024-05-07T14:00:25.264875+0000","last_active":"2024-05-07T14:00:25.264849+0000","last_peered":"2024-05-07T14:00:25.264849+0000","last_clean":"2024-05-07T14:00:25.264849+0000","last_became_active":"2024-05-07T13:55:48.346645+0000","last_became_peered":"2024-05-07T13:55:48.346645+0000","last_unstale":"2024-05-07T14:00:25.264849+0000","last_undegraded":"2024-05-07T14:00:25.264849+0000","last_fullsized":"2024-05-07T14:00:25.264849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:25.264754+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:25.264754+0000","last_clean_scrub_stamp":"2024-05-07T14:00:25.264754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:26.317932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.188866+0000","last_change":"2024-05-07T13:59:57.188866+0000","last_active":"2024-05-07T13:59:57.188866+0000","last_peered":"2024-05-07T13:59:57.188866+0000","last_clean":"2024-05-07T13:59:57.188866+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:59:57.188866+0000","last_undegraded":"2024-05-07T13:59:57.188866+0000","last_fullsized":"2024-05-07T13:59:57.188866+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:57.188686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:57.188686+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.188686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:48.438703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.842021+0000","last_change":"2024-05-07T13:59:12.842021+0000","last_active":"2024-05-07T13:59:12.842021+0000","last_peered":"2024-05-07T13:59:12.842021+0000","last_clean":"2024-05-07T13:59:12.842021+0000","last_became_active":"2024-05-07T13:55:52.321160+0000","last_became_peered":"2024-05-07T13:55:52.321160+0000","last_unstale":"2024-05-07T13:59:12.842021+0000","last_undegraded":"2024-05-07T13:59:12.842021+0000","last_fullsized":"2024-05-07T13:59:12.842021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.841853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:34.497713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.104664+0000","last_change":"2024-05-07T13:59:40.104664+0000","last_active":"2024-05-07T13:59:40.104664+0000","last_peered":"2024-05-07T13:59:40.104664+0000","last_clean":"2024-05-07T13:59:40.104664+0000","last_became_active":"2024-05-07T13:55:54.329885+0000","last_became_peered":"2024-05-07T13:55:54.329885+0000","last_unstale":"2024-05-07T13:59:40.104664+0000","last_undegraded":"2024-05-07T13:59:40.104664+0000","last_fullsized":"2024-05-07T13:59:40.104664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:40.104516+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:40.104516+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.104516+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:58.439308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":402,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.906548+0000","last_change":"2024-05-07T13:59:11.906548+0000","last_active":"2024-05-07T13:59:11.906548+0000","last_peered":"2024-05-07T13:59:11.906548+0000","last_clean":"2024-05-07T13:59:11.906548+0000","last_became_active":"2024-05-07T13:55:56.334023+0000","last_became_peered":"2024-05-07T13:55:56.334023+0000","last_unstale":"2024-05-07T13:59:11.906548+0000","last_undegraded":"2024-05-07T13:59:11.906548+0000","last_fullsized":"2024-05-07T13:59:11.906548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.906422+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:49:19.117395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:06.941687+0000","last_change":"2024-05-07T14:00:06.941687+0000","last_active":"2024-05-07T14:00:06.941687+0000","last_peered":"2024-05-07T14:00:06.941687+0000","last_clean":"2024-05-07T14:00:06.941687+0000","last_became_active":"2024-05-07T13:55:58.346984+0000","last_became_peered":"2024-05-07T13:55:58.346984+0000","last_unstale":"2024-05-07T14:00:06.941687+0000","last_undegraded":"2024-05-07T14:00:06.941687+0000","last_fullsized":"2024-05-07T14:00:06.941687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-07T14:00:06.941537+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-07T14:00:06.941537+0000","last_clean_scrub_stamp":"2024-05-07T14:00:06.941537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:08:16.094580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.079940+0000","last_change":"2024-05-07T13:59:48.079940+0000","last_active":"2024-05-07T13:59:48.079940+0000","last_peered":"2024-05-07T13:59:48.079940+0000","last_clean":"2024-05-07T13:59:48.079940+0000","last_became_active":"2024-05-07T13:55:50.327283+0000","last_became_peered":"2024-05-07T13:55:50.327283+0000","last_unstale":"2024-05-07T13:59:48.079940+0000","last_undegraded":"2024-05-07T13:59:48.079940+0000","last_fullsized":"2024-05-07T13:59:48.079940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:48.079746+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:48.079746+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.079746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:42.880890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.942824+0000","last_change":"2024-05-07T14:00:03.942824+0000","last_active":"2024-05-07T14:00:03.942824+0000","last_peered":"2024-05-07T14:00:03.942824+0000","last_clean":"2024-05-07T14:00:03.942824+0000","last_became_active":"2024-05-07T13:55:48.337553+0000","last_became_peered":"2024-05-07T13:55:48.337553+0000","last_unstale":"2024-05-07T14:00:03.942824+0000","last_undegraded":"2024-05-07T14:00:03.942824+0000","last_fullsized":"2024-05-07T14:00:03.942824+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:03.942685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:03.942685+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.942685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:18:05.627452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:20.253323+0000","last_change":"2024-05-07T14:00:20.253356+0000","last_active":"2024-05-07T14:00:20.253323+0000","last_peered":"2024-05-07T14:00:20.253323+0000","last_clean":"2024-05-07T14:00:20.253323+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T14:00:20.253323+0000","last_undegraded":"2024-05-07T14:00:20.253323+0000","last_fullsized":"2024-05-07T14:00:20.253323+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:20.253230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:20.253230+0000","last_clean_scrub_stamp":"2024-05-07T14:00:20.253230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:43:22.195161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.844877+0000","last_change":"2024-05-07T13:59:19.844877+0000","last_active":"2024-05-07T13:59:19.844877+0000","last_peered":"2024-05-07T13:59:19.844877+0000","last_clean":"2024-05-07T13:59:19.844877+0000","last_became_active":"2024-05-07T13:55:52.314793+0000","last_became_peered":"2024-05-07T13:55:52.314793+0000","last_unstale":"2024-05-07T13:59:19.844877+0000","last_undegraded":"2024-05-07T13:59:19.844877+0000","last_fullsized":"2024-05-07T13:59:19.844877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.844768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:57:45.920718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.116043+0000","last_change":"2024-05-07T13:59:19.116043+0000","last_active":"2024-05-07T13:59:19.116043+0000","last_peered":"2024-05-07T13:59:19.116043+0000","last_clean":"2024-05-07T13:59:19.116043+0000","last_became_active":"2024-05-07T13:55:54.329879+0000","last_became_peered":"2024-05-07T13:55:54.329879+0000","last_unstale":"2024-05-07T13:59:19.116043+0000","last_undegraded":"2024-05-07T13:59:19.116043+0000","last_fullsized":"2024-05-07T13:59:19.116043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.115906+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:13.426945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.963178+0000","last_change":"2024-05-07T13:59:15.963178+0000","last_active":"2024-05-07T13:59:15.963178+0000","last_peered":"2024-05-07T13:59:15.963178+0000","last_clean":"2024-05-07T13:59:15.963178+0000","last_became_active":"2024-05-07T13:55:56.332931+0000","last_became_peered":"2024-05-07T13:55:56.332931+0000","last_unstale":"2024-05-07T13:59:15.963178+0000","last_undegraded":"2024-05-07T13:59:15.963178+0000","last_fullsized":"2024-05-07T13:59:15.963178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.963044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:35.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.085005+0000","last_change":"2024-05-07T13:59:32.085005+0000","last_active":"2024-05-07T13:59:32.085005+0000","last_peered":"2024-05-07T13:59:32.085005+0000","last_clean":"2024-05-07T13:59:32.085005+0000","last_became_active":"2024-05-07T13:55:58.340759+0000","last_became_peered":"2024-05-07T13:55:58.340759+0000","last_unstale":"2024-05-07T13:59:32.085005+0000","last_undegraded":"2024-05-07T13:59:32.085005+0000","last_fullsized":"2024-05-07T13:59:32.085005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.084886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.084886+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.084886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:07:31.603247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.839594+0000","last_change":"2024-05-07T13:59:59.839594+0000","last_active":"2024-05-07T13:59:59.839594+0000","last_peered":"2024-05-07T13:59:59.839594+0000","last_clean":"2024-05-07T13:59:59.839594+0000","last_became_active":"2024-05-07T13:55:58.348566+0000","last_became_peered":"2024-05-07T13:55:58.348566+0000","last_unstale":"2024-05-07T13:59:59.839594+0000","last_undegraded":"2024-05-07T13:59:59.839594+0000","last_fullsized":"2024-05-07T13:59:59.839594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-07T13:59:59.839470+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-07T13:59:59.839470+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.839470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:42.998791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.040601+0000","last_change":"2024-05-07T13:59:33.040654+0000","last_active":"2024-05-07T13:59:33.040601+0000","last_peered":"2024-05-07T13:59:33.040601+0000","last_clean":"2024-05-07T13:59:33.040601+0000","last_became_active":"2024-05-07T13:55:50.329615+0000","last_became_peered":"2024-05-07T13:55:50.329615+0000","last_unstale":"2024-05-07T13:59:33.040601+0000","last_undegraded":"2024-05-07T13:59:33.040601+0000","last_fullsized":"2024-05-07T13:59:33.040601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.040493+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.040493+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.040493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:15.286657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:14.218179+0000","last_change":"2024-05-07T14:00:14.218179+0000","last_active":"2024-05-07T14:00:14.218179+0000","last_peered":"2024-05-07T14:00:14.218179+0000","last_clean":"2024-05-07T14:00:14.218179+0000","last_became_active":"2024-05-07T13:55:48.346558+0000","last_became_peered":"2024-05-07T13:55:48.346558+0000","last_unstale":"2024-05-07T14:00:14.218179+0000","last_undegraded":"2024-05-07T14:00:14.218179+0000","last_fullsized":"2024-05-07T14:00:14.218179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:14.217980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:14.217980+0000","last_clean_scrub_stamp":"2024-05-07T14:00:14.217980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:13.530543+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.052177+0000","last_change":"2024-05-07T13:59:20.052199+0000","last_active":"2024-05-07T13:59:20.052177+0000","last_peered":"2024-05-07T13:59:20.052177+0000","last_clean":"2024-05-07T13:59:20.052177+0000","last_became_active":"2024-05-07T13:55:52.324083+0000","last_became_peered":"2024-05-07T13:55:52.324083+0000","last_unstale":"2024-05-07T13:59:20.052177+0000","last_undegraded":"2024-05-07T13:59:20.052177+0000","last_fullsized":"2024-05-07T13:59:20.052177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.052084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:52.982817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.110559+0000","last_change":"2024-05-07T13:59:39.110608+0000","last_active":"2024-05-07T13:59:39.110559+0000","last_peered":"2024-05-07T13:59:39.110559+0000","last_clean":"2024-05-07T13:59:39.110559+0000","last_became_active":"2024-05-07T13:55:54.330906+0000","last_became_peered":"2024-05-07T13:55:54.330906+0000","last_unstale":"2024-05-07T13:59:39.110559+0000","last_undegraded":"2024-05-07T13:59:39.110559+0000","last_fullsized":"2024-05-07T13:59:39.110559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-07T13:59:39.110467+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-07T13:59:39.110467+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.110467+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:29.925909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.230824+0000","last_change":"2024-05-07T13:59:49.230880+0000","last_active":"2024-05-07T13:59:49.230824+0000","last_peered":"2024-05-07T13:59:49.230824+0000","last_clean":"2024-05-07T13:59:49.230824+0000","last_became_active":"2024-05-07T13:55:56.346371+0000","last_became_peered":"2024-05-07T13:55:56.346371+0000","last_unstale":"2024-05-07T13:59:49.230824+0000","last_undegraded":"2024-05-07T13:59:49.230824+0000","last_fullsized":"2024-05-07T13:59:49.230824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.230724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.230724+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.230724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:52.504500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:08.056848+0000","last_change":"2024-05-07T14:00:08.056875+0000","last_active":"2024-05-07T14:00:08.056848+0000","last_peered":"2024-05-07T14:00:08.056848+0000","last_clean":"2024-05-07T14:00:08.056848+0000","last_became_active":"2024-05-07T13:55:58.341102+0000","last_became_peered":"2024-05-07T13:55:58.341102+0000","last_unstale":"2024-05-07T14:00:08.056848+0000","last_undegraded":"2024-05-07T14:00:08.056848+0000","last_fullsized":"2024-05-07T14:00:08.056848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T14:00:08.056756+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T14:00:08.056756+0000","last_clean_scrub_stamp":"2024-05-07T14:00:08.056756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:36:11.330532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.011707+0000","last_change":"2024-05-07T13:59:33.011759+0000","last_active":"2024-05-07T13:59:33.011707+0000","last_peered":"2024-05-07T13:59:33.011707+0000","last_clean":"2024-05-07T13:59:33.011707+0000","last_became_active":"2024-05-07T13:55:50.329869+0000","last_became_peered":"2024-05-07T13:55:50.329869+0000","last_unstale":"2024-05-07T13:59:33.011707+0000","last_undegraded":"2024-05-07T13:59:33.011707+0000","last_fullsized":"2024-05-07T13:59:33.011707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.011608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.011608+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.011608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:25:02.477664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.070974+0000","last_change":"2024-05-07T13:59:45.071015+0000","last_active":"2024-05-07T13:59:45.070974+0000","last_peered":"2024-05-07T13:59:45.070974+0000","last_clean":"2024-05-07T13:59:45.070974+0000","last_became_active":"2024-05-07T13:55:48.336807+0000","last_became_peered":"2024-05-07T13:55:48.336807+0000","last_unstale":"2024-05-07T13:59:45.070974+0000","last_undegraded":"2024-05-07T13:59:45.070974+0000","last_fullsized":"2024-05-07T13:59:45.070974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:45.070865+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:45.070865+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.070865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:21:52.761753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.827428+0000","last_change":"2024-05-07T13:59:15.827453+0000","last_active":"2024-05-07T13:59:15.827428+0000","last_peered":"2024-05-07T13:59:15.827428+0000","last_clean":"2024-05-07T13:59:15.827428+0000","last_became_active":"2024-05-07T13:55:52.318534+0000","last_became_peered":"2024-05-07T13:55:52.318534+0000","last_unstale":"2024-05-07T13:59:15.827428+0000","last_undegraded":"2024-05-07T13:59:15.827428+0000","last_fullsized":"2024-05-07T13:59:15.827428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.827322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:35.422572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.031728+0000","last_change":"2024-05-07T13:59:25.031770+0000","last_active":"2024-05-07T13:59:25.031728+0000","last_peered":"2024-05-07T13:59:25.031728+0000","last_clean":"2024-05-07T13:59:25.031728+0000","last_became_active":"2024-05-07T13:55:54.319714+0000","last_became_peered":"2024-05-07T13:55:54.319714+0000","last_unstale":"2024-05-07T13:59:25.031728+0000","last_undegraded":"2024-05-07T13:59:25.031728+0000","last_fullsized":"2024-05-07T13:59:25.031728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.031629+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:37.796266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.110151+0000","last_change":"2024-05-07T13:59:10.110217+0000","last_active":"2024-05-07T13:59:10.110151+0000","last_peered":"2024-05-07T13:59:10.110151+0000","last_clean":"2024-05-07T13:59:10.110151+0000","last_became_active":"2024-05-07T13:55:56.334342+0000","last_became_peered":"2024-05-07T13:55:56.334342+0000","last_unstale":"2024-05-07T13:59:10.110151+0000","last_undegraded":"2024-05-07T13:59:10.110151+0000","last_fullsized":"2024-05-07T13:59:10.110151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.110045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:09.225940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:09.066129+0000","last_change":"2024-05-07T14:00:09.066159+0000","last_active":"2024-05-07T14:00:09.066129+0000","last_peered":"2024-05-07T14:00:09.066129+0000","last_clean":"2024-05-07T14:00:09.066129+0000","last_became_active":"2024-05-07T13:55:58.342382+0000","last_became_peered":"2024-05-07T13:55:58.342382+0000","last_unstale":"2024-05-07T14:00:09.066129+0000","last_undegraded":"2024-05-07T14:00:09.066129+0000","last_fullsized":"2024-05-07T14:00:09.066129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:09.066035+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:09.066035+0000","last_clean_scrub_stamp":"2024-05-07T14:00:09.066035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:59.943734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:11.074276+0000","last_change":"2024-05-07T14:00:11.074306+0000","last_active":"2024-05-07T14:00:11.074276+0000","last_peered":"2024-05-07T14:00:11.074276+0000","last_clean":"2024-05-07T14:00:11.074276+0000","last_became_active":"2024-05-07T13:56:35.365890+0000","last_became_peered":"2024-05-07T13:56:35.365890+0000","last_unstale":"2024-05-07T14:00:11.074276+0000","last_undegraded":"2024-05-07T14:00:11.074276+0000","last_fullsized":"2024-05-07T14:00:11.074276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T14:00:11.074166+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T14:00:11.074166+0000","last_clean_scrub_stamp":"2024-05-07T14:00:11.074166+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:10:50.732660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.896282+0000","last_change":"2024-05-07T13:59:53.896309+0000","last_active":"2024-05-07T13:59:53.896282+0000","last_peered":"2024-05-07T13:59:53.896282+0000","last_clean":"2024-05-07T13:59:53.896282+0000","last_became_active":"2024-05-07T13:55:48.336730+0000","last_became_peered":"2024-05-07T13:55:48.336730+0000","last_unstale":"2024-05-07T13:59:53.896282+0000","last_undegraded":"2024-05-07T13:59:53.896282+0000","last_fullsized":"2024-05-07T13:59:53.896282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:53.896185+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:53.896185+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.896185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:27.501340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.138495+0000","last_change":"2024-05-07T13:59:26.138549+0000","last_active":"2024-05-07T13:59:26.138495+0000","last_peered":"2024-05-07T13:59:26.138495+0000","last_clean":"2024-05-07T13:59:26.138495+0000","last_became_active":"2024-05-07T13:55:52.324639+0000","last_became_peered":"2024-05-07T13:55:52.324639+0000","last_unstale":"2024-05-07T13:59:26.138495+0000","last_undegraded":"2024-05-07T13:59:26.138495+0000","last_fullsized":"2024-05-07T13:59:26.138495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.138376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:46.117728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'48","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.012636+0000","last_change":"2024-05-07T13:59:19.012678+0000","last_active":"2024-05-07T13:59:19.012636+0000","last_peered":"2024-05-07T13:59:19.012636+0000","last_clean":"2024-05-07T13:59:19.012636+0000","last_became_active":"2024-05-07T13:55:54.330738+0000","last_became_peered":"2024-05-07T13:55:54.330738+0000","last_unstale":"2024-05-07T13:59:19.012636+0000","last_undegraded":"2024-05-07T13:59:19.012636+0000","last_fullsized":"2024-05-07T13:59:19.012636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.012548+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:59.656224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.078706+0000","last_change":"2024-05-07T13:59:11.078729+0000","last_active":"2024-05-07T13:59:11.078706+0000","last_peered":"2024-05-07T13:59:11.078706+0000","last_clean":"2024-05-07T13:59:11.078706+0000","last_became_active":"2024-05-07T13:55:56.332844+0000","last_became_peered":"2024-05-07T13:55:56.332844+0000","last_unstale":"2024-05-07T13:59:11.078706+0000","last_undegraded":"2024-05-07T13:59:11.078706+0000","last_fullsized":"2024-05-07T13:59:11.078706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.078592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:40.007846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.170568+0000","last_change":"2024-05-07T14:00:01.170594+0000","last_active":"2024-05-07T14:00:01.170568+0000","last_peered":"2024-05-07T14:00:01.170568+0000","last_clean":"2024-05-07T14:00:01.170568+0000","last_became_active":"2024-05-07T13:55:58.347598+0000","last_became_peered":"2024-05-07T13:55:58.347598+0000","last_unstale":"2024-05-07T14:00:01.170568+0000","last_undegraded":"2024-05-07T14:00:01.170568+0000","last_fullsized":"2024-05-07T14:00:01.170568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:01.170476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:01.170476+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.170476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:15.339892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'14","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.025831+0000","last_change":"2024-05-07T13:59:28.025859+0000","last_active":"2024-05-07T13:59:28.025831+0000","last_peered":"2024-05-07T13:59:28.025831+0000","last_clean":"2024-05-07T13:59:28.025831+0000","last_became_active":"2024-05-07T13:55:50.326430+0000","last_became_peered":"2024-05-07T13:55:50.326430+0000","last_unstale":"2024-05-07T13:59:28.025831+0000","last_undegraded":"2024-05-07T13:59:28.025831+0000","last_fullsized":"2024-05-07T13:59:28.025831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.025734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:38.245824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.965273+0000","last_change":"2024-05-07T13:59:57.965301+0000","last_active":"2024-05-07T13:59:57.965273+0000","last_peered":"2024-05-07T13:59:57.965273+0000","last_clean":"2024-05-07T13:59:57.965273+0000","last_became_active":"2024-05-07T13:55:48.331660+0000","last_became_peered":"2024-05-07T13:55:48.331660+0000","last_unstale":"2024-05-07T13:59:57.965273+0000","last_undegraded":"2024-05-07T13:59:57.965273+0000","last_fullsized":"2024-05-07T13:59:57.965273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:57.965178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:57.965178+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.965178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:45:02.830676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.845806+0000","last_change":"2024-05-07T13:59:10.845836+0000","last_active":"2024-05-07T13:59:10.845806+0000","last_peered":"2024-05-07T13:59:10.845806+0000","last_clean":"2024-05-07T13:59:10.845806+0000","last_became_active":"2024-05-07T13:55:52.320520+0000","last_became_peered":"2024-05-07T13:55:52.320520+0000","last_unstale":"2024-05-07T13:59:10.845806+0000","last_undegraded":"2024-05-07T13:59:10.845806+0000","last_fullsized":"2024-05-07T13:59:10.845806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.845698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:25:38.217921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.157708+0000","last_change":"2024-05-07T13:59:23.157743+0000","last_active":"2024-05-07T13:59:23.157708+0000","last_peered":"2024-05-07T13:59:23.157708+0000","last_clean":"2024-05-07T13:59:23.157708+0000","last_became_active":"2024-05-07T13:55:54.320266+0000","last_became_peered":"2024-05-07T13:55:54.320266+0000","last_unstale":"2024-05-07T13:59:23.157708+0000","last_undegraded":"2024-05-07T13:59:23.157708+0000","last_fullsized":"2024-05-07T13:59:23.157708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.157605+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:28.358470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.079062+0000","last_change":"2024-05-07T13:59:15.079086+0000","last_active":"2024-05-07T13:59:15.079062+0000","last_peered":"2024-05-07T13:59:15.079062+0000","last_clean":"2024-05-07T13:59:15.079062+0000","last_became_active":"2024-05-07T13:55:56.330251+0000","last_became_peered":"2024-05-07T13:55:56.330251+0000","last_unstale":"2024-05-07T13:59:15.079062+0000","last_undegraded":"2024-05-07T13:59:15.079062+0000","last_fullsized":"2024-05-07T13:59:15.079062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:55.222720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.189084+0000","last_change":"2024-05-07T13:59:54.189084+0000","last_active":"2024-05-07T13:59:54.189084+0000","last_peered":"2024-05-07T13:59:54.189084+0000","last_clean":"2024-05-07T13:59:54.189084+0000","last_became_active":"2024-05-07T13:55:50.323159+0000","last_became_peered":"2024-05-07T13:55:50.323159+0000","last_unstale":"2024-05-07T13:59:54.189084+0000","last_undegraded":"2024-05-07T13:59:54.189084+0000","last_fullsized":"2024-05-07T13:59:54.189084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:54.188966+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:54.188966+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.188966+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:45:09.716257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'4","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:27.221248+0000","last_change":"2024-05-07T14:00:27.221277+0000","last_active":"2024-05-07T14:00:27.221248+0000","last_peered":"2024-05-07T14:00:27.221248+0000","last_clean":"2024-05-07T14:00:27.221248+0000","last_became_active":"2024-05-07T13:55:48.350462+0000","last_became_peered":"2024-05-07T13:55:48.350462+0000","last_unstale":"2024-05-07T14:00:27.221248+0000","last_undegraded":"2024-05-07T14:00:27.221248+0000","last_fullsized":"2024-05-07T14:00:27.221248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-07T14:00:27.221150+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-07T14:00:27.221150+0000","last_clean_scrub_stamp":"2024-05-07T14:00:27.221150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:41:51.409323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.020866+0000","last_change":"2024-05-07T13:59:35.020866+0000","last_active":"2024-05-07T13:59:35.020866+0000","last_peered":"2024-05-07T13:59:35.020866+0000","last_clean":"2024-05-07T13:59:35.020866+0000","last_became_active":"2024-05-07T13:55:52.321171+0000","last_became_peered":"2024-05-07T13:55:52.321171+0000","last_unstale":"2024-05-07T13:59:35.020866+0000","last_undegraded":"2024-05-07T13:59:35.020866+0000","last_fullsized":"2024-05-07T13:59:35.020866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:35.020743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:35.020743+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.020743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:21:42.711631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.985304+0000","last_change":"2024-05-07T13:59:23.985348+0000","last_active":"2024-05-07T13:59:23.985304+0000","last_peered":"2024-05-07T13:59:23.985304+0000","last_clean":"2024-05-07T13:59:23.985304+0000","last_became_active":"2024-05-07T13:55:54.319819+0000","last_became_peered":"2024-05-07T13:55:54.319819+0000","last_unstale":"2024-05-07T13:59:23.985304+0000","last_undegraded":"2024-05-07T13:59:23.985304+0000","last_fullsized":"2024-05-07T13:59:23.985304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.985209+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:20.683798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.078791+0000","last_change":"2024-05-07T13:59:14.078817+0000","last_active":"2024-05-07T13:59:14.078791+0000","last_peered":"2024-05-07T13:59:14.078791+0000","last_clean":"2024-05-07T13:59:14.078791+0000","last_became_active":"2024-05-07T13:55:56.330190+0000","last_became_peered":"2024-05-07T13:55:56.330190+0000","last_unstale":"2024-05-07T13:59:14.078791+0000","last_undegraded":"2024-05-07T13:59:14.078791+0000","last_fullsized":"2024-05-07T13:59:14.078791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.078700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:50:02.500890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:05.075583+0000","last_change":"2024-05-07T14:00:05.075614+0000","last_active":"2024-05-07T14:00:05.075583+0000","last_peered":"2024-05-07T14:00:05.075583+0000","last_clean":"2024-05-07T14:00:05.075583+0000","last_became_active":"2024-05-07T13:55:58.340674+0000","last_became_peered":"2024-05-07T13:55:58.340674+0000","last_unstale":"2024-05-07T14:00:05.075583+0000","last_undegraded":"2024-05-07T14:00:05.075583+0000","last_fullsized":"2024-05-07T14:00:05.075583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T14:00:05.075491+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T14:00:05.075491+0000","last_clean_scrub_stamp":"2024-05-07T14:00:05.075491+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:13.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.075066+0000","last_change":"2024-05-07T13:59:50.075066+0000","last_active":"2024-05-07T13:59:50.075066+0000","last_peered":"2024-05-07T13:59:50.075066+0000","last_clean":"2024-05-07T13:59:50.075066+0000","last_became_active":"2024-05-07T13:55:50.318546+0000","last_became_peered":"2024-05-07T13:55:50.318546+0000","last_unstale":"2024-05-07T13:59:50.075066+0000","last_undegraded":"2024-05-07T13:59:50.075066+0000","last_fullsized":"2024-05-07T13:59:50.075066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:50.074938+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:50.074938+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.074938+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:33.234260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.897247+0000","last_change":"2024-05-07T13:59:59.897301+0000","last_active":"2024-05-07T13:59:59.897247+0000","last_peered":"2024-05-07T13:59:59.897247+0000","last_clean":"2024-05-07T13:59:59.897247+0000","last_became_active":"2024-05-07T13:55:48.331278+0000","last_became_peered":"2024-05-07T13:55:48.331278+0000","last_unstale":"2024-05-07T13:59:59.897247+0000","last_undegraded":"2024-05-07T13:59:59.897247+0000","last_fullsized":"2024-05-07T13:59:59.897247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:59.897110+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:59.897110+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.897110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:51:16.956997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.132317+0000","last_change":"2024-05-07T13:59:31.132317+0000","last_active":"2024-05-07T13:59:31.132317+0000","last_peered":"2024-05-07T13:59:31.132317+0000","last_clean":"2024-05-07T13:59:31.132317+0000","last_became_active":"2024-05-07T13:55:52.317564+0000","last_became_peered":"2024-05-07T13:55:52.317564+0000","last_unstale":"2024-05-07T13:59:31.132317+0000","last_undegraded":"2024-05-07T13:59:31.132317+0000","last_fullsized":"2024-05-07T13:59:31.132317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.132155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.132155+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.132155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:31.984653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.150663+0000","last_change":"2024-05-07T13:59:42.150703+0000","last_active":"2024-05-07T13:59:42.150663+0000","last_peered":"2024-05-07T13:59:42.150663+0000","last_clean":"2024-05-07T13:59:42.150663+0000","last_became_active":"2024-05-07T13:55:54.329443+0000","last_became_peered":"2024-05-07T13:55:54.329443+0000","last_unstale":"2024-05-07T13:59:42.150663+0000","last_undegraded":"2024-05-07T13:59:42.150663+0000","last_fullsized":"2024-05-07T13:59:42.150663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-07T13:59:42.150568+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-07T13:59:42.150568+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.150568+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:03:28.616407+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.090783+0000","last_change":"2024-05-07T13:59:31.090805+0000","last_active":"2024-05-07T13:59:31.090783+0000","last_peered":"2024-05-07T13:59:31.090783+0000","last_clean":"2024-05-07T13:59:31.090783+0000","last_became_active":"2024-05-07T13:55:56.344470+0000","last_became_peered":"2024-05-07T13:55:56.344470+0000","last_unstale":"2024-05-07T13:59:31.090783+0000","last_undegraded":"2024-05-07T13:59:31.090783+0000","last_fullsized":"2024-05-07T13:59:31.090783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.090686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.090686+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.090686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:29.889110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.147041+0000","last_change":"2024-05-07T13:55:58.351086+0000","last_active":"2024-05-07T13:58:59.147041+0000","last_peered":"2024-05-07T13:58:59.147041+0000","last_clean":"2024-05-07T13:58:59.147041+0000","last_became_active":"2024-05-07T13:55:58.350796+0000","last_became_peered":"2024-05-07T13:55:58.350796+0000","last_unstale":"2024-05-07T13:58:59.147041+0000","last_undegraded":"2024-05-07T13:58:59.147041+0000","last_fullsized":"2024-05-07T13:58:59.147041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.935454+0000","last_change":"2024-05-07T13:59:23.935508+0000","last_active":"2024-05-07T13:59:23.935454+0000","last_peered":"2024-05-07T13:59:23.935454+0000","last_clean":"2024-05-07T13:59:23.935454+0000","last_became_active":"2024-05-07T13:55:50.326424+0000","last_became_peered":"2024-05-07T13:55:50.326424+0000","last_unstale":"2024-05-07T13:59:23.935454+0000","last_undegraded":"2024-05-07T13:59:23.935454+0000","last_fullsized":"2024-05-07T13:59:23.935454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.935328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:15.191912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.103945+0000","last_change":"2024-05-07T13:59:50.103971+0000","last_active":"2024-05-07T13:59:50.103945+0000","last_peered":"2024-05-07T13:59:50.103945+0000","last_clean":"2024-05-07T13:59:50.103945+0000","last_became_active":"2024-05-07T13:55:48.342072+0000","last_became_peered":"2024-05-07T13:55:48.342072+0000","last_unstale":"2024-05-07T13:59:50.103945+0000","last_undegraded":"2024-05-07T13:59:50.103945+0000","last_fullsized":"2024-05-07T13:59:50.103945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:50.103851+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:50.103851+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.103851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:45.262431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.097749+0000","last_change":"2024-05-07T13:59:30.097790+0000","last_active":"2024-05-07T13:59:30.097749+0000","last_peered":"2024-05-07T13:59:30.097749+0000","last_clean":"2024-05-07T13:59:30.097749+0000","last_became_active":"2024-05-07T13:55:52.318605+0000","last_became_peered":"2024-05-07T13:55:52.318605+0000","last_unstale":"2024-05-07T13:59:30.097749+0000","last_undegraded":"2024-05-07T13:59:30.097749+0000","last_fullsized":"2024-05-07T13:59:30.097749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.097647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.097647+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.097647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:23.733758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.957062+0000","last_change":"2024-05-07T13:59:22.957062+0000","last_active":"2024-05-07T13:59:22.957062+0000","last_peered":"2024-05-07T13:59:22.957062+0000","last_clean":"2024-05-07T13:59:22.957062+0000","last_became_active":"2024-05-07T13:55:54.326599+0000","last_became_peered":"2024-05-07T13:55:54.326599+0000","last_unstale":"2024-05-07T13:59:22.957062+0000","last_undegraded":"2024-05-07T13:59:22.957062+0000","last_fullsized":"2024-05-07T13:59:22.957062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.956910+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:05.203075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:09.875299+0000","last_change":"2024-05-07T13:59:09.875299+0000","last_active":"2024-05-07T13:59:09.875299+0000","last_peered":"2024-05-07T13:59:09.875299+0000","last_clean":"2024-05-07T13:59:09.875299+0000","last_became_active":"2024-05-07T13:55:56.334226+0000","last_became_peered":"2024-05-07T13:55:56.334226+0000","last_unstale":"2024-05-07T13:59:09.875299+0000","last_undegraded":"2024-05-07T13:59:09.875299+0000","last_fullsized":"2024-05-07T13:59:09.875299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_clean_scrub_stamp":"2024-05-07T13:59:09.875192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:33.279728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183272+0000","last_change":"2024-05-07T13:55:58.352585+0000","last_active":"2024-05-07T13:58:18.183272+0000","last_peered":"2024-05-07T13:58:18.183272+0000","last_clean":"2024-05-07T13:58:18.183272+0000","last_became_active":"2024-05-07T13:55:58.352263+0000","last_became_peered":"2024-05-07T13:55:58.352263+0000","last_unstale":"2024-05-07T13:58:18.183272+0000","last_undegraded":"2024-05-07T13:58:18.183272+0000","last_fullsized":"2024-05-07T13:58:18.183272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.159755+0000","last_change":"2024-05-07T13:59:44.159801+0000","last_active":"2024-05-07T13:59:44.159755+0000","last_peered":"2024-05-07T13:59:44.159755+0000","last_clean":"2024-05-07T13:59:44.159755+0000","last_became_active":"2024-05-07T13:55:50.312852+0000","last_became_peered":"2024-05-07T13:55:50.312852+0000","last_unstale":"2024-05-07T13:59:44.159755+0000","last_undegraded":"2024-05-07T13:59:44.159755+0000","last_fullsized":"2024-05-07T13:59:44.159755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:44.159658+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:44.159658+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.159658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:17.764814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:09.142596+0000","last_change":"2024-05-07T14:00:09.142630+0000","last_active":"2024-05-07T14:00:09.142596+0000","last_peered":"2024-05-07T14:00:09.142596+0000","last_clean":"2024-05-07T14:00:09.142596+0000","last_became_active":"2024-05-07T13:55:48.348476+0000","last_became_peered":"2024-05-07T13:55:48.348476+0000","last_unstale":"2024-05-07T14:00:09.142596+0000","last_undegraded":"2024-05-07T14:00:09.142596+0000","last_fullsized":"2024-05-07T14:00:09.142596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:09.142498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:09.142498+0000","last_clean_scrub_stamp":"2024-05-07T14:00:09.142498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:31.321763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.019050+0000","last_change":"2024-05-07T13:59:21.019075+0000","last_active":"2024-05-07T13:59:21.019050+0000","last_peered":"2024-05-07T13:59:21.019050+0000","last_clean":"2024-05-07T13:59:21.019050+0000","last_became_active":"2024-05-07T13:55:52.322431+0000","last_became_peered":"2024-05-07T13:55:52.322431+0000","last_unstale":"2024-05-07T13:59:21.019050+0000","last_undegraded":"2024-05-07T13:59:21.019050+0000","last_fullsized":"2024-05-07T13:59:21.019050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.018959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:33:21.518908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.997674+0000","last_change":"2024-05-07T13:59:28.997674+0000","last_active":"2024-05-07T13:59:28.997674+0000","last_peered":"2024-05-07T13:59:28.997674+0000","last_clean":"2024-05-07T13:59:28.997674+0000","last_became_active":"2024-05-07T13:55:54.329539+0000","last_became_peered":"2024-05-07T13:55:54.329539+0000","last_unstale":"2024-05-07T13:59:28.997674+0000","last_undegraded":"2024-05-07T13:59:28.997674+0000","last_fullsized":"2024-05-07T13:59:28.997674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-07T13:59:28.997538+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-07T13:59:28.997538+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.997538+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:03.181568+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.068040+0000","last_change":"2024-05-07T13:59:16.068040+0000","last_active":"2024-05-07T13:59:16.068040+0000","last_peered":"2024-05-07T13:59:16.068040+0000","last_clean":"2024-05-07T13:59:16.068040+0000","last_became_active":"2024-05-07T13:55:56.338021+0000","last_became_peered":"2024-05-07T13:55:56.338021+0000","last_unstale":"2024-05-07T13:59:16.068040+0000","last_undegraded":"2024-05-07T13:59:16.068040+0000","last_fullsized":"2024-05-07T13:59:16.068040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.067904+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:55:00.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:18.183170+0000","last_change":"2024-05-07T13:55:58.351904+0000","last_active":"2024-05-07T13:58:18.183170+0000","last_peered":"2024-05-07T13:58:18.183170+0000","last_clean":"2024-05-07T13:58:18.183170+0000","last_became_active":"2024-05-07T13:55:58.351616+0000","last_became_peered":"2024-05-07T13:55:58.351616+0000","last_unstale":"2024-05-07T13:58:18.183170+0000","last_undegraded":"2024-05-07T13:58:18.183170+0000","last_fullsized":"2024-05-07T13:58:18.183170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.073813+0000","last_change":"2024-05-07T13:59:36.073866+0000","last_active":"2024-05-07T13:59:36.073813+0000","last_peered":"2024-05-07T13:59:36.073813+0000","last_clean":"2024-05-07T13:59:36.073813+0000","last_became_active":"2024-05-07T13:55:50.313016+0000","last_became_peered":"2024-05-07T13:55:50.313016+0000","last_unstale":"2024-05-07T13:59:36.073813+0000","last_undegraded":"2024-05-07T13:59:36.073813+0000","last_fullsized":"2024-05-07T13:59:36.073813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:36.073646+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:36.073646+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.073646+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:12.645759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.999483+0000","last_change":"2024-05-07T13:59:53.999532+0000","last_active":"2024-05-07T13:59:53.999483+0000","last_peered":"2024-05-07T13:59:53.999483+0000","last_clean":"2024-05-07T13:59:53.999483+0000","last_became_active":"2024-05-07T13:55:48.339639+0000","last_became_peered":"2024-05-07T13:55:48.339639+0000","last_unstale":"2024-05-07T13:59:53.999483+0000","last_undegraded":"2024-05-07T13:59:53.999483+0000","last_fullsized":"2024-05-07T13:59:53.999483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:53.999377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:53.999377+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.999377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:37.158698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.058938+0000","last_change":"2024-05-07T13:59:18.058974+0000","last_active":"2024-05-07T13:59:18.058938+0000","last_peered":"2024-05-07T13:59:18.058938+0000","last_clean":"2024-05-07T13:59:18.058938+0000","last_became_active":"2024-05-07T13:55:52.324567+0000","last_became_peered":"2024-05-07T13:55:52.324567+0000","last_unstale":"2024-05-07T13:59:18.058938+0000","last_undegraded":"2024-05-07T13:59:18.058938+0000","last_fullsized":"2024-05-07T13:59:18.058938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.058848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:48:50.227510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.085639+0000","last_change":"2024-05-07T13:59:16.085684+0000","last_active":"2024-05-07T13:59:16.085639+0000","last_peered":"2024-05-07T13:59:16.085639+0000","last_clean":"2024-05-07T13:59:16.085639+0000","last_became_active":"2024-05-07T13:55:54.329220+0000","last_became_peered":"2024-05-07T13:55:54.329220+0000","last_unstale":"2024-05-07T13:59:16.085639+0000","last_undegraded":"2024-05-07T13:59:16.085639+0000","last_fullsized":"2024-05-07T13:59:16.085639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.085538+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:26.485669+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.922656+0000","last_change":"2024-05-07T13:59:14.922682+0000","last_active":"2024-05-07T13:59:14.922656+0000","last_peered":"2024-05-07T13:59:14.922656+0000","last_clean":"2024-05-07T13:59:14.922656+0000","last_became_active":"2024-05-07T13:55:56.333373+0000","last_became_peered":"2024-05-07T13:55:56.333373+0000","last_unstale":"2024-05-07T13:59:14.922656+0000","last_undegraded":"2024-05-07T13:59:14.922656+0000","last_fullsized":"2024-05-07T13:59:14.922656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.922551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:15.327295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:07.957645+0000","last_change":"2024-05-07T14:00:07.957668+0000","last_active":"2024-05-07T14:00:07.957645+0000","last_peered":"2024-05-07T14:00:07.957645+0000","last_clean":"2024-05-07T14:00:07.957645+0000","last_became_active":"2024-05-07T13:55:58.347327+0000","last_became_peered":"2024-05-07T13:55:58.347327+0000","last_unstale":"2024-05-07T14:00:07.957645+0000","last_undegraded":"2024-05-07T14:00:07.957645+0000","last_fullsized":"2024-05-07T14:00:07.957645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:07.957550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:07.957550+0000","last_clean_scrub_stamp":"2024-05-07T14:00:07.957550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:12.458074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.036902+0000","last_change":"2024-05-07T13:59:35.036926+0000","last_active":"2024-05-07T13:59:35.036902+0000","last_peered":"2024-05-07T13:59:35.036902+0000","last_clean":"2024-05-07T13:59:35.036902+0000","last_became_active":"2024-05-07T13:55:50.311340+0000","last_became_peered":"2024-05-07T13:55:50.311340+0000","last_unstale":"2024-05-07T13:59:35.036902+0000","last_undegraded":"2024-05-07T13:59:35.036902+0000","last_fullsized":"2024-05-07T13:59:35.036902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:35.036806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:35.036806+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.036806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:47.801444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:05.069311+0000","last_change":"2024-05-07T14:00:05.069333+0000","last_active":"2024-05-07T14:00:05.069311+0000","last_peered":"2024-05-07T14:00:05.069311+0000","last_clean":"2024-05-07T14:00:05.069311+0000","last_became_active":"2024-05-07T13:55:48.349589+0000","last_became_peered":"2024-05-07T13:55:48.349589+0000","last_unstale":"2024-05-07T14:00:05.069311+0000","last_undegraded":"2024-05-07T14:00:05.069311+0000","last_fullsized":"2024-05-07T14:00:05.069311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:05.069220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:05.069220+0000","last_clean_scrub_stamp":"2024-05-07T14:00:05.069220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:01:27.326304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.160962+0000","last_change":"2024-05-07T13:59:27.160985+0000","last_active":"2024-05-07T13:59:27.160962+0000","last_peered":"2024-05-07T13:59:27.160962+0000","last_clean":"2024-05-07T13:59:27.160962+0000","last_became_active":"2024-05-07T13:55:52.323548+0000","last_became_peered":"2024-05-07T13:55:52.323548+0000","last_unstale":"2024-05-07T13:59:27.160962+0000","last_undegraded":"2024-05-07T13:59:27.160962+0000","last_fullsized":"2024-05-07T13:59:27.160962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.160877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:40.043412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.984564+0000","last_change":"2024-05-07T13:59:19.984633+0000","last_active":"2024-05-07T13:59:19.984564+0000","last_peered":"2024-05-07T13:59:19.984564+0000","last_clean":"2024-05-07T13:59:19.984564+0000","last_became_active":"2024-05-07T13:55:54.326844+0000","last_became_peered":"2024-05-07T13:55:54.326844+0000","last_unstale":"2024-05-07T13:59:19.984564+0000","last_undegraded":"2024-05-07T13:59:19.984564+0000","last_fullsized":"2024-05-07T13:59:19.984564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.984455+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:13.620566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.047751+0000","last_change":"2024-05-07T13:59:37.047777+0000","last_active":"2024-05-07T13:59:37.047751+0000","last_peered":"2024-05-07T13:59:37.047751+0000","last_clean":"2024-05-07T13:59:37.047751+0000","last_became_active":"2024-05-07T13:55:56.344885+0000","last_became_peered":"2024-05-07T13:55:56.344885+0000","last_unstale":"2024-05-07T13:59:37.047751+0000","last_undegraded":"2024-05-07T13:59:37.047751+0000","last_fullsized":"2024-05-07T13:59:37.047751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:37.047656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:37.047656+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.047656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:50:54.107543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.182882+0000","last_change":"2024-05-07T13:59:57.182908+0000","last_active":"2024-05-07T13:59:57.182882+0000","last_peered":"2024-05-07T13:59:57.182882+0000","last_clean":"2024-05-07T13:59:57.182882+0000","last_became_active":"2024-05-07T13:55:58.347850+0000","last_became_peered":"2024-05-07T13:55:58.347850+0000","last_unstale":"2024-05-07T13:59:57.182882+0000","last_undegraded":"2024-05-07T13:59:57.182882+0000","last_fullsized":"2024-05-07T13:59:57.182882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:57.182784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:57.182784+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.182784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:52:09.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'20","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.133242+0000","last_change":"2024-05-07T13:59:46.133286+0000","last_active":"2024-05-07T13:59:46.133242+0000","last_peered":"2024-05-07T13:59:46.133242+0000","last_clean":"2024-05-07T13:59:46.133242+0000","last_became_active":"2024-05-07T13:55:50.324745+0000","last_became_peered":"2024-05-07T13:55:50.324745+0000","last_unstale":"2024-05-07T13:59:46.133242+0000","last_undegraded":"2024-05-07T13:59:46.133242+0000","last_fullsized":"2024-05-07T13:59:46.133242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-07T13:59:46.133156+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-07T13:59:46.133156+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.133156+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:54.805339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.169448+0000","last_change":"2024-05-07T13:59:58.169504+0000","last_active":"2024-05-07T13:59:58.169448+0000","last_peered":"2024-05-07T13:59:58.169448+0000","last_clean":"2024-05-07T13:59:58.169448+0000","last_became_active":"2024-05-07T13:55:48.323125+0000","last_became_peered":"2024-05-07T13:55:48.323125+0000","last_unstale":"2024-05-07T13:59:58.169448+0000","last_undegraded":"2024-05-07T13:59:58.169448+0000","last_fullsized":"2024-05-07T13:59:58.169448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:58.169302+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:58.169302+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.169302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:48.984745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.003899+0000","last_change":"2024-05-07T13:59:22.003923+0000","last_active":"2024-05-07T13:59:22.003899+0000","last_peered":"2024-05-07T13:59:22.003899+0000","last_clean":"2024-05-07T13:59:22.003899+0000","last_became_active":"2024-05-07T13:55:52.322012+0000","last_became_peered":"2024-05-07T13:55:52.322012+0000","last_unstale":"2024-05-07T13:59:22.003899+0000","last_undegraded":"2024-05-07T13:59:22.003899+0000","last_fullsized":"2024-05-07T13:59:22.003899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.003807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:25:31.144648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'31","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.881145+0000","last_change":"2024-05-07T13:59:20.881181+0000","last_active":"2024-05-07T13:59:20.881145+0000","last_peered":"2024-05-07T13:59:20.881145+0000","last_clean":"2024-05-07T13:59:20.881145+0000","last_became_active":"2024-05-07T13:55:54.326758+0000","last_became_peered":"2024-05-07T13:55:54.326758+0000","last_unstale":"2024-05-07T13:59:20.881145+0000","last_undegraded":"2024-05-07T13:59:20.881145+0000","last_fullsized":"2024-05-07T13:59:20.881145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.881054+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:08.116261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.101452+0000","last_change":"2024-05-07T13:59:41.101476+0000","last_active":"2024-05-07T13:59:41.101452+0000","last_peered":"2024-05-07T13:59:41.101452+0000","last_clean":"2024-05-07T13:59:41.101452+0000","last_became_active":"2024-05-07T13:55:56.345933+0000","last_became_peered":"2024-05-07T13:55:56.345933+0000","last_unstale":"2024-05-07T13:59:41.101452+0000","last_undegraded":"2024-05-07T13:59:41.101452+0000","last_fullsized":"2024-05-07T13:59:41.101452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.101346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.101346+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.101346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:09.656228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:23.184263+0000","last_change":"2024-05-07T13:55:58.349147+0000","last_active":"2024-05-07T13:58:23.184263+0000","last_peered":"2024-05-07T13:58:23.184263+0000","last_clean":"2024-05-07T13:58:23.184263+0000","last_became_active":"2024-05-07T13:55:58.348763+0000","last_became_peered":"2024-05-07T13:55:58.348763+0000","last_unstale":"2024-05-07T13:58:23.184263+0000","last_undegraded":"2024-05-07T13:58:23.184263+0000","last_fullsized":"2024-05-07T13:58:23.184263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.125138+0000","last_change":"2024-05-07T13:59:40.125168+0000","last_active":"2024-05-07T13:59:40.125138+0000","last_peered":"2024-05-07T13:59:40.125138+0000","last_clean":"2024-05-07T13:59:40.125138+0000","last_became_active":"2024-05-07T13:55:50.312605+0000","last_became_peered":"2024-05-07T13:55:50.312605+0000","last_unstale":"2024-05-07T13:59:40.125138+0000","last_undegraded":"2024-05-07T13:59:40.125138+0000","last_fullsized":"2024-05-07T13:59:40.125138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:40.125038+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:40.125038+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.125038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:59.307579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.920369+0000","last_change":"2024-05-07T14:00:00.920398+0000","last_active":"2024-05-07T14:00:00.920369+0000","last_peered":"2024-05-07T14:00:00.920369+0000","last_clean":"2024-05-07T14:00:00.920369+0000","last_became_active":"2024-05-07T13:55:48.333254+0000","last_became_peered":"2024-05-07T13:55:48.333254+0000","last_unstale":"2024-05-07T14:00:00.920369+0000","last_undegraded":"2024-05-07T14:00:00.920369+0000","last_fullsized":"2024-05-07T14:00:00.920369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.920262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.920262+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.920262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:52.170279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.057867+0000","last_change":"2024-05-07T13:59:26.057899+0000","last_active":"2024-05-07T13:59:26.057867+0000","last_peered":"2024-05-07T13:59:26.057867+0000","last_clean":"2024-05-07T13:59:26.057867+0000","last_became_active":"2024-05-07T13:55:52.321982+0000","last_became_peered":"2024-05-07T13:55:52.321982+0000","last_unstale":"2024-05-07T13:59:26.057867+0000","last_undegraded":"2024-05-07T13:59:26.057867+0000","last_fullsized":"2024-05-07T13:59:26.057867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.057767+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:23.143125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.876939+0000","last_change":"2024-05-07T13:59:16.876994+0000","last_active":"2024-05-07T13:59:16.876939+0000","last_peered":"2024-05-07T13:59:16.876939+0000","last_clean":"2024-05-07T13:59:16.876939+0000","last_became_active":"2024-05-07T13:55:54.326895+0000","last_became_peered":"2024-05-07T13:55:54.326895+0000","last_unstale":"2024-05-07T13:59:16.876939+0000","last_undegraded":"2024-05-07T13:59:16.876939+0000","last_fullsized":"2024-05-07T13:59:16.876939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.876843+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:35.990453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.058174+0000","last_change":"2024-05-07T13:59:30.058208+0000","last_active":"2024-05-07T13:59:30.058174+0000","last_peered":"2024-05-07T13:59:30.058174+0000","last_clean":"2024-05-07T13:59:30.058174+0000","last_became_active":"2024-05-07T13:55:56.343002+0000","last_became_peered":"2024-05-07T13:55:56.343002+0000","last_unstale":"2024-05-07T13:59:30.058174+0000","last_undegraded":"2024-05-07T13:59:30.058174+0000","last_fullsized":"2024-05-07T13:59:30.058174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.058080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.058080+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.058080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:49.240621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:58:59.665404+0000","last_change":"2024-05-07T13:55:58.348783+0000","last_active":"2024-05-07T13:58:59.665404+0000","last_peered":"2024-05-07T13:58:59.665404+0000","last_clean":"2024-05-07T13:58:59.665404+0000","last_became_active":"2024-05-07T13:55:58.347820+0000","last_became_peered":"2024-05-07T13:55:58.347820+0000","last_unstale":"2024-05-07T13:58:59.665404+0000","last_undegraded":"2024-05-07T13:58:59.665404+0000","last_fullsized":"2024-05-07T13:58:59.665404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:55:57.319875+0000","last_clean_scrub_stamp":"2024-05-07T13:55:57.319875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.055073+0000","last_change":"2024-05-07T13:59:32.055073+0000","last_active":"2024-05-07T13:59:32.055073+0000","last_peered":"2024-05-07T13:59:32.055073+0000","last_clean":"2024-05-07T13:59:32.055073+0000","last_became_active":"2024-05-07T13:55:50.330166+0000","last_became_peered":"2024-05-07T13:55:50.330166+0000","last_unstale":"2024-05-07T13:59:32.055073+0000","last_undegraded":"2024-05-07T13:59:32.055073+0000","last_fullsized":"2024-05-07T13:59:32.055073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:32.054935+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:32.054935+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.054935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:31.258103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.120996+0000","last_change":"2024-05-07T13:59:47.120996+0000","last_active":"2024-05-07T13:59:47.120996+0000","last_peered":"2024-05-07T13:59:47.120996+0000","last_clean":"2024-05-07T13:59:47.120996+0000","last_became_active":"2024-05-07T13:55:48.338874+0000","last_became_peered":"2024-05-07T13:55:48.338874+0000","last_unstale":"2024-05-07T13:59:47.120996+0000","last_undegraded":"2024-05-07T13:59:47.120996+0000","last_fullsized":"2024-05-07T13:59:47.120996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:47.120819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:47.120819+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.120819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:29.157325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.065990+0000","last_change":"2024-05-07T13:59:40.065990+0000","last_active":"2024-05-07T13:59:40.065990+0000","last_peered":"2024-05-07T13:59:40.065990+0000","last_clean":"2024-05-07T13:59:40.065990+0000","last_became_active":"2024-05-07T13:55:50.311324+0000","last_became_peered":"2024-05-07T13:55:50.311324+0000","last_unstale":"2024-05-07T13:59:40.065990+0000","last_undegraded":"2024-05-07T13:59:40.065990+0000","last_fullsized":"2024-05-07T13:59:40.065990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:40.065867+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:40.065867+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.065867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:27.301075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.039704+0000","last_change":"2024-05-07T13:59:41.039704+0000","last_active":"2024-05-07T13:59:41.039704+0000","last_peered":"2024-05-07T13:59:41.039704+0000","last_clean":"2024-05-07T13:59:41.039704+0000","last_became_active":"2024-05-07T13:55:48.325561+0000","last_became_peered":"2024-05-07T13:55:48.325561+0000","last_unstale":"2024-05-07T13:59:41.039704+0000","last_undegraded":"2024-05-07T13:59:41.039704+0000","last_fullsized":"2024-05-07T13:59:41.039704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.039521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.039521+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.039521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:57.803837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.983208+0000","last_change":"2024-05-07T13:59:25.983208+0000","last_active":"2024-05-07T13:59:25.983208+0000","last_peered":"2024-05-07T13:59:25.983208+0000","last_clean":"2024-05-07T13:59:25.983208+0000","last_became_active":"2024-05-07T13:55:50.326322+0000","last_became_peered":"2024-05-07T13:55:50.326322+0000","last_unstale":"2024-05-07T13:59:25.983208+0000","last_undegraded":"2024-05-07T13:59:25.983208+0000","last_fullsized":"2024-05-07T13:59:25.983208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.983056+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:20.815531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"27'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:13.196339+0000","last_change":"2024-05-07T14:00:13.196381+0000","last_active":"2024-05-07T14:00:13.196339+0000","last_peered":"2024-05-07T14:00:13.196339+0000","last_clean":"2024-05-07T14:00:13.196339+0000","last_became_active":"2024-05-07T13:55:48.350385+0000","last_became_peered":"2024-05-07T13:55:48.350385+0000","last_unstale":"2024-05-07T14:00:13.196339+0000","last_undegraded":"2024-05-07T14:00:13.196339+0000","last_fullsized":"2024-05-07T14:00:13.196339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-07T14:00:13.196233+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-07T14:00:13.196233+0000","last_clean_scrub_stamp":"2024-05-07T14:00:13.196233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:14.960991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.084260+0000","last_change":"2024-05-07T13:59:42.084260+0000","last_active":"2024-05-07T13:59:42.084260+0000","last_peered":"2024-05-07T13:59:42.084260+0000","last_clean":"2024-05-07T13:59:42.084260+0000","last_became_active":"2024-05-07T13:55:50.312703+0000","last_became_peered":"2024-05-07T13:55:50.312703+0000","last_unstale":"2024-05-07T13:59:42.084260+0000","last_undegraded":"2024-05-07T13:59:42.084260+0000","last_fullsized":"2024-05-07T13:59:42.084260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:42.084125+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:42.084125+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.084125+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:03.874653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.109470+0000","last_change":"2024-05-07T14:00:03.109504+0000","last_active":"2024-05-07T14:00:03.109470+0000","last_peered":"2024-05-07T14:00:03.109470+0000","last_clean":"2024-05-07T14:00:03.109470+0000","last_became_active":"2024-05-07T13:55:48.323979+0000","last_became_peered":"2024-05-07T13:55:48.323979+0000","last_unstale":"2024-05-07T14:00:03.109470+0000","last_undegraded":"2024-05-07T14:00:03.109470+0000","last_fullsized":"2024-05-07T14:00:03.109470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:03.109379+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:03.109379+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.109379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:07.609903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.019212+0000","last_change":"2024-05-07T13:59:36.019212+0000","last_active":"2024-05-07T13:59:36.019212+0000","last_peered":"2024-05-07T13:59:36.019212+0000","last_clean":"2024-05-07T13:59:36.019212+0000","last_became_active":"2024-05-07T13:55:50.331311+0000","last_became_peered":"2024-05-07T13:55:50.331311+0000","last_unstale":"2024-05-07T13:59:36.019212+0000","last_undegraded":"2024-05-07T13:59:36.019212+0000","last_fullsized":"2024-05-07T13:59:36.019212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:36.019068+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:36.019068+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.019068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:40.795315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.030870+0000","last_change":"2024-05-07T13:59:51.030870+0000","last_active":"2024-05-07T13:59:51.030870+0000","last_peered":"2024-05-07T13:59:51.030870+0000","last_clean":"2024-05-07T13:59:51.030870+0000","last_became_active":"2024-05-07T13:55:48.325858+0000","last_became_peered":"2024-05-07T13:55:48.325858+0000","last_unstale":"2024-05-07T13:59:51.030870+0000","last_undegraded":"2024-05-07T13:59:51.030870+0000","last_fullsized":"2024-05-07T13:59:51.030870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:51.030727+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:51.030727+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.030727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:23.693886+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'8","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.064923+0000","last_change":"2024-05-07T13:59:37.064923+0000","last_active":"2024-05-07T13:59:37.064923+0000","last_peered":"2024-05-07T13:59:37.064923+0000","last_clean":"2024-05-07T13:59:37.064923+0000","last_became_active":"2024-05-07T13:55:50.323573+0000","last_became_peered":"2024-05-07T13:55:50.323573+0000","last_unstale":"2024-05-07T13:59:37.064923+0000","last_undegraded":"2024-05-07T13:59:37.064923+0000","last_fullsized":"2024-05-07T13:59:37.064923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:37.064807+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:37.064807+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.064807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:27:22.190330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.913691+0000","last_change":"2024-05-07T14:00:01.913691+0000","last_active":"2024-05-07T14:00:01.913691+0000","last_peered":"2024-05-07T14:00:01.913691+0000","last_clean":"2024-05-07T14:00:01.913691+0000","last_became_active":"2024-05-07T13:55:48.334268+0000","last_became_peered":"2024-05-07T13:55:48.334268+0000","last_unstale":"2024-05-07T14:00:01.913691+0000","last_undegraded":"2024-05-07T14:00:01.913691+0000","last_fullsized":"2024-05-07T14:00:01.913691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T14:00:01.913563+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T14:00:01.913563+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.913563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:52.729005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.072192+0000","last_change":"2024-05-07T14:00:04.072255+0000","last_active":"2024-05-07T14:00:04.072192+0000","last_peered":"2024-05-07T14:00:04.072192+0000","last_clean":"2024-05-07T14:00:04.072192+0000","last_became_active":"2024-05-07T13:55:50.320242+0000","last_became_peered":"2024-05-07T13:55:50.320242+0000","last_unstale":"2024-05-07T14:00:04.072192+0000","last_undegraded":"2024-05-07T14:00:04.072192+0000","last_fullsized":"2024-05-07T14:00:04.072192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T14:00:04.072088+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T14:00:04.072088+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.072088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:32:14.005162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.098472+0000","last_change":"2024-05-07T13:59:39.098472+0000","last_active":"2024-05-07T13:59:39.098472+0000","last_peered":"2024-05-07T13:59:39.098472+0000","last_clean":"2024-05-07T13:59:39.098472+0000","last_became_active":"2024-05-07T13:55:48.340718+0000","last_became_peered":"2024-05-07T13:55:48.340718+0000","last_unstale":"2024-05-07T13:59:39.098472+0000","last_undegraded":"2024-05-07T13:59:39.098472+0000","last_fullsized":"2024-05-07T13:59:39.098472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:39.098327+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:39.098327+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.098327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:06.470550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'12","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.080660+0000","last_change":"2024-05-07T13:59:51.080660+0000","last_active":"2024-05-07T13:59:51.080660+0000","last_peered":"2024-05-07T13:59:51.080660+0000","last_clean":"2024-05-07T13:59:51.080660+0000","last_became_active":"2024-05-07T13:55:50.320430+0000","last_became_peered":"2024-05-07T13:55:50.320430+0000","last_unstale":"2024-05-07T13:59:51.080660+0000","last_undegraded":"2024-05-07T13:59:51.080660+0000","last_fullsized":"2024-05-07T13:59:51.080660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:51.080529+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:51.080529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.080529+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:36.200537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.150670+0000","last_change":"2024-05-07T14:00:00.150670+0000","last_active":"2024-05-07T14:00:00.150670+0000","last_peered":"2024-05-07T14:00:00.150670+0000","last_clean":"2024-05-07T14:00:00.150670+0000","last_became_active":"2024-05-07T13:55:48.323524+0000","last_became_peered":"2024-05-07T13:55:48.323524+0000","last_unstale":"2024-05-07T14:00:00.150670+0000","last_undegraded":"2024-05-07T14:00:00.150670+0000","last_fullsized":"2024-05-07T14:00:00.150670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.150551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.150551+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.150551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:28.705432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.097729+0000","last_change":"2024-05-07T13:59:45.097757+0000","last_active":"2024-05-07T13:59:45.097729+0000","last_peered":"2024-05-07T13:59:45.097729+0000","last_clean":"2024-05-07T13:59:45.097729+0000","last_became_active":"2024-05-07T13:55:50.313012+0000","last_became_peered":"2024-05-07T13:55:50.313012+0000","last_unstale":"2024-05-07T13:59:45.097729+0000","last_undegraded":"2024-05-07T13:59:45.097729+0000","last_fullsized":"2024-05-07T13:59:45.097729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-07T13:59:45.097632+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-07T13:59:45.097632+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.097632+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:52:01.861948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.169146+0000","last_change":"2024-05-07T13:59:59.169146+0000","last_active":"2024-05-07T13:59:59.169146+0000","last_peered":"2024-05-07T13:59:59.169146+0000","last_clean":"2024-05-07T13:59:59.169146+0000","last_became_active":"2024-05-07T13:55:48.351882+0000","last_became_peered":"2024-05-07T13:55:48.351882+0000","last_unstale":"2024-05-07T13:59:59.169146+0000","last_undegraded":"2024-05-07T13:59:59.169146+0000","last_fullsized":"2024-05-07T13:59:59.169146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:59.169028+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:59.169028+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.169028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:32:41.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'8","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.983342+0000","last_change":"2024-05-07T13:59:29.983379+0000","last_active":"2024-05-07T13:59:29.983342+0000","last_peered":"2024-05-07T13:59:29.983342+0000","last_clean":"2024-05-07T13:59:29.983342+0000","last_became_active":"2024-05-07T13:55:50.325807+0000","last_became_peered":"2024-05-07T13:55:50.325807+0000","last_unstale":"2024-05-07T13:59:29.983342+0000","last_undegraded":"2024-05-07T13:59:29.983342+0000","last_fullsized":"2024-05-07T13:59:29.983342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:29.983257+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:29.983257+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.983257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:23.280897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.148407+0000","last_change":"2024-05-07T13:59:45.148407+0000","last_active":"2024-05-07T13:59:45.148407+0000","last_peered":"2024-05-07T13:59:45.148407+0000","last_clean":"2024-05-07T13:59:45.148407+0000","last_became_active":"2024-05-07T13:55:48.324919+0000","last_became_peered":"2024-05-07T13:55:48.324919+0000","last_unstale":"2024-05-07T13:59:45.148407+0000","last_undegraded":"2024-05-07T13:59:45.148407+0000","last_fullsized":"2024-05-07T13:59:45.148407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:45.148279+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:45.148279+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.148279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:40.994289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.037562+0000","last_change":"2024-05-07T13:59:39.037562+0000","last_active":"2024-05-07T13:59:39.037562+0000","last_peered":"2024-05-07T13:59:39.037562+0000","last_clean":"2024-05-07T13:59:39.037562+0000","last_became_active":"2024-05-07T13:55:50.325620+0000","last_became_peered":"2024-05-07T13:55:50.325620+0000","last_unstale":"2024-05-07T13:59:39.037562+0000","last_undegraded":"2024-05-07T13:59:39.037562+0000","last_fullsized":"2024-05-07T13:59:39.037562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:39.037426+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:39.037426+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.037426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:05.113376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.118048+0000","last_change":"2024-05-07T13:59:48.118048+0000","last_active":"2024-05-07T13:59:48.118048+0000","last_peered":"2024-05-07T13:59:48.118048+0000","last_clean":"2024-05-07T13:59:48.118048+0000","last_became_active":"2024-05-07T13:55:48.342508+0000","last_became_peered":"2024-05-07T13:55:48.342508+0000","last_unstale":"2024-05-07T13:59:48.118048+0000","last_undegraded":"2024-05-07T13:59:48.118048+0000","last_fullsized":"2024-05-07T13:59:48.118048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:48.117871+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:48.117871+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.117871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:21.723026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.019469+0000","last_change":"2024-05-07T13:59:53.019469+0000","last_active":"2024-05-07T13:59:53.019469+0000","last_peered":"2024-05-07T13:59:53.019469+0000","last_clean":"2024-05-07T13:59:53.019469+0000","last_became_active":"2024-05-07T13:55:50.321606+0000","last_became_peered":"2024-05-07T13:55:50.321606+0000","last_unstale":"2024-05-07T13:59:53.019469+0000","last_undegraded":"2024-05-07T13:59:53.019469+0000","last_fullsized":"2024-05-07T13:59:53.019469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:53.019341+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:53.019341+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.019341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:46.316981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.943614+0000","last_change":"2024-05-07T13:59:58.943614+0000","last_active":"2024-05-07T13:59:58.943614+0000","last_peered":"2024-05-07T13:59:58.943614+0000","last_clean":"2024-05-07T13:59:58.943614+0000","last_became_active":"2024-05-07T13:55:48.332247+0000","last_became_peered":"2024-05-07T13:55:48.332247+0000","last_unstale":"2024-05-07T13:59:58.943614+0000","last_undegraded":"2024-05-07T13:59:58.943614+0000","last_fullsized":"2024-05-07T13:59:58.943614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:58.943486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:58.943486+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.943486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:27.322012+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'16","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.097975+0000","last_change":"2024-05-07T13:59:36.097975+0000","last_active":"2024-05-07T13:59:36.097975+0000","last_peered":"2024-05-07T13:59:36.097975+0000","last_clean":"2024-05-07T13:59:36.097975+0000","last_became_active":"2024-05-07T13:55:50.329434+0000","last_became_peered":"2024-05-07T13:55:50.329434+0000","last_unstale":"2024-05-07T13:59:36.097975+0000","last_undegraded":"2024-05-07T13:59:36.097975+0000","last_fullsized":"2024-05-07T13:59:36.097975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:36.097848+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:36.097848+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.097848+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:05:27.587259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:16.200233+0000","last_change":"2024-05-07T14:00:16.200233+0000","last_active":"2024-05-07T14:00:16.200233+0000","last_peered":"2024-05-07T14:00:16.200233+0000","last_clean":"2024-05-07T14:00:16.200233+0000","last_became_active":"2024-05-07T13:55:48.345844+0000","last_became_peered":"2024-05-07T13:55:48.345844+0000","last_unstale":"2024-05-07T14:00:16.200233+0000","last_undegraded":"2024-05-07T14:00:16.200233+0000","last_fullsized":"2024-05-07T14:00:16.200233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:16.200038+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:16.200038+0000","last_clean_scrub_stamp":"2024-05-07T14:00:16.200038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:57.962122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.053031+0000","last_change":"2024-05-07T13:59:42.053031+0000","last_active":"2024-05-07T13:59:42.053031+0000","last_peered":"2024-05-07T13:59:42.053031+0000","last_clean":"2024-05-07T13:59:42.053031+0000","last_became_active":"2024-05-07T13:55:50.313049+0000","last_became_peered":"2024-05-07T13:55:50.313049+0000","last_unstale":"2024-05-07T13:59:42.053031+0000","last_undegraded":"2024-05-07T13:59:42.053031+0000","last_fullsized":"2024-05-07T13:59:42.053031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:42.052863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:42.052863+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.052863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:36.854007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:10.129194+0000","last_change":"2024-05-07T14:00:10.129194+0000","last_active":"2024-05-07T14:00:10.129194+0000","last_peered":"2024-05-07T14:00:10.129194+0000","last_clean":"2024-05-07T14:00:10.129194+0000","last_became_active":"2024-05-07T13:55:48.346691+0000","last_became_peered":"2024-05-07T13:55:48.346691+0000","last_unstale":"2024-05-07T14:00:10.129194+0000","last_undegraded":"2024-05-07T14:00:10.129194+0000","last_fullsized":"2024-05-07T14:00:10.129194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:10.129056+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:10.129056+0000","last_clean_scrub_stamp":"2024-05-07T14:00:10.129056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:06:55.990729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'10","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.249376+0000","last_change":"2024-05-07T13:59:51.249376+0000","last_active":"2024-05-07T13:59:51.249376+0000","last_peered":"2024-05-07T13:59:51.249376+0000","last_clean":"2024-05-07T13:59:51.249376+0000","last_became_active":"2024-05-07T13:55:50.322543+0000","last_became_peered":"2024-05-07T13:55:50.322543+0000","last_unstale":"2024-05-07T13:59:51.249376+0000","last_undegraded":"2024-05-07T13:59:51.249376+0000","last_fullsized":"2024-05-07T13:59:51.249376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:51.249245+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:51.249245+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.249245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:52:29.222971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.140179+0000","last_change":"2024-05-07T13:59:41.140179+0000","last_active":"2024-05-07T13:59:41.140179+0000","last_peered":"2024-05-07T13:59:41.140179+0000","last_clean":"2024-05-07T13:59:41.140179+0000","last_became_active":"2024-05-07T13:55:48.339909+0000","last_became_peered":"2024-05-07T13:55:48.339909+0000","last_unstale":"2024-05-07T13:59:41.140179+0000","last_undegraded":"2024-05-07T13:59:41.140179+0000","last_fullsized":"2024-05-07T13:59:41.140179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.140056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.140056+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.140056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:23.488647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.113305+0000","last_change":"2024-05-07T13:59:40.113305+0000","last_active":"2024-05-07T13:59:40.113305+0000","last_peered":"2024-05-07T13:59:40.113305+0000","last_clean":"2024-05-07T13:59:40.113305+0000","last_became_active":"2024-05-07T13:55:50.322967+0000","last_became_peered":"2024-05-07T13:55:50.322967+0000","last_unstale":"2024-05-07T13:59:40.113305+0000","last_undegraded":"2024-05-07T13:59:40.113305+0000","last_fullsized":"2024-05-07T13:59:40.113305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:40.113131+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:40.113131+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.113131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:44.889378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:24.290453+0000","last_change":"2024-05-07T14:00:24.290453+0000","last_active":"2024-05-07T14:00:24.290453+0000","last_peered":"2024-05-07T14:00:24.290453+0000","last_clean":"2024-05-07T14:00:24.290453+0000","last_became_active":"2024-05-07T13:55:48.346724+0000","last_became_peered":"2024-05-07T13:55:48.346724+0000","last_unstale":"2024-05-07T14:00:24.290453+0000","last_undegraded":"2024-05-07T14:00:24.290453+0000","last_fullsized":"2024-05-07T14:00:24.290453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:24.290320+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:24.290320+0000","last_clean_scrub_stamp":"2024-05-07T14:00:24.290320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:02.945247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:11.145467+0000","last_change":"2024-05-07T14:00:11.145467+0000","last_active":"2024-05-07T14:00:11.145467+0000","last_peered":"2024-05-07T14:00:11.145467+0000","last_clean":"2024-05-07T14:00:11.145467+0000","last_became_active":"2024-05-07T13:55:48.349852+0000","last_became_peered":"2024-05-07T13:55:48.349852+0000","last_unstale":"2024-05-07T14:00:11.145467+0000","last_undegraded":"2024-05-07T14:00:11.145467+0000","last_fullsized":"2024-05-07T14:00:11.145467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:11.145337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:11.145337+0000","last_clean_scrub_stamp":"2024-05-07T14:00:11.145337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:11.601729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'4","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.162833+0000","last_change":"2024-05-07T13:59:54.162869+0000","last_active":"2024-05-07T13:59:54.162833+0000","last_peered":"2024-05-07T13:59:54.162833+0000","last_clean":"2024-05-07T13:59:54.162833+0000","last_became_active":"2024-05-07T13:55:50.319033+0000","last_became_peered":"2024-05-07T13:55:50.319033+0000","last_unstale":"2024-05-07T13:59:54.162833+0000","last_undegraded":"2024-05-07T13:59:54.162833+0000","last_fullsized":"2024-05-07T13:59:54.162833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:54.162744+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:54.162744+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.162744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:59.028242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.100759+0000","last_change":"2024-05-07T13:59:47.100759+0000","last_active":"2024-05-07T13:59:47.100759+0000","last_peered":"2024-05-07T13:59:47.100759+0000","last_clean":"2024-05-07T13:59:47.100759+0000","last_became_active":"2024-05-07T13:55:48.324081+0000","last_became_peered":"2024-05-07T13:55:48.324081+0000","last_unstale":"2024-05-07T13:59:47.100759+0000","last_undegraded":"2024-05-07T13:59:47.100759+0000","last_fullsized":"2024-05-07T13:59:47.100759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:47.100641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:47.100641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.100641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:57.320731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.027329+0000","last_change":"2024-05-07T13:59:34.027372+0000","last_active":"2024-05-07T13:59:34.027329+0000","last_peered":"2024-05-07T13:59:34.027329+0000","last_clean":"2024-05-07T13:59:34.027329+0000","last_became_active":"2024-05-07T13:55:50.329848+0000","last_became_peered":"2024-05-07T13:55:50.329848+0000","last_unstale":"2024-05-07T13:59:34.027329+0000","last_undegraded":"2024-05-07T13:59:34.027329+0000","last_fullsized":"2024-05-07T13:59:34.027329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:34.027225+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:34.027225+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.027225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:34.330181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705725,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":136605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":970752,"data_stored":724702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705725,"num_pgs":157,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44628,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327212,"statfs":{"total":96636764160,"available":96591065088,"internally_reserved":0,"allocated":995328,"data_stored":724122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":401408,"data_stored":134585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:00:32.416 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:32.417 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:32.417 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:32.418 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:32.418 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:32.418 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:32.418 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-07T13:55:57.319875+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=55, tm_sec=57, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=13, tm_min=59, tm_sec=7, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:00:32.419 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T14:00:52.420 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:00:52.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.548+0000 7efd0806a640 1 Processor -- start 2024-05-07T14:00:52.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.549+0000 7efd0806a640 1 -- start start 2024-05-07T14:00:52.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.549+0000 7efd0806a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd00131640 0x7efd00133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:52.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.549+0000 7efd0806a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd0006e710 con 0x7efd0006d7f0 2024-05-07T14:00:52.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.549+0000 7efd0806a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7efd0006f2a0 con 0x7efd00131640 2024-05-07T14:00:52.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.549+0000 7efd05605640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd00131640 0x7efd00133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:52.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.549+0000 7efd05e06640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efd0006d7f0 0x7efd0006dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35952/0 (socket says 172.21.15.22:35952) 2024-05-07T14:00:52.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.549+0000 7efd05e06640 1 -- 172.21.15.22:0/738421508 learned_addr learned my addr 172.21.15.22:0/738421508 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T14:00:52.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.549+0000 7efd05605640 1 -- 172.21.15.22:0/738421508 >> v1:172.21.15.22:6789/0 conn(0x7efd0006d7f0 legacy=0x7efd0006dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:52.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.550+0000 7efd05605640 1 -- 172.21.15.22:0/738421508 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0006f4e0 con 0x7efd00131640 2024-05-07T14:00:52.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.549+0000 7efd04e04640 1 -- 172.21.15.22:0/738421508 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287699369 0 0) 0x7efd0006e710 con 0x7efd0006d7f0 2024-05-07T14:00:52.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.550+0000 7efd05605640 1 --2- 172.21.15.22:0/738421508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd00131640 0x7efd00133a30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009720 tx=0x7efcf002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad467ddf28f0a88 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:52.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.550+0000 7efd04e04640 1 -- 172.21.15.22:0/738421508 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf00316d0 con 0x7efd00131640 2024-05-07T14:00:52.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.550+0000 7efd04e04640 1 -- 172.21.15.22:0/738421508 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf0037070 con 0x7efd00131640 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.551+0000 7efd04e04640 1 -- 172.21.15.22:0/738421508 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf00319c0 con 0x7efd00131640 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.551+0000 7efd0806a640 1 -- 172.21.15.22:0/738421508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd00131640 msgr2=0x7efd00133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.551+0000 7efd0806a640 1 --2- 172.21.15.22:0/738421508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd00131640 0x7efd00133a30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009720 tx=0x7efcf002b840 comp rx=0 tx=0).stop 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.551+0000 7efd0806a640 1 -- 172.21.15.22:0/738421508 shutdown_connections 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.551+0000 7efd0806a640 1 --2- 172.21.15.22:0/738421508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd00131640 0x7efd00133a30 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.551+0000 7efd0806a640 1 -- 172.21.15.22:0/738421508 >> 172.21.15.22:0/738421508 conn(0x7efd000a0b40 msgr2=0x7efd000a0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.551+0000 7efd0806a640 1 -- 172.21.15.22:0/738421508 shutdown_connections 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.551+0000 7efd0806a640 1 -- 172.21.15.22:0/738421508 wait complete. 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.552+0000 7efd0806a640 1 Processor -- start 2024-05-07T14:00:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.552+0000 7efd0806a640 1 -- start start 2024-05-07T14:00:52.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.552+0000 7efd0806a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0006d7f0 0x7efd001c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:52.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.552+0000 7efd0806a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efd0006e460 con 0x7efd0006d7f0 2024-05-07T14:00:52.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efd05e06640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0006d7f0 0x7efd001c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:52.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efd05e06640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0006d7f0 0x7efd001c2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49440/0 (socket says 172.21.15.22:49440) 2024-05-07T14:00:52.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efd05e06640 1 -- 172.21.15.22:0/3629366975 learned_addr learned my addr 172.21.15.22:0/3629366975 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T14:00:52.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efd05e06640 1 -- 172.21.15.22:0/3629366975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0009e020 con 0x7efd0006d7f0 2024-05-07T14:00:52.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efd05e06640 1 --2- 172.21.15.22:0/3629366975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0006d7f0 0x7efd001c2ea0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c420 tx=0x7efcfc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:52.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efcf67fc640 1 -- 172.21.15.22:0/3629366975 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcfc018070 con 0x7efd0006d7f0 2024-05-07T14:00:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efcf67fc640 1 -- 172.21.15.22:0/3629366975 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcfc0074d0 con 0x7efd0006d7f0 2024-05-07T14:00:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0009e300 con 0x7efd0006d7f0 2024-05-07T14:00:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efcf67fc640 1 -- 172.21.15.22:0/3629366975 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcfc004950 con 0x7efd0006d7f0 2024-05-07T14:00:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.553+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0009d820 con 0x7efd0006d7f0 2024-05-07T14:00:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.554+0000 7efcf67fc640 1 -- 172.21.15.22:0/3629366975 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efcfc01b070 con 0x7efd0006d7f0 2024-05-07T14:00:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.554+0000 7efcf67fc640 1 --2- 172.21.15.22:0/3629366975 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efce4038060 0x7efce403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.554+0000 7efcf67fc640 1 -- 172.21.15.22:0/3629366975 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7efcfc04adc0 con 0x7efd0006d7f0 2024-05-07T14:00:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.554+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd00062e90 con 0x7efd0006d7f0 2024-05-07T14:00:52.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.555+0000 7efd05605640 1 --2- 172.21.15.22:0/3629366975 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efce4038060 0x7efce403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:52.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.555+0000 7efd05605640 1 --2- 172.21.15.22:0/3629366975 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efce4038060 0x7efce403a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009720 tx=0x7efcf0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:52.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.559+0000 7efcf67fc640 1 -- 172.21.15.22:0/3629366975 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efcfc011980 con 0x7efd0006d7f0 2024-05-07T14:00:52.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.743+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 --> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd00073fd0 con 0x7efce4038060 2024-05-07T14:00:52.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.760+0000 7efcf67fc640 1 -- 172.21.15.22:0/3629366975 <== mgr.4098 v2:172.21.15.50:6824/985543100 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666302 (secure 0 0 0) 0x7efd00073fd0 con 0x7efce4038060 2024-05-07T14:00:52.755 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-07T14:00:52.760 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-07T14:00:52.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efce4038060 msgr2=0x7efce403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:52.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 --2- 172.21.15.22:0/3629366975 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efce4038060 0x7efce403a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009720 tx=0x7efcf0008030 comp rx=0 tx=0).stop 2024-05-07T14:00:52.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0006d7f0 msgr2=0x7efd001c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:52.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 --2- 172.21.15.22:0/3629366975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0006d7f0 0x7efd001c2ea0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c420 tx=0x7efcfc00c8e0 comp rx=0 tx=0).stop 2024-05-07T14:00:52.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 shutdown_connections 2024-05-07T14:00:52.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 --2- 172.21.15.22:0/3629366975 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7efce4038060 0x7efce403a520 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:52.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 --2- 172.21.15.22:0/3629366975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0006d7f0 0x7efd001c2ea0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:52.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 >> 172.21.15.22:0/3629366975 conn(0x7efd000a0b40 msgr2=0x7efd000968b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T14:00:52.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 shutdown_connections 2024-05-07T14:00:52.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.765+0000 7efd0806a640 1 -- 172.21.15.22:0/3629366975 wait complete. 2024-05-07T14:00:52.764 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-05-07T14:00:52.198966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5119,"num_read_kb":4700,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":46,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4785,"ondisk_log_size":4785,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":131608,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377355752,"statfs":{"total":386547056640,"available":386412290048,"internally_reserved":0,"allocated":2809856,"data_stored":1720014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":131917590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004863"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.910461+0000","last_change":"2024-05-07T13:59:51.910461+0000","last_active":"2024-05-07T13:59:51.910461+0000","last_peered":"2024-05-07T13:59:51.910461+0000","last_clean":"2024-05-07T13:59:51.910461+0000","last_became_active":"2024-05-07T13:55:48.335740+0000","last_became_peered":"2024-05-07T13:55:48.335740+0000","last_unstale":"2024-05-07T13:59:51.910461+0000","last_undegraded":"2024-05-07T13:59:51.910461+0000","last_fullsized":"2024-05-07T13:59:51.910461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:51.910320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:51.910320+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.910320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:13.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'14","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.100728+0000","last_change":"2024-05-07T13:59:49.100756+0000","last_active":"2024-05-07T13:59:49.100728+0000","last_peered":"2024-05-07T13:59:49.100728+0000","last_clean":"2024-05-07T13:59:49.100728+0000","last_became_active":"2024-05-07T13:55:50.316253+0000","last_became_peered":"2024-05-07T13:55:50.316253+0000","last_unstale":"2024-05-07T13:59:49.100728+0000","last_undegraded":"2024-05-07T13:59:49.100728+0000","last_fullsized":"2024-05-07T13:59:49.100728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:49.100641+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:49.100641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.100641+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:44.946651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.198506+0000","last_change":"2024-05-07T13:59:59.198533+0000","last_active":"2024-05-07T13:59:59.198506+0000","last_peered":"2024-05-07T13:59:59.198506+0000","last_clean":"2024-05-07T13:59:59.198506+0000","last_became_active":"2024-05-07T13:55:48.323151+0000","last_became_peered":"2024-05-07T13:55:48.323151+0000","last_unstale":"2024-05-07T13:59:59.198506+0000","last_undegraded":"2024-05-07T13:59:59.198506+0000","last_fullsized":"2024-05-07T13:59:59.198506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:59.198410+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:59.198410+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.198410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:17.533202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:55.185191+0000","last_change":"2024-05-07T13:59:55.185213+0000","last_active":"2024-05-07T13:59:55.185191+0000","last_peered":"2024-05-07T13:59:55.185191+0000","last_clean":"2024-05-07T13:59:55.185191+0000","last_became_active":"2024-05-07T13:55:50.322066+0000","last_became_peered":"2024-05-07T13:55:50.322066+0000","last_unstale":"2024-05-07T13:59:55.185191+0000","last_undegraded":"2024-05-07T13:59:55.185191+0000","last_fullsized":"2024-05-07T13:59:55.185191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:55.185090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:55.185090+0000","last_clean_scrub_stamp":"2024-05-07T13:59:55.185090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:57:41.597583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.098344+0000","last_change":"2024-05-07T14:00:04.098378+0000","last_active":"2024-05-07T14:00:04.098344+0000","last_peered":"2024-05-07T14:00:04.098344+0000","last_clean":"2024-05-07T14:00:04.098344+0000","last_became_active":"2024-05-07T13:55:48.347661+0000","last_became_peered":"2024-05-07T13:55:48.347661+0000","last_unstale":"2024-05-07T14:00:04.098344+0000","last_undegraded":"2024-05-07T14:00:04.098344+0000","last_fullsized":"2024-05-07T14:00:04.098344+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:04.098253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:04.098253+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.098253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:24:11.641731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.273171+0000","last_change":"2024-05-07T13:59:50.273197+0000","last_active":"2024-05-07T13:59:50.273171+0000","last_peered":"2024-05-07T13:59:50.273171+0000","last_clean":"2024-05-07T13:59:50.273171+0000","last_became_active":"2024-05-07T13:55:50.321598+0000","last_became_peered":"2024-05-07T13:55:50.321598+0000","last_unstale":"2024-05-07T13:59:50.273171+0000","last_undegraded":"2024-05-07T13:59:50.273171+0000","last_fullsized":"2024-05-07T13:59:50.273171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:50.273079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:50.273079+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.273079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:41.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.888847+0000","last_change":"2024-05-07T13:59:54.888873+0000","last_active":"2024-05-07T13:59:54.888847+0000","last_peered":"2024-05-07T13:59:54.888847+0000","last_clean":"2024-05-07T13:59:54.888847+0000","last_became_active":"2024-05-07T13:55:48.337418+0000","last_became_peered":"2024-05-07T13:55:48.337418+0000","last_unstale":"2024-05-07T13:59:54.888847+0000","last_undegraded":"2024-05-07T13:59:54.888847+0000","last_fullsized":"2024-05-07T13:59:54.888847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:54.888740+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:54.888740+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.888740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:50.734750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.873096+0000","last_change":"2024-05-07T14:00:01.873127+0000","last_active":"2024-05-07T14:00:01.873096+0000","last_peered":"2024-05-07T14:00:01.873096+0000","last_clean":"2024-05-07T14:00:01.873096+0000","last_became_active":"2024-05-07T13:56:35.366947+0000","last_became_peered":"2024-05-07T13:56:35.366947+0000","last_unstale":"2024-05-07T14:00:01.873096+0000","last_undegraded":"2024-05-07T14:00:01.873096+0000","last_fullsized":"2024-05-07T14:00:01.873096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:01.873006+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:01.873006+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.873006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:22:00.612116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:08.132159+0000","last_change":"2024-05-07T14:00:08.132159+0000","last_active":"2024-05-07T14:00:08.132159+0000","last_peered":"2024-05-07T14:00:08.132159+0000","last_clean":"2024-05-07T14:00:08.132159+0000","last_became_active":"2024-05-07T13:55:48.347714+0000","last_became_peered":"2024-05-07T13:55:48.347714+0000","last_unstale":"2024-05-07T14:00:08.132159+0000","last_undegraded":"2024-05-07T14:00:08.132159+0000","last_fullsized":"2024-05-07T14:00:08.132159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:08.132042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:08.132042+0000","last_clean_scrub_stamp":"2024-05-07T14:00:08.132042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:12:48.834991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'8","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.090564+0000","last_change":"2024-05-07T13:59:47.090564+0000","last_active":"2024-05-07T13:59:47.090564+0000","last_peered":"2024-05-07T13:59:47.090564+0000","last_clean":"2024-05-07T13:59:47.090564+0000","last_became_active":"2024-05-07T13:55:50.314660+0000","last_became_peered":"2024-05-07T13:55:50.314660+0000","last_unstale":"2024-05-07T13:59:47.090564+0000","last_undegraded":"2024-05-07T13:59:47.090564+0000","last_fullsized":"2024-05-07T13:59:47.090564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-07T13:59:47.090435+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-07T13:59:47.090435+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.090435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:22.240440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.153642+0000","last_change":"2024-05-07T13:59:43.153642+0000","last_active":"2024-05-07T13:59:43.153642+0000","last_peered":"2024-05-07T13:59:43.153642+0000","last_clean":"2024-05-07T13:59:43.153642+0000","last_became_active":"2024-05-07T13:55:48.337256+0000","last_became_peered":"2024-05-07T13:55:48.337256+0000","last_unstale":"2024-05-07T13:59:43.153642+0000","last_undegraded":"2024-05-07T13:59:43.153642+0000","last_fullsized":"2024-05-07T13:59:43.153642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:43.153472+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:43.153472+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.153472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:43.479597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'6","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.225152+0000","last_change":"2024-05-07T13:59:56.225152+0000","last_active":"2024-05-07T13:59:56.225152+0000","last_peered":"2024-05-07T13:59:56.225152+0000","last_clean":"2024-05-07T13:59:56.225152+0000","last_became_active":"2024-05-07T13:55:50.322204+0000","last_became_peered":"2024-05-07T13:55:50.322204+0000","last_unstale":"2024-05-07T13:59:56.225152+0000","last_undegraded":"2024-05-07T13:59:56.225152+0000","last_fullsized":"2024-05-07T13:59:56.225152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:56.225019+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:56.225019+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.225019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:31:35.247577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:18.186385+0000","last_change":"2024-05-07T14:00:18.186385+0000","last_active":"2024-05-07T14:00:18.186385+0000","last_peered":"2024-05-07T14:00:18.186385+0000","last_clean":"2024-05-07T14:00:18.186385+0000","last_became_active":"2024-05-07T13:55:48.347006+0000","last_became_peered":"2024-05-07T13:55:48.347006+0000","last_unstale":"2024-05-07T14:00:18.186385+0000","last_undegraded":"2024-05-07T14:00:18.186385+0000","last_fullsized":"2024-05-07T14:00:18.186385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:18.186252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:18.186252+0000","last_clean_scrub_stamp":"2024-05-07T14:00:18.186252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:24.119862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.065113+0000","last_change":"2024-05-07T13:59:34.065113+0000","last_active":"2024-05-07T13:59:34.065113+0000","last_peered":"2024-05-07T13:59:34.065113+0000","last_clean":"2024-05-07T13:59:34.065113+0000","last_became_active":"2024-05-07T13:55:50.312835+0000","last_became_peered":"2024-05-07T13:55:50.312835+0000","last_unstale":"2024-05-07T13:59:34.065113+0000","last_undegraded":"2024-05-07T13:59:34.065113+0000","last_fullsized":"2024-05-07T13:59:34.065113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:34.064991+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:34.064991+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.064991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:30.763581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.131481+0000","last_change":"2024-05-07T14:00:02.131481+0000","last_active":"2024-05-07T14:00:02.131481+0000","last_peered":"2024-05-07T14:00:02.131481+0000","last_clean":"2024-05-07T14:00:02.131481+0000","last_became_active":"2024-05-07T13:55:48.323612+0000","last_became_peered":"2024-05-07T13:55:48.323612+0000","last_unstale":"2024-05-07T14:00:02.131481+0000","last_undegraded":"2024-05-07T14:00:02.131481+0000","last_fullsized":"2024-05-07T14:00:02.131481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-07T14:00:02.131343+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-07T14:00:02.131343+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.131343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:38:31.297761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.099829+0000","last_change":"2024-05-07T13:59:46.099829+0000","last_active":"2024-05-07T13:59:46.099829+0000","last_peered":"2024-05-07T13:59:46.099829+0000","last_clean":"2024-05-07T13:59:46.099829+0000","last_became_active":"2024-05-07T13:55:50.325055+0000","last_became_peered":"2024-05-07T13:55:50.325055+0000","last_unstale":"2024-05-07T13:59:46.099829+0000","last_undegraded":"2024-05-07T13:59:46.099829+0000","last_fullsized":"2024-05-07T13:59:46.099829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:46.099644+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:46.099644+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.099644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:50.875891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'22","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.185788+0000","last_change":"2024-05-07T13:59:58.185788+0000","last_active":"2024-05-07T13:59:58.185788+0000","last_peered":"2024-05-07T13:59:58.185788+0000","last_clean":"2024-05-07T13:59:58.185788+0000","last_became_active":"2024-05-07T13:55:50.321385+0000","last_became_peered":"2024-05-07T13:55:50.321385+0000","last_unstale":"2024-05-07T13:59:58.185788+0000","last_undegraded":"2024-05-07T13:59:58.185788+0000","last_fullsized":"2024-05-07T13:59:58.185788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-07T13:59:58.185680+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-07T13:59:58.185680+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.185680+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:35:22.015706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.916321+0000","last_change":"2024-05-07T14:00:02.916321+0000","last_active":"2024-05-07T14:00:02.916321+0000","last_peered":"2024-05-07T14:00:02.916321+0000","last_clean":"2024-05-07T14:00:02.916321+0000","last_became_active":"2024-05-07T13:55:48.335213+0000","last_became_peered":"2024-05-07T13:55:48.335213+0000","last_unstale":"2024-05-07T14:00:02.916321+0000","last_undegraded":"2024-05-07T14:00:02.916321+0000","last_fullsized":"2024-05-07T14:00:02.916321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T14:00:02.916198+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T14:00:02.916198+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.916198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:21.250990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.067301+0000","last_change":"2024-05-07T13:59:41.067301+0000","last_active":"2024-05-07T13:59:41.067301+0000","last_peered":"2024-05-07T13:59:41.067301+0000","last_clean":"2024-05-07T13:59:41.067301+0000","last_became_active":"2024-05-07T13:55:50.313457+0000","last_became_peered":"2024-05-07T13:55:50.313457+0000","last_unstale":"2024-05-07T13:59:41.067301+0000","last_undegraded":"2024-05-07T13:59:41.067301+0000","last_fullsized":"2024-05-07T13:59:41.067301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:41.067158+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:41.067158+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.067158+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:23.103665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.104889+0000","last_change":"2024-05-07T13:59:37.104889+0000","last_active":"2024-05-07T13:59:37.104889+0000","last_peered":"2024-05-07T13:59:37.104889+0000","last_clean":"2024-05-07T13:59:37.104889+0000","last_became_active":"2024-05-07T13:55:48.340516+0000","last_became_peered":"2024-05-07T13:55:48.340516+0000","last_unstale":"2024-05-07T13:59:37.104889+0000","last_undegraded":"2024-05-07T13:59:37.104889+0000","last_fullsized":"2024-05-07T13:59:37.104889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:37.104722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:37.104722+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.104722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:59.079495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'12","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.022101+0000","last_change":"2024-05-07T13:59:43.022101+0000","last_active":"2024-05-07T13:59:43.022101+0000","last_peered":"2024-05-07T13:59:43.022101+0000","last_clean":"2024-05-07T13:59:43.022101+0000","last_became_active":"2024-05-07T13:55:50.313442+0000","last_became_peered":"2024-05-07T13:55:50.313442+0000","last_unstale":"2024-05-07T13:59:43.022101+0000","last_undegraded":"2024-05-07T13:59:43.022101+0000","last_fullsized":"2024-05-07T13:59:43.022101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:43.021976+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:43.021976+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.021976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:09.097926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.004588+0000","last_change":"2024-05-07T13:59:56.004588+0000","last_active":"2024-05-07T13:59:56.004588+0000","last_peered":"2024-05-07T13:59:56.004588+0000","last_clean":"2024-05-07T13:59:56.004588+0000","last_became_active":"2024-05-07T13:55:48.338589+0000","last_became_peered":"2024-05-07T13:55:48.338589+0000","last_unstale":"2024-05-07T13:59:56.004588+0000","last_undegraded":"2024-05-07T13:59:56.004588+0000","last_fullsized":"2024-05-07T13:59:56.004588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:56.004403+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:56.004403+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.004403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:54.743513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.043430+0000","last_change":"2024-05-07T13:59:37.043430+0000","last_active":"2024-05-07T13:59:37.043430+0000","last_peered":"2024-05-07T13:59:37.043430+0000","last_clean":"2024-05-07T13:59:37.043430+0000","last_became_active":"2024-05-07T13:55:50.328471+0000","last_became_peered":"2024-05-07T13:55:50.328471+0000","last_unstale":"2024-05-07T13:59:37.043430+0000","last_undegraded":"2024-05-07T13:59:37.043430+0000","last_fullsized":"2024-05-07T13:59:37.043430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:37.043289+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:37.043289+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.043289+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:19.079795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.047904+0000","last_change":"2024-05-07T13:59:52.047904+0000","last_active":"2024-05-07T13:59:52.047904+0000","last_peered":"2024-05-07T13:59:52.047904+0000","last_clean":"2024-05-07T13:59:52.047904+0000","last_became_active":"2024-05-07T13:55:48.340284+0000","last_became_peered":"2024-05-07T13:55:48.340284+0000","last_unstale":"2024-05-07T13:59:52.047904+0000","last_undegraded":"2024-05-07T13:59:52.047904+0000","last_fullsized":"2024-05-07T13:59:52.047904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:52.047788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:52.047788+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.047788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:40:09.958765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.170509+0000","last_change":"2024-05-07T13:59:42.170509+0000","last_active":"2024-05-07T13:59:42.170509+0000","last_peered":"2024-05-07T13:59:42.170509+0000","last_clean":"2024-05-07T13:59:42.170509+0000","last_became_active":"2024-05-07T13:55:50.322513+0000","last_became_peered":"2024-05-07T13:55:50.322513+0000","last_unstale":"2024-05-07T13:59:42.170509+0000","last_undegraded":"2024-05-07T13:59:42.170509+0000","last_fullsized":"2024-05-07T13:59:42.170509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:42.170338+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:42.170338+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.170338+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:03.826198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.123172+0000","last_change":"2024-05-07T13:59:53.123172+0000","last_active":"2024-05-07T13:59:53.123172+0000","last_peered":"2024-05-07T13:59:53.123172+0000","last_clean":"2024-05-07T13:59:53.123172+0000","last_became_active":"2024-05-07T13:55:48.325321+0000","last_became_peered":"2024-05-07T13:55:48.325321+0000","last_unstale":"2024-05-07T13:59:53.123172+0000","last_undegraded":"2024-05-07T13:59:53.123172+0000","last_fullsized":"2024-05-07T13:59:53.123172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:53.123049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:53.123049+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.123049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:29.780712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.982030+0000","last_change":"2024-05-07T13:59:54.982030+0000","last_active":"2024-05-07T13:59:54.982030+0000","last_peered":"2024-05-07T13:59:54.982030+0000","last_clean":"2024-05-07T13:59:54.982030+0000","last_became_active":"2024-05-07T13:55:50.322476+0000","last_became_peered":"2024-05-07T13:55:50.322476+0000","last_unstale":"2024-05-07T13:59:54.982030+0000","last_undegraded":"2024-05-07T13:59:54.982030+0000","last_fullsized":"2024-05-07T13:59:54.982030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:54.981876+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:54.981876+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.981876+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:27.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:07.102310+0000","last_change":"2024-05-07T14:00:07.102310+0000","last_active":"2024-05-07T14:00:07.102310+0000","last_peered":"2024-05-07T14:00:07.102310+0000","last_clean":"2024-05-07T14:00:07.102310+0000","last_became_active":"2024-05-07T13:55:48.348714+0000","last_became_peered":"2024-05-07T13:55:48.348714+0000","last_unstale":"2024-05-07T14:00:07.102310+0000","last_undegraded":"2024-05-07T14:00:07.102310+0000","last_fullsized":"2024-05-07T14:00:07.102310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:07.102163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:07.102163+0000","last_clean_scrub_stamp":"2024-05-07T14:00:07.102163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:27:32.277841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'38","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:08.962063+0000","last_change":"2024-05-07T14:00:08.962063+0000","last_active":"2024-05-07T14:00:08.962063+0000","last_peered":"2024-05-07T14:00:08.962063+0000","last_clean":"2024-05-07T14:00:08.962063+0000","last_became_active":"2024-05-07T13:55:58.347993+0000","last_became_peered":"2024-05-07T13:55:58.347993+0000","last_unstale":"2024-05-07T14:00:08.962063+0000","last_undegraded":"2024-05-07T14:00:08.962063+0000","last_fullsized":"2024-05-07T14:00:08.962063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-07T14:00:08.961881+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-07T14:00:08.961881+0000","last_clean_scrub_stamp":"2024-05-07T14:00:08.961881+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:27:43.597675+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'2","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.216587+0000","last_change":"2024-05-07T13:59:52.216587+0000","last_active":"2024-05-07T13:59:52.216587+0000","last_peered":"2024-05-07T13:59:52.216587+0000","last_clean":"2024-05-07T13:59:52.216587+0000","last_became_active":"2024-05-07T13:55:50.323355+0000","last_became_peered":"2024-05-07T13:55:50.323355+0000","last_unstale":"2024-05-07T13:59:52.216587+0000","last_undegraded":"2024-05-07T13:59:52.216587+0000","last_fullsized":"2024-05-07T13:59:52.216587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:52.216464+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:52.216464+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.216464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:20:13.424313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:15.204414+0000","last_change":"2024-05-07T14:00:15.204414+0000","last_active":"2024-05-07T14:00:15.204414+0000","last_peered":"2024-05-07T14:00:15.204414+0000","last_clean":"2024-05-07T14:00:15.204414+0000","last_became_active":"2024-05-07T13:55:48.350161+0000","last_became_peered":"2024-05-07T13:55:48.350161+0000","last_unstale":"2024-05-07T14:00:15.204414+0000","last_undegraded":"2024-05-07T14:00:15.204414+0000","last_fullsized":"2024-05-07T14:00:15.204414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:15.204281+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:15.204281+0000","last_clean_scrub_stamp":"2024-05-07T14:00:15.204281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:22:42.244133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.845708+0000","last_change":"2024-05-07T13:59:13.845708+0000","last_active":"2024-05-07T13:59:13.845708+0000","last_peered":"2024-05-07T13:59:13.845708+0000","last_clean":"2024-05-07T13:59:13.845708+0000","last_became_active":"2024-05-07T13:55:52.318966+0000","last_became_peered":"2024-05-07T13:55:52.318966+0000","last_unstale":"2024-05-07T13:59:13.845708+0000","last_undegraded":"2024-05-07T13:59:13.845708+0000","last_fullsized":"2024-05-07T13:59:13.845708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.845587+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.845587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:14.171712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'38","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.069097+0000","last_change":"2024-05-07T13:59:38.069097+0000","last_active":"2024-05-07T13:59:38.069097+0000","last_peered":"2024-05-07T13:59:38.069097+0000","last_clean":"2024-05-07T13:59:38.069097+0000","last_became_active":"2024-05-07T13:55:54.331835+0000","last_became_peered":"2024-05-07T13:55:54.331835+0000","last_unstale":"2024-05-07T13:59:38.069097+0000","last_undegraded":"2024-05-07T13:59:38.069097+0000","last_fullsized":"2024-05-07T13:59:38.069097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-07T13:59:38.068965+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-07T13:59:38.068965+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.068965+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:29.318982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.049169+0000","last_change":"2024-05-07T13:59:23.049169+0000","last_active":"2024-05-07T13:59:23.049169+0000","last_peered":"2024-05-07T13:59:23.049169+0000","last_clean":"2024-05-07T13:59:23.049169+0000","last_became_active":"2024-05-07T13:55:56.338638+0000","last_became_peered":"2024-05-07T13:55:56.338638+0000","last_unstale":"2024-05-07T13:59:23.049169+0000","last_undegraded":"2024-05-07T13:59:23.049169+0000","last_fullsized":"2024-05-07T13:59:23.049169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:23.049049+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.049049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:44:20.135960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'13","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:11.011801+0000","last_change":"2024-05-07T14:00:11.011801+0000","last_active":"2024-05-07T14:00:11.011801+0000","last_peered":"2024-05-07T14:00:11.011801+0000","last_clean":"2024-05-07T14:00:11.011801+0000","last_became_active":"2024-05-07T13:55:58.348341+0000","last_became_peered":"2024-05-07T13:55:58.348341+0000","last_unstale":"2024-05-07T14:00:11.011801+0000","last_undegraded":"2024-05-07T14:00:11.011801+0000","last_fullsized":"2024-05-07T14:00:11.011801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-05-07T14:00:11.011662+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-05-07T14:00:11.011662+0000","last_clean_scrub_stamp":"2024-05-07T14:00:11.011662+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:01:10.406823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.166197+0000","last_change":"2024-05-07T13:59:44.166197+0000","last_active":"2024-05-07T13:59:44.166197+0000","last_peered":"2024-05-07T13:59:44.166197+0000","last_clean":"2024-05-07T13:59:44.166197+0000","last_became_active":"2024-05-07T13:55:50.325201+0000","last_became_peered":"2024-05-07T13:55:50.325201+0000","last_unstale":"2024-05-07T13:59:44.166197+0000","last_undegraded":"2024-05-07T13:59:44.166197+0000","last_fullsized":"2024-05-07T13:59:44.166197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:44.166027+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:44.166027+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.166027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:43:48.666551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.852646+0000","last_change":"2024-05-07T13:59:56.852646+0000","last_active":"2024-05-07T13:59:56.852646+0000","last_peered":"2024-05-07T13:59:56.852646+0000","last_clean":"2024-05-07T13:59:56.852646+0000","last_became_active":"2024-05-07T13:55:48.338704+0000","last_became_peered":"2024-05-07T13:55:48.338704+0000","last_unstale":"2024-05-07T13:59:56.852646+0000","last_undegraded":"2024-05-07T13:59:56.852646+0000","last_fullsized":"2024-05-07T13:59:56.852646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:56.852511+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:56.852511+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.852511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:41.972519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:12.018605+0000","last_change":"2024-05-07T14:00:12.018627+0000","last_active":"2024-05-07T14:00:12.018605+0000","last_peered":"2024-05-07T14:00:12.018605+0000","last_clean":"2024-05-07T14:00:12.018605+0000","last_became_active":"2024-05-07T13:56:35.361623+0000","last_became_peered":"2024-05-07T13:56:35.361623+0000","last_unstale":"2024-05-07T14:00:12.018605+0000","last_undegraded":"2024-05-07T14:00:12.018605+0000","last_fullsized":"2024-05-07T14:00:12.018605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:12.018502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:12.018502+0000","last_clean_scrub_stamp":"2024-05-07T14:00:12.018502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:39.620956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.125828+0000","last_change":"2024-05-07T13:59:12.125828+0000","last_active":"2024-05-07T13:59:12.125828+0000","last_peered":"2024-05-07T13:59:12.125828+0000","last_clean":"2024-05-07T13:59:12.125828+0000","last_became_active":"2024-05-07T13:55:54.333402+0000","last_became_peered":"2024-05-07T13:55:54.333402+0000","last_unstale":"2024-05-07T13:59:12.125828+0000","last_undegraded":"2024-05-07T13:59:12.125828+0000","last_fullsized":"2024-05-07T13:59:12.125828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:12.125709+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.125709+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:10.791591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.010859+0000","last_change":"2024-05-07T13:59:19.010859+0000","last_active":"2024-05-07T13:59:19.010859+0000","last_peered":"2024-05-07T13:59:19.010859+0000","last_clean":"2024-05-07T13:59:19.010859+0000","last_became_active":"2024-05-07T13:55:56.335463+0000","last_became_peered":"2024-05-07T13:55:56.335463+0000","last_unstale":"2024-05-07T13:59:19.010859+0000","last_undegraded":"2024-05-07T13:59:19.010859+0000","last_fullsized":"2024-05-07T13:59:19.010859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.010674+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.010674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:27.103094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:07.101518+0000","last_change":"2024-05-07T14:00:07.101546+0000","last_active":"2024-05-07T14:00:07.101518+0000","last_peered":"2024-05-07T14:00:07.101518+0000","last_clean":"2024-05-07T14:00:07.101518+0000","last_became_active":"2024-05-07T13:55:58.340688+0000","last_became_peered":"2024-05-07T13:55:58.340688+0000","last_unstale":"2024-05-07T14:00:07.101518+0000","last_undegraded":"2024-05-07T14:00:07.101518+0000","last_fullsized":"2024-05-07T14:00:07.101518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T14:00:07.101412+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T14:00:07.101412+0000","last_clean_scrub_stamp":"2024-05-07T14:00:07.101412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:05:50.740119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.165656+0000","last_change":"2024-05-07T13:59:47.165656+0000","last_active":"2024-05-07T13:59:47.165656+0000","last_peered":"2024-05-07T13:59:47.165656+0000","last_clean":"2024-05-07T13:59:47.165656+0000","last_became_active":"2024-05-07T13:55:50.323775+0000","last_became_peered":"2024-05-07T13:55:50.323775+0000","last_unstale":"2024-05-07T13:59:47.165656+0000","last_undegraded":"2024-05-07T13:59:47.165656+0000","last_fullsized":"2024-05-07T13:59:47.165656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:47.165529+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:47.165529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.165529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:40:02.425709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:06.096751+0000","last_change":"2024-05-07T14:00:06.096751+0000","last_active":"2024-05-07T14:00:06.096751+0000","last_peered":"2024-05-07T14:00:06.096751+0000","last_clean":"2024-05-07T14:00:06.096751+0000","last_became_active":"2024-05-07T13:55:48.349636+0000","last_became_peered":"2024-05-07T13:55:48.349636+0000","last_unstale":"2024-05-07T14:00:06.096751+0000","last_undegraded":"2024-05-07T14:00:06.096751+0000","last_fullsized":"2024-05-07T14:00:06.096751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:06.096608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:06.096608+0000","last_clean_scrub_stamp":"2024-05-07T14:00:06.096608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:42:01.919712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.889687+0000","last_change":"2024-05-07T14:00:02.889730+0000","last_active":"2024-05-07T14:00:02.889687+0000","last_peered":"2024-05-07T14:00:02.889687+0000","last_clean":"2024-05-07T14:00:02.889687+0000","last_became_active":"2024-05-07T13:56:35.370109+0000","last_became_peered":"2024-05-07T13:56:35.370109+0000","last_unstale":"2024-05-07T14:00:02.889687+0000","last_undegraded":"2024-05-07T14:00:02.889687+0000","last_fullsized":"2024-05-07T14:00:02.889687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:02.889568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:02.889568+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.889568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:39.547231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.187264+0000","last_change":"2024-05-07T13:59:22.187264+0000","last_active":"2024-05-07T13:59:22.187264+0000","last_peered":"2024-05-07T13:59:22.187264+0000","last_clean":"2024-05-07T13:59:22.187264+0000","last_became_active":"2024-05-07T13:55:54.327178+0000","last_became_peered":"2024-05-07T13:55:54.327178+0000","last_unstale":"2024-05-07T13:59:22.187264+0000","last_undegraded":"2024-05-07T13:59:22.187264+0000","last_fullsized":"2024-05-07T13:59:22.187264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-07T13:59:22.187065+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.187065+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:32.587195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":404,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.169121+0000","last_change":"2024-05-07T13:59:45.169121+0000","last_active":"2024-05-07T13:59:45.169121+0000","last_peered":"2024-05-07T13:59:45.169121+0000","last_clean":"2024-05-07T13:59:45.169121+0000","last_became_active":"2024-05-07T13:55:56.345712+0000","last_became_peered":"2024-05-07T13:55:56.345712+0000","last_unstale":"2024-05-07T13:59:45.169121+0000","last_undegraded":"2024-05-07T13:59:45.169121+0000","last_fullsized":"2024-05-07T13:59:45.169121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-05-07T13:59:45.168931+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-05-07T13:59:45.168931+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.168931+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:31:55.102005+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.162805+0000","last_change":"2024-05-07T13:59:28.162826+0000","last_active":"2024-05-07T13:59:28.162805+0000","last_peered":"2024-05-07T13:59:28.162805+0000","last_clean":"2024-05-07T13:59:28.162805+0000","last_became_active":"2024-05-07T13:55:58.339825+0000","last_became_peered":"2024-05-07T13:55:58.339825+0000","last_unstale":"2024-05-07T13:59:28.162805+0000","last_undegraded":"2024-05-07T13:59:28.162805+0000","last_fullsized":"2024-05-07T13:59:28.162805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.162716+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.162716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:49.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.074112+0000","last_change":"2024-05-07T13:59:52.074112+0000","last_active":"2024-05-07T13:59:52.074112+0000","last_peered":"2024-05-07T13:59:52.074112+0000","last_clean":"2024-05-07T13:59:52.074112+0000","last_became_active":"2024-05-07T13:55:50.318502+0000","last_became_peered":"2024-05-07T13:55:50.318502+0000","last_unstale":"2024-05-07T13:59:52.074112+0000","last_undegraded":"2024-05-07T13:59:52.074112+0000","last_fullsized":"2024-05-07T13:59:52.074112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:52.074006+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:52.074006+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.074006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:50.813115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.052825+0000","last_change":"2024-05-07T13:59:46.052825+0000","last_active":"2024-05-07T13:59:46.052825+0000","last_peered":"2024-05-07T13:59:46.052825+0000","last_clean":"2024-05-07T13:59:46.052825+0000","last_became_active":"2024-05-07T13:55:48.345080+0000","last_became_peered":"2024-05-07T13:55:48.345080+0000","last_unstale":"2024-05-07T13:59:46.052825+0000","last_undegraded":"2024-05-07T13:59:46.052825+0000","last_fullsized":"2024-05-07T13:59:46.052825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:46.052643+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:46.052643+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.052643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:07.843171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.860501+0000","last_change":"2024-05-07T13:59:18.860501+0000","last_active":"2024-05-07T13:59:18.860501+0000","last_peered":"2024-05-07T13:59:18.860501+0000","last_clean":"2024-05-07T13:59:18.860501+0000","last_became_active":"2024-05-07T13:55:52.318178+0000","last_became_peered":"2024-05-07T13:55:52.318178+0000","last_unstale":"2024-05-07T13:59:18.860501+0000","last_undegraded":"2024-05-07T13:59:18.860501+0000","last_fullsized":"2024-05-07T13:59:18.860501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.860344+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.860344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:31:08.364202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'37","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.065153+0000","last_change":"2024-05-07T13:59:17.065153+0000","last_active":"2024-05-07T13:59:17.065153+0000","last_peered":"2024-05-07T13:59:17.065153+0000","last_clean":"2024-05-07T13:59:17.065153+0000","last_became_active":"2024-05-07T13:55:54.330662+0000","last_became_peered":"2024-05-07T13:55:54.330662+0000","last_unstale":"2024-05-07T13:59:17.065153+0000","last_undegraded":"2024-05-07T13:59:17.065153+0000","last_fullsized":"2024-05-07T13:59:17.065153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2024-05-07T13:59:17.065035+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.065035+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:20.830603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":414,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.894332+0000","last_change":"2024-05-07T13:59:10.894332+0000","last_active":"2024-05-07T13:59:10.894332+0000","last_peered":"2024-05-07T13:59:10.894332+0000","last_clean":"2024-05-07T13:59:10.894332+0000","last_became_active":"2024-05-07T13:55:56.334111+0000","last_became_peered":"2024-05-07T13:55:56.334111+0000","last_unstale":"2024-05-07T13:59:10.894332+0000","last_undegraded":"2024-05-07T13:59:10.894332+0000","last_fullsized":"2024-05-07T13:59:10.894332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:10.894211+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.894211+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:00.735952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'11","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.031904+0000","last_change":"2024-05-07T13:59:27.031904+0000","last_active":"2024-05-07T13:59:27.031904+0000","last_peered":"2024-05-07T13:59:27.031904+0000","last_clean":"2024-05-07T13:59:27.031904+0000","last_became_active":"2024-05-07T13:55:50.324820+0000","last_became_peered":"2024-05-07T13:55:50.324820+0000","last_unstale":"2024-05-07T13:59:27.031904+0000","last_undegraded":"2024-05-07T13:59:27.031904+0000","last_fullsized":"2024-05-07T13:59:27.031904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-07T13:59:27.031775+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.031775+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:22.190354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.956851+0000","last_change":"2024-05-07T13:59:50.956851+0000","last_active":"2024-05-07T13:59:50.956851+0000","last_peered":"2024-05-07T13:59:50.956851+0000","last_clean":"2024-05-07T13:59:50.956851+0000","last_became_active":"2024-05-07T13:55:48.335443+0000","last_became_peered":"2024-05-07T13:55:48.335443+0000","last_unstale":"2024-05-07T13:59:50.956851+0000","last_undegraded":"2024-05-07T13:59:50.956851+0000","last_fullsized":"2024-05-07T13:59:50.956851+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:50.956641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:50.956641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.956641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:52:07.720957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.073496+0000","last_change":"2024-05-07T13:59:24.073496+0000","last_active":"2024-05-07T13:59:24.073496+0000","last_peered":"2024-05-07T13:59:24.073496+0000","last_clean":"2024-05-07T13:59:24.073496+0000","last_became_active":"2024-05-07T13:55:52.322188+0000","last_became_peered":"2024-05-07T13:55:52.322188+0000","last_unstale":"2024-05-07T13:59:24.073496+0000","last_undegraded":"2024-05-07T13:59:24.073496+0000","last_fullsized":"2024-05-07T13:59:24.073496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:24.073340+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.073340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:33:13.708665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.081901+0000","last_change":"2024-05-07T13:59:18.081901+0000","last_active":"2024-05-07T13:59:18.081901+0000","last_peered":"2024-05-07T13:59:18.081901+0000","last_clean":"2024-05-07T13:59:18.081901+0000","last_became_active":"2024-05-07T13:55:54.330401+0000","last_became_peered":"2024-05-07T13:55:54.330401+0000","last_unstale":"2024-05-07T13:59:18.081901+0000","last_undegraded":"2024-05-07T13:59:18.081901+0000","last_fullsized":"2024-05-07T13:59:18.081901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-07T13:59:18.081750+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.081750+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:16:16.381571+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.945668+0000","last_change":"2024-05-07T13:59:13.945668+0000","last_active":"2024-05-07T13:59:13.945668+0000","last_peered":"2024-05-07T13:59:13.945668+0000","last_clean":"2024-05-07T13:59:13.945668+0000","last_became_active":"2024-05-07T13:55:56.334368+0000","last_became_peered":"2024-05-07T13:55:56.334368+0000","last_unstale":"2024-05-07T13:59:13.945668+0000","last_undegraded":"2024-05-07T13:59:13.945668+0000","last_fullsized":"2024-05-07T13:59:13.945668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.945550+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.945550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:11.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.843455+0000","last_change":"2024-05-07T13:59:58.843455+0000","last_active":"2024-05-07T13:59:58.843455+0000","last_peered":"2024-05-07T13:59:58.843455+0000","last_clean":"2024-05-07T13:59:58.843455+0000","last_became_active":"2024-05-07T13:55:58.346457+0000","last_became_peered":"2024-05-07T13:55:58.346457+0000","last_unstale":"2024-05-07T13:59:58.843455+0000","last_undegraded":"2024-05-07T13:59:58.843455+0000","last_fullsized":"2024-05-07T13:59:58.843455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T13:59:58.843311+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T13:59:58.843311+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.843311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:52.140951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'6","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.050463+0000","last_change":"2024-05-07T13:59:44.050463+0000","last_active":"2024-05-07T13:59:44.050463+0000","last_peered":"2024-05-07T13:59:44.050463+0000","last_clean":"2024-05-07T13:59:44.050463+0000","last_became_active":"2024-05-07T13:55:50.312564+0000","last_became_peered":"2024-05-07T13:55:50.312564+0000","last_unstale":"2024-05-07T13:59:44.050463+0000","last_undegraded":"2024-05-07T13:59:44.050463+0000","last_fullsized":"2024-05-07T13:59:44.050463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:44.050311+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:44.050311+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.050311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:31.285519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:52.933051+0000","last_change":"2024-05-07T13:59:52.933051+0000","last_active":"2024-05-07T13:59:52.933051+0000","last_peered":"2024-05-07T13:59:52.933051+0000","last_clean":"2024-05-07T13:59:52.933051+0000","last_became_active":"2024-05-07T13:55:48.335791+0000","last_became_peered":"2024-05-07T13:55:48.335791+0000","last_unstale":"2024-05-07T13:59:52.933051+0000","last_undegraded":"2024-05-07T13:59:52.933051+0000","last_fullsized":"2024-05-07T13:59:52.933051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:52.932909+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:52.932909+0000","last_clean_scrub_stamp":"2024-05-07T13:59:52.932909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:28.082914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.088805+0000","last_change":"2024-05-07T13:59:27.088805+0000","last_active":"2024-05-07T13:59:27.088805+0000","last_peered":"2024-05-07T13:59:27.088805+0000","last_clean":"2024-05-07T13:59:27.088805+0000","last_became_active":"2024-05-07T13:55:52.325676+0000","last_became_peered":"2024-05-07T13:55:52.325676+0000","last_unstale":"2024-05-07T13:59:27.088805+0000","last_undegraded":"2024-05-07T13:59:27.088805+0000","last_fullsized":"2024-05-07T13:59:27.088805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.088632+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.088632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:25:08.861590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'39","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.053158+0000","last_change":"2024-05-07T13:59:35.053158+0000","last_active":"2024-05-07T13:59:35.053158+0000","last_peered":"2024-05-07T13:59:35.053158+0000","last_clean":"2024-05-07T13:59:35.053158+0000","last_became_active":"2024-05-07T13:55:54.331979+0000","last_became_peered":"2024-05-07T13:55:54.331979+0000","last_unstale":"2024-05-07T13:59:35.053158+0000","last_undegraded":"2024-05-07T13:59:35.053158+0000","last_fullsized":"2024-05-07T13:59:35.053158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:35.053039+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:35.053039+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.053039+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:39.918537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.927307+0000","last_change":"2024-05-07T13:59:12.927307+0000","last_active":"2024-05-07T13:59:12.927307+0000","last_peered":"2024-05-07T13:59:12.927307+0000","last_clean":"2024-05-07T13:59:12.927307+0000","last_became_active":"2024-05-07T13:55:56.333357+0000","last_became_peered":"2024-05-07T13:55:56.333357+0000","last_unstale":"2024-05-07T13:59:12.927307+0000","last_undegraded":"2024-05-07T13:59:12.927307+0000","last_fullsized":"2024-05-07T13:59:12.927307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.927183+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.927183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:18.128049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.070919+0000","last_change":"2024-05-07T13:59:35.070919+0000","last_active":"2024-05-07T13:59:35.070919+0000","last_peered":"2024-05-07T13:59:35.070919+0000","last_clean":"2024-05-07T13:59:35.070919+0000","last_became_active":"2024-05-07T13:55:58.344955+0000","last_became_peered":"2024-05-07T13:55:58.344955+0000","last_unstale":"2024-05-07T13:59:35.070919+0000","last_undegraded":"2024-05-07T13:59:35.070919+0000","last_fullsized":"2024-05-07T13:59:35.070919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:35.070796+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:35.070796+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.070796+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:54.753266+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.890156+0000","last_change":"2024-05-07T13:59:57.890156+0000","last_active":"2024-05-07T13:59:57.890156+0000","last_peered":"2024-05-07T13:59:57.890156+0000","last_clean":"2024-05-07T13:59:57.890156+0000","last_became_active":"2024-05-07T13:55:50.327059+0000","last_became_peered":"2024-05-07T13:55:50.327059+0000","last_unstale":"2024-05-07T13:59:57.890156+0000","last_undegraded":"2024-05-07T13:59:57.890156+0000","last_fullsized":"2024-05-07T13:59:57.890156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:57.889977+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:57.889977+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.889977+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:40:15.800954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.126658+0000","last_change":"2024-05-07T14:00:03.126658+0000","last_active":"2024-05-07T14:00:03.126658+0000","last_peered":"2024-05-07T14:00:03.126658+0000","last_clean":"2024-05-07T14:00:03.126658+0000","last_became_active":"2024-05-07T13:55:48.350442+0000","last_became_peered":"2024-05-07T13:55:48.350442+0000","last_unstale":"2024-05-07T14:00:03.126658+0000","last_undegraded":"2024-05-07T14:00:03.126658+0000","last_fullsized":"2024-05-07T14:00:03.126658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:03.126502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:03.126502+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.126502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:54:47.586769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.008644+0000","last_change":"2024-05-07T13:59:31.008644+0000","last_active":"2024-05-07T13:59:31.008644+0000","last_peered":"2024-05-07T13:59:31.008644+0000","last_clean":"2024-05-07T13:59:31.008644+0000","last_became_active":"2024-05-07T13:55:52.321674+0000","last_became_peered":"2024-05-07T13:55:52.321674+0000","last_unstale":"2024-05-07T13:59:31.008644+0000","last_undegraded":"2024-05-07T13:59:31.008644+0000","last_fullsized":"2024-05-07T13:59:31.008644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.008529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.008529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.008529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:13.357119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.831318+0000","last_change":"2024-05-07T13:59:14.831318+0000","last_active":"2024-05-07T13:59:14.831318+0000","last_peered":"2024-05-07T13:59:14.831318+0000","last_clean":"2024-05-07T13:59:14.831318+0000","last_became_active":"2024-05-07T13:55:54.325336+0000","last_became_peered":"2024-05-07T13:55:54.325336+0000","last_unstale":"2024-05-07T13:59:14.831318+0000","last_undegraded":"2024-05-07T13:59:14.831318+0000","last_fullsized":"2024-05-07T13:59:14.831318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:14.831128+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.831128+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:26:59.956651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":367,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.962101+0000","last_change":"2024-05-07T13:59:17.962101+0000","last_active":"2024-05-07T13:59:17.962101+0000","last_peered":"2024-05-07T13:59:17.962101+0000","last_clean":"2024-05-07T13:59:17.962101+0000","last_became_active":"2024-05-07T13:55:56.334895+0000","last_became_peered":"2024-05-07T13:55:56.334895+0000","last_unstale":"2024-05-07T13:59:17.962101+0000","last_undegraded":"2024-05-07T13:59:17.962101+0000","last_fullsized":"2024-05-07T13:59:17.962101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:17.961985+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.961985+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:39.314908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:06.098595+0000","last_change":"2024-05-07T14:00:06.098595+0000","last_active":"2024-05-07T14:00:06.098595+0000","last_peered":"2024-05-07T14:00:06.098595+0000","last_clean":"2024-05-07T14:00:06.098595+0000","last_became_active":"2024-05-07T13:55:58.340764+0000","last_became_peered":"2024-05-07T13:55:58.340764+0000","last_unstale":"2024-05-07T14:00:06.098595+0000","last_undegraded":"2024-05-07T14:00:06.098595+0000","last_fullsized":"2024-05-07T14:00:06.098595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:06.098465+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:06.098465+0000","last_clean_scrub_stamp":"2024-05-07T14:00:06.098465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:01:05.493626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"29'12","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.114438+0000","last_change":"2024-05-07T13:59:38.114438+0000","last_active":"2024-05-07T13:59:38.114438+0000","last_peered":"2024-05-07T13:59:38.114438+0000","last_clean":"2024-05-07T13:59:38.114438+0000","last_became_active":"2024-05-07T13:55:50.312649+0000","last_became_peered":"2024-05-07T13:55:50.312649+0000","last_unstale":"2024-05-07T13:59:38.114438+0000","last_undegraded":"2024-05-07T13:59:38.114438+0000","last_fullsized":"2024-05-07T13:59:38.114438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:38.114264+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:38.114264+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.114264+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:14:52.055884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:26.221506+0000","last_change":"2024-05-07T14:00:26.221559+0000","last_active":"2024-05-07T14:00:26.221506+0000","last_peered":"2024-05-07T14:00:26.221506+0000","last_clean":"2024-05-07T14:00:26.221506+0000","last_became_active":"2024-05-07T13:55:48.346027+0000","last_became_peered":"2024-05-07T13:55:48.346027+0000","last_unstale":"2024-05-07T14:00:26.221506+0000","last_undegraded":"2024-05-07T14:00:26.221506+0000","last_fullsized":"2024-05-07T14:00:26.221506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:26.221367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:26.221367+0000","last_clean_scrub_stamp":"2024-05-07T14:00:26.221367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:05.778287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.054894+0000","last_change":"2024-05-07T13:59:28.054894+0000","last_active":"2024-05-07T13:59:28.054894+0000","last_peered":"2024-05-07T13:59:28.054894+0000","last_clean":"2024-05-07T13:59:28.054894+0000","last_became_active":"2024-05-07T13:55:52.325427+0000","last_became_peered":"2024-05-07T13:55:52.325427+0000","last_unstale":"2024-05-07T13:59:28.054894+0000","last_undegraded":"2024-05-07T13:59:28.054894+0000","last_fullsized":"2024-05-07T13:59:28.054894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.054722+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.054722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:47.334525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'63","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.081043+0000","last_change":"2024-05-07T13:59:34.081043+0000","last_active":"2024-05-07T13:59:34.081043+0000","last_peered":"2024-05-07T13:59:34.081043+0000","last_clean":"2024-05-07T13:59:34.081043+0000","last_became_active":"2024-05-07T13:55:54.334315+0000","last_became_peered":"2024-05-07T13:55:54.334315+0000","last_unstale":"2024-05-07T13:59:34.081043+0000","last_undegraded":"2024-05-07T13:59:34.081043+0000","last_fullsized":"2024-05-07T13:59:34.081043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-07T13:59:34.080919+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-07T13:59:34.080919+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.080919+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:10.738582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.917820+0000","last_change":"2024-05-07T13:59:16.917820+0000","last_active":"2024-05-07T13:59:16.917820+0000","last_peered":"2024-05-07T13:59:16.917820+0000","last_clean":"2024-05-07T13:59:16.917820+0000","last_became_active":"2024-05-07T13:55:56.330355+0000","last_became_peered":"2024-05-07T13:55:56.330355+0000","last_unstale":"2024-05-07T13:59:16.917820+0000","last_undegraded":"2024-05-07T13:59:16.917820+0000","last_fullsized":"2024-05-07T13:59:16.917820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:16.917702+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.917702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:29.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'21","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.010583+0000","last_change":"2024-05-07T13:59:34.010583+0000","last_active":"2024-05-07T13:59:34.010583+0000","last_peered":"2024-05-07T13:59:34.010583+0000","last_clean":"2024-05-07T13:59:34.010583+0000","last_became_active":"2024-05-07T13:55:58.336692+0000","last_became_peered":"2024-05-07T13:55:58.336692+0000","last_unstale":"2024-05-07T13:59:34.010583+0000","last_undegraded":"2024-05-07T13:59:34.010583+0000","last_fullsized":"2024-05-07T13:59:34.010583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:34.010409+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:34.010409+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.010409+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:23.971858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'8","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.957267+0000","last_change":"2024-05-07T14:00:04.957267+0000","last_active":"2024-05-07T14:00:04.957267+0000","last_peered":"2024-05-07T14:00:04.957267+0000","last_clean":"2024-05-07T14:00:04.957267+0000","last_became_active":"2024-05-07T13:55:50.322764+0000","last_became_peered":"2024-05-07T13:55:50.322764+0000","last_unstale":"2024-05-07T14:00:04.957267+0000","last_undegraded":"2024-05-07T14:00:04.957267+0000","last_fullsized":"2024-05-07T14:00:04.957267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T14:00:04.957162+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T14:00:04.957162+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.957162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:34:40.825959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:55.201411+0000","last_change":"2024-05-07T13:59:55.201411+0000","last_active":"2024-05-07T13:59:55.201411+0000","last_peered":"2024-05-07T13:59:55.201411+0000","last_clean":"2024-05-07T13:59:55.201411+0000","last_became_active":"2024-05-07T13:55:48.325075+0000","last_became_peered":"2024-05-07T13:55:48.325075+0000","last_unstale":"2024-05-07T13:59:55.201411+0000","last_undegraded":"2024-05-07T13:59:55.201411+0000","last_fullsized":"2024-05-07T13:59:55.201411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:55.201253+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:55.201253+0000","last_clean_scrub_stamp":"2024-05-07T13:59:55.201253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:23.579779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.138879+0000","last_change":"2024-05-07T13:59:29.138879+0000","last_active":"2024-05-07T13:59:29.138879+0000","last_peered":"2024-05-07T13:59:29.138879+0000","last_clean":"2024-05-07T13:59:29.138879+0000","last_became_active":"2024-05-07T13:55:52.321730+0000","last_became_peered":"2024-05-07T13:55:52.321730+0000","last_unstale":"2024-05-07T13:59:29.138879+0000","last_undegraded":"2024-05-07T13:59:29.138879+0000","last_fullsized":"2024-05-07T13:59:29.138879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:29.138750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:29.138750+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.138750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:09.782425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'41","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.091397+0000","last_change":"2024-05-07T13:59:17.091397+0000","last_active":"2024-05-07T13:59:17.091397+0000","last_peered":"2024-05-07T13:59:17.091397+0000","last_clean":"2024-05-07T13:59:17.091397+0000","last_became_active":"2024-05-07T13:55:54.324530+0000","last_became_peered":"2024-05-07T13:55:54.324530+0000","last_unstale":"2024-05-07T13:59:17.091397+0000","last_undegraded":"2024-05-07T13:59:17.091397+0000","last_fullsized":"2024-05-07T13:59:17.091397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-07T13:59:17.091253+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.091253+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:22.292118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.984243+0000","last_change":"2024-05-07T13:59:30.984243+0000","last_active":"2024-05-07T13:59:30.984243+0000","last_peered":"2024-05-07T13:59:30.984243+0000","last_clean":"2024-05-07T13:59:30.984243+0000","last_became_active":"2024-05-07T13:55:56.343900+0000","last_became_peered":"2024-05-07T13:55:56.343900+0000","last_unstale":"2024-05-07T13:59:30.984243+0000","last_undegraded":"2024-05-07T13:59:30.984243+0000","last_fullsized":"2024-05-07T13:59:30.984243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.984114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.984114+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.984114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:14.143436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:33.243415+0000","last_change":"2024-05-07T14:00:33.243461+0000","last_active":"2024-05-07T14:00:33.243415+0000","last_peered":"2024-05-07T14:00:33.243415+0000","last_clean":"2024-05-07T14:00:33.243415+0000","last_became_active":"2024-05-07T13:55:58.351724+0000","last_became_peered":"2024-05-07T13:55:58.351724+0000","last_unstale":"2024-05-07T14:00:33.243415+0000","last_undegraded":"2024-05-07T14:00:33.243415+0000","last_fullsized":"2024-05-07T14:00:33.243415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T14:00:33.243311+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T14:00:33.243311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:33.243311+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:25:14.538703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'6","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.842752+0000","last_change":"2024-05-07T13:59:21.842752+0000","last_active":"2024-05-07T13:59:21.842752+0000","last_peered":"2024-05-07T13:59:21.842752+0000","last_clean":"2024-05-07T13:59:21.842752+0000","last_became_active":"2024-05-07T13:55:50.326050+0000","last_became_peered":"2024-05-07T13:55:50.326050+0000","last_unstale":"2024-05-07T13:59:21.842752+0000","last_undegraded":"2024-05-07T13:59:21.842752+0000","last_fullsized":"2024-05-07T13:59:21.842752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:21.842623+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.842623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:38.606939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:17.169773+0000","last_change":"2024-05-07T14:00:17.169836+0000","last_active":"2024-05-07T14:00:17.169773+0000","last_peered":"2024-05-07T14:00:17.169773+0000","last_clean":"2024-05-07T14:00:17.169773+0000","last_became_active":"2024-05-07T13:55:48.350335+0000","last_became_peered":"2024-05-07T13:55:48.350335+0000","last_unstale":"2024-05-07T14:00:17.169773+0000","last_undegraded":"2024-05-07T14:00:17.169773+0000","last_fullsized":"2024-05-07T14:00:17.169773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:17.169672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:17.169672+0000","last_clean_scrub_stamp":"2024-05-07T14:00:17.169672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:44:42.128993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'2","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.050888+0000","last_change":"2024-05-07T13:59:29.050888+0000","last_active":"2024-05-07T13:59:29.050888+0000","last_peered":"2024-05-07T13:59:29.050888+0000","last_clean":"2024-05-07T13:59:29.050888+0000","last_became_active":"2024-05-07T13:55:52.322006+0000","last_became_peered":"2024-05-07T13:55:52.322006+0000","last_unstale":"2024-05-07T13:59:29.050888+0000","last_undegraded":"2024-05-07T13:59:29.050888+0000","last_fullsized":"2024-05-07T13:59:29.050888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:29.050679+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:29.050679+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.050679+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:28.253848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.102617+0000","last_change":"2024-05-07T13:59:25.102617+0000","last_active":"2024-05-07T13:59:25.102617+0000","last_peered":"2024-05-07T13:59:25.102617+0000","last_clean":"2024-05-07T13:59:25.102617+0000","last_became_active":"2024-05-07T13:55:54.319812+0000","last_became_peered":"2024-05-07T13:55:54.319812+0000","last_unstale":"2024-05-07T13:59:25.102617+0000","last_undegraded":"2024-05-07T13:59:25.102617+0000","last_fullsized":"2024-05-07T13:59:25.102617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:25.102469+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.102469+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:25.507214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":443,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.102102+0000","last_change":"2024-05-07T13:59:11.102102+0000","last_active":"2024-05-07T13:59:11.102102+0000","last_peered":"2024-05-07T13:59:11.102102+0000","last_clean":"2024-05-07T13:59:11.102102+0000","last_became_active":"2024-05-07T13:55:56.331966+0000","last_became_peered":"2024-05-07T13:55:56.331966+0000","last_unstale":"2024-05-07T13:59:11.102102+0000","last_undegraded":"2024-05-07T13:59:11.102102+0000","last_fullsized":"2024-05-07T13:59:11.102102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.101988+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.101988+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:35.873097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'21","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.051692+0000","last_change":"2024-05-07T13:59:38.051692+0000","last_active":"2024-05-07T13:59:38.051692+0000","last_peered":"2024-05-07T13:59:38.051692+0000","last_clean":"2024-05-07T13:59:38.051692+0000","last_became_active":"2024-05-07T13:55:58.340608+0000","last_became_peered":"2024-05-07T13:55:58.340608+0000","last_unstale":"2024-05-07T13:59:38.051692+0000","last_undegraded":"2024-05-07T13:59:38.051692+0000","last_fullsized":"2024-05-07T13:59:38.051692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:38.051568+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:38.051568+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.051568+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:32.852712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":35,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.106440+0000","last_change":"2024-05-07T13:59:44.106440+0000","last_active":"2024-05-07T13:59:44.106440+0000","last_peered":"2024-05-07T13:59:44.106440+0000","last_clean":"2024-05-07T13:59:44.106440+0000","last_became_active":"2024-05-07T13:55:50.322650+0000","last_became_peered":"2024-05-07T13:55:50.322650+0000","last_unstale":"2024-05-07T13:59:44.106440+0000","last_undegraded":"2024-05-07T13:59:44.106440+0000","last_fullsized":"2024-05-07T13:59:44.106440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:44.106305+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:44.106305+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.106305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:34.067754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:12.165642+0000","last_change":"2024-05-07T14:00:12.165675+0000","last_active":"2024-05-07T14:00:12.165642+0000","last_peered":"2024-05-07T14:00:12.165642+0000","last_clean":"2024-05-07T14:00:12.165642+0000","last_became_active":"2024-05-07T13:55:48.347434+0000","last_became_peered":"2024-05-07T13:55:48.347434+0000","last_unstale":"2024-05-07T14:00:12.165642+0000","last_undegraded":"2024-05-07T14:00:12.165642+0000","last_fullsized":"2024-05-07T14:00:12.165642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:12.165550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:12.165550+0000","last_clean_scrub_stamp":"2024-05-07T14:00:12.165550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:19:50.586404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.028855+0000","last_change":"2024-05-07T13:59:25.028855+0000","last_active":"2024-05-07T13:59:25.028855+0000","last_peered":"2024-05-07T13:59:25.028855+0000","last_clean":"2024-05-07T13:59:25.028855+0000","last_became_active":"2024-05-07T13:55:52.321251+0000","last_became_peered":"2024-05-07T13:55:52.321251+0000","last_unstale":"2024-05-07T13:59:25.028855+0000","last_undegraded":"2024-05-07T13:59:25.028855+0000","last_fullsized":"2024-05-07T13:59:25.028855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:25.028700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.028700+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:12.963826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.075367+0000","last_change":"2024-05-07T13:59:36.075367+0000","last_active":"2024-05-07T13:59:36.075367+0000","last_peered":"2024-05-07T13:59:36.075367+0000","last_clean":"2024-05-07T13:59:36.075367+0000","last_became_active":"2024-05-07T13:55:54.331844+0000","last_became_peered":"2024-05-07T13:55:54.331844+0000","last_unstale":"2024-05-07T13:59:36.075367+0000","last_undegraded":"2024-05-07T13:59:36.075367+0000","last_fullsized":"2024-05-07T13:59:36.075367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:36.075220+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:36.075220+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.075220+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:04.453746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.078526+0000","last_change":"2024-05-07T13:59:15.078526+0000","last_active":"2024-05-07T13:59:15.078526+0000","last_peered":"2024-05-07T13:59:15.078526+0000","last_clean":"2024-05-07T13:59:15.078526+0000","last_became_active":"2024-05-07T13:55:56.332858+0000","last_became_peered":"2024-05-07T13:55:56.332858+0000","last_unstale":"2024-05-07T13:59:15.078526+0000","last_undegraded":"2024-05-07T13:59:15.078526+0000","last_fullsized":"2024-05-07T13:59:15.078526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:15.078412+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078412+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:21:04.920152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.107497+0000","last_change":"2024-05-07T13:59:24.107497+0000","last_active":"2024-05-07T13:59:24.107497+0000","last_peered":"2024-05-07T13:59:24.107497+0000","last_clean":"2024-05-07T13:59:24.107497+0000","last_became_active":"2024-05-07T13:55:58.335341+0000","last_became_peered":"2024-05-07T13:55:58.335341+0000","last_unstale":"2024-05-07T13:59:24.107497+0000","last_undegraded":"2024-05-07T13:59:24.107497+0000","last_fullsized":"2024-05-07T13:59:24.107497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:24.107327+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.107327+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:37:21.412357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'5","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.039705+0000","last_change":"2024-05-07T13:59:29.039705+0000","last_active":"2024-05-07T13:59:29.039705+0000","last_peered":"2024-05-07T13:59:29.039705+0000","last_clean":"2024-05-07T13:59:29.039705+0000","last_became_active":"2024-05-07T13:55:50.331295+0000","last_became_peered":"2024-05-07T13:55:50.331295+0000","last_unstale":"2024-05-07T13:59:29.039705+0000","last_undegraded":"2024-05-07T13:59:29.039705+0000","last_fullsized":"2024-05-07T13:59:29.039705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:29.039589+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:29.039589+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.039589+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:05.611702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.138775+0000","last_change":"2024-05-07T14:00:00.138775+0000","last_active":"2024-05-07T14:00:00.138775+0000","last_peered":"2024-05-07T14:00:00.138775+0000","last_clean":"2024-05-07T14:00:00.138775+0000","last_became_active":"2024-05-07T13:55:48.351055+0000","last_became_peered":"2024-05-07T13:55:48.351055+0000","last_unstale":"2024-05-07T14:00:00.138775+0000","last_undegraded":"2024-05-07T14:00:00.138775+0000","last_fullsized":"2024-05-07T14:00:00.138775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.138659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.138659+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.138659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:33:34.608921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"29'5","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.888832+0000","last_change":"2024-05-07T13:59:11.888832+0000","last_active":"2024-05-07T13:59:11.888832+0000","last_peered":"2024-05-07T13:59:11.888832+0000","last_clean":"2024-05-07T13:59:11.888832+0000","last_became_active":"2024-05-07T13:55:52.320027+0000","last_became_peered":"2024-05-07T13:55:52.320027+0000","last_unstale":"2024-05-07T13:59:11.888832+0000","last_undegraded":"2024-05-07T13:59:11.888832+0000","last_fullsized":"2024-05-07T13:59:11.888832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:11.888710+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.888710+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:38:54.237300+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'49","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.067275+0000","last_change":"2024-05-07T13:59:10.067275+0000","last_active":"2024-05-07T13:59:10.067275+0000","last_peered":"2024-05-07T13:59:10.067275+0000","last_clean":"2024-05-07T13:59:10.067275+0000","last_became_active":"2024-05-07T13:55:54.333766+0000","last_became_peered":"2024-05-07T13:55:54.333766+0000","last_unstale":"2024-05-07T13:59:10.067275+0000","last_undegraded":"2024-05-07T13:59:10.067275+0000","last_fullsized":"2024-05-07T13:59:10.067275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2024-05-07T13:59:10.067149+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.067149+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:19.058798+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.069535+0000","last_change":"2024-05-07T13:59:12.069535+0000","last_active":"2024-05-07T13:59:12.069535+0000","last_peered":"2024-05-07T13:59:12.069535+0000","last_clean":"2024-05-07T13:59:12.069535+0000","last_became_active":"2024-05-07T13:55:56.338195+0000","last_became_peered":"2024-05-07T13:55:56.338195+0000","last_unstale":"2024-05-07T13:59:12.069535+0000","last_undegraded":"2024-05-07T13:59:12.069535+0000","last_fullsized":"2024-05-07T13:59:12.069535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.069419+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.069419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:19:55.425213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:05.979447+0000","last_change":"2024-05-07T14:00:05.979447+0000","last_active":"2024-05-07T14:00:05.979447+0000","last_peered":"2024-05-07T14:00:05.979447+0000","last_clean":"2024-05-07T14:00:05.979447+0000","last_became_active":"2024-05-07T13:55:58.346040+0000","last_became_peered":"2024-05-07T13:55:58.346040+0000","last_unstale":"2024-05-07T14:00:05.979447+0000","last_undegraded":"2024-05-07T14:00:05.979447+0000","last_fullsized":"2024-05-07T14:00:05.979447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-07T14:00:05.979333+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-07T14:00:05.979333+0000","last_clean_scrub_stamp":"2024-05-07T14:00:05.979333+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:17:00.089927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'16","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.895973+0000","last_change":"2024-05-07T14:00:03.895973+0000","last_active":"2024-05-07T14:00:03.895973+0000","last_peered":"2024-05-07T14:00:03.895973+0000","last_clean":"2024-05-07T14:00:03.895973+0000","last_became_active":"2024-05-07T13:56:35.369148+0000","last_became_peered":"2024-05-07T13:56:35.369148+0000","last_unstale":"2024-05-07T14:00:03.895973+0000","last_undegraded":"2024-05-07T14:00:03.895973+0000","last_fullsized":"2024-05-07T14:00:03.895973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T14:00:03.895789+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T14:00:03.895789+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.895789+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:45:08.761287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.004137+0000","last_change":"2024-05-07T13:59:57.004204+0000","last_active":"2024-05-07T13:59:57.004137+0000","last_peered":"2024-05-07T13:59:57.004137+0000","last_clean":"2024-05-07T13:59:57.004137+0000","last_became_active":"2024-05-07T13:55:40.043176+0000","last_became_peered":"2024-05-07T13:55:40.043176+0000","last_unstale":"2024-05-07T13:59:57.004137+0000","last_undegraded":"2024-05-07T13:59:57.004137+0000","last_fullsized":"2024-05-07T13:59:57.004137+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-05-07T13:59:57.004031+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-05-07T13:59:57.004031+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.004031+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:20:33.661694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:23.325332+0000","last_change":"2024-05-07T14:00:23.325367+0000","last_active":"2024-05-07T14:00:23.325332+0000","last_peered":"2024-05-07T14:00:23.325332+0000","last_clean":"2024-05-07T14:00:23.325332+0000","last_became_active":"2024-05-07T13:55:40.045181+0000","last_became_peered":"2024-05-07T13:55:40.045181+0000","last_unstale":"2024-05-07T14:00:23.325332+0000","last_undegraded":"2024-05-07T14:00:23.325332+0000","last_fullsized":"2024-05-07T14:00:23.325332+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:23.325234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:23.325234+0000","last_clean_scrub_stamp":"2024-05-07T14:00:23.325234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:36:01.523750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'3","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:02.150595+0000","last_change":"2024-05-07T14:00:02.150624+0000","last_active":"2024-05-07T14:00:02.150595+0000","last_peered":"2024-05-07T14:00:02.150595+0000","last_clean":"2024-05-07T14:00:02.150595+0000","last_became_active":"2024-05-07T13:55:48.350998+0000","last_became_peered":"2024-05-07T13:55:48.350998+0000","last_unstale":"2024-05-07T14:00:02.150595+0000","last_undegraded":"2024-05-07T14:00:02.150595+0000","last_fullsized":"2024-05-07T14:00:02.150595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T14:00:02.150501+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T14:00:02.150501+0000","last_clean_scrub_stamp":"2024-05-07T14:00:02.150501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:43.337012+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.053567+0000","last_change":"2024-05-07T13:59:28.053567+0000","last_active":"2024-05-07T13:59:28.053567+0000","last_peered":"2024-05-07T13:59:28.053567+0000","last_clean":"2024-05-07T13:59:28.053567+0000","last_became_active":"2024-05-07T13:55:52.321406+0000","last_became_peered":"2024-05-07T13:55:52.321406+0000","last_unstale":"2024-05-07T13:59:28.053567+0000","last_undegraded":"2024-05-07T13:59:28.053567+0000","last_fullsized":"2024-05-07T13:59:28.053567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:28.053456+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.053456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:40.818094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.891601+0000","last_change":"2024-05-07T13:59:22.891601+0000","last_active":"2024-05-07T13:59:22.891601+0000","last_peered":"2024-05-07T13:59:22.891601+0000","last_clean":"2024-05-07T13:59:22.891601+0000","last_became_active":"2024-05-07T13:55:54.328677+0000","last_became_peered":"2024-05-07T13:55:54.328677+0000","last_unstale":"2024-05-07T13:59:22.891601+0000","last_undegraded":"2024-05-07T13:59:22.891601+0000","last_fullsized":"2024-05-07T13:59:22.891601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-07T13:59:22.891465+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.891465+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:38.858949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.993105+0000","last_change":"2024-05-07T13:59:21.993105+0000","last_active":"2024-05-07T13:59:21.993105+0000","last_peered":"2024-05-07T13:59:21.993105+0000","last_clean":"2024-05-07T13:59:21.993105+0000","last_became_active":"2024-05-07T13:55:56.335013+0000","last_became_peered":"2024-05-07T13:55:56.335013+0000","last_unstale":"2024-05-07T13:59:21.993105+0000","last_undegraded":"2024-05-07T13:59:21.993105+0000","last_fullsized":"2024-05-07T13:59:21.993105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.992994+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.992994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:07:21.511355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'82","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.141198+0000","last_change":"2024-05-07T13:59:20.141198+0000","last_active":"2024-05-07T13:59:20.141198+0000","last_peered":"2024-05-07T13:59:20.141198+0000","last_clean":"2024-05-07T13:59:20.141198+0000","last_became_active":"2024-05-07T13:55:58.335220+0000","last_became_peered":"2024-05-07T13:55:58.335220+0000","last_unstale":"2024-05-07T13:59:20.141198+0000","last_undegraded":"2024-05-07T13:59:20.141198+0000","last_fullsized":"2024-05-07T13:59:20.141198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'82","last_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_deep_scrub":"29'82","last_deep_scrub_stamp":"2024-05-07T13:59:20.141061+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.141061+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:19.754291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.184294+0000","last_change":"2024-05-07T13:59:48.184294+0000","last_active":"2024-05-07T13:59:48.184294+0000","last_peered":"2024-05-07T13:59:48.184294+0000","last_clean":"2024-05-07T13:59:48.184294+0000","last_became_active":"2024-05-07T13:55:50.323408+0000","last_became_peered":"2024-05-07T13:55:50.323408+0000","last_unstale":"2024-05-07T13:59:48.184294+0000","last_undegraded":"2024-05-07T13:59:48.184294+0000","last_fullsized":"2024-05-07T13:59:48.184294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:48.184128+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:48.184128+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.184128+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:05:31.822835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:19.204957+0000","last_change":"2024-05-07T14:00:19.204986+0000","last_active":"2024-05-07T14:00:19.204957+0000","last_peered":"2024-05-07T14:00:19.204957+0000","last_clean":"2024-05-07T14:00:19.204957+0000","last_became_active":"2024-05-07T13:55:40.042785+0000","last_became_peered":"2024-05-07T13:55:40.042785+0000","last_unstale":"2024-05-07T14:00:19.204957+0000","last_undegraded":"2024-05-07T14:00:19.204957+0000","last_fullsized":"2024-05-07T14:00:19.204957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:19.204863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:19.204863+0000","last_clean_scrub_stamp":"2024-05-07T14:00:19.204863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:55.971116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.128078+0000","last_change":"2024-05-07T13:59:43.128078+0000","last_active":"2024-05-07T13:59:43.128078+0000","last_peered":"2024-05-07T13:59:43.128078+0000","last_clean":"2024-05-07T13:59:43.128078+0000","last_became_active":"2024-05-07T13:55:48.325905+0000","last_became_peered":"2024-05-07T13:55:48.325905+0000","last_unstale":"2024-05-07T13:59:43.128078+0000","last_undegraded":"2024-05-07T13:59:43.128078+0000","last_fullsized":"2024-05-07T13:59:43.128078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:43.127954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:43.127954+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.127954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:34.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:17.859922+0000","last_change":"2024-05-07T13:59:17.859922+0000","last_active":"2024-05-07T13:59:17.859922+0000","last_peered":"2024-05-07T13:59:17.859922+0000","last_clean":"2024-05-07T13:59:17.859922+0000","last_became_active":"2024-05-07T13:55:52.318221+0000","last_became_peered":"2024-05-07T13:55:52.318221+0000","last_unstale":"2024-05-07T13:59:17.859922+0000","last_undegraded":"2024-05-07T13:59:17.859922+0000","last_fullsized":"2024-05-07T13:59:17.859922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:17.859806+0000","last_clean_scrub_stamp":"2024-05-07T13:59:17.859806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:59.896313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.121985+0000","last_change":"2024-05-07T13:59:14.121985+0000","last_active":"2024-05-07T13:59:14.121985+0000","last_peered":"2024-05-07T13:59:14.121985+0000","last_clean":"2024-05-07T13:59:14.121985+0000","last_became_active":"2024-05-07T13:55:54.329774+0000","last_became_peered":"2024-05-07T13:55:54.329774+0000","last_unstale":"2024-05-07T13:59:14.121985+0000","last_undegraded":"2024-05-07T13:59:14.121985+0000","last_fullsized":"2024-05-07T13:59:14.121985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-07T13:59:14.121829+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.121829+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:41:13.735059+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.058168+0000","last_change":"2024-05-07T13:59:33.058168+0000","last_active":"2024-05-07T13:59:33.058168+0000","last_peered":"2024-05-07T13:59:33.058168+0000","last_clean":"2024-05-07T13:59:33.058168+0000","last_became_active":"2024-05-07T13:55:56.343224+0000","last_became_peered":"2024-05-07T13:55:56.343224+0000","last_unstale":"2024-05-07T13:59:33.058168+0000","last_undegraded":"2024-05-07T13:59:33.058168+0000","last_fullsized":"2024-05-07T13:59:33.058168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:33.058058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:33.058058+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.058058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:21:31.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.076744+0000","last_change":"2024-05-07T13:59:39.076744+0000","last_active":"2024-05-07T13:59:39.076744+0000","last_peered":"2024-05-07T13:59:39.076744+0000","last_clean":"2024-05-07T13:59:39.076744+0000","last_became_active":"2024-05-07T13:55:58.344996+0000","last_became_peered":"2024-05-07T13:55:58.344996+0000","last_unstale":"2024-05-07T13:59:39.076744+0000","last_undegraded":"2024-05-07T13:59:39.076744+0000","last_fullsized":"2024-05-07T13:59:39.076744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T13:59:39.076601+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T13:59:39.076601+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.076601+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:24:16.973175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.071620+0000","last_change":"2024-05-07T13:59:48.071620+0000","last_active":"2024-05-07T13:59:48.071620+0000","last_peered":"2024-05-07T13:59:48.071620+0000","last_clean":"2024-05-07T13:59:48.071620+0000","last_became_active":"2024-05-07T13:55:50.318471+0000","last_became_peered":"2024-05-07T13:55:50.318471+0000","last_unstale":"2024-05-07T13:59:48.071620+0000","last_undegraded":"2024-05-07T13:59:48.071620+0000","last_fullsized":"2024-05-07T13:59:48.071620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:48.071503+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:48.071503+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.071503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:22.255533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.988080+0000","last_change":"2024-05-07T13:59:49.988108+0000","last_active":"2024-05-07T13:59:49.988080+0000","last_peered":"2024-05-07T13:59:49.988080+0000","last_clean":"2024-05-07T13:59:49.988080+0000","last_became_active":"2024-05-07T13:55:40.042829+0000","last_became_peered":"2024-05-07T13:55:40.042829+0000","last_unstale":"2024-05-07T13:59:49.988080+0000","last_undegraded":"2024-05-07T13:59:49.988080+0000","last_fullsized":"2024-05-07T13:59:49.988080+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.987988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.987988+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.987988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:37.223196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.086185+0000","last_change":"2024-05-07T13:59:49.086219+0000","last_active":"2024-05-07T13:59:49.086185+0000","last_peered":"2024-05-07T13:59:49.086185+0000","last_clean":"2024-05-07T13:59:49.086185+0000","last_became_active":"2024-05-07T13:55:48.325013+0000","last_became_peered":"2024-05-07T13:55:48.325013+0000","last_unstale":"2024-05-07T13:59:49.086185+0000","last_undegraded":"2024-05-07T13:59:49.086185+0000","last_fullsized":"2024-05-07T13:59:49.086185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.086089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.086089+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.086089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:42.383729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.874466+0000","last_change":"2024-05-07T14:00:04.874466+0000","last_active":"2024-05-07T14:00:04.874466+0000","last_peered":"2024-05-07T14:00:04.874466+0000","last_clean":"2024-05-07T14:00:04.874466+0000","last_became_active":"2024-05-07T13:56:35.368904+0000","last_became_peered":"2024-05-07T13:56:35.368904+0000","last_unstale":"2024-05-07T14:00:04.874466+0000","last_undegraded":"2024-05-07T14:00:04.874466+0000","last_fullsized":"2024-05-07T14:00:04.874466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:04.874325+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:04.874325+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.874325+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:33.252851+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.147329+0000","last_change":"2024-05-07T13:59:21.147329+0000","last_active":"2024-05-07T13:59:21.147329+0000","last_peered":"2024-05-07T13:59:21.147329+0000","last_clean":"2024-05-07T13:59:21.147329+0000","last_became_active":"2024-05-07T13:55:54.329778+0000","last_became_peered":"2024-05-07T13:55:54.329778+0000","last_unstale":"2024-05-07T13:59:21.147329+0000","last_undegraded":"2024-05-07T13:59:21.147329+0000","last_fullsized":"2024-05-07T13:59:21.147329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-07T13:59:21.147200+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.147200+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:14:48.234250+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.061795+0000","last_change":"2024-05-07T13:59:26.061795+0000","last_active":"2024-05-07T13:59:26.061795+0000","last_peered":"2024-05-07T13:59:26.061795+0000","last_clean":"2024-05-07T13:59:26.061795+0000","last_became_active":"2024-05-07T13:55:56.336064+0000","last_became_peered":"2024-05-07T13:55:56.336064+0000","last_unstale":"2024-05-07T13:59:26.061795+0000","last_undegraded":"2024-05-07T13:59:26.061795+0000","last_fullsized":"2024-05-07T13:59:26.061795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.061660+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.061660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:02.633772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:30.257833+0000","last_change":"2024-05-07T14:00:30.257864+0000","last_active":"2024-05-07T14:00:30.257833+0000","last_peered":"2024-05-07T14:00:30.257833+0000","last_clean":"2024-05-07T14:00:30.257833+0000","last_became_active":"2024-05-07T13:55:58.350208+0000","last_became_peered":"2024-05-07T13:55:58.350208+0000","last_unstale":"2024-05-07T14:00:30.257833+0000","last_undegraded":"2024-05-07T14:00:30.257833+0000","last_fullsized":"2024-05-07T14:00:30.257833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:30.257739+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:30.257739+0000","last_clean_scrub_stamp":"2024-05-07T14:00:30.257739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:17:14.585555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'8","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.147024+0000","last_change":"2024-05-07T13:59:46.147024+0000","last_active":"2024-05-07T13:59:46.147024+0000","last_peered":"2024-05-07T13:59:46.147024+0000","last_clean":"2024-05-07T13:59:46.147024+0000","last_became_active":"2024-05-07T13:55:50.313163+0000","last_became_peered":"2024-05-07T13:55:50.313163+0000","last_unstale":"2024-05-07T13:59:46.147024+0000","last_undegraded":"2024-05-07T13:59:46.147024+0000","last_fullsized":"2024-05-07T13:59:46.147024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:46.146906+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:46.146906+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.146906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:41.305486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:22.336078+0000","last_change":"2024-05-07T14:00:22.336100+0000","last_active":"2024-05-07T14:00:22.336078+0000","last_peered":"2024-05-07T14:00:22.336078+0000","last_clean":"2024-05-07T14:00:22.336078+0000","last_became_active":"2024-05-07T13:55:40.043054+0000","last_became_peered":"2024-05-07T13:55:40.043054+0000","last_unstale":"2024-05-07T14:00:22.336078+0000","last_undegraded":"2024-05-07T14:00:22.336078+0000","last_fullsized":"2024-05-07T14:00:22.336078+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:22.335987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:22.335987+0000","last_clean_scrub_stamp":"2024-05-07T14:00:22.335987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:54.789383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:55.875626+0000","last_change":"2024-05-07T13:59:55.875626+0000","last_active":"2024-05-07T13:59:55.875626+0000","last_peered":"2024-05-07T13:59:55.875626+0000","last_clean":"2024-05-07T13:59:55.875626+0000","last_became_active":"2024-05-07T13:55:48.338442+0000","last_became_peered":"2024-05-07T13:55:48.338442+0000","last_unstale":"2024-05-07T13:59:55.875626+0000","last_undegraded":"2024-05-07T13:59:55.875626+0000","last_fullsized":"2024-05-07T13:59:55.875626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:55.875457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:55.875457+0000","last_clean_scrub_stamp":"2024-05-07T13:59:55.875457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:51.034037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.005460+0000","last_change":"2024-05-07T13:59:32.005460+0000","last_active":"2024-05-07T13:59:32.005460+0000","last_peered":"2024-05-07T13:59:32.005460+0000","last_clean":"2024-05-07T13:59:32.005460+0000","last_became_active":"2024-05-07T13:55:52.321506+0000","last_became_peered":"2024-05-07T13:55:52.321506+0000","last_unstale":"2024-05-07T13:59:32.005460+0000","last_undegraded":"2024-05-07T13:59:32.005460+0000","last_fullsized":"2024-05-07T13:59:32.005460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.005333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.005333+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.005333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:53.661193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'22","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:24.983843+0000","last_change":"2024-05-07T13:59:24.983843+0000","last_active":"2024-05-07T13:59:24.983843+0000","last_peered":"2024-05-07T13:59:24.983843+0000","last_clean":"2024-05-07T13:59:24.983843+0000","last_became_active":"2024-05-07T13:55:54.328763+0000","last_became_peered":"2024-05-07T13:55:54.328763+0000","last_unstale":"2024-05-07T13:59:24.983843+0000","last_undegraded":"2024-05-07T13:59:24.983843+0000","last_fullsized":"2024-05-07T13:59:24.983843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-07T13:59:24.983703+0000","last_clean_scrub_stamp":"2024-05-07T13:59:24.983703+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:59.173853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.014388+0000","last_change":"2024-05-07T13:59:32.014388+0000","last_active":"2024-05-07T13:59:32.014388+0000","last_peered":"2024-05-07T13:59:32.014388+0000","last_clean":"2024-05-07T13:59:32.014388+0000","last_became_active":"2024-05-07T13:55:56.343131+0000","last_became_peered":"2024-05-07T13:55:56.343131+0000","last_unstale":"2024-05-07T13:59:32.014388+0000","last_undegraded":"2024-05-07T13:59:32.014388+0000","last_fullsized":"2024-05-07T13:59:32.014388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.014263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.014263+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.014263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:11:56.176284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:09.996634+0000","last_change":"2024-05-07T14:00:09.996634+0000","last_active":"2024-05-07T14:00:09.996634+0000","last_peered":"2024-05-07T14:00:09.996634+0000","last_clean":"2024-05-07T14:00:09.996634+0000","last_became_active":"2024-05-07T13:55:58.348068+0000","last_became_peered":"2024-05-07T13:55:58.348068+0000","last_unstale":"2024-05-07T14:00:09.996634+0000","last_undegraded":"2024-05-07T14:00:09.996634+0000","last_fullsized":"2024-05-07T14:00:09.996634+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:09.996470+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:09.996470+0000","last_clean_scrub_stamp":"2024-05-07T14:00:09.996470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:18.668653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'14","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:38.092977+0000","last_change":"2024-05-07T13:59:38.092977+0000","last_active":"2024-05-07T13:59:38.092977+0000","last_peered":"2024-05-07T13:59:38.092977+0000","last_clean":"2024-05-07T13:59:38.092977+0000","last_became_active":"2024-05-07T13:55:50.323820+0000","last_became_peered":"2024-05-07T13:55:50.323820+0000","last_unstale":"2024-05-07T13:59:38.092977+0000","last_undegraded":"2024-05-07T13:59:38.092977+0000","last_fullsized":"2024-05-07T13:59:38.092977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:38.092855+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:38.092855+0000","last_clean_scrub_stamp":"2024-05-07T13:59:38.092855+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:57.688105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.031920+0000","last_change":"2024-05-07T13:59:49.031920+0000","last_active":"2024-05-07T13:59:49.031920+0000","last_peered":"2024-05-07T13:59:49.031920+0000","last_clean":"2024-05-07T13:59:49.031920+0000","last_became_active":"2024-05-07T13:55:48.338139+0000","last_became_peered":"2024-05-07T13:55:48.338139+0000","last_unstale":"2024-05-07T13:59:49.031920+0000","last_undegraded":"2024-05-07T13:59:49.031920+0000","last_fullsized":"2024-05-07T13:59:49.031920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.031788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.031788+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.031788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:15.107738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:56.216260+0000","last_change":"2024-05-07T13:59:56.216304+0000","last_active":"2024-05-07T13:59:56.216260+0000","last_peered":"2024-05-07T13:59:56.216260+0000","last_clean":"2024-05-07T13:59:56.216260+0000","last_became_active":"2024-05-07T13:55:40.042870+0000","last_became_peered":"2024-05-07T13:55:40.042870+0000","last_unstale":"2024-05-07T13:59:56.216260+0000","last_undegraded":"2024-05-07T13:59:56.216260+0000","last_fullsized":"2024-05-07T13:59:56.216260+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:56.216155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:56.216155+0000","last_clean_scrub_stamp":"2024-05-07T13:59:56.216155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:51:13.276042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.010339+0000","last_change":"2024-05-07T13:59:33.010339+0000","last_active":"2024-05-07T13:59:33.010339+0000","last_peered":"2024-05-07T13:59:33.010339+0000","last_clean":"2024-05-07T13:59:33.010339+0000","last_became_active":"2024-05-07T13:55:52.321249+0000","last_became_peered":"2024-05-07T13:55:52.321249+0000","last_unstale":"2024-05-07T13:59:33.010339+0000","last_undegraded":"2024-05-07T13:59:33.010339+0000","last_fullsized":"2024-05-07T13:59:33.010339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.010232+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.010232+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.010232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:59:33.336357+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'74","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.980067+0000","last_change":"2024-05-07T13:59:20.980067+0000","last_active":"2024-05-07T13:59:20.980067+0000","last_peered":"2024-05-07T13:59:20.980067+0000","last_clean":"2024-05-07T13:59:20.980067+0000","last_became_active":"2024-05-07T13:55:54.326812+0000","last_became_peered":"2024-05-07T13:55:54.326812+0000","last_unstale":"2024-05-07T13:59:20.980067+0000","last_undegraded":"2024-05-07T13:59:20.980067+0000","last_fullsized":"2024-05-07T13:59:20.980067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-07T13:59:20.979917+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.979917+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:21.832415+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.116256+0000","last_change":"2024-05-07T13:59:13.116256+0000","last_active":"2024-05-07T13:59:13.116256+0000","last_peered":"2024-05-07T13:59:13.116256+0000","last_clean":"2024-05-07T13:59:13.116256+0000","last_became_active":"2024-05-07T13:55:56.331343+0000","last_became_peered":"2024-05-07T13:55:56.331343+0000","last_unstale":"2024-05-07T13:59:13.116256+0000","last_undegraded":"2024-05-07T13:59:13.116256+0000","last_fullsized":"2024-05-07T13:59:13.116256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:13.116129+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.116129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:14:37.954463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'11","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:10.088955+0000","last_change":"2024-05-07T14:00:10.088955+0000","last_active":"2024-05-07T14:00:10.088955+0000","last_peered":"2024-05-07T14:00:10.088955+0000","last_clean":"2024-05-07T14:00:10.088955+0000","last_became_active":"2024-05-07T13:55:58.347566+0000","last_became_peered":"2024-05-07T13:55:58.347566+0000","last_unstale":"2024-05-07T14:00:10.088955+0000","last_undegraded":"2024-05-07T14:00:10.088955+0000","last_fullsized":"2024-05-07T14:00:10.088955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-07T14:00:10.088835+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-07T14:00:10.088835+0000","last_clean_scrub_stamp":"2024-05-07T14:00:10.088835+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:31:45.322682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'8","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.061535+0000","last_change":"2024-05-07T13:59:30.061535+0000","last_active":"2024-05-07T13:59:30.061535+0000","last_peered":"2024-05-07T13:59:30.061535+0000","last_clean":"2024-05-07T13:59:30.061535+0000","last_became_active":"2024-05-07T13:55:50.330547+0000","last_became_peered":"2024-05-07T13:55:50.330547+0000","last_unstale":"2024-05-07T13:59:30.061535+0000","last_undegraded":"2024-05-07T13:59:30.061535+0000","last_fullsized":"2024-05-07T13:59:30.061535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:30.061415+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:30.061415+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.061415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:52:52.036188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.111799+0000","last_change":"2024-05-07T14:00:01.111847+0000","last_active":"2024-05-07T14:00:01.111799+0000","last_peered":"2024-05-07T14:00:01.111799+0000","last_clean":"2024-05-07T14:00:01.111799+0000","last_became_active":"2024-05-07T13:55:48.324378+0000","last_became_peered":"2024-05-07T13:55:48.324378+0000","last_unstale":"2024-05-07T14:00:01.111799+0000","last_undegraded":"2024-05-07T14:00:01.111799+0000","last_fullsized":"2024-05-07T14:00:01.111799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:01.111703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:01.111703+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.111703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:34:36.980500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:21.292378+0000","last_change":"2024-05-07T14:00:21.292455+0000","last_active":"2024-05-07T14:00:21.292378+0000","last_peered":"2024-05-07T14:00:21.292378+0000","last_clean":"2024-05-07T14:00:21.292378+0000","last_became_active":"2024-05-07T13:55:40.042716+0000","last_became_peered":"2024-05-07T13:55:40.042716+0000","last_unstale":"2024-05-07T14:00:21.292378+0000","last_undegraded":"2024-05-07T14:00:21.292378+0000","last_fullsized":"2024-05-07T14:00:21.292378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:21.292247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:21.292247+0000","last_clean_scrub_stamp":"2024-05-07T14:00:21.292247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:01:31.566378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.855799+0000","last_change":"2024-05-07T14:00:00.855799+0000","last_active":"2024-05-07T14:00:00.855799+0000","last_peered":"2024-05-07T14:00:00.855799+0000","last_clean":"2024-05-07T14:00:00.855799+0000","last_became_active":"2024-05-07T13:56:35.366075+0000","last_became_peered":"2024-05-07T13:56:35.366075+0000","last_unstale":"2024-05-07T14:00:00.855799+0000","last_undegraded":"2024-05-07T14:00:00.855799+0000","last_fullsized":"2024-05-07T14:00:00.855799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.855661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.855661+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.855661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:12:25.017681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"29'21","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:13.152407+0000","last_change":"2024-05-07T13:59:13.152407+0000","last_active":"2024-05-07T13:59:13.152407+0000","last_peered":"2024-05-07T13:59:13.152407+0000","last_clean":"2024-05-07T13:59:13.152407+0000","last_became_active":"2024-05-07T13:55:54.330896+0000","last_became_peered":"2024-05-07T13:55:54.330896+0000","last_unstale":"2024-05-07T13:59:13.152407+0000","last_undegraded":"2024-05-07T13:59:13.152407+0000","last_fullsized":"2024-05-07T13:59:13.152407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-07T13:59:13.152223+0000","last_clean_scrub_stamp":"2024-05-07T13:59:13.152223+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.463262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.085692+0000","last_change":"2024-05-07T13:59:27.085692+0000","last_active":"2024-05-07T13:59:27.085692+0000","last_peered":"2024-05-07T13:59:27.085692+0000","last_clean":"2024-05-07T13:59:27.085692+0000","last_became_active":"2024-05-07T13:55:56.333242+0000","last_became_peered":"2024-05-07T13:55:56.333242+0000","last_unstale":"2024-05-07T13:59:27.085692+0000","last_undegraded":"2024-05-07T13:59:27.085692+0000","last_fullsized":"2024-05-07T13:59:27.085692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:27.085530+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.085530+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:23.784119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.217771+0000","last_change":"2024-05-07T13:59:53.217771+0000","last_active":"2024-05-07T13:59:53.217771+0000","last_peered":"2024-05-07T13:59:53.217771+0000","last_clean":"2024-05-07T13:59:53.217771+0000","last_became_active":"2024-05-07T13:55:58.346295+0000","last_became_peered":"2024-05-07T13:55:58.346295+0000","last_unstale":"2024-05-07T13:59:53.217771+0000","last_undegraded":"2024-05-07T13:59:53.217771+0000","last_fullsized":"2024-05-07T13:59:53.217771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:53.217633+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:53.217633+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.217633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:19:36.621308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:43.139684+0000","last_change":"2024-05-07T13:59:43.139684+0000","last_active":"2024-05-07T13:59:43.139684+0000","last_peered":"2024-05-07T13:59:43.139684+0000","last_clean":"2024-05-07T13:59:43.139684+0000","last_became_active":"2024-05-07T13:55:50.325665+0000","last_became_peered":"2024-05-07T13:55:50.325665+0000","last_unstale":"2024-05-07T13:59:43.139684+0000","last_undegraded":"2024-05-07T13:59:43.139684+0000","last_fullsized":"2024-05-07T13:59:43.139684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T13:59:43.139573+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T13:59:43.139573+0000","last_clean_scrub_stamp":"2024-05-07T13:59:43.139573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:38:12.305990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:25.264849+0000","last_change":"2024-05-07T14:00:25.264875+0000","last_active":"2024-05-07T14:00:25.264849+0000","last_peered":"2024-05-07T14:00:25.264849+0000","last_clean":"2024-05-07T14:00:25.264849+0000","last_became_active":"2024-05-07T13:55:48.346645+0000","last_became_peered":"2024-05-07T13:55:48.346645+0000","last_unstale":"2024-05-07T14:00:25.264849+0000","last_undegraded":"2024-05-07T14:00:25.264849+0000","last_fullsized":"2024-05-07T14:00:25.264849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:25.264754+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:25.264754+0000","last_clean_scrub_stamp":"2024-05-07T14:00:25.264754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:26.317932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.188866+0000","last_change":"2024-05-07T13:59:57.188866+0000","last_active":"2024-05-07T13:59:57.188866+0000","last_peered":"2024-05-07T13:59:57.188866+0000","last_clean":"2024-05-07T13:59:57.188866+0000","last_became_active":"2024-05-07T13:55:40.045112+0000","last_became_peered":"2024-05-07T13:55:40.045112+0000","last_unstale":"2024-05-07T13:59:57.188866+0000","last_undegraded":"2024-05-07T13:59:57.188866+0000","last_fullsized":"2024-05-07T13:59:57.188866+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:57.188686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:57.188686+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.188686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:48.438703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:12.842021+0000","last_change":"2024-05-07T13:59:12.842021+0000","last_active":"2024-05-07T13:59:12.842021+0000","last_peered":"2024-05-07T13:59:12.842021+0000","last_clean":"2024-05-07T13:59:12.842021+0000","last_became_active":"2024-05-07T13:55:52.321160+0000","last_became_peered":"2024-05-07T13:55:52.321160+0000","last_unstale":"2024-05-07T13:59:12.842021+0000","last_undegraded":"2024-05-07T13:59:12.842021+0000","last_fullsized":"2024-05-07T13:59:12.842021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:12.841853+0000","last_clean_scrub_stamp":"2024-05-07T13:59:12.841853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:34.497713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.104664+0000","last_change":"2024-05-07T13:59:40.104664+0000","last_active":"2024-05-07T13:59:40.104664+0000","last_peered":"2024-05-07T13:59:40.104664+0000","last_clean":"2024-05-07T13:59:40.104664+0000","last_became_active":"2024-05-07T13:55:54.329885+0000","last_became_peered":"2024-05-07T13:55:54.329885+0000","last_unstale":"2024-05-07T13:59:40.104664+0000","last_undegraded":"2024-05-07T13:59:40.104664+0000","last_fullsized":"2024-05-07T13:59:40.104664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:40.104516+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:40.104516+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.104516+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:58.439308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":402,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.906548+0000","last_change":"2024-05-07T13:59:11.906548+0000","last_active":"2024-05-07T13:59:11.906548+0000","last_peered":"2024-05-07T13:59:11.906548+0000","last_clean":"2024-05-07T13:59:11.906548+0000","last_became_active":"2024-05-07T13:55:56.334023+0000","last_became_peered":"2024-05-07T13:55:56.334023+0000","last_unstale":"2024-05-07T13:59:11.906548+0000","last_undegraded":"2024-05-07T13:59:11.906548+0000","last_fullsized":"2024-05-07T13:59:11.906548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:11.906422+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.906422+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:49:19.117395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"27'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:06.941687+0000","last_change":"2024-05-07T14:00:06.941687+0000","last_active":"2024-05-07T14:00:06.941687+0000","last_peered":"2024-05-07T14:00:06.941687+0000","last_clean":"2024-05-07T14:00:06.941687+0000","last_became_active":"2024-05-07T13:55:58.346984+0000","last_became_peered":"2024-05-07T13:55:58.346984+0000","last_unstale":"2024-05-07T14:00:06.941687+0000","last_undegraded":"2024-05-07T14:00:06.941687+0000","last_fullsized":"2024-05-07T14:00:06.941687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-07T14:00:06.941537+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-07T14:00:06.941537+0000","last_clean_scrub_stamp":"2024-05-07T14:00:06.941537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:08:16.094580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.079940+0000","last_change":"2024-05-07T13:59:48.079940+0000","last_active":"2024-05-07T13:59:48.079940+0000","last_peered":"2024-05-07T13:59:48.079940+0000","last_clean":"2024-05-07T13:59:48.079940+0000","last_became_active":"2024-05-07T13:55:50.327283+0000","last_became_peered":"2024-05-07T13:55:50.327283+0000","last_unstale":"2024-05-07T13:59:48.079940+0000","last_undegraded":"2024-05-07T13:59:48.079940+0000","last_fullsized":"2024-05-07T13:59:48.079940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:48.079746+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:48.079746+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.079746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:42.880890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.942824+0000","last_change":"2024-05-07T14:00:03.942824+0000","last_active":"2024-05-07T14:00:03.942824+0000","last_peered":"2024-05-07T14:00:03.942824+0000","last_clean":"2024-05-07T14:00:03.942824+0000","last_became_active":"2024-05-07T13:55:48.337553+0000","last_became_peered":"2024-05-07T13:55:48.337553+0000","last_unstale":"2024-05-07T14:00:03.942824+0000","last_undegraded":"2024-05-07T14:00:03.942824+0000","last_fullsized":"2024-05-07T14:00:03.942824+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:03.942685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:03.942685+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.942685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:18:05.627452+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:20.253323+0000","last_change":"2024-05-07T14:00:20.253356+0000","last_active":"2024-05-07T14:00:20.253323+0000","last_peered":"2024-05-07T14:00:20.253323+0000","last_clean":"2024-05-07T14:00:20.253323+0000","last_became_active":"2024-05-07T13:55:40.042848+0000","last_became_peered":"2024-05-07T13:55:40.042848+0000","last_unstale":"2024-05-07T14:00:20.253323+0000","last_undegraded":"2024-05-07T14:00:20.253323+0000","last_fullsized":"2024-05-07T14:00:20.253323+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:20.253230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:20.253230+0000","last_clean_scrub_stamp":"2024-05-07T14:00:20.253230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:43:22.195161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.844877+0000","last_change":"2024-05-07T13:59:19.844877+0000","last_active":"2024-05-07T13:59:19.844877+0000","last_peered":"2024-05-07T13:59:19.844877+0000","last_clean":"2024-05-07T13:59:19.844877+0000","last_became_active":"2024-05-07T13:55:52.314793+0000","last_became_peered":"2024-05-07T13:55:52.314793+0000","last_unstale":"2024-05-07T13:59:19.844877+0000","last_undegraded":"2024-05-07T13:59:19.844877+0000","last_fullsized":"2024-05-07T13:59:19.844877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:19.844768+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.844768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:57:45.920718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.116043+0000","last_change":"2024-05-07T13:59:19.116043+0000","last_active":"2024-05-07T13:59:19.116043+0000","last_peered":"2024-05-07T13:59:19.116043+0000","last_clean":"2024-05-07T13:59:19.116043+0000","last_became_active":"2024-05-07T13:55:54.329879+0000","last_became_peered":"2024-05-07T13:55:54.329879+0000","last_unstale":"2024-05-07T13:59:19.116043+0000","last_undegraded":"2024-05-07T13:59:19.116043+0000","last_fullsized":"2024-05-07T13:59:19.116043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-07T13:59:19.115906+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.115906+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:13.426945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.963178+0000","last_change":"2024-05-07T13:59:15.963178+0000","last_active":"2024-05-07T13:59:15.963178+0000","last_peered":"2024-05-07T13:59:15.963178+0000","last_clean":"2024-05-07T13:59:15.963178+0000","last_became_active":"2024-05-07T13:55:56.332931+0000","last_became_peered":"2024-05-07T13:55:56.332931+0000","last_unstale":"2024-05-07T13:59:15.963178+0000","last_undegraded":"2024-05-07T13:59:15.963178+0000","last_fullsized":"2024-05-07T13:59:15.963178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.963044+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.963044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:35.942397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.085005+0000","last_change":"2024-05-07T13:59:32.085005+0000","last_active":"2024-05-07T13:59:32.085005+0000","last_peered":"2024-05-07T13:59:32.085005+0000","last_clean":"2024-05-07T13:59:32.085005+0000","last_became_active":"2024-05-07T13:55:58.340759+0000","last_became_peered":"2024-05-07T13:55:58.340759+0000","last_unstale":"2024-05-07T13:59:32.085005+0000","last_undegraded":"2024-05-07T13:59:32.085005+0000","last_fullsized":"2024-05-07T13:59:32.085005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:32.084886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:32.084886+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.084886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:07:31.603247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.839594+0000","last_change":"2024-05-07T13:59:59.839594+0000","last_active":"2024-05-07T13:59:59.839594+0000","last_peered":"2024-05-07T13:59:59.839594+0000","last_clean":"2024-05-07T13:59:59.839594+0000","last_became_active":"2024-05-07T13:55:58.348566+0000","last_became_peered":"2024-05-07T13:55:58.348566+0000","last_unstale":"2024-05-07T13:59:59.839594+0000","last_undegraded":"2024-05-07T13:59:59.839594+0000","last_fullsized":"2024-05-07T13:59:59.839594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-07T13:59:59.839470+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-07T13:59:59.839470+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.839470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:42.998791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.040654+0000","last_change":"2024-05-07T13:59:33.040654+0000","last_active":"2024-05-07T13:59:33.040654+0000","last_peered":"2024-05-07T13:59:33.040654+0000","last_clean":"2024-05-07T13:59:33.040654+0000","last_became_active":"2024-05-07T13:55:50.329615+0000","last_became_peered":"2024-05-07T13:55:50.329615+0000","last_unstale":"2024-05-07T13:59:33.040654+0000","last_undegraded":"2024-05-07T13:59:33.040654+0000","last_fullsized":"2024-05-07T13:59:33.040654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.040493+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.040493+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.040493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:15.286657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:14.218179+0000","last_change":"2024-05-07T14:00:14.218179+0000","last_active":"2024-05-07T14:00:14.218179+0000","last_peered":"2024-05-07T14:00:14.218179+0000","last_clean":"2024-05-07T14:00:14.218179+0000","last_became_active":"2024-05-07T13:55:48.346558+0000","last_became_peered":"2024-05-07T13:55:48.346558+0000","last_unstale":"2024-05-07T14:00:14.218179+0000","last_undegraded":"2024-05-07T14:00:14.218179+0000","last_fullsized":"2024-05-07T14:00:14.218179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:14.217980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:14.217980+0000","last_clean_scrub_stamp":"2024-05-07T14:00:14.217980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:13.530543+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.052199+0000","last_change":"2024-05-07T13:59:20.052199+0000","last_active":"2024-05-07T13:59:20.052199+0000","last_peered":"2024-05-07T13:59:20.052199+0000","last_clean":"2024-05-07T13:59:20.052199+0000","last_became_active":"2024-05-07T13:55:52.324083+0000","last_became_peered":"2024-05-07T13:55:52.324083+0000","last_unstale":"2024-05-07T13:59:20.052199+0000","last_undegraded":"2024-05-07T13:59:20.052199+0000","last_fullsized":"2024-05-07T13:59:20.052199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:20.052084+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.052084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:09:52.982817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'40","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.110608+0000","last_change":"2024-05-07T13:59:39.110608+0000","last_active":"2024-05-07T13:59:39.110608+0000","last_peered":"2024-05-07T13:59:39.110608+0000","last_clean":"2024-05-07T13:59:39.110608+0000","last_became_active":"2024-05-07T13:55:54.330906+0000","last_became_peered":"2024-05-07T13:55:54.330906+0000","last_unstale":"2024-05-07T13:59:39.110608+0000","last_undegraded":"2024-05-07T13:59:39.110608+0000","last_fullsized":"2024-05-07T13:59:39.110608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-07T13:59:39.110467+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-07T13:59:39.110467+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.110467+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:29.925909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:49.230880+0000","last_change":"2024-05-07T13:59:49.230880+0000","last_active":"2024-05-07T13:59:49.230880+0000","last_peered":"2024-05-07T13:59:49.230880+0000","last_clean":"2024-05-07T13:59:49.230880+0000","last_became_active":"2024-05-07T13:55:56.346371+0000","last_became_peered":"2024-05-07T13:55:56.346371+0000","last_unstale":"2024-05-07T13:59:49.230880+0000","last_undegraded":"2024-05-07T13:59:49.230880+0000","last_fullsized":"2024-05-07T13:59:49.230880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:49.230724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:49.230724+0000","last_clean_scrub_stamp":"2024-05-07T13:59:49.230724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:52.504500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:08.056848+0000","last_change":"2024-05-07T14:00:08.056875+0000","last_active":"2024-05-07T14:00:08.056848+0000","last_peered":"2024-05-07T14:00:08.056848+0000","last_clean":"2024-05-07T14:00:08.056848+0000","last_became_active":"2024-05-07T13:55:58.341102+0000","last_became_peered":"2024-05-07T13:55:58.341102+0000","last_unstale":"2024-05-07T14:00:08.056848+0000","last_undegraded":"2024-05-07T14:00:08.056848+0000","last_fullsized":"2024-05-07T14:00:08.056848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T14:00:08.056756+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T14:00:08.056756+0000","last_clean_scrub_stamp":"2024-05-07T14:00:08.056756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:36:11.330532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:33.011759+0000","last_change":"2024-05-07T13:59:33.011759+0000","last_active":"2024-05-07T13:59:33.011759+0000","last_peered":"2024-05-07T13:59:33.011759+0000","last_clean":"2024-05-07T13:59:33.011759+0000","last_became_active":"2024-05-07T13:55:50.329869+0000","last_became_peered":"2024-05-07T13:55:50.329869+0000","last_unstale":"2024-05-07T13:59:33.011759+0000","last_undegraded":"2024-05-07T13:59:33.011759+0000","last_fullsized":"2024-05-07T13:59:33.011759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:33.011608+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:33.011608+0000","last_clean_scrub_stamp":"2024-05-07T13:59:33.011608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:25:02.477664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.071015+0000","last_change":"2024-05-07T13:59:45.071015+0000","last_active":"2024-05-07T13:59:45.071015+0000","last_peered":"2024-05-07T13:59:45.071015+0000","last_clean":"2024-05-07T13:59:45.071015+0000","last_became_active":"2024-05-07T13:55:48.336807+0000","last_became_peered":"2024-05-07T13:55:48.336807+0000","last_unstale":"2024-05-07T13:59:45.071015+0000","last_undegraded":"2024-05-07T13:59:45.071015+0000","last_fullsized":"2024-05-07T13:59:45.071015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:45.070865+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:45.070865+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.070865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:21:52.761753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.827453+0000","last_change":"2024-05-07T13:59:15.827453+0000","last_active":"2024-05-07T13:59:15.827453+0000","last_peered":"2024-05-07T13:59:15.827453+0000","last_clean":"2024-05-07T13:59:15.827453+0000","last_became_active":"2024-05-07T13:55:52.318534+0000","last_became_peered":"2024-05-07T13:55:52.318534+0000","last_unstale":"2024-05-07T13:59:15.827453+0000","last_undegraded":"2024-05-07T13:59:15.827453+0000","last_fullsized":"2024-05-07T13:59:15.827453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.827322+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.827322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:35.422572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'9","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.031770+0000","last_change":"2024-05-07T13:59:25.031770+0000","last_active":"2024-05-07T13:59:25.031770+0000","last_peered":"2024-05-07T13:59:25.031770+0000","last_clean":"2024-05-07T13:59:25.031770+0000","last_became_active":"2024-05-07T13:55:54.319714+0000","last_became_peered":"2024-05-07T13:55:54.319714+0000","last_unstale":"2024-05-07T13:59:25.031770+0000","last_undegraded":"2024-05-07T13:59:25.031770+0000","last_fullsized":"2024-05-07T13:59:25.031770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.031629+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.031629+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:37.796266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.110217+0000","last_change":"2024-05-07T13:59:10.110217+0000","last_active":"2024-05-07T13:59:10.110217+0000","last_peered":"2024-05-07T13:59:10.110217+0000","last_clean":"2024-05-07T13:59:10.110217+0000","last_became_active":"2024-05-07T13:55:56.334342+0000","last_became_peered":"2024-05-07T13:55:56.334342+0000","last_unstale":"2024-05-07T13:59:10.110217+0000","last_undegraded":"2024-05-07T13:59:10.110217+0000","last_fullsized":"2024-05-07T13:59:10.110217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.110045+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.110045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:09.225940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:09.066129+0000","last_change":"2024-05-07T14:00:09.066159+0000","last_active":"2024-05-07T14:00:09.066129+0000","last_peered":"2024-05-07T14:00:09.066129+0000","last_clean":"2024-05-07T14:00:09.066129+0000","last_became_active":"2024-05-07T13:55:58.342382+0000","last_became_peered":"2024-05-07T13:55:58.342382+0000","last_unstale":"2024-05-07T14:00:09.066129+0000","last_undegraded":"2024-05-07T14:00:09.066129+0000","last_fullsized":"2024-05-07T14:00:09.066129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:09.066035+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:09.066035+0000","last_clean_scrub_stamp":"2024-05-07T14:00:09.066035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:59.943734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'12","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:11.074306+0000","last_change":"2024-05-07T14:00:11.074306+0000","last_active":"2024-05-07T14:00:11.074306+0000","last_peered":"2024-05-07T14:00:11.074306+0000","last_clean":"2024-05-07T14:00:11.074306+0000","last_became_active":"2024-05-07T13:56:35.365890+0000","last_became_peered":"2024-05-07T13:56:35.365890+0000","last_unstale":"2024-05-07T14:00:11.074306+0000","last_undegraded":"2024-05-07T14:00:11.074306+0000","last_fullsized":"2024-05-07T14:00:11.074306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T14:00:11.074166+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T14:00:11.074166+0000","last_clean_scrub_stamp":"2024-05-07T14:00:11.074166+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:10:50.732660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.896309+0000","last_change":"2024-05-07T13:59:53.896309+0000","last_active":"2024-05-07T13:59:53.896309+0000","last_peered":"2024-05-07T13:59:53.896309+0000","last_clean":"2024-05-07T13:59:53.896309+0000","last_became_active":"2024-05-07T13:55:48.336730+0000","last_became_peered":"2024-05-07T13:55:48.336730+0000","last_unstale":"2024-05-07T13:59:53.896309+0000","last_undegraded":"2024-05-07T13:59:53.896309+0000","last_fullsized":"2024-05-07T13:59:53.896309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:53.896185+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:53.896185+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.896185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:27.501340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.138549+0000","last_change":"2024-05-07T13:59:26.138549+0000","last_active":"2024-05-07T13:59:26.138549+0000","last_peered":"2024-05-07T13:59:26.138549+0000","last_clean":"2024-05-07T13:59:26.138549+0000","last_became_active":"2024-05-07T13:55:52.324639+0000","last_became_peered":"2024-05-07T13:55:52.324639+0000","last_unstale":"2024-05-07T13:59:26.138549+0000","last_undegraded":"2024-05-07T13:59:26.138549+0000","last_fullsized":"2024-05-07T13:59:26.138549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:26.138376+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.138376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:46.117728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'48","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.012678+0000","last_change":"2024-05-07T13:59:19.012678+0000","last_active":"2024-05-07T13:59:19.012678+0000","last_peered":"2024-05-07T13:59:19.012678+0000","last_clean":"2024-05-07T13:59:19.012678+0000","last_became_active":"2024-05-07T13:55:54.330738+0000","last_became_peered":"2024-05-07T13:55:54.330738+0000","last_unstale":"2024-05-07T13:59:19.012678+0000","last_undegraded":"2024-05-07T13:59:19.012678+0000","last_fullsized":"2024-05-07T13:59:19.012678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-07T13:59:19.012548+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.012548+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:59.656224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:11.078729+0000","last_change":"2024-05-07T13:59:11.078729+0000","last_active":"2024-05-07T13:59:11.078729+0000","last_peered":"2024-05-07T13:59:11.078729+0000","last_clean":"2024-05-07T13:59:11.078729+0000","last_became_active":"2024-05-07T13:55:56.332844+0000","last_became_peered":"2024-05-07T13:55:56.332844+0000","last_unstale":"2024-05-07T13:59:11.078729+0000","last_undegraded":"2024-05-07T13:59:11.078729+0000","last_fullsized":"2024-05-07T13:59:11.078729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:11.078592+0000","last_clean_scrub_stamp":"2024-05-07T13:59:11.078592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:40.007846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.170568+0000","last_change":"2024-05-07T14:00:01.170594+0000","last_active":"2024-05-07T14:00:01.170568+0000","last_peered":"2024-05-07T14:00:01.170568+0000","last_clean":"2024-05-07T14:00:01.170568+0000","last_became_active":"2024-05-07T13:55:58.347598+0000","last_became_peered":"2024-05-07T13:55:58.347598+0000","last_unstale":"2024-05-07T14:00:01.170568+0000","last_undegraded":"2024-05-07T14:00:01.170568+0000","last_fullsized":"2024-05-07T14:00:01.170568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:01.170476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:01.170476+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.170476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:15.339892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'14","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.025859+0000","last_change":"2024-05-07T13:59:28.025859+0000","last_active":"2024-05-07T13:59:28.025859+0000","last_peered":"2024-05-07T13:59:28.025859+0000","last_clean":"2024-05-07T13:59:28.025859+0000","last_became_active":"2024-05-07T13:55:50.326430+0000","last_became_peered":"2024-05-07T13:55:50.326430+0000","last_unstale":"2024-05-07T13:59:28.025859+0000","last_undegraded":"2024-05-07T13:59:28.025859+0000","last_fullsized":"2024-05-07T13:59:28.025859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T13:59:28.025734+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.025734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:38.245824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.965301+0000","last_change":"2024-05-07T13:59:57.965301+0000","last_active":"2024-05-07T13:59:57.965301+0000","last_peered":"2024-05-07T13:59:57.965301+0000","last_clean":"2024-05-07T13:59:57.965301+0000","last_became_active":"2024-05-07T13:55:48.331660+0000","last_became_peered":"2024-05-07T13:55:48.331660+0000","last_unstale":"2024-05-07T13:59:57.965301+0000","last_undegraded":"2024-05-07T13:59:57.965301+0000","last_fullsized":"2024-05-07T13:59:57.965301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:57.965178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:57.965178+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.965178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:45:02.830676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:10.845836+0000","last_change":"2024-05-07T13:59:10.845836+0000","last_active":"2024-05-07T13:59:10.845836+0000","last_peered":"2024-05-07T13:59:10.845836+0000","last_clean":"2024-05-07T13:59:10.845836+0000","last_became_active":"2024-05-07T13:55:52.320520+0000","last_became_peered":"2024-05-07T13:55:52.320520+0000","last_unstale":"2024-05-07T13:59:10.845836+0000","last_undegraded":"2024-05-07T13:59:10.845836+0000","last_fullsized":"2024-05-07T13:59:10.845836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:10.845698+0000","last_clean_scrub_stamp":"2024-05-07T13:59:10.845698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:25:38.217921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.157743+0000","last_change":"2024-05-07T13:59:23.157743+0000","last_active":"2024-05-07T13:59:23.157743+0000","last_peered":"2024-05-07T13:59:23.157743+0000","last_clean":"2024-05-07T13:59:23.157743+0000","last_became_active":"2024-05-07T13:55:54.320266+0000","last_became_peered":"2024-05-07T13:55:54.320266+0000","last_unstale":"2024-05-07T13:59:23.157743+0000","last_undegraded":"2024-05-07T13:59:23.157743+0000","last_fullsized":"2024-05-07T13:59:23.157743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:23.157605+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.157605+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:58:28.358470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:15.079086+0000","last_change":"2024-05-07T13:59:15.079086+0000","last_active":"2024-05-07T13:59:15.079086+0000","last_peered":"2024-05-07T13:59:15.079086+0000","last_clean":"2024-05-07T13:59:15.079086+0000","last_became_active":"2024-05-07T13:55:56.330251+0000","last_became_peered":"2024-05-07T13:55:56.330251+0000","last_unstale":"2024-05-07T13:59:15.079086+0000","last_undegraded":"2024-05-07T13:59:15.079086+0000","last_fullsized":"2024-05-07T13:59:15.079086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:15.078974+0000","last_clean_scrub_stamp":"2024-05-07T13:59:15.078974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:55.222720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"29'10","reported_seq":95,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.189084+0000","last_change":"2024-05-07T13:59:54.189084+0000","last_active":"2024-05-07T13:59:54.189084+0000","last_peered":"2024-05-07T13:59:54.189084+0000","last_clean":"2024-05-07T13:59:54.189084+0000","last_became_active":"2024-05-07T13:55:50.323159+0000","last_became_peered":"2024-05-07T13:55:50.323159+0000","last_unstale":"2024-05-07T13:59:54.189084+0000","last_undegraded":"2024-05-07T13:59:54.189084+0000","last_fullsized":"2024-05-07T13:59:54.189084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:54.188966+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:54.188966+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.188966+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:45:09.716257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'4","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:27.221277+0000","last_change":"2024-05-07T14:00:27.221277+0000","last_active":"2024-05-07T14:00:27.221277+0000","last_peered":"2024-05-07T14:00:27.221277+0000","last_clean":"2024-05-07T14:00:27.221277+0000","last_became_active":"2024-05-07T13:55:48.350462+0000","last_became_peered":"2024-05-07T13:55:48.350462+0000","last_unstale":"2024-05-07T14:00:27.221277+0000","last_undegraded":"2024-05-07T14:00:27.221277+0000","last_fullsized":"2024-05-07T14:00:27.221277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-07T14:00:27.221150+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-07T14:00:27.221150+0000","last_clean_scrub_stamp":"2024-05-07T14:00:27.221150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:41:51.409323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.020866+0000","last_change":"2024-05-07T13:59:35.020866+0000","last_active":"2024-05-07T13:59:35.020866+0000","last_peered":"2024-05-07T13:59:35.020866+0000","last_clean":"2024-05-07T13:59:35.020866+0000","last_became_active":"2024-05-07T13:55:52.321171+0000","last_became_peered":"2024-05-07T13:55:52.321171+0000","last_unstale":"2024-05-07T13:59:35.020866+0000","last_undegraded":"2024-05-07T13:59:35.020866+0000","last_fullsized":"2024-05-07T13:59:35.020866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:35.020743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:35.020743+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.020743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:21:42.711631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.985304+0000","last_change":"2024-05-07T13:59:23.985348+0000","last_active":"2024-05-07T13:59:23.985304+0000","last_peered":"2024-05-07T13:59:23.985304+0000","last_clean":"2024-05-07T13:59:23.985304+0000","last_became_active":"2024-05-07T13:55:54.319819+0000","last_became_peered":"2024-05-07T13:55:54.319819+0000","last_unstale":"2024-05-07T13:59:23.985304+0000","last_undegraded":"2024-05-07T13:59:23.985304+0000","last_fullsized":"2024-05-07T13:59:23.985304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-07T13:59:23.985209+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.985209+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:20.683798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.078791+0000","last_change":"2024-05-07T13:59:14.078817+0000","last_active":"2024-05-07T13:59:14.078791+0000","last_peered":"2024-05-07T13:59:14.078791+0000","last_clean":"2024-05-07T13:59:14.078791+0000","last_became_active":"2024-05-07T13:55:56.330190+0000","last_became_peered":"2024-05-07T13:55:56.330190+0000","last_unstale":"2024-05-07T13:59:14.078791+0000","last_undegraded":"2024-05-07T13:59:14.078791+0000","last_fullsized":"2024-05-07T13:59:14.078791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.078700+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.078700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:50:02.500890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'14","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:05.075614+0000","last_change":"2024-05-07T14:00:05.075614+0000","last_active":"2024-05-07T14:00:05.075614+0000","last_peered":"2024-05-07T14:00:05.075614+0000","last_clean":"2024-05-07T14:00:05.075614+0000","last_became_active":"2024-05-07T13:55:58.340674+0000","last_became_peered":"2024-05-07T13:55:58.340674+0000","last_unstale":"2024-05-07T14:00:05.075614+0000","last_undegraded":"2024-05-07T14:00:05.075614+0000","last_fullsized":"2024-05-07T14:00:05.075614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-07T14:00:05.075491+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-07T14:00:05.075491+0000","last_clean_scrub_stamp":"2024-05-07T14:00:05.075491+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:54:13.747674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"29'8","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.075066+0000","last_change":"2024-05-07T13:59:50.075066+0000","last_active":"2024-05-07T13:59:50.075066+0000","last_peered":"2024-05-07T13:59:50.075066+0000","last_clean":"2024-05-07T13:59:50.075066+0000","last_became_active":"2024-05-07T13:55:50.318546+0000","last_became_peered":"2024-05-07T13:55:50.318546+0000","last_unstale":"2024-05-07T13:59:50.075066+0000","last_undegraded":"2024-05-07T13:59:50.075066+0000","last_fullsized":"2024-05-07T13:59:50.075066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:50.074938+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:50.074938+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.074938+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:33.234260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.897301+0000","last_change":"2024-05-07T13:59:59.897301+0000","last_active":"2024-05-07T13:59:59.897301+0000","last_peered":"2024-05-07T13:59:59.897301+0000","last_clean":"2024-05-07T13:59:59.897301+0000","last_became_active":"2024-05-07T13:55:48.331278+0000","last_became_peered":"2024-05-07T13:55:48.331278+0000","last_unstale":"2024-05-07T13:59:59.897301+0000","last_undegraded":"2024-05-07T13:59:59.897301+0000","last_fullsized":"2024-05-07T13:59:59.897301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:59.897110+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:59.897110+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.897110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:51:16.956997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.132317+0000","last_change":"2024-05-07T13:59:31.132317+0000","last_active":"2024-05-07T13:59:31.132317+0000","last_peered":"2024-05-07T13:59:31.132317+0000","last_clean":"2024-05-07T13:59:31.132317+0000","last_became_active":"2024-05-07T13:55:52.317564+0000","last_became_peered":"2024-05-07T13:55:52.317564+0000","last_unstale":"2024-05-07T13:59:31.132317+0000","last_undegraded":"2024-05-07T13:59:31.132317+0000","last_fullsized":"2024-05-07T13:59:31.132317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.132155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.132155+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.132155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:31.984653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.150663+0000","last_change":"2024-05-07T13:59:42.150703+0000","last_active":"2024-05-07T13:59:42.150663+0000","last_peered":"2024-05-07T13:59:42.150663+0000","last_clean":"2024-05-07T13:59:42.150663+0000","last_became_active":"2024-05-07T13:55:54.329443+0000","last_became_peered":"2024-05-07T13:55:54.329443+0000","last_unstale":"2024-05-07T13:59:42.150663+0000","last_undegraded":"2024-05-07T13:59:42.150663+0000","last_fullsized":"2024-05-07T13:59:42.150663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-07T13:59:42.150568+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-07T13:59:42.150568+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.150568+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:03:28.616407+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:31.090783+0000","last_change":"2024-05-07T13:59:31.090805+0000","last_active":"2024-05-07T13:59:31.090783+0000","last_peered":"2024-05-07T13:59:31.090783+0000","last_clean":"2024-05-07T13:59:31.090783+0000","last_became_active":"2024-05-07T13:55:56.344470+0000","last_became_peered":"2024-05-07T13:55:56.344470+0000","last_unstale":"2024-05-07T13:59:31.090783+0000","last_undegraded":"2024-05-07T13:59:31.090783+0000","last_fullsized":"2024-05-07T13:59:31.090783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:31.090686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:31.090686+0000","last_clean_scrub_stamp":"2024-05-07T13:59:31.090686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:29.889110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'6","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:31.223503+0000","last_change":"2024-05-07T14:00:31.223503+0000","last_active":"2024-05-07T14:00:31.223503+0000","last_peered":"2024-05-07T14:00:31.223503+0000","last_clean":"2024-05-07T14:00:31.223503+0000","last_became_active":"2024-05-07T13:55:58.350796+0000","last_became_peered":"2024-05-07T13:55:58.350796+0000","last_unstale":"2024-05-07T14:00:31.223503+0000","last_undegraded":"2024-05-07T14:00:31.223503+0000","last_fullsized":"2024-05-07T14:00:31.223503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T14:00:31.223310+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T14:00:31.223310+0000","last_clean_scrub_stamp":"2024-05-07T14:00:31.223310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:37:57.405993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:23.935454+0000","last_change":"2024-05-07T13:59:23.935508+0000","last_active":"2024-05-07T13:59:23.935454+0000","last_peered":"2024-05-07T13:59:23.935454+0000","last_clean":"2024-05-07T13:59:23.935454+0000","last_became_active":"2024-05-07T13:55:50.326424+0000","last_became_peered":"2024-05-07T13:55:50.326424+0000","last_unstale":"2024-05-07T13:59:23.935454+0000","last_undegraded":"2024-05-07T13:59:23.935454+0000","last_fullsized":"2024-05-07T13:59:23.935454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:23.935328+0000","last_clean_scrub_stamp":"2024-05-07T13:59:23.935328+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:15.191912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:50.103971+0000","last_change":"2024-05-07T13:59:50.103971+0000","last_active":"2024-05-07T13:59:50.103971+0000","last_peered":"2024-05-07T13:59:50.103971+0000","last_clean":"2024-05-07T13:59:50.103971+0000","last_became_active":"2024-05-07T13:55:48.342072+0000","last_became_peered":"2024-05-07T13:55:48.342072+0000","last_unstale":"2024-05-07T13:59:50.103971+0000","last_undegraded":"2024-05-07T13:59:50.103971+0000","last_fullsized":"2024-05-07T13:59:50.103971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:50.103851+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:50.103851+0000","last_clean_scrub_stamp":"2024-05-07T13:59:50.103851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:57:45.262431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.097749+0000","last_change":"2024-05-07T13:59:30.097790+0000","last_active":"2024-05-07T13:59:30.097749+0000","last_peered":"2024-05-07T13:59:30.097749+0000","last_clean":"2024-05-07T13:59:30.097749+0000","last_became_active":"2024-05-07T13:55:52.318605+0000","last_became_peered":"2024-05-07T13:55:52.318605+0000","last_unstale":"2024-05-07T13:59:30.097749+0000","last_undegraded":"2024-05-07T13:59:30.097749+0000","last_fullsized":"2024-05-07T13:59:30.097749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.097647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.097647+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.097647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:23.733758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.957062+0000","last_change":"2024-05-07T13:59:22.957062+0000","last_active":"2024-05-07T13:59:22.957062+0000","last_peered":"2024-05-07T13:59:22.957062+0000","last_clean":"2024-05-07T13:59:22.957062+0000","last_became_active":"2024-05-07T13:55:54.326599+0000","last_became_peered":"2024-05-07T13:55:54.326599+0000","last_unstale":"2024-05-07T13:59:22.957062+0000","last_undegraded":"2024-05-07T13:59:22.957062+0000","last_fullsized":"2024-05-07T13:59:22.957062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:22.956910+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.956910+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:30:05.203075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:09.875299+0000","last_change":"2024-05-07T13:59:09.875299+0000","last_active":"2024-05-07T13:59:09.875299+0000","last_peered":"2024-05-07T13:59:09.875299+0000","last_clean":"2024-05-07T13:59:09.875299+0000","last_became_active":"2024-05-07T13:55:56.334226+0000","last_became_peered":"2024-05-07T13:55:56.334226+0000","last_unstale":"2024-05-07T13:59:09.875299+0000","last_undegraded":"2024-05-07T13:59:09.875299+0000","last_fullsized":"2024-05-07T13:59:09.875299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:09.875192+0000","last_clean_scrub_stamp":"2024-05-07T13:59:09.875192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:33.279728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:34.286404+0000","last_change":"2024-05-07T14:00:34.286404+0000","last_active":"2024-05-07T14:00:34.286404+0000","last_peered":"2024-05-07T14:00:34.286404+0000","last_clean":"2024-05-07T14:00:34.286404+0000","last_became_active":"2024-05-07T13:55:58.352263+0000","last_became_peered":"2024-05-07T13:55:58.352263+0000","last_unstale":"2024-05-07T14:00:34.286404+0000","last_undegraded":"2024-05-07T14:00:34.286404+0000","last_fullsized":"2024-05-07T14:00:34.286404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T14:00:34.286261+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T14:00:34.286261+0000","last_clean_scrub_stamp":"2024-05-07T14:00:34.286261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:13:07.287833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:44.159755+0000","last_change":"2024-05-07T13:59:44.159801+0000","last_active":"2024-05-07T13:59:44.159755+0000","last_peered":"2024-05-07T13:59:44.159755+0000","last_clean":"2024-05-07T13:59:44.159755+0000","last_became_active":"2024-05-07T13:55:50.312852+0000","last_became_peered":"2024-05-07T13:55:50.312852+0000","last_unstale":"2024-05-07T13:59:44.159755+0000","last_undegraded":"2024-05-07T13:59:44.159755+0000","last_fullsized":"2024-05-07T13:59:44.159755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:44.159658+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:44.159658+0000","last_clean_scrub_stamp":"2024-05-07T13:59:44.159658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:17.764814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:09.142630+0000","last_change":"2024-05-07T14:00:09.142630+0000","last_active":"2024-05-07T14:00:09.142630+0000","last_peered":"2024-05-07T14:00:09.142630+0000","last_clean":"2024-05-07T14:00:09.142630+0000","last_became_active":"2024-05-07T13:55:48.348476+0000","last_became_peered":"2024-05-07T13:55:48.348476+0000","last_unstale":"2024-05-07T14:00:09.142630+0000","last_undegraded":"2024-05-07T14:00:09.142630+0000","last_fullsized":"2024-05-07T14:00:09.142630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:09.142498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:09.142498+0000","last_clean_scrub_stamp":"2024-05-07T14:00:09.142498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:00:31.321763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:21.019050+0000","last_change":"2024-05-07T13:59:21.019075+0000","last_active":"2024-05-07T13:59:21.019050+0000","last_peered":"2024-05-07T13:59:21.019050+0000","last_clean":"2024-05-07T13:59:21.019050+0000","last_became_active":"2024-05-07T13:55:52.322431+0000","last_became_peered":"2024-05-07T13:55:52.322431+0000","last_unstale":"2024-05-07T13:59:21.019050+0000","last_undegraded":"2024-05-07T13:59:21.019050+0000","last_fullsized":"2024-05-07T13:59:21.019050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:21.018959+0000","last_clean_scrub_stamp":"2024-05-07T13:59:21.018959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:33:21.518908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:28.997674+0000","last_change":"2024-05-07T13:59:28.997674+0000","last_active":"2024-05-07T13:59:28.997674+0000","last_peered":"2024-05-07T13:59:28.997674+0000","last_clean":"2024-05-07T13:59:28.997674+0000","last_became_active":"2024-05-07T13:55:54.329539+0000","last_became_peered":"2024-05-07T13:55:54.329539+0000","last_unstale":"2024-05-07T13:59:28.997674+0000","last_undegraded":"2024-05-07T13:59:28.997674+0000","last_fullsized":"2024-05-07T13:59:28.997674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-07T13:59:28.997538+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-07T13:59:28.997538+0000","last_clean_scrub_stamp":"2024-05-07T13:59:28.997538+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:03.181568+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.068040+0000","last_change":"2024-05-07T13:59:16.068040+0000","last_active":"2024-05-07T13:59:16.068040+0000","last_peered":"2024-05-07T13:59:16.068040+0000","last_clean":"2024-05-07T13:59:16.068040+0000","last_became_active":"2024-05-07T13:55:56.338021+0000","last_became_peered":"2024-05-07T13:55:56.338021+0000","last_unstale":"2024-05-07T13:59:16.068040+0000","last_undegraded":"2024-05-07T13:59:16.068040+0000","last_fullsized":"2024-05-07T13:59:16.068040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-07T13:59:16.067904+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.067904+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:55:00.563194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:32.226563+0000","last_change":"2024-05-07T14:00:32.226563+0000","last_active":"2024-05-07T14:00:32.226563+0000","last_peered":"2024-05-07T14:00:32.226563+0000","last_clean":"2024-05-07T14:00:32.226563+0000","last_became_active":"2024-05-07T13:55:58.351616+0000","last_became_peered":"2024-05-07T13:55:58.351616+0000","last_unstale":"2024-05-07T14:00:32.226563+0000","last_undegraded":"2024-05-07T14:00:32.226563+0000","last_fullsized":"2024-05-07T14:00:32.226563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:32.226445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:32.226445+0000","last_clean_scrub_stamp":"2024-05-07T14:00:32.226445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:26:39.014499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.073813+0000","last_change":"2024-05-07T13:59:36.073866+0000","last_active":"2024-05-07T13:59:36.073813+0000","last_peered":"2024-05-07T13:59:36.073813+0000","last_clean":"2024-05-07T13:59:36.073813+0000","last_became_active":"2024-05-07T13:55:50.313016+0000","last_became_peered":"2024-05-07T13:55:50.313016+0000","last_unstale":"2024-05-07T13:59:36.073813+0000","last_undegraded":"2024-05-07T13:59:36.073813+0000","last_fullsized":"2024-05-07T13:59:36.073813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:36.073646+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:36.073646+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.073646+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:12.645759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.999532+0000","last_change":"2024-05-07T13:59:53.999532+0000","last_active":"2024-05-07T13:59:53.999532+0000","last_peered":"2024-05-07T13:59:53.999532+0000","last_clean":"2024-05-07T13:59:53.999532+0000","last_became_active":"2024-05-07T13:55:48.339639+0000","last_became_peered":"2024-05-07T13:55:48.339639+0000","last_unstale":"2024-05-07T13:59:53.999532+0000","last_undegraded":"2024-05-07T13:59:53.999532+0000","last_fullsized":"2024-05-07T13:59:53.999532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:53.999377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:53.999377+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.999377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:51:37.158698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:18.058938+0000","last_change":"2024-05-07T13:59:18.058974+0000","last_active":"2024-05-07T13:59:18.058938+0000","last_peered":"2024-05-07T13:59:18.058938+0000","last_clean":"2024-05-07T13:59:18.058938+0000","last_became_active":"2024-05-07T13:55:52.324567+0000","last_became_peered":"2024-05-07T13:55:52.324567+0000","last_unstale":"2024-05-07T13:59:18.058938+0000","last_undegraded":"2024-05-07T13:59:18.058938+0000","last_fullsized":"2024-05-07T13:59:18.058938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:18.058848+0000","last_clean_scrub_stamp":"2024-05-07T13:59:18.058848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:48:50.227510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.085684+0000","last_change":"2024-05-07T13:59:16.085684+0000","last_active":"2024-05-07T13:59:16.085684+0000","last_peered":"2024-05-07T13:59:16.085684+0000","last_clean":"2024-05-07T13:59:16.085684+0000","last_became_active":"2024-05-07T13:55:54.329220+0000","last_became_peered":"2024-05-07T13:55:54.329220+0000","last_unstale":"2024-05-07T13:59:16.085684+0000","last_undegraded":"2024-05-07T13:59:16.085684+0000","last_fullsized":"2024-05-07T13:59:16.085684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-07T13:59:16.085538+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.085538+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:26.485669+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:14.922682+0000","last_change":"2024-05-07T13:59:14.922682+0000","last_active":"2024-05-07T13:59:14.922682+0000","last_peered":"2024-05-07T13:59:14.922682+0000","last_clean":"2024-05-07T13:59:14.922682+0000","last_became_active":"2024-05-07T13:55:56.333373+0000","last_became_peered":"2024-05-07T13:55:56.333373+0000","last_unstale":"2024-05-07T13:59:14.922682+0000","last_undegraded":"2024-05-07T13:59:14.922682+0000","last_fullsized":"2024-05-07T13:59:14.922682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:14.922551+0000","last_clean_scrub_stamp":"2024-05-07T13:59:14.922551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:21:15.327295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:07.957668+0000","last_change":"2024-05-07T14:00:07.957668+0000","last_active":"2024-05-07T14:00:07.957668+0000","last_peered":"2024-05-07T14:00:07.957668+0000","last_clean":"2024-05-07T14:00:07.957668+0000","last_became_active":"2024-05-07T13:55:58.347327+0000","last_became_peered":"2024-05-07T13:55:58.347327+0000","last_unstale":"2024-05-07T14:00:07.957668+0000","last_undegraded":"2024-05-07T14:00:07.957668+0000","last_fullsized":"2024-05-07T14:00:07.957668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:07.957550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:07.957550+0000","last_clean_scrub_stamp":"2024-05-07T14:00:07.957550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:12.458074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:35.036902+0000","last_change":"2024-05-07T13:59:35.036926+0000","last_active":"2024-05-07T13:59:35.036902+0000","last_peered":"2024-05-07T13:59:35.036902+0000","last_clean":"2024-05-07T13:59:35.036902+0000","last_became_active":"2024-05-07T13:55:50.311340+0000","last_became_peered":"2024-05-07T13:55:50.311340+0000","last_unstale":"2024-05-07T13:59:35.036902+0000","last_undegraded":"2024-05-07T13:59:35.036902+0000","last_fullsized":"2024-05-07T13:59:35.036902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:35.036806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:35.036806+0000","last_clean_scrub_stamp":"2024-05-07T13:59:35.036806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:35:47.801444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:05.069333+0000","last_change":"2024-05-07T14:00:05.069333+0000","last_active":"2024-05-07T14:00:05.069333+0000","last_peered":"2024-05-07T14:00:05.069333+0000","last_clean":"2024-05-07T14:00:05.069333+0000","last_became_active":"2024-05-07T13:55:48.349589+0000","last_became_peered":"2024-05-07T13:55:48.349589+0000","last_unstale":"2024-05-07T14:00:05.069333+0000","last_undegraded":"2024-05-07T14:00:05.069333+0000","last_fullsized":"2024-05-07T14:00:05.069333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:05.069220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:05.069220+0000","last_clean_scrub_stamp":"2024-05-07T14:00:05.069220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:01:27.326304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:27.160962+0000","last_change":"2024-05-07T13:59:27.160985+0000","last_active":"2024-05-07T13:59:27.160962+0000","last_peered":"2024-05-07T13:59:27.160962+0000","last_clean":"2024-05-07T13:59:27.160962+0000","last_became_active":"2024-05-07T13:55:52.323548+0000","last_became_peered":"2024-05-07T13:55:52.323548+0000","last_unstale":"2024-05-07T13:59:27.160962+0000","last_undegraded":"2024-05-07T13:59:27.160962+0000","last_fullsized":"2024-05-07T13:59:27.160962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:27.160877+0000","last_clean_scrub_stamp":"2024-05-07T13:59:27.160877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:13:40.043412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:19.984633+0000","last_change":"2024-05-07T13:59:19.984633+0000","last_active":"2024-05-07T13:59:19.984633+0000","last_peered":"2024-05-07T13:59:19.984633+0000","last_clean":"2024-05-07T13:59:19.984633+0000","last_became_active":"2024-05-07T13:55:54.326844+0000","last_became_peered":"2024-05-07T13:55:54.326844+0000","last_unstale":"2024-05-07T13:59:19.984633+0000","last_undegraded":"2024-05-07T13:59:19.984633+0000","last_fullsized":"2024-05-07T13:59:19.984633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-07T13:59:19.984455+0000","last_clean_scrub_stamp":"2024-05-07T13:59:19.984455+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:21:13.620566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.047777+0000","last_change":"2024-05-07T13:59:37.047777+0000","last_active":"2024-05-07T13:59:37.047777+0000","last_peered":"2024-05-07T13:59:37.047777+0000","last_clean":"2024-05-07T13:59:37.047777+0000","last_became_active":"2024-05-07T13:55:56.344885+0000","last_became_peered":"2024-05-07T13:55:56.344885+0000","last_unstale":"2024-05-07T13:59:37.047777+0000","last_undegraded":"2024-05-07T13:59:37.047777+0000","last_fullsized":"2024-05-07T13:59:37.047777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:37.047656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:37.047656+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.047656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:50:54.107543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:57.182908+0000","last_change":"2024-05-07T13:59:57.182908+0000","last_active":"2024-05-07T13:59:57.182908+0000","last_peered":"2024-05-07T13:59:57.182908+0000","last_clean":"2024-05-07T13:59:57.182908+0000","last_became_active":"2024-05-07T13:55:58.347850+0000","last_became_peered":"2024-05-07T13:55:58.347850+0000","last_unstale":"2024-05-07T13:59:57.182908+0000","last_undegraded":"2024-05-07T13:59:57.182908+0000","last_fullsized":"2024-05-07T13:59:57.182908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:57.182784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:57.182784+0000","last_clean_scrub_stamp":"2024-05-07T13:59:57.182784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:52:09.520386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'20","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:46.133286+0000","last_change":"2024-05-07T13:59:46.133286+0000","last_active":"2024-05-07T13:59:46.133286+0000","last_peered":"2024-05-07T13:59:46.133286+0000","last_clean":"2024-05-07T13:59:46.133286+0000","last_became_active":"2024-05-07T13:55:50.324745+0000","last_became_peered":"2024-05-07T13:55:50.324745+0000","last_unstale":"2024-05-07T13:59:46.133286+0000","last_undegraded":"2024-05-07T13:59:46.133286+0000","last_fullsized":"2024-05-07T13:59:46.133286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-07T13:59:46.133156+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-07T13:59:46.133156+0000","last_clean_scrub_stamp":"2024-05-07T13:59:46.133156+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:53:54.805339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.169448+0000","last_change":"2024-05-07T13:59:58.169504+0000","last_active":"2024-05-07T13:59:58.169448+0000","last_peered":"2024-05-07T13:59:58.169448+0000","last_clean":"2024-05-07T13:59:58.169448+0000","last_became_active":"2024-05-07T13:55:48.323125+0000","last_became_peered":"2024-05-07T13:55:48.323125+0000","last_unstale":"2024-05-07T13:59:58.169448+0000","last_undegraded":"2024-05-07T13:59:58.169448+0000","last_fullsized":"2024-05-07T13:59:58.169448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:58.169302+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:58.169302+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.169302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:48.984745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:22.003923+0000","last_change":"2024-05-07T13:59:22.003923+0000","last_active":"2024-05-07T13:59:22.003923+0000","last_peered":"2024-05-07T13:59:22.003923+0000","last_clean":"2024-05-07T13:59:22.003923+0000","last_became_active":"2024-05-07T13:55:52.322012+0000","last_became_peered":"2024-05-07T13:55:52.322012+0000","last_unstale":"2024-05-07T13:59:22.003923+0000","last_undegraded":"2024-05-07T13:59:22.003923+0000","last_fullsized":"2024-05-07T13:59:22.003923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:22.003807+0000","last_clean_scrub_stamp":"2024-05-07T13:59:22.003807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:25:31.144648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'31","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:20.881145+0000","last_change":"2024-05-07T13:59:20.881181+0000","last_active":"2024-05-07T13:59:20.881145+0000","last_peered":"2024-05-07T13:59:20.881145+0000","last_clean":"2024-05-07T13:59:20.881145+0000","last_became_active":"2024-05-07T13:55:54.326758+0000","last_became_peered":"2024-05-07T13:55:54.326758+0000","last_unstale":"2024-05-07T13:59:20.881145+0000","last_undegraded":"2024-05-07T13:59:20.881145+0000","last_fullsized":"2024-05-07T13:59:20.881145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-05-07T13:59:20.881054+0000","last_clean_scrub_stamp":"2024-05-07T13:59:20.881054+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:08.116261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.101452+0000","last_change":"2024-05-07T13:59:41.101476+0000","last_active":"2024-05-07T13:59:41.101452+0000","last_peered":"2024-05-07T13:59:41.101452+0000","last_clean":"2024-05-07T13:59:41.101452+0000","last_became_active":"2024-05-07T13:55:56.345933+0000","last_became_peered":"2024-05-07T13:55:56.345933+0000","last_unstale":"2024-05-07T13:59:41.101452+0000","last_undegraded":"2024-05-07T13:59:41.101452+0000","last_fullsized":"2024-05-07T13:59:41.101452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.101346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.101346+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.101346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:09.656228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'6","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:29.209291+0000","last_change":"2024-05-07T14:00:29.209291+0000","last_active":"2024-05-07T14:00:29.209291+0000","last_peered":"2024-05-07T14:00:29.209291+0000","last_clean":"2024-05-07T14:00:29.209291+0000","last_became_active":"2024-05-07T13:55:58.348763+0000","last_became_peered":"2024-05-07T13:55:58.348763+0000","last_unstale":"2024-05-07T14:00:29.209291+0000","last_undegraded":"2024-05-07T14:00:29.209291+0000","last_fullsized":"2024-05-07T14:00:29.209291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T14:00:29.209159+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T14:00:29.209159+0000","last_clean_scrub_stamp":"2024-05-07T14:00:29.209159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:14:16.169466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.125168+0000","last_change":"2024-05-07T13:59:40.125168+0000","last_active":"2024-05-07T13:59:40.125168+0000","last_peered":"2024-05-07T13:59:40.125168+0000","last_clean":"2024-05-07T13:59:40.125168+0000","last_became_active":"2024-05-07T13:55:50.312605+0000","last_became_peered":"2024-05-07T13:55:50.312605+0000","last_unstale":"2024-05-07T13:59:40.125168+0000","last_undegraded":"2024-05-07T13:59:40.125168+0000","last_fullsized":"2024-05-07T13:59:40.125168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:40.125038+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:40.125038+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.125038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:59.307579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.920369+0000","last_change":"2024-05-07T14:00:00.920398+0000","last_active":"2024-05-07T14:00:00.920369+0000","last_peered":"2024-05-07T14:00:00.920369+0000","last_clean":"2024-05-07T14:00:00.920369+0000","last_became_active":"2024-05-07T13:55:48.333254+0000","last_became_peered":"2024-05-07T13:55:48.333254+0000","last_unstale":"2024-05-07T14:00:00.920369+0000","last_undegraded":"2024-05-07T14:00:00.920369+0000","last_fullsized":"2024-05-07T14:00:00.920369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.920262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.920262+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.920262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:26:52.170279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:26.057899+0000","last_change":"2024-05-07T13:59:26.057899+0000","last_active":"2024-05-07T13:59:26.057899+0000","last_peered":"2024-05-07T13:59:26.057899+0000","last_clean":"2024-05-07T13:59:26.057899+0000","last_became_active":"2024-05-07T13:55:52.321982+0000","last_became_peered":"2024-05-07T13:55:52.321982+0000","last_unstale":"2024-05-07T13:59:26.057899+0000","last_undegraded":"2024-05-07T13:59:26.057899+0000","last_fullsized":"2024-05-07T13:59:26.057899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-07T13:59:26.057767+0000","last_clean_scrub_stamp":"2024-05-07T13:59:26.057767+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:23.143125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'39","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:16.876939+0000","last_change":"2024-05-07T13:59:16.876994+0000","last_active":"2024-05-07T13:59:16.876939+0000","last_peered":"2024-05-07T13:59:16.876939+0000","last_clean":"2024-05-07T13:59:16.876939+0000","last_became_active":"2024-05-07T13:55:54.326895+0000","last_became_peered":"2024-05-07T13:55:54.326895+0000","last_unstale":"2024-05-07T13:59:16.876939+0000","last_undegraded":"2024-05-07T13:59:16.876939+0000","last_fullsized":"2024-05-07T13:59:16.876939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2024-05-07T13:59:16.876843+0000","last_clean_scrub_stamp":"2024-05-07T13:59:16.876843+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:46:35.990453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:30.058174+0000","last_change":"2024-05-07T13:59:30.058208+0000","last_active":"2024-05-07T13:59:30.058174+0000","last_peered":"2024-05-07T13:59:30.058174+0000","last_clean":"2024-05-07T13:59:30.058174+0000","last_became_active":"2024-05-07T13:55:56.343002+0000","last_became_peered":"2024-05-07T13:55:56.343002+0000","last_unstale":"2024-05-07T13:59:30.058174+0000","last_undegraded":"2024-05-07T13:59:30.058174+0000","last_fullsized":"2024-05-07T13:59:30.058174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:30.058080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:30.058080+0000","last_clean_scrub_stamp":"2024-05-07T13:59:30.058080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:49.240621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:28.217719+0000","last_change":"2024-05-07T14:00:28.217719+0000","last_active":"2024-05-07T14:00:28.217719+0000","last_peered":"2024-05-07T14:00:28.217719+0000","last_clean":"2024-05-07T14:00:28.217719+0000","last_became_active":"2024-05-07T13:55:58.347820+0000","last_became_peered":"2024-05-07T13:55:58.347820+0000","last_unstale":"2024-05-07T14:00:28.217719+0000","last_undegraded":"2024-05-07T14:00:28.217719+0000","last_fullsized":"2024-05-07T14:00:28.217719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-07T14:00:28.217587+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-07T14:00:28.217587+0000","last_clean_scrub_stamp":"2024-05-07T14:00:28.217587+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:33.415831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:32.055073+0000","last_change":"2024-05-07T13:59:32.055073+0000","last_active":"2024-05-07T13:59:32.055073+0000","last_peered":"2024-05-07T13:59:32.055073+0000","last_clean":"2024-05-07T13:59:32.055073+0000","last_became_active":"2024-05-07T13:55:50.330166+0000","last_became_peered":"2024-05-07T13:55:50.330166+0000","last_unstale":"2024-05-07T13:59:32.055073+0000","last_undegraded":"2024-05-07T13:59:32.055073+0000","last_fullsized":"2024-05-07T13:59:32.055073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:32.054935+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:32.054935+0000","last_clean_scrub_stamp":"2024-05-07T13:59:32.054935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:04:31.258103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.120996+0000","last_change":"2024-05-07T13:59:47.120996+0000","last_active":"2024-05-07T13:59:47.120996+0000","last_peered":"2024-05-07T13:59:47.120996+0000","last_clean":"2024-05-07T13:59:47.120996+0000","last_became_active":"2024-05-07T13:55:48.338874+0000","last_became_peered":"2024-05-07T13:55:48.338874+0000","last_unstale":"2024-05-07T13:59:47.120996+0000","last_undegraded":"2024-05-07T13:59:47.120996+0000","last_fullsized":"2024-05-07T13:59:47.120996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:47.120819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:47.120819+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.120819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:01:29.157325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'12","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.065990+0000","last_change":"2024-05-07T13:59:40.065990+0000","last_active":"2024-05-07T13:59:40.065990+0000","last_peered":"2024-05-07T13:59:40.065990+0000","last_clean":"2024-05-07T13:59:40.065990+0000","last_became_active":"2024-05-07T13:55:50.311324+0000","last_became_peered":"2024-05-07T13:55:50.311324+0000","last_unstale":"2024-05-07T13:59:40.065990+0000","last_undegraded":"2024-05-07T13:59:40.065990+0000","last_fullsized":"2024-05-07T13:59:40.065990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:40.065867+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:40.065867+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.065867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:00:27.301075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.039704+0000","last_change":"2024-05-07T13:59:41.039704+0000","last_active":"2024-05-07T13:59:41.039704+0000","last_peered":"2024-05-07T13:59:41.039704+0000","last_clean":"2024-05-07T13:59:41.039704+0000","last_became_active":"2024-05-07T13:55:48.325561+0000","last_became_peered":"2024-05-07T13:55:48.325561+0000","last_unstale":"2024-05-07T13:59:41.039704+0000","last_undegraded":"2024-05-07T13:59:41.039704+0000","last_fullsized":"2024-05-07T13:59:41.039704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.039521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.039521+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.039521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:51:57.803837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:25.983208+0000","last_change":"2024-05-07T13:59:25.983208+0000","last_active":"2024-05-07T13:59:25.983208+0000","last_peered":"2024-05-07T13:59:25.983208+0000","last_clean":"2024-05-07T13:59:25.983208+0000","last_became_active":"2024-05-07T13:55:50.326322+0000","last_became_peered":"2024-05-07T13:55:50.326322+0000","last_unstale":"2024-05-07T13:59:25.983208+0000","last_undegraded":"2024-05-07T13:59:25.983208+0000","last_fullsized":"2024-05-07T13:59:25.983208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-07T13:59:25.983056+0000","last_clean_scrub_stamp":"2024-05-07T13:59:25.983056+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:20.815531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"27'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:13.196339+0000","last_change":"2024-05-07T14:00:13.196381+0000","last_active":"2024-05-07T14:00:13.196339+0000","last_peered":"2024-05-07T14:00:13.196339+0000","last_clean":"2024-05-07T14:00:13.196339+0000","last_became_active":"2024-05-07T13:55:48.350385+0000","last_became_peered":"2024-05-07T13:55:48.350385+0000","last_unstale":"2024-05-07T14:00:13.196339+0000","last_undegraded":"2024-05-07T14:00:13.196339+0000","last_fullsized":"2024-05-07T14:00:13.196339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-07T14:00:13.196233+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-07T14:00:13.196233+0000","last_clean_scrub_stamp":"2024-05-07T14:00:13.196233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:14.960991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.084260+0000","last_change":"2024-05-07T13:59:42.084260+0000","last_active":"2024-05-07T13:59:42.084260+0000","last_peered":"2024-05-07T13:59:42.084260+0000","last_clean":"2024-05-07T13:59:42.084260+0000","last_became_active":"2024-05-07T13:55:50.312703+0000","last_became_peered":"2024-05-07T13:55:50.312703+0000","last_unstale":"2024-05-07T13:59:42.084260+0000","last_undegraded":"2024-05-07T13:59:42.084260+0000","last_fullsized":"2024-05-07T13:59:42.084260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:42.084125+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:42.084125+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.084125+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:39:03.874653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:03.109470+0000","last_change":"2024-05-07T14:00:03.109504+0000","last_active":"2024-05-07T14:00:03.109470+0000","last_peered":"2024-05-07T14:00:03.109470+0000","last_clean":"2024-05-07T14:00:03.109470+0000","last_became_active":"2024-05-07T13:55:48.323979+0000","last_became_peered":"2024-05-07T13:55:48.323979+0000","last_unstale":"2024-05-07T14:00:03.109470+0000","last_undegraded":"2024-05-07T14:00:03.109470+0000","last_fullsized":"2024-05-07T14:00:03.109470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:03.109379+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:03.109379+0000","last_clean_scrub_stamp":"2024-05-07T14:00:03.109379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:44:07.609903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.019212+0000","last_change":"2024-05-07T13:59:36.019212+0000","last_active":"2024-05-07T13:59:36.019212+0000","last_peered":"2024-05-07T13:59:36.019212+0000","last_clean":"2024-05-07T13:59:36.019212+0000","last_became_active":"2024-05-07T13:55:50.331311+0000","last_became_peered":"2024-05-07T13:55:50.331311+0000","last_unstale":"2024-05-07T13:59:36.019212+0000","last_undegraded":"2024-05-07T13:59:36.019212+0000","last_fullsized":"2024-05-07T13:59:36.019212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:36.019068+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:36.019068+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.019068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:40.795315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.030870+0000","last_change":"2024-05-07T13:59:51.030870+0000","last_active":"2024-05-07T13:59:51.030870+0000","last_peered":"2024-05-07T13:59:51.030870+0000","last_clean":"2024-05-07T13:59:51.030870+0000","last_became_active":"2024-05-07T13:55:48.325858+0000","last_became_peered":"2024-05-07T13:55:48.325858+0000","last_unstale":"2024-05-07T13:59:51.030870+0000","last_undegraded":"2024-05-07T13:59:51.030870+0000","last_fullsized":"2024-05-07T13:59:51.030870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:51.030727+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:51.030727+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.030727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:23:23.693886+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'8","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:37.064923+0000","last_change":"2024-05-07T13:59:37.064923+0000","last_active":"2024-05-07T13:59:37.064923+0000","last_peered":"2024-05-07T13:59:37.064923+0000","last_clean":"2024-05-07T13:59:37.064923+0000","last_became_active":"2024-05-07T13:55:50.323573+0000","last_became_peered":"2024-05-07T13:55:50.323573+0000","last_unstale":"2024-05-07T13:59:37.064923+0000","last_undegraded":"2024-05-07T13:59:37.064923+0000","last_fullsized":"2024-05-07T13:59:37.064923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:37.064807+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:37.064807+0000","last_clean_scrub_stamp":"2024-05-07T13:59:37.064807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:27:22.190330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:01.913691+0000","last_change":"2024-05-07T14:00:01.913691+0000","last_active":"2024-05-07T14:00:01.913691+0000","last_peered":"2024-05-07T14:00:01.913691+0000","last_clean":"2024-05-07T14:00:01.913691+0000","last_became_active":"2024-05-07T13:55:48.334268+0000","last_became_peered":"2024-05-07T13:55:48.334268+0000","last_unstale":"2024-05-07T14:00:01.913691+0000","last_undegraded":"2024-05-07T14:00:01.913691+0000","last_fullsized":"2024-05-07T14:00:01.913691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T14:00:01.913563+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T14:00:01.913563+0000","last_clean_scrub_stamp":"2024-05-07T14:00:01.913563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:52.729005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'6","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:04.072192+0000","last_change":"2024-05-07T14:00:04.072255+0000","last_active":"2024-05-07T14:00:04.072192+0000","last_peered":"2024-05-07T14:00:04.072192+0000","last_clean":"2024-05-07T14:00:04.072192+0000","last_became_active":"2024-05-07T13:55:50.320242+0000","last_became_peered":"2024-05-07T13:55:50.320242+0000","last_unstale":"2024-05-07T14:00:04.072192+0000","last_undegraded":"2024-05-07T14:00:04.072192+0000","last_fullsized":"2024-05-07T14:00:04.072192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-07T14:00:04.072088+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-07T14:00:04.072088+0000","last_clean_scrub_stamp":"2024-05-07T14:00:04.072088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:32:14.005162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.098472+0000","last_change":"2024-05-07T13:59:39.098472+0000","last_active":"2024-05-07T13:59:39.098472+0000","last_peered":"2024-05-07T13:59:39.098472+0000","last_clean":"2024-05-07T13:59:39.098472+0000","last_became_active":"2024-05-07T13:55:48.340718+0000","last_became_peered":"2024-05-07T13:55:48.340718+0000","last_unstale":"2024-05-07T13:59:39.098472+0000","last_undegraded":"2024-05-07T13:59:39.098472+0000","last_fullsized":"2024-05-07T13:59:39.098472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:39.098327+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:39.098327+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.098327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:26:06.470550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'12","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.080660+0000","last_change":"2024-05-07T13:59:51.080660+0000","last_active":"2024-05-07T13:59:51.080660+0000","last_peered":"2024-05-07T13:59:51.080660+0000","last_clean":"2024-05-07T13:59:51.080660+0000","last_became_active":"2024-05-07T13:55:50.320430+0000","last_became_peered":"2024-05-07T13:55:50.320430+0000","last_unstale":"2024-05-07T13:59:51.080660+0000","last_undegraded":"2024-05-07T13:59:51.080660+0000","last_fullsized":"2024-05-07T13:59:51.080660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-07T13:59:51.080529+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-07T13:59:51.080529+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.080529+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:36.200537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:00.150670+0000","last_change":"2024-05-07T14:00:00.150670+0000","last_active":"2024-05-07T14:00:00.150670+0000","last_peered":"2024-05-07T14:00:00.150670+0000","last_clean":"2024-05-07T14:00:00.150670+0000","last_became_active":"2024-05-07T13:55:48.323524+0000","last_became_peered":"2024-05-07T13:55:48.323524+0000","last_unstale":"2024-05-07T14:00:00.150670+0000","last_undegraded":"2024-05-07T14:00:00.150670+0000","last_fullsized":"2024-05-07T14:00:00.150670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:00.150551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:00.150551+0000","last_clean_scrub_stamp":"2024-05-07T14:00:00.150551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:23:28.705432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.097757+0000","last_change":"2024-05-07T13:59:45.097757+0000","last_active":"2024-05-07T13:59:45.097757+0000","last_peered":"2024-05-07T13:59:45.097757+0000","last_clean":"2024-05-07T13:59:45.097757+0000","last_became_active":"2024-05-07T13:55:50.313012+0000","last_became_peered":"2024-05-07T13:55:50.313012+0000","last_unstale":"2024-05-07T13:59:45.097757+0000","last_undegraded":"2024-05-07T13:59:45.097757+0000","last_fullsized":"2024-05-07T13:59:45.097757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-07T13:59:45.097632+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-07T13:59:45.097632+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.097632+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:52:01.861948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:59.169146+0000","last_change":"2024-05-07T13:59:59.169146+0000","last_active":"2024-05-07T13:59:59.169146+0000","last_peered":"2024-05-07T13:59:59.169146+0000","last_clean":"2024-05-07T13:59:59.169146+0000","last_became_active":"2024-05-07T13:55:48.351882+0000","last_became_peered":"2024-05-07T13:55:48.351882+0000","last_unstale":"2024-05-07T13:59:59.169146+0000","last_undegraded":"2024-05-07T13:59:59.169146+0000","last_fullsized":"2024-05-07T13:59:59.169146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:59.169028+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:59.169028+0000","last_clean_scrub_stamp":"2024-05-07T13:59:59.169028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:32:41.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'8","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:29.983379+0000","last_change":"2024-05-07T13:59:29.983379+0000","last_active":"2024-05-07T13:59:29.983379+0000","last_peered":"2024-05-07T13:59:29.983379+0000","last_clean":"2024-05-07T13:59:29.983379+0000","last_became_active":"2024-05-07T13:55:50.325807+0000","last_became_peered":"2024-05-07T13:55:50.325807+0000","last_unstale":"2024-05-07T13:59:29.983379+0000","last_undegraded":"2024-05-07T13:59:29.983379+0000","last_fullsized":"2024-05-07T13:59:29.983379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:29.983257+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:29.983257+0000","last_clean_scrub_stamp":"2024-05-07T13:59:29.983257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:23.280897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:45.148407+0000","last_change":"2024-05-07T13:59:45.148407+0000","last_active":"2024-05-07T13:59:45.148407+0000","last_peered":"2024-05-07T13:59:45.148407+0000","last_clean":"2024-05-07T13:59:45.148407+0000","last_became_active":"2024-05-07T13:55:48.324919+0000","last_became_peered":"2024-05-07T13:55:48.324919+0000","last_unstale":"2024-05-07T13:59:45.148407+0000","last_undegraded":"2024-05-07T13:59:45.148407+0000","last_fullsized":"2024-05-07T13:59:45.148407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-07T13:59:45.148279+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-07T13:59:45.148279+0000","last_clean_scrub_stamp":"2024-05-07T13:59:45.148279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:13:40.994289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:39.037562+0000","last_change":"2024-05-07T13:59:39.037562+0000","last_active":"2024-05-07T13:59:39.037562+0000","last_peered":"2024-05-07T13:59:39.037562+0000","last_clean":"2024-05-07T13:59:39.037562+0000","last_became_active":"2024-05-07T13:55:50.325620+0000","last_became_peered":"2024-05-07T13:55:50.325620+0000","last_unstale":"2024-05-07T13:59:39.037562+0000","last_undegraded":"2024-05-07T13:59:39.037562+0000","last_fullsized":"2024-05-07T13:59:39.037562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:39.037426+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:39.037426+0000","last_clean_scrub_stamp":"2024-05-07T13:59:39.037426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:58:05.113376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:48.118048+0000","last_change":"2024-05-07T13:59:48.118048+0000","last_active":"2024-05-07T13:59:48.118048+0000","last_peered":"2024-05-07T13:59:48.118048+0000","last_clean":"2024-05-07T13:59:48.118048+0000","last_became_active":"2024-05-07T13:55:48.342508+0000","last_became_peered":"2024-05-07T13:55:48.342508+0000","last_unstale":"2024-05-07T13:59:48.118048+0000","last_undegraded":"2024-05-07T13:59:48.118048+0000","last_fullsized":"2024-05-07T13:59:48.118048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T13:59:48.117871+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T13:59:48.117871+0000","last_clean_scrub_stamp":"2024-05-07T13:59:48.117871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:21.723026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:53.019469+0000","last_change":"2024-05-07T13:59:53.019469+0000","last_active":"2024-05-07T13:59:53.019469+0000","last_peered":"2024-05-07T13:59:53.019469+0000","last_clean":"2024-05-07T13:59:53.019469+0000","last_became_active":"2024-05-07T13:55:50.321606+0000","last_became_peered":"2024-05-07T13:55:50.321606+0000","last_unstale":"2024-05-07T13:59:53.019469+0000","last_undegraded":"2024-05-07T13:59:53.019469+0000","last_fullsized":"2024-05-07T13:59:53.019469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:53.019341+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:53.019341+0000","last_clean_scrub_stamp":"2024-05-07T13:59:53.019341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:03:46.316981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:58.943614+0000","last_change":"2024-05-07T13:59:58.943614+0000","last_active":"2024-05-07T13:59:58.943614+0000","last_peered":"2024-05-07T13:59:58.943614+0000","last_clean":"2024-05-07T13:59:58.943614+0000","last_became_active":"2024-05-07T13:55:48.332247+0000","last_became_peered":"2024-05-07T13:55:48.332247+0000","last_unstale":"2024-05-07T13:59:58.943614+0000","last_undegraded":"2024-05-07T13:59:58.943614+0000","last_fullsized":"2024-05-07T13:59:58.943614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:58.943486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:58.943486+0000","last_clean_scrub_stamp":"2024-05-07T13:59:58.943486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:25:27.322012+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'16","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:36.097975+0000","last_change":"2024-05-07T13:59:36.097975+0000","last_active":"2024-05-07T13:59:36.097975+0000","last_peered":"2024-05-07T13:59:36.097975+0000","last_clean":"2024-05-07T13:59:36.097975+0000","last_became_active":"2024-05-07T13:55:50.329434+0000","last_became_peered":"2024-05-07T13:55:50.329434+0000","last_unstale":"2024-05-07T13:59:36.097975+0000","last_undegraded":"2024-05-07T13:59:36.097975+0000","last_fullsized":"2024-05-07T13:59:36.097975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-07T13:59:36.097848+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-07T13:59:36.097848+0000","last_clean_scrub_stamp":"2024-05-07T13:59:36.097848+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:05:27.587259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:16.200233+0000","last_change":"2024-05-07T14:00:16.200233+0000","last_active":"2024-05-07T14:00:16.200233+0000","last_peered":"2024-05-07T14:00:16.200233+0000","last_clean":"2024-05-07T14:00:16.200233+0000","last_became_active":"2024-05-07T13:55:48.345844+0000","last_became_peered":"2024-05-07T13:55:48.345844+0000","last_unstale":"2024-05-07T14:00:16.200233+0000","last_undegraded":"2024-05-07T14:00:16.200233+0000","last_fullsized":"2024-05-07T14:00:16.200233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:16.200038+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:16.200038+0000","last_clean_scrub_stamp":"2024-05-07T14:00:16.200038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:05:57.962122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:42.053031+0000","last_change":"2024-05-07T13:59:42.053031+0000","last_active":"2024-05-07T13:59:42.053031+0000","last_peered":"2024-05-07T13:59:42.053031+0000","last_clean":"2024-05-07T13:59:42.053031+0000","last_became_active":"2024-05-07T13:55:50.313049+0000","last_became_peered":"2024-05-07T13:55:50.313049+0000","last_unstale":"2024-05-07T13:59:42.053031+0000","last_undegraded":"2024-05-07T13:59:42.053031+0000","last_fullsized":"2024-05-07T13:59:42.053031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:42.052863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:42.052863+0000","last_clean_scrub_stamp":"2024-05-07T13:59:42.052863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:36.854007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:10.129194+0000","last_change":"2024-05-07T14:00:10.129194+0000","last_active":"2024-05-07T14:00:10.129194+0000","last_peered":"2024-05-07T14:00:10.129194+0000","last_clean":"2024-05-07T14:00:10.129194+0000","last_became_active":"2024-05-07T13:55:48.346691+0000","last_became_peered":"2024-05-07T13:55:48.346691+0000","last_unstale":"2024-05-07T14:00:10.129194+0000","last_undegraded":"2024-05-07T14:00:10.129194+0000","last_fullsized":"2024-05-07T14:00:10.129194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-07T14:00:10.129056+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-07T14:00:10.129056+0000","last_clean_scrub_stamp":"2024-05-07T14:00:10.129056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:06:55.990729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'10","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:51.249376+0000","last_change":"2024-05-07T13:59:51.249376+0000","last_active":"2024-05-07T13:59:51.249376+0000","last_peered":"2024-05-07T13:59:51.249376+0000","last_clean":"2024-05-07T13:59:51.249376+0000","last_became_active":"2024-05-07T13:55:50.322543+0000","last_became_peered":"2024-05-07T13:55:50.322543+0000","last_unstale":"2024-05-07T13:59:51.249376+0000","last_undegraded":"2024-05-07T13:59:51.249376+0000","last_fullsized":"2024-05-07T13:59:51.249376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-07T13:59:51.249245+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-07T13:59:51.249245+0000","last_clean_scrub_stamp":"2024-05-07T13:59:51.249245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:52:29.222971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:41.140179+0000","last_change":"2024-05-07T13:59:41.140179+0000","last_active":"2024-05-07T13:59:41.140179+0000","last_peered":"2024-05-07T13:59:41.140179+0000","last_clean":"2024-05-07T13:59:41.140179+0000","last_became_active":"2024-05-07T13:55:48.339909+0000","last_became_peered":"2024-05-07T13:55:48.339909+0000","last_unstale":"2024-05-07T13:59:41.140179+0000","last_undegraded":"2024-05-07T13:59:41.140179+0000","last_fullsized":"2024-05-07T13:59:41.140179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:41.140056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:41.140056+0000","last_clean_scrub_stamp":"2024-05-07T13:59:41.140056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:23.488647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:40.113305+0000","last_change":"2024-05-07T13:59:40.113305+0000","last_active":"2024-05-07T13:59:40.113305+0000","last_peered":"2024-05-07T13:59:40.113305+0000","last_clean":"2024-05-07T13:59:40.113305+0000","last_became_active":"2024-05-07T13:55:50.322967+0000","last_became_peered":"2024-05-07T13:55:50.322967+0000","last_unstale":"2024-05-07T13:59:40.113305+0000","last_undegraded":"2024-05-07T13:59:40.113305+0000","last_fullsized":"2024-05-07T13:59:40.113305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-07T13:59:40.113131+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-07T13:59:40.113131+0000","last_clean_scrub_stamp":"2024-05-07T13:59:40.113131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:23:44.889378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:24.290453+0000","last_change":"2024-05-07T14:00:24.290453+0000","last_active":"2024-05-07T14:00:24.290453+0000","last_peered":"2024-05-07T14:00:24.290453+0000","last_clean":"2024-05-07T14:00:24.290453+0000","last_became_active":"2024-05-07T13:55:48.346724+0000","last_became_peered":"2024-05-07T13:55:48.346724+0000","last_unstale":"2024-05-07T14:00:24.290453+0000","last_undegraded":"2024-05-07T14:00:24.290453+0000","last_fullsized":"2024-05-07T14:00:24.290453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T14:00:24.290320+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T14:00:24.290320+0000","last_clean_scrub_stamp":"2024-05-07T14:00:24.290320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:25:02.945247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T14:00:11.145467+0000","last_change":"2024-05-07T14:00:11.145467+0000","last_active":"2024-05-07T14:00:11.145467+0000","last_peered":"2024-05-07T14:00:11.145467+0000","last_clean":"2024-05-07T14:00:11.145467+0000","last_became_active":"2024-05-07T13:55:48.349852+0000","last_became_peered":"2024-05-07T13:55:48.349852+0000","last_unstale":"2024-05-07T14:00:11.145467+0000","last_undegraded":"2024-05-07T14:00:11.145467+0000","last_fullsized":"2024-05-07T14:00:11.145467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:11.145337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:11.145337+0000","last_clean_scrub_stamp":"2024-05-07T14:00:11.145337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:49:11.601729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'4","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:54.162869+0000","last_change":"2024-05-07T13:59:54.162869+0000","last_active":"2024-05-07T13:59:54.162869+0000","last_peered":"2024-05-07T13:59:54.162869+0000","last_clean":"2024-05-07T13:59:54.162869+0000","last_became_active":"2024-05-07T13:55:50.319033+0000","last_became_peered":"2024-05-07T13:55:50.319033+0000","last_unstale":"2024-05-07T13:59:54.162869+0000","last_undegraded":"2024-05-07T13:59:54.162869+0000","last_fullsized":"2024-05-07T13:59:54.162869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:54.162744+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:54.162744+0000","last_clean_scrub_stamp":"2024-05-07T13:59:54.162744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:44:59.028242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:47.100759+0000","last_change":"2024-05-07T13:59:47.100759+0000","last_active":"2024-05-07T13:59:47.100759+0000","last_peered":"2024-05-07T13:59:47.100759+0000","last_clean":"2024-05-07T13:59:47.100759+0000","last_became_active":"2024-05-07T13:55:48.324081+0000","last_became_peered":"2024-05-07T13:55:48.324081+0000","last_unstale":"2024-05-07T13:59:47.100759+0000","last_undegraded":"2024-05-07T13:59:47.100759+0000","last_fullsized":"2024-05-07T13:59:47.100759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T13:59:47.100641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T13:59:47.100641+0000","last_clean_scrub_stamp":"2024-05-07T13:59:47.100641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:57.320731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'4","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-07T13:59:34.027372+0000","last_change":"2024-05-07T13:59:34.027372+0000","last_active":"2024-05-07T13:59:34.027372+0000","last_peered":"2024-05-07T13:59:34.027372+0000","last_clean":"2024-05-07T13:59:34.027372+0000","last_became_active":"2024-05-07T13:55:50.329848+0000","last_became_peered":"2024-05-07T13:55:50.329848+0000","last_unstale":"2024-05-07T13:59:34.027372+0000","last_undegraded":"2024-05-07T13:59:34.027372+0000","last_fullsized":"2024-05-07T13:59:34.027372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-07T13:59:34.027225+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-07T13:59:34.027225+0000","last_clean_scrub_stamp":"2024-05-07T13:59:34.027225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:34.330181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705729,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":136605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705729,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":970752,"data_stored":724702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705729,"num_pgs":157,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44628,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327212,"statfs":{"total":96636764160,"available":96591065088,"internally_reserved":0,"allocated":995328,"data_stored":724122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":401408,"data_stored":134585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:00:52.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-07T14:00:52.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.919+0000 7f8950b32640 1 Processor -- start 2024-05-07T14:00:52.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.919+0000 7f8950b32640 1 -- start start 2024-05-07T14:00:52.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f8950b32640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f894c12e340 0x7f894c130730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:52.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f8950b32640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f894c098840 con 0x7f894c12b2e0 2024-05-07T14:00:52.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f8950b32640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f894c06f9a0 con 0x7f894c12e340 2024-05-07T14:00:52.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f894a59c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f894c12b2e0 0x7f894c12b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35962/0 (socket says 172.21.15.22:35962) 2024-05-07T14:00:52.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f894a59c640 1 -- 172.21.15.22:0/141357439 learned_addr learned my addr 172.21.15.22:0/141357439 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-07T14:00:52.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f8949d9b640 1 --2- 172.21.15.22:0/141357439 >> v2:172.21.15.22:3300/0 conn(0x7f894c12e340 0x7f894c130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:52.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f894959a640 1 -- 172.21.15.22:0/141357439 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 911901795 0 0) 0x7f894c098840 con 0x7f894c12b2e0 2024-05-07T14:00:52.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f894959a640 1 -- 172.21.15.22:0/141357439 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8934003520 con 0x7f894c12b2e0 2024-05-07T14:00:52.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f8949d9b640 1 -- 172.21.15.22:0/141357439 >> v1:172.21.15.22:6789/0 conn(0x7f894c12b2e0 legacy=0x7f894c12b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:52.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.920+0000 7f8949d9b640 1 -- 172.21.15.22:0/141357439 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c12bdd0 con 0x7f894c12e340 2024-05-07T14:00:52.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.921+0000 7f8949d9b640 1 --2- 172.21.15.22:0/141357439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12e340 0x7f894c130730 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f8940009750 tx=0x7f894002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65335d58899ef522 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:52.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.921+0000 7f894959a640 1 -- 172.21.15.22:0/141357439 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89400316d0 con 0x7f894c12e340 2024-05-07T14:00:52.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.921+0000 7f894959a640 1 -- 172.21.15.22:0/141357439 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8940037070 con 0x7f894c12e340 2024-05-07T14:00:52.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.921+0000 7f894959a640 1 -- 172.21.15.22:0/141357439 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89400319a0 con 0x7f894c12e340 2024-05-07T14:00:52.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.922+0000 7f8950b32640 1 -- 172.21.15.22:0/141357439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12e340 msgr2=0x7f894c130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:52.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.922+0000 7f8950b32640 1 --2- 172.21.15.22:0/141357439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12e340 0x7f894c130730 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f8940009750 tx=0x7f894002b840 comp rx=0 tx=0).stop 2024-05-07T14:00:52.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.922+0000 7f8950b32640 1 -- 172.21.15.22:0/141357439 shutdown_connections 2024-05-07T14:00:52.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.922+0000 7f8950b32640 1 --2- 172.21.15.22:0/141357439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12e340 0x7f894c130730 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:52.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.922+0000 7f8950b32640 1 -- 172.21.15.22:0/141357439 >> 172.21.15.22:0/141357439 conn(0x7f894c0996c0 msgr2=0x7f894c099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.922+0000 7f8950b32640 1 -- 172.21.15.22:0/141357439 shutdown_connections 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.922+0000 7f8950b32640 1 -- 172.21.15.22:0/141357439 wait complete. 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.923+0000 7f8950b32640 1 Processor -- start 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.923+0000 7f8950b32640 1 -- start start 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.923+0000 7f8950b32640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12b2e0 0x7f894c125b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.923+0000 7f8950b32640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f894c070190 con 0x7f894c12b2e0 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.923+0000 7f894a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12b2e0 0x7f894c125b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.923+0000 7f894a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12b2e0 0x7f894c125b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49458/0 (socket says 172.21.15.22:49458) 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.923+0000 7f894a59c640 1 -- 172.21.15.22:0/992638121 learned_addr learned my addr 172.21.15.22:0/992638121 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.923+0000 7f894a59c640 1 -- 172.21.15.22:0/992638121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c127ce0 con 0x7f894c12b2e0 2024-05-07T14:00:52.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.924+0000 7f894a59c640 1 --2- 172.21.15.22:0/992638121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12b2e0 0x7f894c125b40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f893c00cb40 tx=0x7f893c0021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.924+0000 7f893affd640 1 -- 172.21.15.22:0/992638121 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f893c017070 con 0x7f894c12b2e0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.924+0000 7f893affd640 1 -- 172.21.15.22:0/992638121 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f893c00ab80 con 0x7f894c12b2e0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.924+0000 7f893affd640 1 -- 172.21.15.22:0/992638121 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f893c012400 con 0x7f894c12b2e0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.924+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894c128270 con 0x7f894c12b2e0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.924+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f894c128730 con 0x7f894c12b2e0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.925+0000 7f893affd640 1 -- 172.21.15.22:0/992638121 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f893c01a070 con 0x7f894c12b2e0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.925+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f894c062e90 con 0x7f894c12b2e0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.925+0000 7f893affd640 1 --2- 172.21.15.22:0/992638121 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f892c038060 0x7f892c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.925+0000 7f893affd640 1 -- 172.21.15.22:0/992638121 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f893c04b7d0 con 0x7f894c12b2e0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.925+0000 7f8949d9b640 1 --2- 172.21.15.22:0/992638121 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f892c038060 0x7f892c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-07T14:00:52.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.926+0000 7f8949d9b640 1 --2- 172.21.15.22:0/992638121 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f892c038060 0x7f892c03a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8940009750 tx=0x7f8940008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-07T14:00:52.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:52.930+0000 7f893affd640 1 -- 172.21.15.22:0/992638121 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f894c128270 con 0x7f894c12b2e0 2024-05-07T14:00:53.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.111+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f894c127600 con 0x7f894c12b2e0 2024-05-07T14:00:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.114+0000 7f893affd640 1 -- 172.21.15.22:0/992638121 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f893c01b7b0 con 0x7f894c12b2e0 2024-05-07T14:00:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.114+0000 7f893affd640 1 -- 172.21.15.22:0/992638121 <== mon.0 v2:172.21.15.22:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f893c051080 con 0x7f894c12b2e0 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f892c038060 msgr2=0x7f892c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 --2- 172.21.15.22:0/992638121 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f892c038060 0x7f892c03a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8940009750 tx=0x7f8940008030 comp rx=0 tx=0).stop 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12b2e0 msgr2=0x7f894c125b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 --2- 172.21.15.22:0/992638121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12b2e0 0x7f894c125b40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f893c00cb40 tx=0x7f893c0021e0 comp rx=0 tx=0).stop 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 shutdown_connections 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 --2- 172.21.15.22:0/992638121 >> [v2:172.21.15.50:6824/985543100,v1:172.21.15.50:6825/985543100] conn(0x7f892c038060 0x7f892c03a520 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 --2- 172.21.15.22:0/992638121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f894c12b2e0 0x7f894c125b40 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 >> 172.21.15.22:0/992638121 conn(0x7f894c0996c0 msgr2=0x7f894c09afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 shutdown_connections 2024-05-07T14:00:53.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-07T14:00:53.116+0000 7f8950b32640 1 -- 172.21.15.22:0/992638121 wait complete. 2024-05-07T14:00:53.113 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-07T14:00:53.113 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-07T14:00:53.113 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-07T14:00:53.113 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:00:53.150 INFO:tasks.ceph.osd.0:Stopped 2024-05-07T14:00:53.150 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-07T14:00:53.150 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:00:53.189 INFO:tasks.ceph.osd.1:Stopped 2024-05-07T14:00:53.190 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-07T14:00:53.190 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:00:53.259 INFO:tasks.ceph.osd.2:Stopped 2024-05-07T14:00:53.260 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-07T14:00:53.260 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:00:53.331 INFO:tasks.ceph.osd.3:Stopped 2024-05-07T14:00:53.331 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-07T14:00:53.331 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-07T14:00:53.331 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:00:53.402 INFO:tasks.ceph.mgr.x:Stopped 2024-05-07T14:00:53.403 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-07T14:00:53.403 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-07T14:00:53.403 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:00:53.414 INFO:tasks.ceph.mon.a:Stopped 2024-05-07T14:00:53.414 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-07T14:00:53.415 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-05-07T14:00:53.487 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-07T14:00:53.487 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-07T14:00:53.667 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2024-05-07T14:00:53.668 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-07T14:00:53.821 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2024-05-07T14:00:53.821 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-07T14:00:53.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2024-05-07T14:00:53.901 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-07T14:00:53.959 INFO:tasks.ceph:Archiving mon data... 2024-05-07T14:00:53.960 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427/data/mon.a.tgz 2024-05-07T14:00:53.960 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-05-07T14:00:53.977 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.yon8chlYzv 2024-05-07T14:00:53.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yon8chlYzv 2024-05-07T14:00:54.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.yon8chlYzv 2024-05-07T14:00:54.197 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.yon8chlYzv is 264KB 2024-05-07T14:00:54.293 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.yon8chlYzv 2024-05-07T14:00:54.309 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-07T14:00:54.309 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-07T14:00:54.351 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-07T14:00:54.430 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-07T14:00:54.449 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-07T14:00:54.450 INFO:tasks.ceph:Archiving crash dumps... 2024-05-07T14:00:54.451 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427/remote/smithi022/crash 2024-05-07T14:00:54.452 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-07T14:00:54.496 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427/remote/smithi050/crash 2024-05-07T14:00:54.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-07T14:00:54.536 INFO:tasks.ceph:Compressing logs... 2024-05-07T14:00:54.536 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-07T14:00:54.540 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-07T14:00:54.579 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29478.log 2024-05-07T14:00:54.579 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30484.log 2024-05-07T14:00:54.579 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29846.log 2024-05-07T14:00:54.579 INFO:teuthology.orchestra.run.smithi022.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29478.log.gz 2024-05-07T14:00:54.579 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30316.log 2024-05-07T14:00:54.579 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29846.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-07T14:00:54.579 INFO:teuthology.orchestra.run.smithi022.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30484.log.gz 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr: 85.9%/var/log/ceph/ceph-client.admin.30316.log: -- replaced with /var/log/ceph/ceph-client.admin.29846.log.gz 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30014.log 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30316.log.gz 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30736.log 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30947.log 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30014.log: /var/log/ceph/ceph-client.admin.30736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30778.log 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30014.log.gz 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30736.log.gz 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30947.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30778.log: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30947.log.gz 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30400.log 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30778.log.gz 2024-05-07T14:00:54.580 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29848.log 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30442.log 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30400.log.gz 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30274.log 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29848.log.gz 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30820.log 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30442.log.gz 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30358.log 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30274.log.gz 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29677.log 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30820.log.gz 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29528.log 2024-05-07T14:00:54.581 INFO:teuthology.orchestra.run.smithi022.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30358.log.gz 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29677.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29677.log.gz 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28098.log 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29528.log.gz 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30694.log 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.28098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29436.log 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28098.log.gz 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28259.log 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30694.log.gz 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30016.log 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29436.log.gz 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.28259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30862.log 2024-05-07T14:00:54.582 INFO:teuthology.orchestra.run.smithi022.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.28259.log.gz 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31029.log 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30016.log.gz 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29847.log 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31029.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30862.log.gz 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31029.log.gz 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29578.log 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29847.log.gz 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29956.log 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30989.log 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29578.log.gz 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30125.log 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29956.log.gz 2024-05-07T14:00:54.583 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30610.log 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30989.log.gz 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30125.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26396.log 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30125.log.gz 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29336.log 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30610.log.gz 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.tmp-client.admin.26396.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26396.log.gz 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29394.log 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29678.log 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29336.log.gz 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29844.log 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29394.log.gz 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30652.log 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29678.log.gz 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30219.log 2024-05-07T14:00:54.584 INFO:teuthology.orchestra.run.smithi022.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29844.log.gz 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28216.log 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30652.log.gz 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30526.log 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30219.log: /var/log/ceph/ceph-client.admin.28216.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30219.log.gz 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30568.log 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28216.log.gz 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30175.log 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30526.log: /var/log/ceph/ceph-client.admin.30568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30015.log 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30526.log.gz 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30568.log.gz 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30905.log 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30175.log.gz 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29679.log 2024-05-07T14:00:54.585 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.30015.log: /var/log/ceph/ceph-client.admin.30905.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30015.log.gz 2024-05-07T14:00:54.586 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29680.log 2024-05-07T14:00:54.586 INFO:teuthology.orchestra.run.smithi022.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30905.log.gz 2024-05-07T14:00:54.586 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.29679.log: /var/log/ceph/ceph-client.admin.29680.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29679.log.gz 2024-05-07T14:00:54.586 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29680.log.gz 2024-05-07T14:00:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69444.log 2024-05-07T14:00:54.616 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36780.log 2024-05-07T14:00:54.616 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.69444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77309.log 2024-05-07T14:00:54.616 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.0.36780.log: -5 --verbose -- /var/log/ceph/ceph-client.0.76704.log 2024-05-07T14:00:54.618 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.77309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42219.log 2024-05-07T14:00:54.618 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.76704.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.69444.log.gz 2024-05-07T14:00:54.618 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87564.log 2024-05-07T14:00:54.618 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41009.log 2024-05-07T14:00:54.618 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.42219.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36780.log.gz 2024-05-07T14:00:54.618 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.87564.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77309.log.gz 2024-05-07T14:00:54.618 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89984.log 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.41009.log: /var/log/ceph/ceph-client.admin.34012.log 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.76704.log.gz 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.89984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53714.log 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.42219.log.gz 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.87564.log.gz 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62789.log 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34012.log: /var/log/ceph/ceph-client.0.53714.log: gzip -5 --verbose -- 85.7% /var/log/ceph/ceph-client.0.60369.log 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34012.log.gz 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41009.log.gz 2024-05-07T14:00:54.622 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.89984.log.gz 2024-05-07T14:00:54.623 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.62789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72469.log 2024-05-07T14:00:54.623 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86959.log 2024-05-07T14:00:54.623 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.60369.log: /var/log/ceph/ceph-client.0.72469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47664.log 2024-05-07T14:00:54.623 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.86959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67629.log 2024-05-07T14:00:54.623 INFO:teuthology.orchestra.run.smithi050.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53714.log.gz 2024-05-07T14:00:54.623 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.62789.log.gz 2024-05-07T14:00:54.623 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.47664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46454.log 2024-05-07T14:00:54.623 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.67629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88169.log 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60369.log.gz 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.46454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82149.log 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.86959.log.gz 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72469.log.gz 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.0.88169.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.47664.log.gz 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.82149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75494.log 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.2.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.46454.log.gz 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45244.log 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.75494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34965.log 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.45244.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88169.log.gz 2024-05-07T14:00:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80939.log 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.67629.log.gz 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.82149.log.gz 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.34965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40404.log 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.80939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70654.log 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75494.log.gz 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.40404.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.45244.log.gz 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82754.log 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34092.log 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.70654.log: /var/log/ceph/ceph-client.0.82754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91799.log 91.9% -- replaced with /var/log/ceph/ceph-client.0.34965.log.gz 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80939.log.gz 2024-05-07T14:00:54.634 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34092.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.40404.log.gz 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38589.log 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.34092.log.gz 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.91799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56134.log 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82754.log.gz 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44034.log 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.38589.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70654.log.gz 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.56134.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91799.log.gz 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50689.log 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.44034.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34132.log 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.50689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94876.log 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38589.log.gz 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34132.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.56134.log.gz 2024-05-07T14:00:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61579.log 2024-05-07T14:00:54.636 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.44034.log.gz 2024-05-07T14:00:54.636 INFO:teuthology.orchestra.run.smithi050.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.34132.log.gz 2024-05-07T14:00:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.94876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80334.log 2024-05-07T14:00:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35570.log 2024-05-07T14:00:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.61579.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.50689.log.gz 2024-05-07T14:00:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.80334.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-07T14:00:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.35570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49479.log 2024-05-07T14:00:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-07T14:00:54.641 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61579.log.gz 2024-05-07T14:00:54.641 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.49479.log: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- 91.4% /var/log/ceph/ceph-osd.1.log 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.35570.log.gz 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/rgw.ceph.client.0.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.80334.log.gz 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr: 93.2%gzip -- replaced with /var/log/ceph/ceph-client.0.94876.log.gz -5 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.0.50084.log 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78519.log 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49479.log.gz 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.50084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83958.log 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.78519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67024.log 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.83958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51294.log 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.50084.log.gz/var/log/ceph/ceph-client.0.67024.log: 2024-05-07T14:00:54.642 INFO:teuthology.orchestra.run.smithi050.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.83958.log.gz 2024-05-07T14:00:54.643 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78519.log.gz 2024-05-07T14:00:54.643 INFO:teuthology.orchestra.run.smithi050.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.0.67024.log.gz 2024-05-07T14:00:54.643 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79124.log 2024-05-07T14:00:54.643 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.51294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74284.log 2024-05-07T14:00:54.643 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.79124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88774.log 2024-05-07T14:00:54.643 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.74284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30480.log 2024-05-07T14:00:54.643 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51294.log.gz 2024-05-07T14:00:54.643 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.88774.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79124.log.gz 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.74284.log.gz 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88774.log.gz 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64604.log 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84557.log 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.30480.log.gz 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.64604.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.84557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48269.log 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mgr.x.log: 90.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83359.log 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.84557.log.gz 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5/var/log/ceph/ceph-client.0.48269.log: --verbose -- /var/log/ceph/ceph-client.0.71259.log 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.83359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58554.log 2024-05-07T14:00:54.656 INFO:teuthology.orchestra.run.smithi050.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.83359.log.gz 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.71259.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.64604.log.gz 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48269.log.gz 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57344.log 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.58554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48874.log 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71259.log.gz 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.57344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90589.log 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.48874.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58554.log.gz 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37385.log 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.90589.log: 91.3% 91.3% -- replaced with /var/log/ceph/ceph-client.0.57344.log.gz 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.48874.log.gz 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62184.log 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.37385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2024-05-07T14:00:54.657 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.90589.log.gz 2024-05-07T14:00:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.62184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51899.log 2024-05-07T14:00:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34172.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2024-05-07T14:00:54.658 INFO:teuthology.orchestra.run.smithi050.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37385.log.gz 2024-05-07T14:00:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92404.log 2024-05-07T14:00:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.51899.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62184.log.gz 2024-05-07T14:00:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81544.log 2024-05-07T14:00:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.92404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70049.log 2024-05-07T14:00:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.81544.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51899.log.gz 2024-05-07T14:00:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59764.log 2024-05-07T14:00:54.666 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92404.log.gz 2024-05-07T14:00:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.70049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65209.log 2024-05-07T14:00:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.59764.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81544.log.gz 2024-05-07T14:00:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34052.log 2024-05-07T14:00:54.666 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.70049.log.gz 2024-05-07T14:00:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.65209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85156.log 2024-05-07T14:00:54.666 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59764.log.gz/var/log/ceph/ceph-client.admin.34052.log: 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr: 86.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71864.log 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34052.log.gz 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.85156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79729.log 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.71864.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.85156.log.gz 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.65209.log.gz 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57949.log 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.79729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63999.log 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71864.log.gz 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.57949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77914.log 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.63999.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.79729.log.gz 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57949.log.gz 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63999.log.gz 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59159.log 2024-05-07T14:00:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.0.77914.log: -5 --verbose -- /var/log/ceph/ceph-client.0.76099.log 2024-05-07T14:00:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.59159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30560.log 2024-05-07T14:00:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.76099.log: 90.9% 91.1% -- replaced with /var/log/ceph/ceph-client.0.77914.log.gz 2024-05-07T14:00:54.670 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.59159.log.gz 2024-05-07T14:00:54.670 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76099.log.gz 2024-05-07T14:00:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54924.log 2024-05-07T14:00:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.30560.log: -5 --verbose -- /var/log/ceph/ceph-client.0.94219.log 2024-05-07T14:00:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.54924.log: 84.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55529.log 2024-05-07T14:00:54.670 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30560.log.gz 2024-05-07T14:00:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74889.log 2024-05-07T14:00:54.674 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.94219.log: /var/log/ceph/ceph-client.0.55529.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54924.log.gz 2024-05-07T14:00:54.674 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93614.log 2024-05-07T14:00:54.674 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.0.94219.log.gz 2024-05-07T14:00:54.674 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.74889.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55529.log.gz 2024-05-07T14:00:54.674 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91194.log 2024-05-07T14:00:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.93614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86354.log 2024-05-07T14:00:54.675 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.74889.log.gz 2024-05-07T14:00:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.91194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54319.log 2024-05-07T14:00:54.675 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93614.log.gz 2024-05-07T14:00:54.675 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.86354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44639.log 2024-05-07T14:00:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.54319.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91194.log.gz 2024-05-07T14:00:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89379.log 2024-05-07T14:00:54.677 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.86354.log.gz 2024-05-07T14:00:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.44639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56739.log 2024-05-07T14:00:54.677 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54319.log.gz 2024-05-07T14:00:54.677 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.89379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53109.log 2024-05-07T14:00:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.56739.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44639.log.gz 2024-05-07T14:00:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65814.log 2024-05-07T14:00:54.679 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89379.log.gz/var/log/ceph/ceph-client.0.53109.log: 2024-05-07T14:00:54.679 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.56739.log.gz 2024-05-07T14:00:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73679.log 2024-05-07T14:00:54.679 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.65814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30440.log 2024-05-07T14:00:54.680 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.73679.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.53109.log.gz 2024-05-07T14:00:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85755.log 2024-05-07T14:00:54.686 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.65814.log.gz 2024-05-07T14:00:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30440.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.73679.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.39194.log 2024-05-07T14:00:54.686 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-05-07T14:00:54.686 INFO:teuthology.orchestra.run.smithi050.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.30440.log.gz/var/log/ceph/ceph-client.0.85755.log: 2024-05-07T14:00:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41614.log 2024-05-07T14:00:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.39194.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.85755.log.gz 2024-05-07T14:00:54.686 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45849.log 2024-05-07T14:00:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68234.log 2024-05-07T14:00:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.45849.log: /var/log/ceph/ceph-client.0.41614.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39194.log.gz 2024-05-07T14:00:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68839.log 2024-05-07T14:00:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.68234.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45849.log.gz 2024-05-07T14:00:54.687 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.41614.log.gz 2024-05-07T14:00:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93009.log 2024-05-07T14:00:54.687 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.68839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63394.log 2024-05-07T14:00:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.93009.log: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68234.log.gz 2024-05-07T14:00:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39799.log 2024-05-07T14:00:54.692 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.68839.log.gz 2024-05-07T14:00:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.63394.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93009.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.36175.log 2024-05-07T14:00:54.692 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.39799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30520.log 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.36175.log: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63394.log.gz 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 91.2% -- replaced with /var/log/ceph/ceph-client.0.39799.log.gz 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.73074.log 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30520.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.30520.log.gz 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43429.log 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36175.log.gz 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66419.log 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.73074.log: /var/log/ceph/ceph-client.0.43429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52504.log 2024-05-07T14:00:54.693 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.66419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60974.log 2024-05-07T14:00:54.695 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.52504.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.43429.log.gz 2024-05-07T14:00:54.696 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.66419.log.gz 2024-05-07T14:00:54.696 INFO:teuthology.orchestra.run.smithi050.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.73074.log.gz 2024-05-07T14:00:54.696 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52504.log.gz 2024-05-07T14:00:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37990.log 2024-05-07T14:00:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.60974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47059.log 2024-05-07T14:00:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.37990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42824.log 2024-05-07T14:00:54.696 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.47059.log: 90.2% -- replaced with /var/log/ceph/ceph-client.0.37990.log.gz/var/log/ceph/ceph-client.0.42824.log: 2024-05-07T14:00:54.696 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60974.log.gz 2024-05-07T14:00:54.697 INFO:teuthology.orchestra.run.smithi050.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.47059.log.gz 2024-05-07T14:00:54.697 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.42824.log.gz 2024-05-07T14:00:54.705 INFO:teuthology.orchestra.run.smithi050.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-07T14:00:54.748 INFO:teuthology.orchestra.run.smithi022.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-07T14:00:55.575 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-07T14:00:55.636 INFO:teuthology.orchestra.run.smithi022.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-07T14:00:55.638 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-05-07T14:00:55.638 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m1.085s 2024-05-07T14:00:55.639 INFO:teuthology.orchestra.run.smithi022.stderr:user 0m1.231s 2024-05-07T14:00:55.639 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m0.077s 2024-05-07T14:00:55.763 INFO:teuthology.orchestra.run.smithi050.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-07T14:00:55.764 INFO:teuthology.orchestra.run.smithi050.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-07T14:00:55.766 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-05-07T14:00:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m1.163s 2024-05-07T14:00:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m3.381s 2024-05-07T14:00:55.766 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m0.227s 2024-05-07T14:00:55.767 INFO:tasks.ceph:Archiving logs... 2024-05-07T14:00:55.767 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427/remote/smithi022/log 2024-05-07T14:00:55.768 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-07T14:00:56.004 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427/remote/smithi050/log 2024-05-07T14:00:56.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-07T14:00:56.579 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-07T14:00:56.591 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-07T14:00:56.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-07T14:00:56.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-07T14:00:56.667 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-07T14:00:56.685 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-07T14:00:56.686 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T14:00:56.689 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T14:00:56.704 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-05-07T14:00:56.704 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-05-07T14:00:56.708 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T14:00:56.708 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-05-07T14:00:56.708 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +3873us[+3829us] +/- 61ms 2024-05-07T14:00:56.708 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -2839us[-2884us] +/- 78ms 2024-05-07T14:00:56.708 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -2139us[-2184us] +/- 80ms 2024-05-07T14:00:56.708 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T14:00:56.710 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-07T14:00:56.710 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-05-07T14:00:56.710 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +3901us[+3930us] +/- 61ms 2024-05-07T14:00:56.710 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -2801us[-2772us] +/- 78ms 2024-05-07T14:00:56.710 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -2114us[-2114us] +/- 80ms 2024-05-07T14:00:56.710 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-07T14:00:56.710 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-07T14:00:56.720 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-07T14:00:56.721 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-07T14:00:56.732 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-07T14:00:56.817 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-07T14:00:56.880 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T14:00:56.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:00:56.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-07T14:00:56.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:00:56.939 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-07T14:00:56.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-07T14:00:57.130 INFO:teuthology.task.internal:Duration was 786.152455 seconds 2024-05-07T14:00:57.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-07T14:00:57.203 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-07T14:00:57.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-07T14:00:57.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-07T14:00:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T14:00:57.248 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-07T14:00:57.731 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-07T14:00:57.731 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-05-07T14:00:57.732 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-07T14:00:57.796 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-05-07T14:00:57.796 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-07T14:00:57.822 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-07T14:00:57.823 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-07T14:00:57.839 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-07T14:00:57.892 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-07T14:00:57.892 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-07T14:00:57.909 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-07T14:00:58.030 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-07T14:00:58.042 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-07T14:00:58.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-07T14:00:58.068 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-07T14:00:58.094 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-07T14:00:58.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-07T14:00:58.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-07T14:00:58.151 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-05-07T14:00:58.158 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-05-07T14:00:58.178 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-07T14:00:58.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:00:58.230 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-07T14:00:58.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:00:58.245 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-07T14:00:58.259 INFO:teuthology.task.internal:Transferring archived files... 2024-05-07T14:00:58.260 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427/remote/smithi022 2024-05-07T14:00:58.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-07T14:00:58.305 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695427/remote/smithi050 2024-05-07T14:00:58.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-07T14:00:58.340 INFO:teuthology.task.internal:Removing archive directory... 2024-05-07T14:00:58.340 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-07T14:00:58.343 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-07T14:00:58.390 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-07T14:00:58.412 INFO:teuthology.task.internal:Not uploading archives. 2024-05-07T14:00:58.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-07T14:00:58.463 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-07T14:00:58.463 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-07T14:00:58.466 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-07T14:00:58.479 INFO:teuthology.orchestra.run.smithi022.stdout: 265296 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 7 14:00 /home/ubuntu/cephtest 2024-05-07T14:00:58.481 INFO:teuthology.orchestra.run.smithi050.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 7 14:00 /home/ubuntu/cephtest 2024-05-07T14:00:58.482 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-07T14:00:58.586 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-07T14:00:58.741 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 786.1524550914764 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-05-07T14:00:58.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-07T14:00:58.847 INFO:teuthology.run:pass